Tavily

Nimble Web Search Agents are domain-specific web research agents from Nimble that perform self-learning search, crawling, structured extraction, dataset enrichment, and web monitoring. They use auditable Search Plans, a proprietary index, and memory that adapts to a use case after each run to retrieve targeted data from the live web, including JavaScript-rendered pages, without requiring an LLM to parse raw pages. Nimble exposes these capabilities through APIs for search, complex research workflows, dataset building, monitoring, extraction, and crawling.

Apify MCP Server is an MCP server from Apify that lets AI assistants use Apify Actors as tools for web search, data extraction, scraping, browsing, and automation. Its hosted endpoint at mcp.apify.com supports Streamable HTTP and OAuth, while a local stdio distribution is available through the @apify/actors-mcp-server package. The server dynamically discovers Actors from the Apify Store, loads their input schemas, runs them, and exposes results through Apify datasets and key-value stores. It also provides tools for searching Apify documentation, inspecting and managing Actor runs, tasks, schedules, builds, and source files. Tool selection can be restricted through URL parameters or CLI flags, and the server supports agentic payment mechanisms including AGI, direct x402, and Skyfire.

Apify is a marketplace and platform for web-data extraction and AI automation tools called Actors. Actors collect data from sources such as TikTok, Instagram, Google Maps, and websites; their results can be exported, accessed through an API, scheduled, monitored, or integrated with applications, workflows, and AI agents. Apify’s Website Content Crawler cleans HTML, extracts website text in Markdown and other rich formats, downloads files, and supplies content to AI models, LLM applications, vector databases, and retrieval-augmented generation pipelines, with integrations including LangChain and LlamaIndex.

Voyage AI, by MongoDB, provides embedding models and rerankers for search, retrieval, and retrieval-augmented generation applications. Its embeddings convert unstructured data into vectors for retrieval, while rerankers improve the ordering of retrieved results; the models are designed for high accuracy, low-dimensional vectors, low latency, long context, and compatibility with different vector databases and large language models. Voyage AI is available as a pay-as-you-go service through major cloud and data platforms, with SaaS, customer-tenant, custom, and on-premises deployment options.

Firecrawl is an open-source web context API and hosted service for AI agents and applications. It searches the web, scrapes individual pages, crawls websites, maps site URLs, and batch-processes large URL sets, returning content as clean Markdown, HTML, screenshots, structured JSON, and other extracted data. It handles JavaScript-heavy pages, rotating proxies, orchestration, rate limits, and blocked content, and can parse web-hosted PDFs and DOCX files. Its interaction endpoint lets users or agents click, scroll, write, wait, and press on a page before extracting content; its agent endpoint gathers web data from a natural-language request without requiring URLs. Firecrawl provides Python and Node.js SDKs, cURL and CLI interfaces, and an MCP connection for AI agents and applications.