Bright Data APIs

Bright Data MCP Server is a Model Context Protocol server from Bright Data that gives AI agents, coding agents, chat assistants, and other MCP-compatible clients access to public web data. It provides web search across Google, Bing, and Yandex; page retrieval as Markdown or HTML; AI-based structured extraction; browser automation; and structured JSON through more than 1,200 pre-built scrapers for sites and services including Amazon, LinkedIn, Instagram, TikTok, YouTube, X, Reddit, and package registries. Requests are routed through Bright Data's web-unblocking infrastructure, which handles bot detection, CAPTCHA challenges, proxy rotation, rate limits, and geo-restrictions. The server also supports batch search and scraping, AI-relevance-ranked discovery, remote browser sessions for navigation and interaction, and structured response collection from ChatGPT and Perplexity. It can run as a hosted remote server or locally through the `@brightdata/mcp` npm package, with tool groups and individual tools selectable through configuration. The repository states that the service includes a recurring free tier of 5,000 requests per month and is distributed under the MIT license.

Bright Data's Web Unlocker API and Browser API are web-access services for collecting public-site data when ordinary requests encounter anti-bot systems. The Unlocker API handles blocked access and CAPTCHAs, while the Browser API provides remote browsers with stealth features and JavaScript rendering. The videos describe them as infrastructure that manages blocking, retries, and IP selection, including access to a Glassdoor page that a plain Claude request could not open.

Firecrawl is an open-source web context API and hosted service for AI agents and applications. It searches the web, scrapes individual pages, crawls websites, maps site URLs, and batch-processes large URL sets, returning content as clean Markdown, HTML, screenshots, structured JSON, and other extracted data. It handles JavaScript-heavy pages, rotating proxies, orchestration, rate limits, and blocked content, and can parse web-hosted PDFs and DOCX files. Its interaction endpoint lets users or agents click, scroll, write, wait, and press on a page before extracting content; its agent endpoint gathers web data from a natural-language request without requiring URLs. Firecrawl provides Python and Node.js SDKs, cURL and CLI interfaces, and an MCP connection for AI agents and applications.

Deasy Labs is an AI data-curation platform with APIs and a Python SDK for preparing unstructured organizational data for RAG systems, search, and AI agents. It connects to sources such as SharePoint and S3, OCRs, parses, chunks, and normalizes files, then builds taxonomies, applies metadata, detects sensitive data, and evaluates file quality and relevance against a use case. Users can slice the enriched corpus by relevance, topic, time, quality, or sensitivity, write metadata back to source systems, or deliver datasets to downstream retrieval pipelines. Data slices are continuously monitored and refreshed as source content changes. The SDK can also generate context files and folder indexes for coding agents, as demonstrated in the video.

Nimble Web Search Agents are domain-specific web research agents from Nimble that perform self-learning search, crawling, structured extraction, dataset enrichment, and web monitoring. They use auditable Search Plans, a proprietary index, and memory that adapts to a use case after each run to retrieve targeted data from the live web, including JavaScript-rendered pages, without requiring an LLM to parse raw pages. Nimble exposes these capabilities through APIs for search, complex research workflows, dataset building, monitoring, extraction, and crawling.