Nimble Web Search Agents

Hyperagent is an AI agent platform for assigning work to a fleet of agents that research, build, deliver and maintain outputs using an organization's data, tools and working style. Its agents operate through real browsers and shells, can search, code, make decisions and generate artifacts such as live websites, videos, presentations, documents and dashboards. Agents run in individual computing environments, expose their execution as it happens, and can learn new memories and skills over time. Work is delivered through Slack, email, Telegram, webhooks or scheduled runs, and agents are deployed and managed from a central command center.

Firecrawl is an open-source web context API and hosted service for AI agents and applications. It searches the web, scrapes individual pages, crawls websites, maps site URLs, and batch-processes large URL sets, returning content as clean Markdown, HTML, screenshots, structured JSON, and other extracted data. It handles JavaScript-heavy pages, rotating proxies, orchestration, rate limits, and blocked content, and can parse web-hosted PDFs and DOCX files. Its interaction endpoint lets users or agents click, scroll, write, wait, and press on a page before extracting content; its agent endpoint gathers web data from a natural-language request without requiring URLs. Firecrawl provides Python and Node.js SDKs, cURL and CLI interfaces, and an MCP connection for AI agents and applications.

Comp AI CRM is an open-source, self-hostable customer relationship management system for AI agents, developed by Comp AI and hosted by Try Comp AI. Its agent runs as an independent durable deployment on its own schedule and database-backed work queue rather than waiting for browser requests: it selects records to investigate, researches contacts and companies, spends a research budget, schedules follow-ups and rechecks, records observed evidence, and sends weak or ambiguous matches to a human instead of writing them directly to records. It supports durable sessions, contact and company records, an Agent tab for viewing work and answering questions, authored tools for reading CRM history, searching records, identifying contacts, researching people, enriching companies, recording facts and scheduling rechecks, and versioned Markdown skills. The agent uses file-based tools and Markdown skills on Vercel's eve durable-agent framework, while its queue leases due tasks with PostgreSQL row locking so concurrent workers claim disjoint work and expired leases release tasks from failed runs. A restricted shell sandbox provides bash, grep, glob and a workspace without network egress, database credentials or direct database access. Optional sources include mailbox history, company brand data, LinkedIn and Perplexity web research.

Apify is a marketplace and platform for web-data extraction and AI automation tools called Actors. Actors collect data from sources such as TikTok, Instagram, Google Maps, and websites; their results can be exported, accessed through an API, scheduled, monitored, or integrated with applications, workflows, and AI agents. Apify’s Website Content Crawler cleans HTML, extracts website text in Markdown and other rich formats, downloads files, and supplies content to AI models, LLM applications, vector databases, and retrieval-augmented generation pipelines, with integrations including LangChain and LlamaIndex.