CommerceAgentBench

Commerce Agents is Anthropic's reference implementation for building shopping agents for customers and merchant agents for back-office staff with Claude. It defines each agent through prompts, skills, tool contracts, grounding, memory, approval gates, and backend interfaces, and provides runnable examples for retail, travel, telecom, and entertainment. The shopping agent searches and compares products, plans purchases, fills carts, answers order and policy questions, and maintains customer memory. The merchant agent analyzes performance, manages listings and inventory alerts, handles pricing and promotions, and drafts campaigns; its writes are staged until a host approves them. The agents can run through the Anthropic Messages API, Claude Agent SDK, or Managed Agents, and the repository provides a Claude Code plugin for scaffolding or reviewing commerce agents.

Assistant Benchmark is a comparative evaluation of AI assistants created by David Pawlan. It gives different assistants the same real-world prompts, including tasks such as email management, travel booking, and financial administration, and compares their outcomes, follow-up questions, speed, and performance across 16 dimensions. The benchmark is based on ongoing testing of multiple assistants and examines both task execution and the degree of autonomy assistants can usefully take.

Multi-Agent Workbench is a local-first browser control room for orchestrating coding agents such as Claude Code, Codex CLI, and generic PTY-based command-line agents. Agents work in task rooms under editable YAML role cards that define permissions, speaking style, and decision boundaries; a rule-driven orchestrator pauses execution and risky commands for human approval, while persistent sessions expose terminal activity and status. The system uses a local event-driven architecture with a React interface, Fastify backend, REST API, server-sent events, agent adapters, an approval service, and a SQLite event store. Every action passes through the API and is recorded in an append-only event log, whose events are projected into timelines, decisions, terminal views, artifacts, and diff views. It also provides task templates, Markdown reports and decision logs, real-time room updates, and configurable risk resolutions. Code-writing agents are intended to use isolated Git worktrees, with diff and patch review before changes reach the main workspace; the repository marks this worktree and merge flow as in progress.

Comp AI CRM is an open-source, self-hostable customer relationship management system for AI agents, developed by Comp AI and hosted by Try Comp AI. Its agent runs as an independent durable deployment on its own schedule and database-backed work queue rather than waiting for browser requests: it selects records to investigate, researches contacts and companies, spends a research budget, schedules follow-ups and rechecks, records observed evidence, and sends weak or ambiguous matches to a human instead of writing them directly to records. It supports durable sessions, contact and company records, an Agent tab for viewing work and answering questions, authored tools for reading CRM history, searching records, identifying contacts, researching people, enriching companies, recording facts and scheduling rechecks, and versioned Markdown skills. The agent uses file-based tools and Markdown skills on Vercel's eve durable-agent framework, while its queue leases due tasks with PostgreSQL row locking so concurrent workers claim disjoint work and expired leases release tasks from failed runs. A restricted shell sandbox provides bash, grep, glob and a workspace without network egress, database credentials or direct database access. Optional sources include mailbox history, company brand data, LinkedIn and Perplexity web research.