Google Benchmark

GoogleTest is Google's open-source C++ testing and mocking framework, maintained in the repository that merged the formerly separate GoogleTest and GoogleMock projects. Based on the xUnit architecture, it automatically discovers and runs tests and provides built-in and user-defined assertions, including equality, inequality, exception, fatal and non-fatal failure, and death-test assertions. It supports value-parameterized and type-parameterized tests, as well as options for running individual tests, controlling test order, and executing tests in parallel. The 1.18.x branch requires at least C++17; documentation is provided through the project's GitHub Pages site.

Terminal Bench 4 is a benchmark for comparing coding-model performance across tasks with different difficulty levels.

CommerceAgentBench is a benchmark developed and maintained by the Accio team at Alibaba International for evaluating whether AI agents can complete long-horizon business workflows in high-fidelity, stateful, reproducible replicas of online services. Its tasks cover browser operations, native-style command-line tools, file and spreadsheet production, API and MCP workflows, public-web research, supplier analysis, product publishing, logistics, storefront configuration, and other commerce operations. Each task runs in a fresh container and is graded by a deterministic or LLM-assisted verifier. The benchmark uses local mock services representing commerce, SaaS, messaging, document, and operational systems; runs preserve the resolved configuration, agent trajectory, verifier result, artifacts, logs, and container metadata for auditing and reproducibility. The repository describes 107 tasks spanning CLI, browser, file, and API/MCP interfaces, with text-only, browser-text-capable, and vision-required capability slices. The project was previously called RealReplicaBench.

Catch2 is an open-source, C++-native unit testing framework for unit tests, test-driven development (TDD), and behavior-driven development (BDD). It uses readable test names, assertions written as ordinary C++ boolean expressions, and sections for localized sharing of setup and teardown code. It also provides simple BDD macros and basic microbenchmarking; benchmarks are opt-in rather than run by default. Catch2 v3 is distributed as a normal library with multiple headers and separately compiled implementation, while the v2.x branch provides the previous major version and C++11 support.

Assistant Benchmark is a comparative evaluation of AI assistants created by David Pawlan. It gives different assistants the same real-world prompts, including tasks such as email management, travel booking, and financial administration, and compares their outcomes, follow-up questions, speed, and performance across 16 dimensions. The benchmark is based on ongoing testing of multiple assistants and examines both task execution and the degree of autonomy assistants can usefully take.