FrontierHarness Eval

Better Harness is an open-source Harness Engineering platform for coding agents. It analyzes project and, where supported, session evidence around an agent's work rather than only its final code diff, evaluating the Agent Work Loop for issues such as task understanding, validation, delivery control, and retained lessons. It turns supported gaps into prioritized findings linked to their evidence, expected outcomes, repair boundaries, and acceptance checks, and produces host-specific reports in formats including HTML, paired Markdown, or native Canvas reports. The platform also supports defining harnesses as code, running controlled experiments, inspecting evidence, and comparing outcomes across coding-agent hosts such as Claude Code, Codex, Qoder, Cursor, and GitHub Copilot CLI.

Harness Engineering is Ryan Lopopolo’s anthology, field guide, and agent-context repository for improving coding-agent output without changing the underlying model or coding agent. It shapes the surrounding environment through context and tools so an agent can recover intent, operate the real system, respect authority, prove its outcome, and incorporate lessons from accepted work, corrections, failures, and user responses. The repository uses AGENTS.md to route agents to relevant arguments, cases, and proof, and provides a thesis index, playbooks, source material, and executable constraints for encoding organizational requirements and decisions. Repository-authored material is licensed under CC BY 4.0.

FrontierAgent is an open-source agent runtime, terminal product, and evaluation suite for long-horizon research and file-based work. Its native terminal TUI provides a ReAct workflow in which one stateful agent researches, reads files, writes deliverables, runs commands, and iterates in a task-scoped sandbox, and an Agent Team workflow in which a coordinator maintains a task board, delegates bounded independent assignments to parallel sub-agents, collects structured reports, and synthesizes the result. Shell and file tools use a shared sandbox with read-only /inputs, working-state /workspace, and persistent /outputs directories. The TUI supports queued instructions during execution, approval-required diffs for mutating operations, local action traces, checkpointed sessions, resumption, and reversion. The same workflow engine powers a subprocess benchmark runner with deterministic artifact collection, concurrency, progress inspection, and reruns of individual failures. The repository also documents connection to the OpenAI-compatible Apodex-1.1 endpoint through the Apodex API.

HarnessRouter Community Edition is the open-source edition of HarnessRouter, an agent-harness infrastructure that provides a unified Agent API to integrate language models and agent runtimes. It is maintained by HarnessRouter and is intended for deployment on users' own infrastructure to connect models such as Codex, Claude Code, and Hermes.

ai-evaluation-framework is an open-source framework by Dreamers Inc. for benchmarking model-based solutions by accuracy, p95 latency, and estimated cost against user-defined ground-truth cases. Each task specifies fields and a scoring rule per field, including exact identifiers, normalized dates, numeric tolerances, containment, token overlap, and expected-missing values; cases can also provide alternate accepted renderings. It runs models from OpenAI, Anthropic, or an OpenAI-compatible gateway, compares results in a table, emits detailed JSON reports, and caches responses by model, task, and case so scoring rules can be changed without another model call. The repository uses document-field extraction as its worked example but accepts arbitrary text inputs such as OCR output, transcripts, and PDF text. A separate feedback server collects thumbs-up or thumbs-down responses with required comments, stores append-only JSONL data, and exposes statistics, exports, and candidate cases for human review; it does not train models. The repository includes tests using scripted mock models and is licensed under Apache-2.0.