VSC-Bench

VI codebench is a coding benchmark that measures how well AI models turn natural-language prompts into full-stack web applications. It is associated with VALS, an AI evaluation company that develops continuously evolving assessments for measuring model performance before release and in practical coding workflows.

SWE-bench is an execution-based benchmark for evaluating large language models on real-world software issues collected from GitHub. Given a repository codebase and an issue, a model must generate a patch intended to resolve the problem; the patch is evaluated by running repository tests in Docker-based environments. The project provides datasets and an evaluation command-line tool, with dataset variants including full, verified, multimodal, multilingual, and locally supplied datasets. It is distributed as open-source code through its GitHub repository and can also be loaded from Hugging Face.

Visual Studio Code is a free, open-source Microsoft-developed source-code editor and development environment for Windows, macOS, Linux, and the web, built from the Code - OSS repository. It supports code editing, navigation, code understanding, lightweight debugging, integration with existing development tools, and extensibility through extensions. It provides an environment for building with AI agents that plan, modify, and debug code, managing multi-agent workflows, hosting AI coding plugins such as Claude Code, and running workflows such as Spec Kit commands.

Vals is a code-generation evaluation product that uses a company's GitHub codebase to build an internal coding benchmark. It evaluates coding models and agents against private, continuously evolving tasks to identify which systems perform best on the company's work and which offer the strongest return on investment. The platform is also described as supporting pre-release testing and evaluation of agentic coding work that may unfold over hours, days, or weeks, while accounting for factors such as token cost and latency.

Terminal Bench 4 is a benchmark for comparing coding-model performance across tasks with different difficulty levels.