Vals

VI codebench is a coding benchmark that measures how well AI models turn natural-language prompts into full-stack web applications. It is associated with VALS, an AI evaluation company that develops continuously evolving assessments for measuring model performance before release and in practical coding workflows.

vals is a Helm-like configuration values loader and secrets-management tool developed in the helmfile project. It resolves references to values and secrets from backends such as Vault, AWS Secrets Manager, AWS SSM Parameter Store, Google Cloud Secret Manager, SOPS-encrypted files, Kubernetes, 1Password, Doppler, Bitwarden, Infisical, and others. Its CLI can evaluate JSON or YAML templates and replace `ref+<TYPE>` expressions with fetched values, render environment variables, or populate environment variables and execute a command. It supports installation on Linux, macOS, and Windows, and can be built from source with optional Go build tags to include selected providers.

Devin is Cognition's coding agent. Vals evaluated it internally and increased its adoption after finding it to be token-efficient.

Can I Vibecode It? is an open-source catalog that evaluates whether AI coding agents such as Claude Code, Codex, or Cursor can build a usable personal replacement for a paid SaaS application. Each app entry provides a YES, KINDA, or NOT REALLY verdict, the exact prompt for attempting the replacement, and the tradeoffs of leaving the original service, including lost network effects, data, or infrastructure. App entries are contributed as one JSON file per app, with the schema and verdict criteria documented in the repository. The site uses Astro server output with a Node adapter to render fully server-rendered HTML, SQLite via better-sqlite3 for vote counters and waitlist data, and vanilla JavaScript and CSS for interactions. Satori and resvg generate Open Graph images at build time. It runs locally with npm install, npm run dev, npm run build, and npm start, requires no environment variables for local development, and supports optional analytics, sign-in, payments, email, and media-storage configuration. It can be deployed on a VPS behind a reverse proxy, with DATA_DIR used to keep user data outside the repository. The project is released under the MIT License, and its prompts are intended to remain free.

Vertex AI is Google Cloud’s managed platform for developing and deploying machine-learning and generative-AI applications. It provides hosted models and APIs that applications, including agents, can call at runtime, along with tools for model training, evaluation, and serving.