LMArena

OpenArt Arena is a leaderboard within OpenArt that compares AI models by task. Experts blindly evaluate model outputs side by side and rank them for jobs such as lip synchronization, helping users choose a model before spending tokens.

arena.ai is a model-discovery platform or mechanism used to find and try newly released AI models. The videos identify it as a resource for exploring available models rather than as a particular model itself.

An independent platform for evaluating and comparing generative AI models. It publishes third-party assessments and comparative data on model capabilities and performance.

livenerf is an open-source benchmark for detecting post-launch capability changes in frontier models. It calibrates a panel of intermittently solved questions from GPQA Diamond, MMLU-Pro, competition mathematics and AIME, then runs the same panel repeatedly through a hermetic, pinned Claude Code harness and compares paired per-item scores with a launch-period baseline. The benchmark records raw prompts and responses, usage, latency, CLI and harness versions, and token counts; it also runs a control model and applies preregistered statistical thresholds rather than relying on an LLM judge. It is built on the Inspect evaluation framework, supports scheduled daily runs on Linux, macOS and Windows, and is distributed under the MIT license. The repository describes it as an independent project, not affiliated with Anthropic.

FriendliAI is an inference cloud and API for running frontier open-weight and custom AI models in production, with support for long-context inference, real-time streaming, tool calling, and agent workloads. Its stack combines custom GPU kernels, continuous batching, parallel inference, prefix caching with cache-aware routing, and a GPU-, CPU-, and NVMe-based KV-cache hierarchy for repetitive or long agent inputs. It also uses hybrid speculative decoding that adapts to live traffic, alongside multi-cloud scaling and autoscaling. The service provides model APIs and one-click deployment for models from Hugging Face, as well as deployment support for proprietary or fine-tuned models. FriendliAI advertises 99.99% uptime SLAs and reports performance claims including up to 7x faster output token speed and lower inference costs.