Arize AX CLI

AX CLI is Arize's command-line tool for setting up instrumentation for AI agents and sending traces to Arize AX. Its tracing output includes hierarchical trace trees with spans for tool calls and model calls, token counts, and session grouping. It can also run experiments that help agents validate whether a fix works.

Arize AX is an AI engineering platform from Arize AI for observing and evaluating AI agents, including voice agents. It provides a unified session and trace view that combines audio, transcripts, latency metrics, tool calls, and evaluation results, allowing failures such as dead air, interruptions, transcription errors, and incorrect tool actions to be investigated together. The platform supports tracing real-time audio with OpenInference semantic conventions, audio-native evaluations for factors such as sentiment, latency, interruptions, and task success, and agent experiments that test fixes against failed traces. It is available through the Arize AX product interface and a terminal-based setup.

Arize AI is an AI-agent observability, evaluation, tracing, and experimentation platform for diagnosing production behavior, identifying issues, and testing changes. It stores production traces, evaluations, annotations, datasets, and experiments, with instrumentation adapters for multiple frameworks and LLM providers. It combines audio, transcripts, and traces in a session view for investigating voice-agent problems such as latency, interruptions, transcription errors, and incorrect tool actions. Its audio workflows use OpenInference semantic conventions to trace real-time audio across providers, run evaluations for sentiment, latency, interruptions, and task success, and attach evaluation results to spans. Its Phoenix tooling includes code-mode capabilities such as Bash, a Python sandbox, SQL, and user-interface control, allowing agents to search for and compose tools in code rather than placing complete tool catalogs and raw outputs in their context. Its CLI and skills can bring spans and evaluation results into a coding agent's workspace, where the agent can inspect supervisor, specialist-agent, model, and tool calls, and create or use evaluators.

Arize Skills is a set of installable skills for AI coding agents, maintained by Arize, that guides agents through adding observability, creating datasets, running experiments and evaluations, and optimizing prompts for LLM applications. The skills use the ax CLI to interact with Arize and include workflows for tracing and debugging applications, OpenInference-based instrumentation, dataset management, experiments, LLM-as-judge evaluators, annotations, prompt optimization, provider credentials, and production monitoring. They can be installed into agents such as Cursor, Claude Code, Codex, GitHub Copilot, and Windsurf through npx, the repository's installers, the ax CLI, or a Claude Code plugin. The repository is licensed under MIT.