Alex

Arize AI is an AI-agent observability, evaluation, tracing, and experimentation platform. It combines audio, transcripts, and traces in a session view for investigating voice-agent problems such as latency, interruptions, transcription errors, and incorrect tool actions. Its audio workflows use OpenInference semantic conventions to trace real-time audio across providers, run evaluations for sentiment, latency, interruptions, and task success, and attach evaluation results to spans. The platform supports an observe-evaluate-improve workflow in which teams investigate failed traces and test fixes through agent experiments. It is available through Arize AX and a terminal-based setup.

Arize AX is an AI engineering platform from Arize AI for observing and evaluating AI agents, including voice agents. It provides a unified session and trace view that combines audio, transcripts, latency metrics, tool calls, and evaluation results, allowing failures such as dead air, interruptions, transcription errors, and incorrect tool actions to be investigated together. The platform supports tracing real-time audio with OpenInference semantic conventions, audio-native evaluations for factors such as sentiment, latency, interruptions, and task success, and agent experiments that test fixes against failed traces. It is available through the Arize AX product interface and a terminal-based setup.

Arize Skills is a set of installable skills for AI coding agents, maintained by Arize, that guides agents through adding observability, creating datasets, running experiments and evaluations, and optimizing prompts for LLM applications. The skills use the ax CLI to interact with Arize and include workflows for tracing and debugging applications, OpenInference-based instrumentation, dataset management, experiments, LLM-as-judge evaluators, annotations, prompt optimization, provider credentials, and production monitoring. They can be installed into agents such as Cursor, Claude Code, Codex, GitHub Copilot, and Windsurf through npx, the repository's installers, the ax CLI, or a Claude Code plugin. The repository is licensed under MIT.

Alexa is Amazon’s voice assistant and conversational interface, available through the Alexa app, browser, Echo devices, Fire TV, and other compatible devices. It supports natural-language requests, answers questions, maintains conversations across devices, and can turn information into actions such as scheduling, creating checklists, planning events, and booking services. In the cited use, an Alexa skill placed an LLM assistant behind an interface subject to an eight-second response limit, allowing the assistant’s responses and context-handling behavior to be tested in everyday use.