AI product
Comet is an AI developer and evaluation platform that combines Opik observability for generative AI with experiment management and performance monitoring for classical machine learning. Opik records traces from LLM applications and agents, supports evaluation with test suites, datasets, human annotations, and LLM-as-a-judge metrics, and provides production monitoring, dashboards, and alerts. Comet’s MLOps features log training runs, metrics, parameters, model versions, datasets, and visualizations across machine-learning frameworks. The platform can be used in the cloud or through self-hosted and custom deployment options; the video describes it being consumed as a signed AWS partner application in an air-gapped environment.
1 use taken from transcripts — each links to the moment in the video.
Evaluation and observability platform: stores traces, scores and experiments; brings together Opik tracing for generative AI and ML performance monitoring for classical ML in one platform, consumed as a signed partner app via AWS in an air-gapped environment.
1 in the library.