AI product Open source · Apache-2.0

SkillEvaluator

SkillEvaluator is an NVIDIA open-source CLI and evaluation framework for AI agent skills, which are folders of instructions and supporting files defined by the Agent Skills specification. Its three independent tiers perform quality and security validation, semantic-overlap and deduplication analysis using embeddings, and live agent evaluation in a sandbox to measure how a skill affects task results. It can run deterministically without an LLM for initial quality checks, use model-backed rubric evaluation, generate synthetic evaluation datasets, and integrate with GitHub or GitLab CI and skill-aware agents such as Claude Code and Codex. The project is distributed under the Apache License 2.0 and is described as experimental and community-supported.

View repository Visit site