AI product
Promptfoo is an AI application security and evaluation platform for testing prompts, RAG systems, agents, models, and guardrails. It can run evaluation tests with LLM-judge scoring against defined criteria and verify citations against source documents; in the described payment-rules assistant, it was used to assess answer quality and investigate apparent regressions against the underlying evidence. Its security workflows simulate context-aware attacks, including prompt injection, jailbreaks, data leaks, business-rule violations, insecure agent tool use, and toxic-content generation, and can run in development and CI/CD workflows. Promptfoo also provides automated red teaming, code scanning, MCP security testing, remediation guidance, and continuous monitoring, with integrations for AI applications, agent frameworks, CI/CD systems, and on-premises or cloud deployments.
1 use taken from transcripts — each links to the moment in the video.
Used to run the system's ~86 evaluation tests, with LLM-judge scoring against defined criteria plus citation verification against source documents.
1 in the library.