What differs
- Framework: Promptfoo is a config-driven CLI under the MIT license with model-graded assertions such as llm-rubric; DeepEval is an Apache 2.0 Python framework that plugs into Pytest with LLM-as-a-judge metrics.
- Security testing: Promptfoo’s Community plan includes red teaming up to 10k probes per month; Confident AI lists LLM red-teaming and chat simulations.
- Public pricing: Promptfoo Enterprise and On-Premise are custom priced; Confident AI publishes Free, Starter ($200 per organization per month), and Team ($2,000 per organization per month) plans.
- Published security and ownership: Promptfoo states SOC 2 Type II and ISO 27001 and announced in March 2026 that it agreed to be acquired by OpenAI; Confident AI shows SOC 2 Type II, HIPAA, and GDPR badges.
Who each tends to fit
Security-focused teams testing for jailbreaks and injection may look first at Promptfoo. Python teams that want Pytest-style evals with a hosted dashboard may look first at Confident AI.
Last checked: . No winner declared.