Confident AI (DeepEval)
Confident AI Inc.; maintains the DeepEval framework · confident-ai.com · Last checked:
- Hosted SaaS platform
- Open-source framework (DeepEval, Apache 2.0)
- On-prem deployment (Enterprise)
Company status
Active, privately held.
Sources 1, 2, 3, 4 · checked 2026-11-08
Capabilities
- DeepEval open-source framework that plugs into Pytest; runs locally
- LLM-as-a-judge metrics and custom evaluation metrics
- Online evals on live traffic, tracing, annotation queues, real-time alerting
- LLM red-teaming and chat simulations
Sources 1, 2, 3, 4 · checked 2026-11-08
Who it tends to fit
- Python teams that want unit-test style evals in CI and a hosted dashboard
- Teams that want unlimited seats on paid plans
Sources 1, 2, 3, 4 · checked 2026-11-08
Pricing
Free: $0 forever (2 user seats, 1 project, 5 test runs per week, 1 GB-month of trace spans). Starter: $200 per organization per month (unlimited seats, 5 projects, 5 GB-months of trace spans, then $1 per GB-month). Team: $2,000 per organization per month (unlimited projects, 75 GB-months of trace spans, then $1 per GB-month). Enterprise: custom.
Sources 1, 2, 3, 4 · checked 2026-11-08
Published certifications
- SOC 2 Type II
- HIPAA compliant
- GDPR compliant
Listed as stated by the vendor. Scope can differ by product or subsidiary; request current reports.
Sources 1, 2, 3, 4 · checked 2026-11-08
Limitations to check
- Dedicated on-prem deployment is an Enterprise feature
- Certifications appear as site badges; request the SOC 2 report to confirm scope
Sources 1, 2, 3, 4 · checked 2026-11-08
Sources
- Free, Starter, Team, Enterprise pricing per organization; online evals; Enterprise on-premwww.confident-ai.com/pricingChecked 2026-11-08
- Site footer badges: SOC 2 Type II, HIPAA compliant, GDPR compliant; LLM red-teaming listedwww.confident-ai.com/Checked 2026-11-08
- DeepEval plugs into Pytest, runs locally, optional login to Confident AI; LLM-as-a-judge metricsdeepeval.com/docs/getting-startedChecked 2026-11-08
- DeepEval license is Apache 2.0github.com/confident-ai/deepevalChecked 2026-11-08
Report a correction: [email protected]. Facts are re-checked at least every 90 days.