Best AI Evals

Vendor profileChecked Nov 8, 2026

Fiddler AI

Fiddler AI · fiddler.ai · Last checked:

  • Hosted SaaS platform
  • Self-hosted or VPC deployment (Enterprise: SaaS, VPC, or on-premise)

Company status

Active, privately held. Agreed to be acquired by CrowdStrike (announced November 3, 2026), pending close; CrowdStrike expects the deal to close in its fiscal fourth quarter of 2027, subject to customary closing conditions.

Sources 1, 2, 3 · checked 2026-11-08

Capabilities

  • Real-time guardrails for hallucinations, toxicity, PII/PHI, prompt injection, and jailbreaks (Fiddler Centor Models)
  • Custom evaluators and bring-your-own judge (LLM-as-a-judge)
  • Unified observability with tests and experiments for agentic and predictive systems
  • Trace-based pricing for agent and LLM observability

Sources 1, 2, 3 · checked 2026-11-08

Who it tends to fit

  • Teams that want low-latency guardrails and evaluations in one product
  • Enterprises that need VPC or on-premise deployment

Sources 1, 2, 3 · checked 2026-11-08

Pricing

Free: free (real-time guardrails). Developer: $0.002 per trace (SaaS). Enterprise: contact sales (SaaS, VPC, or on-premise).

Sources 1, 2, 3 · checked 2026-11-08

Published certifications

  • SOC 2 Type II
  • HIPAA compliant

Listed as stated by the vendor. Scope can differ by product or subsidiary; request current reports.

Sources 1, 2, 3 · checked 2026-11-08

Limitations to check

  • VPC and on-premise deployment are Enterprise options without public prices
  • SOC 2 report is available on request
  • Pending acquisition by CrowdStrike: confirm contracting entity, standalone availability, and roadmap

Sources 1, 2, 3 · checked 2026-11-08

Sources

  1. Free, Developer ($0.002 per trace), Enterprise plans; guardrails; custom evaluators and bring your own judgewww.fiddler.ai/pricingChecked 2026-11-08
  2. SOC 2 Type II (security, confidentiality, availability; audited annually) and HIPAA compliantwww.fiddler.ai/securityChecked 2026-11-08
  3. CrowdStrike press release (November 3, 2026): definitive agreement to acquire Fiddler AI; expected to close in CrowdStrike's Q4 FY27, subject to customary closing conditionswww.crowdstrike.com/en-us/press-releases/crowdstrike-to-acquire-fiddler-to-deliver-agent-observability/Checked 2026-11-08

Report a correction: [email protected]. Facts are re-checked at least every 90 days.