refund-policy-check

prompt_refund_policy_checkv5restores grounded policy behavior

Versions3

Latestv5

Traces71

Error rate1.4%

Avg cost$0.0362

Version history

gpt-4o-mini · Created 4/22/2026, 5:33:07 PM

restores grounded policy behavior

Corrected policy grounding with safer escalation fallback

Impact: v4 → v5Improved

Error rate

100.0%→0.0%-100.0pp

Avg cost

$0.0522→$0.0000-100%

Avg latency

10.90s→0.00s-100%

Traces

1→0-1

Changes from v4Full diff view

Overly strictCorrected policy branchgrounding with hallucinatedsafer denialsescalation fallback