Finding ·
A system that declines every question…
A system that declines every question already scores about 0.31 on the raw ratio, because the rubric never goes below 1 of 5.
From the record
- Value
- always-decline raw ratio D = 0.306 (v0.2-weighted 0.307)
- Caveat
- This is why the floor-adjusted ratio, not the raw ratio, is the headline.
Where this comes from
- A system that declines every question already scores about 0.31 on the raw ratio, because the rubric never goes below 1 of 5.A system that declines every question already scores about 0.31 on the raw ratio, because the rubric never goes below 1 of 5.always-decline raw ratio D = 0.306 (v0.2-weighted 0.307)Setv0.1 night runsStatusdevJudgeClaude Opus (judge.v1, both orders)n79 judged declines over 7 runsSeedsnot recordedDate2026-10-02CaveatThis is why the floor-adjusted ratio, not the raw ratio, is the headline.Sourcebenchmark
bench/v0.3/plan/analysis-plan.md:24research recordreports/BAR-TABLE.md:14research recordREADME.mdOpen the data file