Concept
rubric floor / always-decline baseline
Because the lowest score is 1, not 0, an app that refuses every question already earns about 0.31 on the raw ratio.
From the record
- In technical terms
- Always-decline baseline D = 0.306 raw (79 judged declines over 7 runs; v0.2-weighted 0.307). About 61 % of a raw 0.50 is therefore "free".
Linked facts · 1
- A system that declines every question already scores about 0.31 on the raw ratio, because the rubric never goes below 1 of 5.A system that declines every question already scores about 0.31 on the raw ratio, because the rubric never goes below 1 of 5.always-decline raw ratio D = 0.306 (v0.2-weighted 0.307)Setv0.1 night runsStatusdevJudgeClaude Opus (judge.v1, both orders)n79 judged declines over 7 runsSeedsnot recordedDate2026-10-02CaveatThis is why the floor-adjusted ratio, not the raw ratio, is the headline.Sourcebenchmark
bench/v0.3/plan/analysis-plan.md:24research recordreports/BAR-TABLE.md:14research recordREADME.mdOpen the data file