Decision ·
Claude judge stays the headline (lower of two judges); judge family named next to every ratio; win/tie/loss leads
From the record
- Context
- Claim v4.2 / v4.2.1: judge family named on every ratio; native comparison kept internal
- Why
- analysis-plan rule: when judges differ by > 0.05, the lower is the headline
- What followed
- claim v4.2.x
- Reversible
- yes
- Status
- kept
- Alternatives considered
- headline the higher cross-family number
- Report the higher judge
- lead with OpenAI-judge numbers (deep crosses 0.50)
Linked facts · 3
- Name the judge family next to every ratio; lead with the stricter (Claude) judge; keep win-rate first — why: Cross-family judge ≈ +0.10 more lenient — outcome: Claim v4.2.xName the judge family next to every ratio; lead with the stricter (Claude) judge; keep win-rate first — why: Cross-family judge ≈ +0.10 more lenient — outcome: Claim v4.2.xDate2026-10-16/17Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Sourcenot in the public repositories yetOpen the data file
- Claude judge stays the headline (lower of two judges); judge family named next to every ratio; win/tie/loss leads — why: analysis-plan rule: when judges differ by > 0.05, the lower is the headline — outcome: claim v4.2.xClaude judge stays the headline (lower of two judges); judge family named next to every ratio; win/tie/loss leads — why: analysis-plan rule: when judges differ by > 0.05, the lower is the headline — outcome: claim v4.2.xDate2026-10-16/17Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Sourcenot in the public repositories yetOpen the data file
- Headline judge = Claude Opus (the stricter, lower judge); cross-family numbers reported beside, labelled post-hoc (why: analysis plan's lower-judge rule)Headline judge = Claude Opus (the stricter, lower judge); cross-family numbers reported beside, labelled post-hoc (why: analysis plan's lower-judge rule)Date2026-10-16/17Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Caveatoutcome: Claim draft v4.2.xSourcenot in the public repositories yetOpen the data file