Concept
outcome labels (CWS, correct-any, WU, WW, HU)
Each answer is put into one class: right with the right source shown, right from memory, wrong with no warning, wrong with a warning, or an honest "unknown".
From the record
- In technical terms
- Shares of n items labelled by Claude Haiku 5.5-low under the UXMATRIX protocol: CWS = correct with the right source shown; CFM = correct from memory; correct-any = CWS + CFM; WC/WU = wrong with no warning; WW = wrong with the warning line; HU = honest unknown; RW = refused wrongly. Not a ratio to a reference: never compare with the judge.v1 ratio or with U-total.
Linked facts · 3
- PACKPROOF pooled correct-any with pack installed vs withoutPACKPROOF pooled correct-any with pack installed vs without0.48 vs 0.26, Δ +0.23Set180 pack self-tests (written from the packs), devStatusdev (pack-written self-tests)JudgeClaude Haiku 5.5-low labels; correct-anyn180Seeds4295 % CICI +0.16..+0.31; n 180; seed 42Date2026-10-23Caveatself-tests favour the pack; hosts differ by arm; 1 seed Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file
- Succinct on ENGINE-RC (page numbers)Succinct on ENGINE-RC (page numbers)ON CWS 0.30, correct-any 0.43, WU 0.12; OFF correct-any 0.22, WU 0.10SetUXMATRIX 60, devStatusdevJudgeClaude Haiku labelsn60Seeds42Date2026-10-24CaveatPASS vs frozen CWS ≥0.28, WU OFF ≤0.10 Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file
- UXMATRIX Succinct: correct-any ON / OFFUXMATRIX Succinct: correct-any ON / OFF0.35 / 0.28 (CWS 0.28 / 0.03; WC 0.22 / 0.07)Set60 dev items (40 cooking/money, 15 delivered general, 5 no-pack)StatusdevJudgeClaude Haiku; outcome sharesn60Seeds42Date2026-10-23CaveatSuccinct and Detailed on different hosts Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file