Experiment ·
PACKPROOF
With vs without the pack on its own self-tests
From the record
- What was tested
- PACKPROOF
- Result
- correct-any 0.48 vs 0.26; when own article kept 0.65 vs 0.28; OFF wrong-confident 0.17
- Verdict
- closed: rule failed, CI excluded the hoped-for gain, a step-0 gate failed, or the mechanism was falsified
- Detail
- P1 MISS (bar 0.75); honest-when-not via warning
- Set
- 180 self-tests of 9 packs (pack-written)
- Judge
- Claude Haiku
- Pre-registered
- yes (37f74d6f)
Linked facts · 1
- PACKPROOF: With vs without the pack on its own self-testsPACKPROOF: With vs without the pack on its own self-testscorrect-any 0.48 vs 0.26; when own article kept 0.65 vs 0.28; OFF wrong-confident 0.17Set180 self-tests of 9 packs (pack-written)Statusdev (pack-written self-tests)JudgeClaude Haikunnot recordedSeedsnot recorded95 % CI+0.23 (+0.16..+0.31)Date2026-10-23Caveatcriterion frozen: yes (37f74d6f); arm verdict: P1 MISS (bar 0.75); honest-when-not via warning Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file