RatLabA Boar Research
Closed recordas of what’s still open →

Finding ·

PACKPROOF pooled correct-any with pack…

PACKPROOF pooled correct-any with pack installed vs without

Chapter 14 · Closing the research: what a small model needs

From the record

Value
0.48 vs 0.26, Δ +0.23
Caveat
self-tests favour the pack; hosts differ by arm; 1 seed Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.

Where this comes from

  • PACKPROOF pooled correct-any with pack installed vs withoutPACKPROOF pooled correct-any with pack installed vs without0.48 vs 0.26, Δ +0.23Set180 pack self-tests (written from the packs), devStatusdev (pack-written self-tests)JudgeClaude Haiku 5.5-low labels; correct-anyn180Seeds4295 % CICI +0.16..+0.31; n 180; seed 42Date2026-10-23Caveatself-tests favour the pack; hosts differ by arm; 1 seed Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file