Concept
conditional thesis
The author's closing claim, in the form the tests support: the app is right about two times in three when the right passage reaches the model.
From the record
- In technical terms
- Stated by the author on 2026-10-23 as "right whenever the content is in a knowledge pack"; PACKPROOF supports only the conditional form: correct-any 0.65 when the item's own article is kept vs 0.28 when not, with the pack installed 0.48 vs 0.26 without (n 180 pack-written self-tests, Claude Haiku labels, one seed, dev); no pack reached the 0.75 bar.
Linked facts · 3
- Thesis to present with the app: right whenever the content is in a pack; app built for itThesis to present with the app: right whenever the content is in a pack; app built for itPACKPROOF supports only a conditional form (65 % when delivered)Date2026-10-23Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Caveatwho: author; why: product framing; reversible: yes (framing)Later2026-10-25: the author restated the thesis (small models need external knowledge; a harness built around a small model's real capabilities); this sentence stays quoted as the hypothesis the closing tests checked.Sourcenot in the public repositories yetOpen the data file
- PACKPROOF pooled correct-any with pack installed vs withoutPACKPROOF pooled correct-any with pack installed vs without0.48 vs 0.26, Δ +0.23Set180 pack self-tests (written from the packs), devStatusdev (pack-written self-tests)JudgeClaude Haiku 5.5-low labels; correct-anyn180Seeds4295 % CICI +0.16..+0.31; n 180; seed 42Date2026-10-23Caveatself-tests favour the pack; hosts differ by arm; 1 seed Metric: outcome-label shares of n items (Claude Haiku 5.5-low labels, UXMATRIX protocol); not the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file
- Packs reaching the 0.75 "proves" barPacks reaching the 0.75 "proves" bar0 of 9; 7 below 0.60 (not default-eligible by rule); best 0.60 (two Q&A packs), worst factbook 0.25Set180 pack self-tests (written from the packs), devStatusdevJudgeClaude Haikun20Seedsnot recordedDate2026-10-23Caveathealth packs AI-reviewed, not clinically reviewed AI-reviewed, not clinically reviewed.Sourcenot in the public repositories yetOpen the data file