# 18 · Reproduce it (appendix) > Closed record · research record 1.0 · as of 2026-10-25 16:46; the author closed the research lines on 2026-10-23. Current standing, not a final result: Open fronts: https://r4topunk.github.io/boar-research/data/status.json. > > Final · as of 2026-10-25 16:46 · 0 of 71 wins on the phone, U-total 0.165 (Claude) / 0.242 (gpt-5.6-sol), below the 0.50 bar - Page: https://r4topunk.github.io/boar-research/research/reproduce/ · Markdown twin: https://r4topunk.github.io/boar-research/research/reproduce.md · Whole paper: https://r4topunk.github.io/boar-research/llms-full.txt · Index: https://r4topunk.github.io/boar-research/llms.txt - Span: — **In one sentence.** Everything that can be rerun is public, and what cannot be rerun is named. ## For curious readers {#curious} Yes, most of it. The benchmark questions, reference answers, judge prompt and scoring code of the first exam are public, and you can run them on your own app with a few commands. What you cannot rerun: the sealed question sets (sealed by design), the new exam (sealed until it is graded), and the exact judge outputs (the judge is a closed model, so reruns agree closely but not bit for bit). *Facts: [D-195]* ## For tech people {#tech} ### Plug your app into the same answer key Everything you need to measure your own assistant is public: 60 v0.1 questions (57 judged), frozen Opus-plus-web references with provenance, the judge, the scorers and the floor metric. Write one trace per question with `itemId`, `answer.text` and `error: null`, run the judge with your own Claude Code login, and compute the three scales. The research record holds frozen criteria, arm reports, aggregates, the negative-results registry and pack cards; the engine is a public upstream commit plus each arm's patch. **Not reproducible:** held-out sets, bit-identical judge outputs, the detector runner profile ( "Reproduction"). **Still open (as of 2026-10-25 03:30):** a short box rendered from `data/status.json` `open_fronts`: LabRat (formerly BoarLite) delivery and scoring (OF-4: final bundled build, Hugging Face upload, install-path check), the on-phone matrix DEVICE-FINAL (OF-8, running; its M1 fills the headline), claim text (OF-5), shaped-pack publication (OF-7; the author keeps factbook v2 unpublished), plus the landed desktop-twin ruler run on b4ef94f3 (OF-6, published as history), each with its state and what would change; the dropped fronts (OF-1 deep tier on a phone, OF-2 expert streaming on Android, OF-3 v0.3) collapsed with their decision ids. ## For AI professionals {#ai} ### The record for this chapter **Key facts:** engine = public upstream commit `0cfd4a77` + arm patch; bench = boar-bench v0.1 (questions, references, judge, scorers); models and packs in; not reproducible: held-out sets (private by design), bit-identical judge outputs (closed model), the emergency-detector runner profile (not released) ( "Reproduction"). Added 2026-10-24: bench v0.4 items, references and information-available labels are not public until its result card [D-195]; the 2026-10-18 → 10-24 arm reports live in the private research log and are cited by data id here; RETBENCH v1 and the W78 pack index become reproducible only if they are published (as of 2026-10-24 neither publication is recorded). ### 10 What can be rerun, by whom, at what cost The engine is a public upstream commit (0cfd4a77) plus per-arm patches; the benchmark (v0.1 questions, frozen references with provenance, judge, scorers, floor metrics) and the v0.3 plan are public; models and packs are listed with licences and revisions in the bill of materials. Every judgment row records judge model, CLI version, judge version and the sha256 of traces, questions and references, and everything after the judge is deterministic given the judgment rows. A full v0.1 judge pass is 114 calls (≈ 5 min at four shards). Not reproducible from public material: the held-out sets (private by design; hashes only), bit-identical judge outputs (closed model; σ_judge ≈ 0.003), and the emergency-detector runner profile (base-model licence unknown; not released). *Facts: [F-371] [F-241] [F-242] [F-243] [F-959]* ## Facts cited {#facts} Resolve every [F-…] marker in https://r4topunk.github.io/boar-research/data/facts.json. Each line gives the claim, the number with its metric family, set and status, judge, n, seeds, CI, date and caveat. - [F-241] Every judgment row records judgeModel, cliVersion, judgeVersion and the three input shas. 6 provenance fields · set UNKNOWN (status UNKNOWN) · judge UNKNOWN · n UNKNOWN · seeds UNKNOWN · CI not computed - [F-242] Judge versions are tagged and never pooled: judge.v1 (Opus), judge.v1-low (cheap effort), judge.v1-med. tags (judge.v1 ratio) · set UNKNOWN (status UNKNOWN) · judge UNKNOWN · n UNKNOWN · seeds UNKNOWN · CI not computed · caveat: citation fix: the version tag is built at l.33 - [F-243] Everything after the judge (traces → metrics) is deterministic given the judgment rows. deterministic · set UNKNOWN (status UNKNOWN) · judge UNKNOWN · n UNKNOWN · seeds UNKNOWN · CI not computed - [F-371] Resume safety: a cached judgment row is reused only if traces, questions and references sha256, judge version and model all match; else exit 7. exit 7 · set UNKNOWN (status UNKNOWN) · judge UNKNOWN · n UNKNOWN · seeds UNKNOWN · CI not computed · date 2026-10-13 - [F-959] One full v0.1 judge pass is 114 judge calls (57 items × 2 orders). 114 calls · set v0.1 (status UNKNOWN) · judge Opus judge.v1 · n UNKNOWN · seeds UNKNOWN · CI not computed ### Decisions cited {#decisions} - [D-195] 2026-10-21 · No public upload of v0.4 items or references; labels of FACT-AVAIL quarantined (coordinator-only) until the result card · why: held-out discipline. · status: kept --- Cite as: r4to, independent researcher. RatLab — A Boar Research (2026), research record 1.0, as of 2026-10-25. Text and data CC BY 4.0. Fact ids or a link must travel with a quote. How to cite: https://r4topunk.github.io/boar-research/cite/ · https://r4topunk.github.io/boar-research/CITATION.cff. AI-reviewed, not clinically reviewed. Nothing here is medical advice.