Concept
V-para
A set of 58 questions (51 judged + 7 venue questions) written paraphrased from Vitalik Buterin's public blog posts; the set closest to the bar.
From the record
- In technical terms
- Paraphrased public-figure-blog set, created 2026-10-03; held-out for the 4B claim runs, dev-style after 2026-10-06.
Linked facts · 2
- The frozen 4B claim build on the bounty-style set (V-para) delivers about a quarter of the frontier reference's value above "nothing", and loses every head-to-head.The frozen 4B claim build on the bounty-style set (V-para) delivers about a quarter of the frontier reference's value above "nothing", and loses every head-to-head.raw 0.413 (0.384–0.445); floor-adjusted 0.261 (0.224–0.300); win/tie/loss 0/0/51 in both seedsSetV-paraStatusheld-out for this run (cut 3 on 2026-10-05, cut 6 on 2026-10-06); dev-style for everything measured after 2026-10-06JudgeClaude Opus (judge.v1, both orders)n51Seeds2 (42, 43)Date2026-10-06CaveatCut 7 = cut 6 on this set (the FACTS table fires 0 times on it). Public BAR-TABLE prints CI high 0.300; one claim draft prints 0.299 (rounding).Sourceresearch record
reports/BAR-TABLE.md:35research recordreports/SET-STATUS.md:15research recordREADME.md:25research recordreports/BAR-TABLE.mdOpen the data file - Every touch of a held-out set was logged; both held-out sets are now development data.Every touch of a held-out set was logged; both held-out sets are now development data.v0.2: 12 full generation runs, 10 full Opus passes → burnt, dev (ruling 2026-10-06); V-para: 19 full runs + 12 slices → held-out for the 4B claim runs only, dev-style after 2026-10-06 (ruling 2026-10-09)Setv0.2; V-paraStatusburnt / dev-styleJudgenot recordedn110 / 58 (51 judged + 7 venue)Seedsnot recordedDate2026-10-09Sourceresearch record
reports/SET-STATUS.md:14research recordreports/SET-STATUS.md:15Open the data file