Concept

the bar (0.50)

The target: BOAR's answers should be worth at least half of what a frontier AI with web search gives.

From the record

In technical terms: Operationalised as floor-adjusted ratio CI low ≥ 0.50 (primary target, from 2026-10-06) and raw ratio CI low > 0.50 on both V-para and v0.2 (formal rule of the 2026-10-02 analysis plan). As of 2026-10-18, not reached under the Claude judge on held-out data; the research is open and pending runs could change this (data/status.json).

Bar status: no configuration reaches 0.50 on the primary (floor-adjusted) reading; the formal raw rule is met only on development data by the deep tier with thinking.Bar status: no configuration reaches 0.50 on the primary (floor-adjusted) reading; the formal raw rule is met only on development data by the deep tier with thinking.best floor-adjusted on V-para = 0.436 (CI high 0.472), short by 0.064; formal raw rule (CI low > 0.50) met by deep + thinking on dev data only (desktop; the v0.2 leg of the 512 budget is 1 seed); 0 wins on every Claude-judged row of V-para and v0.2SetV-para; v0.2Statusdev / dev-styleJudgeClaude Opus (judge.v1, both orders)n51 / 110Seedssee rowsDate2026-10-10CaveatNever present as "bar reached". Under the Claude judge on held-out data the bar was not reached.Sourceresearch record reports/BAR-TABLE.md:80research record README.md:42research record reports/BAR-TABLE.md:73,80research record reports/BAR-TABLE.md:66-80Open the data file