Concept

U-total

The ruler's headline number: how much of a reference answer's useful content the app delivers, over all 71 headline questions.

AI-reviewed, not clinically reviewed. Nothing here is medical advice.

From the record

In technical terms: Ratio of sums: Σ(app mass) / Σ(reference mass), where each mass is the mean of correctness, completeness and usefulness minus 1 (judge.v1, 1-5 scale), so the rubric floor maps to 0; detected non-answers are set to 0 by DECLINE2STAGE; health items weigh 0.5 (weight-1 printed beside). Verdict statistic = the lower of the two judge families per bootstrap draw; "meets the bar" needs CI low > 0.50. A different metric from the judge.v1 V-para / v0.2 ratios: never compare across.

RULING R1: judge = judge.v1 unchanged + DECLINE2STAGE zero per detected non-answer; D 0.058 kept as sensitivity rowRULING R1: judge = judge.v1 unchanged + DECLINE2STAGE zero per detected non-answer; D 0.058 kept as sensitivity rowadopted into ruler r3/r4Date2026-10-21Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Caveatwho decided: delegated coordinator (override of a frozen FAIL, accepted with conditions by reviewer); why: judge v1.1/v1.1b changed CE verdicts (5-7/40 flips); DECLINE2STAGE's 2 bar-(b) hits were engine refusal strings; alternatives: judge v1.1; decline subtraction only; reversible: yes (pre-exposure)Sourcenot in the public repositories yetOpen the data file
Freeze r4: add information-available split (FACT-AVAIL) + ORACLE/ORACLE-0 rows; U-total stays verdictFreeze r4: add information-available split (FACT-AVAIL) + ORACLE/ORACLE-0 rows; U-total stays verdictfrozen sha 82772e33; labels quarantinedDate2026-10-21Kinda record, not a measurement (set, status, judge, n, seeds: not recorded)Caveatwho decided: author asked; coordinator + reviewer (H1-H8); why: separate "packs lack it" from "app fails to deliver it"; alternatives: no split; reversible: no (frozen) Metric: ruler v0.4 U-total (ratio of sums against the reference mass, 71 headline items, health weight 0.5); never compare with the judge.v1 ratio.Sourcenot in the public repositories yetOpen the data file