Concept
pairwise judge (both orders)
An AI judge reads the question and both answers side by side, scores both, then reads them again in the swapped order to cancel any bias for whichever comes first.
From the record
- In technical terms
- judge.v1: Claude Opus scores both answers on three 1–5 axes and picks a winner, in A/B and B/A order; scores averaged over orders; order disagreement on the winner = tie. Links, source lists and citation markers are stripped (blinding).