candidates: F1-002-B027

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

This data as json

candidate_id app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-002-B027 F1-002 b The system lets a user run an external agent on their own machine that hands each task to a coding-agent command-line tool [`@itsaplan/runner`](packages/runner) and it gives every task to Claude Code, Codex, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A055   rejected (duplicate upheld) duplicate upheld 0.0

Links from other tables