candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

2 rows where adjudicator = "corrected", app_id = "F1-002" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • It's a Plan · 2 ✖

adjudicator 1

  • corrected · 2 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-002-A038 It's a Plan F1-002 a The system lets an administrator control access by role. - Auto-archive, a notification inbox, role-based access control, and more https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed corrected Actor "administrator" is not stated in the source; use "a user". The system lets a user control access by role. corrected The source names role-based access control without stating an administrator actor. 1.0
F1-002-A067 It's a Plan F1-002 a The system lets a user use the interface in 13 languages. - Interface in English, Ukrainian, Russian, Simplified Chinese, Traditional Chinese (Taiwan), Arabic, Persian, French, Portuguese (Brazil), Bahasa Indonesia, Spanish (Spain), Korean, and Turkish https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed corrected The source gives both 12 and 13 languages; the count is not reliably supported. The system lets a user use the interface in several languages. corrected The sources give both 12 and 13 languages, so the count is dropped. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);