candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

2 rows where adjudicator = "(not sent: confirmed)", app_id = "F2-001" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • Asana · 2 ✖

adjudicator 1

  • (not sent: confirmed) · 2 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-001-B011 Asana F2-001 b The system automatically shows an update to a task in every project that includes the task. When someone updates the task’s assignee, due date, comments, attachments, or other details, that update appears in every project that includes the task. https://asana.com/features/project-management 02.txt passed confirmed     (not sent: confirmed)   1.0
F2-001-B028 Asana F2-001 b The system lets a user link a goal to supporting projects, portfolios, or tasks. allowing you to link a goal to supporting projects, portfolios, or tasks https://asana.com/features/goals-reporting 04.txt passed confirmed     (not sent: confirmed)   1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);