candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

3 rows where adjudicator = "corrected", app_id = "F2-015" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • Pipedrive · 3 ✖

adjudicator 1

  • corrected · 3 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-015-B025 Pipedrive F2-015 b The system lets a user hold video calls, meetings and conferences with remote team members and contacts. Communicate with remote team members and contacts through video calls, meetings and conferences with Zoom, Microsoft Teams and more https://www.pipedrive.com/en/features 01.txt passed corrected Delivered through a third-party integration, not native. The system lets a user communicate with remote team members and contacts through a video conferencing integration. corrected Delivered via integrations; correction names the kind of exchange. 1.0
F2-015-B028 Pipedrive F2-015 b The system lets a user fill the pipeline with new leads from websites, social media and events. Fill your pipeline with new leads from websites, social media and events by using marketing and sales force automation https://www.pipedrive.com/en/features 01.txt passed corrected Delivered through integrations; wording tightened. The system lets a user capture new leads from websites, social media and events through lead generation integrations. corrected Delivered via integrations; wording tightened. 1.0
F2-015-B029 Pipedrive F2-015 b The system lets a user keep track of goals, projects and individual tasks. Assist salespeople and sales teams by keeping track of goals, projects and individual tasks https://www.pipedrive.com/en/features 01.txt passed corrected Delivered through integrations. The system lets a user keep track of goals, projects and individual tasks through task management integrations. corrected Delivered via integrations. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);