candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

4 rows where adjudicator = "rejected (duplicate upheld)", app_id = "F2-043" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • ServiceNow IT Service Management · 4 ✖

adjudicator 1

  • rejected (duplicate upheld) · 4 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-043-A012 ServiceNow IT Service Management F2-043 a The system lets an agent create a problem to identify the root cause of an incident Create a problem to identify the root cause of the incident https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected duplicate of F2-043-A010   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A077 ServiceNow IT Service Management F2-043 a The system automatically suggests resolutions to service desk agents based on similar incidents Service desk agents get resolution suggestions based on similar incidents https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/VJrgA~RGa2uCwOB_SKOI9A/content 12.txt passed rejected duplicate of F2-043-A025   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A092 ServiceNow IT Service Management F2-043 a The system lets a user log an incident by sending an email Log incidents in the instance or by sending email https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/YPPvhvaR2f1XnxYWSOG6Cg/content 14.txt passed rejected duplicate of F2-043-A091   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A122 ServiceNow IT Service Management F2-043 a The system lets a user create a change from an incident or a problem you can create a standard, normal, or an emergency change from an incident or a problem https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected duplicate of F2-043-A054   rejected (duplicate upheld) duplicate upheld 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);