candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

8 rows where app_id = "F2-043", in_final_set = "0.0" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, verifier_reason, adjudicator_reason

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • ServiceNow IT Service Management · 8 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-043-A012 ServiceNow IT Service Management F2-043 a The system lets an agent create a problem to identify the root cause of an incident Create a problem to identify the root cause of the incident https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected duplicate of F2-043-A010   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A020 ServiceNow IT Service Management F2-043 a The system automatically redirects UI16 module links to the equivalent Service Operations Workspace pages when redirection is enabled navigating through UI16 paths automatically redirects you to the equivalent list or record pages in SOW https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected UI navigation redirect for an upgrade/admin setting, not a business capability.   rejected Redirecting legacy UI paths to the new workspace is an upgrade navigation setting, not a business capability. 0.0
F2-043-A055 ServiceNow IT Service Management F2-043 a The system automatically prevents creating another record of the same task type when an incident already has an associated problem or change record If the incident already has an associated https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/Uc8KCF0LjG~p2cz7LcOYiw/content 10.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Blocking creation of a second record of the same task type is a validation rule, not a capability. 0.0
F2-043-A077 ServiceNow IT Service Management F2-043 a The system automatically suggests resolutions to service desk agents based on similar incidents Service desk agents get resolution suggestions based on similar incidents https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/VJrgA~RGa2uCwOB_SKOI9A/content 12.txt passed rejected duplicate of F2-043-A025   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A092 ServiceNow IT Service Management F2-043 a The system lets a user log an incident by sending an email Log incidents in the instance or by sending email https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/YPPvhvaR2f1XnxYWSOG6Cg/content 14.txt passed rejected duplicate of F2-043-A091   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A122 ServiceNow IT Service Management F2-043 a The system lets a user create a change from an incident or a problem you can create a standard, normal, or an emergency change from an incident or a problem https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected duplicate of F2-043-A054   rejected (duplicate upheld) duplicate upheld 0.0
F2-043-A130 ServiceNow IT Service Management F2-043 a The system automatically prevents editing of the fields of a change request after it is authorized The fields are set to read only to prevent unintended changes after approval https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Making fields read only after authorization is an edit restriction, not a capability. 0.0
F2-043-A131 ServiceNow IT Service Management F2-043 a The system automatically prevents changing the primary configuration item of a change request after it leaves the New state You can set or change the primary configuration item (CI) only while the change request is in the New state https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Limiting changes of the primary CI to the New state is an edit restriction, not a capability. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);