home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

4 rows where adjudicator = "confirmed" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

app_id 3

  • ServiceNow IT Service Management 2
  • Pipedrive 1
  • Givebutter 1

verifier_verdict 1

  • rejected · 4 ✖

run 1

  • b 4

in_final_set 1

  • 1.0 4

adjudicator 1

  • confirmed · 4 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-015-B003 Pipedrive F2-015 b The system automatically transcribes calls when a user holds a call. It records and transcribes your calls so you don’t have to. https://www.pipedrive.com/en/features 01.txt passed rejected duplicate of A002   confirmed Transcription is a distinct capability from recording, now that F2-015-A002 is narrowed to recording. 1.0
F2-043-B032 ServiceNow IT Service Management F2-043 b The system lets an agent manage the entire life cycle of requests Agents can also manage the entire life cycle of requests. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/IuHkukKoSrzunmpTtJoRPA/content 06.txt passed rejected duplicate of F2-043-A008   confirmed Agent-side management of the request life cycle (06.txt line 82) differs from a user requesting catalog items in A008. 1.0
F2-043-B157 ServiceNow IT Service Management F2-043 b The system lets a user associate multiple impacted configuration items with a change You can associate multiple impacted CIs with a change. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected duplicate of F2-043-A125   confirmed The source lists Impacted services/CIs as a separate related list from Affected CIs (21.txt lines 158-161), so this is a different capability from A125. 1.0
F2-067-B219 Givebutter F2-067 b The system lets a user log emails to a contact activity feed with a BCC or forwarding address How to log emails to a contact activity feed with BCC or forwarding address https://help.givebutter.com/en/collections/3094625-crm-donor-management 12.txt passed rejected duplicate of F2-067-A084   confirmed Logging any email through a BCC or forwarding address is a separate user capability from A084's automatic logging when the user emails from the contact profile. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 1019.981ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University