candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

6 rows where app_id = "F2-031", in_final_set = "1.0" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

verifier_verdict 2

adjudicator 2

run 1

in_final_set 1

app_id 1

  • Salesforce Service Cloud · 6 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-031-B020 Salesforce Service Cloud F2-031 b The system lets a service rep collaborate internally within the case record allows for seamless internal collaboration directly within the record https://www.salesforce.com/service/cloud/ 04.txt passed confirmed     (not sent: confirmed)   1.0
F2-031-B028 Salesforce Service Cloud F2-031 b The system automatically captures every conversation in the customer record in real time ensure every conversation is captured in real time https://www.salesforce.com/service/contact-center/ 05.txt passed confirmed     (not sent: confirmed)   1.0
F2-031-B042 Salesforce Service Cloud F2-031 b The system lets an administrator build AI voice agents that serve customers Build AI voice agents that sound human and serve customers autonomously 24/7. https://www.salesforce.com/service/contact-center/ 05.txt passed confirmed     (not sent: confirmed)   1.0
F2-031-B044 Salesforce Service Cloud F2-031 b The system lets an administrator deploy an AI help agent across voice, web, portals, SMS, and WhatsApp deploys across voice, web, portals, SMS, and WhatsApp. https://www.salesforce.com/service/customer-self-service/ 07.txt passed confirmed     (not sent: confirmed)   1.0
F2-031-B064 Salesforce Service Cloud F2-031 b The system automatically prioritizes tickets with AI It centralizes ticket management, automates routing, and uses AI to categorize, prioritize, and resolve simple issues automatically. https://www.salesforce.com/service/support-ticketing-tools-systems/ 09.txt passed corrected Form requires an automation statement without a missing trigger; kept as the separate prioritizing capability after A053 was narrowed to categorizing. The system automatically prioritizes tickets with AI confirmed The verifier's correction is identical to the original statement, which is supported and well formed as the separate prioritizing capability. 1.0
F2-031-B073 Salesforce Service Cloud F2-031 b The system lets a service rep share an AI-generated reply with one click or edit it before sending Reps can share replies with a single click or edit them before sending. https://www.salesforce.com/service/support-ticketing-tools-systems/ 09.txt passed confirmed     (not sent: confirmed)   1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);