candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

3 rows where adjudicator = "corrected", app_id = "F2-025" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 2

run 1

in_final_set 1

app_id 1

  • Salesforce Field Service · 3 ✖

adjudicator 1

  • corrected · 3 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-025-B007 Salesforce Field Service F2-025 b The system automatically guides a technician through each troubleshooting step. guide technicians through each troubleshooting step for faster resolution https://www.salesforce.com/service/field-service-management/ 01.txt passed corrected Not an automation triggered by an event; user-action form is correct. The system lets a technician follow guided troubleshooting steps from an AI agent. corrected No triggering event, so the user-action form fits. 1.0
F2-025-B056 Salesforce Field Service F2-025 b The system lets a technician get step-by-step guidance from an expert using Visual Remote Assistant from a mobile device. a technician can get step-by-step guidance from an expert using Visual Remote Assistant, reference knowledge base articles, or check inventory in an asset service management system https://www.salesforce.com/service/field-service-management/mobile-workforce/ 04.txt passed rejected duplicate of F2-025-A030   corrected Technician-side expert remote assistance differs from the customer-side video guidance in F2-025-A030. 1.0
F2-025-B058 Salesforce Field Service F2-025 b The system lets a user integrate asset data from any source with prebuilt connectors and monitor real-time telemetry data. Integrate asset data from any source with prebuilt connectors to drive calculated insights. Monitor and act on comprehensive telemetry data in real-time. https://www.salesforce.com/service/field-service-management/asset-management/ 05.txt passed corrected Integration is covered by A041; this keeps only the monitoring capability. The system lets a user monitor real-time asset telemetry data. corrected Integration is kept in F2-025-A041; this keeps the distinct monitoring capability. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);