candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

6 rows where app_id = "F2-025", run = "a" and verifier_verdict = "corrected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

verifier_verdict 1

  • corrected · 6 ✖

run 1

in_final_set 1

app_id 1

  • Salesforce Field Service · 6 ✖

adjudicator 1

candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-025-A007 Salesforce Field Service F2-025 a The system lets a dispatcher use natural language to find appointments that need attention and take action such as filling a gap in the schedule or locating missing parts. Dispatchers can speak to Agentforce using natural language to quickly find appointments that need attention and take action like filling a gap in the schedule or even locating missing parts. https://www.salesforce.com/service/field-service-management/ 01.txt passed corrected Two capabilities in one statement; taking action is covered separately. The system lets a dispatcher use natural language to find appointments that need attention. corrected Split two capabilities; taking action on gaps or missing parts is covered separately. 1.0
F2-025-A019 Salesforce Field Service F2-025 a The system automatically schedules the workforce and ensures compliance with service-level agreements. automates workforce scheduling, reduces travel time, and ensures compliance with service-level agreements https://www.salesforce.com/service/field-service-management/ 01.txt passed corrected Tightened to the single scheduling automation the excerpt supports. The system automatically schedules the workforce in line with service-level agreements. corrected SLA compliance is a quality of the scheduling automation, not a second capability. 1.0
F2-025-A022 Salesforce Field Service F2-025 a The system lets a manager monitor service outcomes and create preventive maintenance plans based on asset use, condition, and specific criteria. Monitor service outcomes and create preventive maintenance plans based on asset use, condition, and specific criteria. https://www.salesforce.com/service/field-service-management/ 01.txt passed corrected Two capabilities in one statement; monitoring service outcomes is covered separately. The system lets a manager create preventive maintenance plans based on asset use, condition and specific criteria. corrected Split two capabilities; monitoring service outcomes is covered separately. 1.0
F2-025-A024 Salesforce Field Service F2-025 a The system lets a manager predict the time and reason for an asset failure. predict the time of — and reason for — an asset failure https://www.salesforce.com/service/field-service-management/ 01.txt passed corrected Describes an automation, not a user action. The system automatically predicts the time and reason for an asset failure. corrected Describes an automation. 1.0
F2-025-A041 Salesforce Field Service F2-025 a The system lets a user integrate asset data from any source with prebuilt connectors and monitor telemetry data in real time. Integrate asset data from any source with prebuilt connectors to drive calculated insights. Monitor and act on comprehensive telemetry data in real-time. https://www.salesforce.com/service/field-service-management/asset-management/ 05.txt passed corrected Two capabilities in one statement; telemetry monitoring covered separately. The system lets a user integrate asset data from any source with prebuilt connectors. corrected Split two capabilities; telemetry monitoring is kept via F2-025-B058. 1.0
F2-025-A059 Salesforce Field Service F2-025 a The system lets a dispatcher ask a conversational AI assistant to find and schedule unscheduled appointments, summarize service appointments and answer from knowledge base articles. They can simply ask the assistant to quickly find and schedule appointments that haven’t been scheduled yet, create summaries of service appointments, and generate answers from knowledge base articles to resolve customer questions faster. https://www.salesforce.com/service/field-service-management/what-is-dispatch-management/ 07.txt passed corrected Three capabilities in one statement; narrowed to the first. The system lets a dispatcher ask a conversational AI assistant to find and schedule unscheduled appointments. corrected Three capabilities in one; the other two are accepted as missed items. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);