candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

1 row where adjudicator = "rejected (duplicate upheld)", app_id = "F2-049" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • Sage Intacct · 1 ✖

adjudicator 1

  • rejected (duplicate upheld) · 1 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-049-A074 Sage Intacct F2-049 a The system lets a user create variations of financial reports using the Financial Report Writer Using the Financial Report Writer, you can create innumerable variations of reports, including income statements, balance sheets, budget variance reports, departmental expense reports, gross margin, statement of cash flows, and so on. https://www.intacct.com/ia/docs/en_US/help_action/General_Ledger/General_Ledger_reports/gl-reports-overview.htm 07.txt passed rejected duplicate of F2-049-A009   rejected (duplicate upheld) duplicate upheld 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);