candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

4 rows where adjudicator = "rejected", app_id = "F1-001" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, adjudicator_reason

verifier_verdict 1

run 1

in_final_set 1

app_id 1

  • Operately · 4 ✖

adjudicator 1

  • rejected · 4 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-B043 Operately F1-001 b The system automatically requires a project start date when a project template is selected Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B080 Operately F1-001 b The system automatically prevents a goal from having more than one draft check-in at a time Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-B099 Operately F1-001 b The system automatically requires a name and a unit when a KPI is created Name and Unit are required. https://operately.com/help/create-kpi 07.txt passed rejected A form validation rule, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B100 Operately F1-001 b The system automatically hides the New KPI button from users who can only view or comment on the space The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);