home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

7 rows where app_id = "F1-001", in_final_set = "0.0" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, adjudicator_reason

adjudicator 2

  • rejected 5
  • rejected (duplicate upheld) 2

verifier_verdict 1

  • rejected 7

run 1

  • a · 7 ✖

in_final_set 1

  • - · 7 ✖

app_id 1

  • Operately · 7 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-A022 Operately F1-001 a The system automatically allows only one draft check-in per goal at a time when a draft is saved. Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-A028 Operately F1-001 a The system automatically requires a project start date when a user selects a project template. Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-A069 Operately F1-001 a The system automatically hides the New KPI button when a user can only view or comment on the space. The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-001-A070 Operately F1-001 a The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly. If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence. https://operately.com/help/create-kpi 07.txt passed rejected A form validation message, not a capability.   rejected A form validation prompt is not a capability. 0.0
F1-001-A072 Operately F1-001 a The system automatically requires edit access to the space, project or goal when a user creates a document. You need edit access to the space, project, or goal where you want to create a document. https://operately.com/help/create-document 10.txt passed rejected States a permission prerequisite, not a capability.   rejected A permission prerequisite for document creation is not a capability in itself. 0.0
F1-001-A086 Operately F1-001 a The system lets a user reuse project templates for recurring work. Reuse project templates for recurring work https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A026   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-A087 Operately F1-001 a The system lets a user track KPIs for a space. Track KPIs for the numbers each space cares about https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A066   rejected (duplicate upheld) duplicate upheld 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 1140.337ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University