candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

116 rows where app_id = "F1-001" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, adjudicator_reason

run 2

  • b 109
  • a 7

verifier_verdict 1

  • rejected · 116 ✖

in_final_set 1

app_id 1

  • Operately · 116 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-A022 Operately F1-001 a The system automatically allows only one draft check-in per goal at a time when a draft is saved. Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-A028 Operately F1-001 a The system automatically requires a project start date when a user selects a project template. Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-A069 Operately F1-001 a The system automatically hides the New KPI button when a user can only view or comment on the space. The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-001-A070 Operately F1-001 a The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly. If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence. https://operately.com/help/create-kpi 07.txt passed rejected A form validation message, not a capability.   rejected A form validation prompt is not a capability. 0.0
F1-001-A072 Operately F1-001 a The system automatically requires edit access to the space, project or goal when a user creates a document. You need edit access to the space, project, or goal where you want to create a document. https://operately.com/help/create-document 10.txt passed rejected States a permission prerequisite, not a capability.   rejected A permission prerequisite for document creation is not a capability in itself. 0.0
F1-001-A086 Operately F1-001 a The system lets a user reuse project templates for recurring work. Reuse project templates for recurring work https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A026   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-A087 Operately F1-001 a The system lets a user track KPIs for a space. Track KPIs for the numbers each space cares about https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A066   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B001 Operately F1-001 b The system lets a user create goals at any level, including company, team, and individual Create and track goals at any level - company, team, or individual https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A001   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B002 Operately F1-001 b The system lets a user track goals at any level, including company, team, and individual Create and track goals at any level - company, team, or individual https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A002   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B003 Operately F1-001 b The system lets a user break down complex initiatives into sub-goals Break down complex initiatives into sub-goals https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A003   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B004 Operately F1-001 b The system lets a user set success criteria for a goal Set success criteria and timelines that keep teams focused https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A004   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B005 Operately F1-001 b The system lets a user link projects directly to goals Link projects directly to goals so everyone sees how their work contributes https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A005   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B006 Operately F1-001 b The system lets a user add a description to a goal Goal Description — Click “Write” to add context about why this goal matters and what success looks like. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A006   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B007 Operately F1-001 b The system lets a user add measurable targets to a goal Targets — Click “Add” to create measurable outcomes that track progress. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A007   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B008 Operately F1-001 b The system lets a user add a checklist of key milestones and deliverables to a goal Checklist — Add checks to track key milestones and deliverables. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A008   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B009 Operately F1-001 b The system lets a user set the champion of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B010 Operately F1-001 b The system lets a user set the reviewer of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B011 Operately F1-001 b The system lets a user set the due date of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B012 Operately F1-001 b The system lets a user create multiple goals in sequence without closing the creation dialog Create more — Toggle this on to keep the dialog open after creating a goal, so you can quickly create multiple goals in sequence. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A010   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B013 Operately F1-001 b The system automatically sets the status of a new goal to pending until the first check-in is submitted Your new goal will start with a ‘pending’ status until you submit your first check-in. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A014   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B014 Operately F1-001 b The system lets a user configure baseline access for company members and space members on a goal Permissions — Configure baseline access for Company members and Space members. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A012   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B015 Operately F1-001 b The system lets a user grant specific company members direct access to a goal Direct people access for specific company members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A013   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B016 Operately F1-001 b The system lets a user grant specific contributors access to a project Contributor access for specific contributors https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A034   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B017 Operately F1-001 b The system automatically gives a person the most permissive of the applicable grants as their access to a goal A person’s final goal access comes from the most permissive applicable grant. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A050   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B018 Operately F1-001 b The system automatically gives a person the most permissive of the applicable grants as their access to a project A person’s final project access comes from the most permissive applicable grant. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A051   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B019 Operately F1-001 b The system lets a user configure company-wide access for a space Company-wide access for all company members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B020 Operately F1-001 b The system lets a user configure individual member access for explicitly added space members Individual member access for explicitly added space members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B021 Operately F1-001 b The system automatically restricts a space to explicitly granted members when company-wide access is set to No Access Setting company-wide access to No Access makes the space secret. In that case, only explicitly granted members can see or use it. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A049   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B022 Operately F1-001 b The system lets a user control the access level of every space, goal, and project Control access level of every space, goal, and project. https://operately.com/features 02.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B023 Operately F1-001 b The system lets a user make a space private You can make any space private using access management tools. https://operately.com/help/intro-to-spaces 08.txt passed rejected duplicate of F1-001-A046   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B024 Operately F1-001 b The system lets a user create additional spaces for different teams and departments Create additional spaces for different teams and departments. https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A045   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B025 Operately F1-001 b The system lets a user add members to a space Add people who actively work on your team’s initiatives. https://operately.com/help/intro-to-spaces 08.txt passed rejected duplicate of F1-001-A047   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B027 Operately F1-001 b The system lets a user see recent activity across spaces Activity Feed: See all recent activity across spaces - updates, changes, discussions, and more. https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A044   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B029 Operately F1-001 b The system lets a user see the progress and status of the ongoing goals and projects of a space Goals & Projects overview: See progress and status of ongoing work https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A053   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B030 Operately F1-001 b The system lets a user see all goals and projects across the organization on a company work map Company Work Map — The big picture. Shows all goals and projects across your entire organization. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A052   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B031 Operately F1-001 b The system lets a user see the goals and projects of a specific department or team on a space work map Space Work Map — Team focus. Shows goals and projects within a specific department or team. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A053   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B032 Operately F1-001 b The system lets a user see everything the user owns or contributes to on a personal work map, regardless of space My Work — Personal dashboard. Shows everything you own or contribute to, regardless of which space it lives in. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A054   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B033 Operately F1-001 b The system lets a user filter a work map to all work, goals only, projects only, paused work, or completed items The tabs at the top let you filter what you see: All work, just goals, just projects, paused work, or completed items. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A056   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B034 Operately F1-001 b The system lets a user switch the projects on a work map between a table view and a timeline view On Company Work Map and Space Work Map, open the projects tab to switch Work map view between Table and Timeline. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A057   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B035 Operately F1-001 b The system lets a user plan new goals and projects from a quick dialog at the bottom of a work map The + Add new item link at the bottom of any Work Map opens a quick planning dialog. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A055   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B037 Operately F1-001 b The system automatically calculates the progress of a goal from the sum of its targets Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A058   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B038 Operately F1-001 b The system automatically calculates the progress of a project from its milestones Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A058   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B039 Operately F1-001 b The system automatically updates work maps in real time when someone updates a project’s progress or adds a new milestone When someone updates a project’s progress or adds a new milestone, you’ll see it reflected immediately across all views. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A059   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B040 Operately F1-001 b The system lets a user create a project There are several ways to create a project in Operately: https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A025   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B041 Operately F1-001 b The system lets a user create a project from a project template Template — Optional. Choose a project template, No template, or Create a project template to open template creation for the selected space. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A026   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B042 Operately F1-001 b The system lets a user save a project as a template You can also save a project as a template later. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A027   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B043 Operately F1-001 b The system automatically requires a project start date when a project template is selected Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B045 Operately F1-001 b The system lets a user add a description to a project Project Description — Click “Add a project description…” to add context about what needs to be done and what deliverables are expected. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A029   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B046 Operately F1-001 b The system lets a user add milestones to a project Milestones — Click “Add milestone” to create key checkpoints and deadlines. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A030   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B047 Operately F1-001 b The system lets a user add tasks to a project Tasks — In the tasks tab, add specific tasks and action items that need to be completed. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A031   rejected (duplicate upheld) duplicate upheld 0.0

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);