pub10: candidates: 1,847 rows where in_final

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

1,847 rows where in_final_set = "0.0"

descending

✎ View and edit SQL

This data as json, CSV (advanced)

candidate_id ▼	app_id	run	statement	excerpt	source_url	source_file	script_check	verifier_verdict	verifier_reason	adjudicator	adjudicator_reason
F1-001-A022	Operately F1-001	a	The system automatically allows only one draft check-in per goal at a time when a draft is saved.	Each goal can have only one draft check-in at a time.	https://operately.com/help/check-in-goal	14.txt	passed	rejected	Describes a constraint on drafts, not a user-observable capability.	rejected	A limit of one draft per goal is a constraint, not a user-observable capability.
F1-001-A028	Operately F1-001	a	The system automatically requires a project start date when a user selects a project template.	Project start date — Required when you select a template.	https://operately.com/help/create-project	06.txt	passed	rejected	A validation rule on a form field, not a capability.	rejected	A required-field validation rule is not a capability.
F1-001-A069	Operately F1-001	a	The system automatically hides the New KPI button when a user can only view or comment on the space.	The New KPI button is hidden if you can only view or comment.	https://operately.com/help/create-kpi	07.txt	passed	rejected	Describes a permission-based UI restriction, not a capability.	rejected	Hiding a button for view-only users is a permission restriction, not a capability.
F1-001-A070	Operately F1-001	a	The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly.	If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence.	https://operately.com/help/create-kpi	07.txt	passed	rejected	A form validation message, not a capability.	rejected	A form validation prompt is not a capability.
F1-001-A072	Operately F1-001	a	The system automatically requires edit access to the space, project or goal when a user creates a document.	You need edit access to the space, project, or goal where you want to create a document.	https://operately.com/help/create-document	10.txt	passed	rejected	States a permission prerequisite, not a capability.	rejected	A permission prerequisite for document creation is not a capability in itself.
F1-001-A086	Operately F1-001	a	The system lets a user reuse project templates for recurring work.	Reuse project templates for recurring work	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A026	rejected (duplicate upheld)	duplicate upheld
F1-001-A087	Operately F1-001	a	The system lets a user track KPIs for a space.	Track KPIs for the numbers each space cares about	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A066	rejected (duplicate upheld)	duplicate upheld
F1-001-B001	Operately F1-001	b	The system lets a user create goals at any level, including company, team, and individual	Create and track goals at any level - company, team, or individual	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A001	rejected (duplicate upheld)	duplicate upheld
F1-001-B002	Operately F1-001	b	The system lets a user track goals at any level, including company, team, and individual	Create and track goals at any level - company, team, or individual	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A002	rejected (duplicate upheld)	duplicate upheld
F1-001-B003	Operately F1-001	b	The system lets a user break down complex initiatives into sub-goals	Break down complex initiatives into sub-goals	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A003	rejected (duplicate upheld)	duplicate upheld
F1-001-B004	Operately F1-001	b	The system lets a user set success criteria for a goal	Set success criteria and timelines that keep teams focused	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A004	rejected (duplicate upheld)	duplicate upheld
F1-001-B005	Operately F1-001	b	The system lets a user link projects directly to goals	Link projects directly to goals so everyone sees how their work contributes	https://operately.com/help/features-overview	03.txt	passed	rejected	duplicate of F1-001-A005	rejected (duplicate upheld)	duplicate upheld
F1-001-B006	Operately F1-001	b	The system lets a user add a description to a goal	Goal Description — Click “Write” to add context about why this goal matters and what success looks like.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A006	rejected (duplicate upheld)	duplicate upheld
F1-001-B007	Operately F1-001	b	The system lets a user add measurable targets to a goal	Targets — Click “Add” to create measurable outcomes that track progress.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A007	rejected (duplicate upheld)	duplicate upheld
F1-001-B008	Operately F1-001	b	The system lets a user add a checklist of key milestones and deliverables to a goal	Checklist — Add checks to track key milestones and deliverables.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A008	rejected (duplicate upheld)	duplicate upheld
F1-001-B009	Operately F1-001	b	The system lets a user set the champion of a goal	Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A009	rejected (duplicate upheld)	duplicate upheld
F1-001-B010	Operately F1-001	b	The system lets a user set the reviewer of a goal	Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A009	rejected (duplicate upheld)	duplicate upheld
F1-001-B011	Operately F1-001	b	The system lets a user set the due date of a goal	Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A009	rejected (duplicate upheld)	duplicate upheld
F1-001-B012	Operately F1-001	b	The system lets a user create multiple goals in sequence without closing the creation dialog	Create more — Toggle this on to keep the dialog open after creating a goal, so you can quickly create multiple goals in sequence.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A010	rejected (duplicate upheld)	duplicate upheld
F1-001-B013	Operately F1-001	b	The system automatically sets the status of a new goal to pending until the first check-in is submitted	Your new goal will start with a ‘pending’ status until you submit your first check-in.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A014	rejected (duplicate upheld)	duplicate upheld
F1-001-B014	Operately F1-001	b	The system lets a user configure baseline access for company members and space members on a goal	Permissions — Configure baseline access for Company members and Space members.	https://operately.com/help/create-goal	05.txt	passed	rejected	duplicate of F1-001-A012	rejected (duplicate upheld)	duplicate upheld
F1-001-B015	Operately F1-001	b	The system lets a user grant specific company members direct access to a goal	Direct people access for specific company members	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A013	rejected (duplicate upheld)	duplicate upheld
F1-001-B016	Operately F1-001	b	The system lets a user grant specific contributors access to a project	Contributor access for specific contributors	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A034	rejected (duplicate upheld)	duplicate upheld
F1-001-B017	Operately F1-001	b	The system automatically gives a person the most permissive of the applicable grants as their access to a goal	A person’s final goal access comes from the most permissive applicable grant.	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A050	rejected (duplicate upheld)	duplicate upheld
F1-001-B018	Operately F1-001	b	The system automatically gives a person the most permissive of the applicable grants as their access to a project	A person’s final project access comes from the most permissive applicable grant.	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A051	rejected (duplicate upheld)	duplicate upheld
F1-001-B019	Operately F1-001	b	The system lets a user configure company-wide access for a space	Company-wide access for all company members	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A048	rejected (duplicate upheld)	duplicate upheld
F1-001-B020	Operately F1-001	b	The system lets a user configure individual member access for explicitly added space members	Individual member access for explicitly added space members	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A048	rejected (duplicate upheld)	duplicate upheld
F1-001-B021	Operately F1-001	b	The system automatically restricts a space to explicitly granted members when company-wide access is set to No Access	Setting company-wide access to No Access makes the space secret. In that case, only explicitly granted members can see or use it.	https://operately.com/help/permissions-overview	12.txt	passed	rejected	duplicate of F1-001-A049	rejected (duplicate upheld)	duplicate upheld
F1-001-B022	Operately F1-001	b	The system lets a user control the access level of every space, goal, and project	Control access level of every space, goal, and project.	https://operately.com/features	02.txt	passed	rejected	duplicate of F1-001-A048	rejected (duplicate upheld)	duplicate upheld
F1-001-B023	Operately F1-001	b	The system lets a user make a space private	You can make any space private using access management tools.	https://operately.com/help/intro-to-spaces	08.txt	passed	rejected	duplicate of F1-001-A046	rejected (duplicate upheld)	duplicate upheld
F1-001-B024	Operately F1-001	b	The system lets a user create additional spaces for different teams and departments	Create additional spaces for different teams and departments.	https://operately.com/help/quick-tour	04.txt	passed	rejected	duplicate of F1-001-A045	rejected (duplicate upheld)	duplicate upheld
F1-001-B025	Operately F1-001	b	The system lets a user add members to a space	Add people who actively work on your team’s initiatives.	https://operately.com/help/intro-to-spaces	08.txt	passed	rejected	duplicate of F1-001-A047	rejected (duplicate upheld)	duplicate upheld
F1-001-B027	Operately F1-001	b	The system lets a user see recent activity across spaces	Activity Feed: See all recent activity across spaces - updates, changes, discussions, and more.	https://operately.com/help/quick-tour	04.txt	passed	rejected	duplicate of F1-001-A044	rejected (duplicate upheld)	duplicate upheld
F1-001-B029	Operately F1-001	b	The system lets a user see the progress and status of the ongoing goals and projects of a space	Goals & Projects overview: See progress and status of ongoing work	https://operately.com/help/quick-tour	04.txt	passed	rejected	duplicate of F1-001-A053	rejected (duplicate upheld)	duplicate upheld
F1-001-B030	Operately F1-001	b	The system lets a user see all goals and projects across the organization on a company work map	Company Work Map — The big picture. Shows all goals and projects across your entire organization.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A052	rejected (duplicate upheld)	duplicate upheld
F1-001-B031	Operately F1-001	b	The system lets a user see the goals and projects of a specific department or team on a space work map	Space Work Map — Team focus. Shows goals and projects within a specific department or team.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A053	rejected (duplicate upheld)	duplicate upheld
F1-001-B032	Operately F1-001	b	The system lets a user see everything the user owns or contributes to on a personal work map, regardless of space	My Work — Personal dashboard. Shows everything you own or contribute to, regardless of which space it lives in.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A054	rejected (duplicate upheld)	duplicate upheld
F1-001-B033	Operately F1-001	b	The system lets a user filter a work map to all work, goals only, projects only, paused work, or completed items	The tabs at the top let you filter what you see: All work, just goals, just projects, paused work, or completed items.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A056	rejected (duplicate upheld)	duplicate upheld
F1-001-B034	Operately F1-001	b	The system lets a user switch the projects on a work map between a table view and a timeline view	On Company Work Map and Space Work Map, open the projects tab to switch Work map view between Table and Timeline.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A057	rejected (duplicate upheld)	duplicate upheld
F1-001-B035	Operately F1-001	b	The system lets a user plan new goals and projects from a quick dialog at the bottom of a work map	The + Add new item link at the bottom of any Work Map opens a quick planning dialog.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A055	rejected (duplicate upheld)	duplicate upheld
F1-001-B037	Operately F1-001	b	The system automatically calculates the progress of a goal from the sum of its targets	Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A058	rejected (duplicate upheld)	duplicate upheld
F1-001-B038	Operately F1-001	b	The system automatically calculates the progress of a project from its milestones	Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A058	rejected (duplicate upheld)	duplicate upheld
F1-001-B039	Operately F1-001	b	The system automatically updates work maps in real time when someone updates a project’s progress or adds a new milestone	When someone updates a project’s progress or adds a new milestone, you’ll see it reflected immediately across all views.	https://operately.com/help/work-map-overview	09.txt	passed	rejected	duplicate of F1-001-A059	rejected (duplicate upheld)	duplicate upheld
F1-001-B040	Operately F1-001	b	The system lets a user create a project	There are several ways to create a project in Operately:	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A025	rejected (duplicate upheld)	duplicate upheld
F1-001-B041	Operately F1-001	b	The system lets a user create a project from a project template	Template — Optional. Choose a project template, No template, or Create a project template to open template creation for the selected space.	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A026	rejected (duplicate upheld)	duplicate upheld
F1-001-B042	Operately F1-001	b	The system lets a user save a project as a template	You can also save a project as a template later.	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A027	rejected (duplicate upheld)	duplicate upheld
F1-001-B043	Operately F1-001	b	The system automatically requires a project start date when a project template is selected	Project start date — Required when you select a template.	https://operately.com/help/create-project	06.txt	passed	rejected	A validation rule on a form field, not a capability.	rejected	A required-field validation rule is not a capability.
F1-001-B045	Operately F1-001	b	The system lets a user add a description to a project	Project Description — Click “Add a project description…” to add context about what needs to be done and what deliverables are expected.	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A029	rejected (duplicate upheld)	duplicate upheld
F1-001-B046	Operately F1-001	b	The system lets a user add milestones to a project	Milestones — Click “Add milestone” to create key checkpoints and deadlines.	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A030	rejected (duplicate upheld)	duplicate upheld
F1-001-B047	Operately F1-001	b	The system lets a user add tasks to a project	Tasks — In the tasks tab, add specific tasks and action items that need to be completed.	https://operately.com/help/create-project	06.txt	passed	rejected	duplicate of F1-001-A031	rejected (duplicate upheld)	duplicate upheld

Advanced export

JSON shape: default, array, newline-delimited, object

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);