home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

1,735 rows where adjudicator = "rejected (duplicate upheld)", in_final_set = "0.0" and run = "b"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_file

app_id 25

  • Givebutter 194
  • ServiceNow IT Service Management 141
  • MaintainX 112
  • Operately 105
  • Sage Intacct 98
  • Mayan EDMS 85
  • Vanta 81
  • Userback 80
  • Xero 77
  • Asana 68
  • Salesforce Service Cloud 67
  • Success.co 67
  • Salesforce Field Service 65
  • It's a Plan 64
  • ZenTao (now branded Sanplex) 64
  • DeskcommCRM 62
  • Probo 55
  • Pipedrive 53
  • QloApps 50
  • WeCMDB 38
  • Asp.Net Core Inventory Order Management System (Indotalent WMS) 37
  • FOSSBilling 34
  • Helper 17
  • Wukong HRM 15
  • RUN Powered by ADP 6

verifier_verdict 1

  • rejected 1,735

run 1

  • b · 1,735 ✖

in_final_set 1

  • - · 1,735 ✖

adjudicator 1

  • rejected (duplicate upheld) · 1,735 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-B001 Operately F1-001 b The system lets a user create goals at any level, including company, team, and individual Create and track goals at any level - company, team, or individual https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A001   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B002 Operately F1-001 b The system lets a user track goals at any level, including company, team, and individual Create and track goals at any level - company, team, or individual https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A002   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B003 Operately F1-001 b The system lets a user break down complex initiatives into sub-goals Break down complex initiatives into sub-goals https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A003   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B004 Operately F1-001 b The system lets a user set success criteria for a goal Set success criteria and timelines that keep teams focused https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A004   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B005 Operately F1-001 b The system lets a user link projects directly to goals Link projects directly to goals so everyone sees how their work contributes https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A005   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B006 Operately F1-001 b The system lets a user add a description to a goal Goal Description — Click “Write” to add context about why this goal matters and what success looks like. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A006   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B007 Operately F1-001 b The system lets a user add measurable targets to a goal Targets — Click “Add” to create measurable outcomes that track progress. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A007   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B008 Operately F1-001 b The system lets a user add a checklist of key milestones and deliverables to a goal Checklist — Add checks to track key milestones and deliverables. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A008   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B009 Operately F1-001 b The system lets a user set the champion of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B010 Operately F1-001 b The system lets a user set the reviewer of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B011 Operately F1-001 b The system lets a user set the due date of a goal Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and due date in the sidebar. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B012 Operately F1-001 b The system lets a user create multiple goals in sequence without closing the creation dialog Create more — Toggle this on to keep the dialog open after creating a goal, so you can quickly create multiple goals in sequence. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A010   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B013 Operately F1-001 b The system automatically sets the status of a new goal to pending until the first check-in is submitted Your new goal will start with a ‘pending’ status until you submit your first check-in. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A014   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B014 Operately F1-001 b The system lets a user configure baseline access for company members and space members on a goal Permissions — Configure baseline access for Company members and Space members. https://operately.com/help/create-goal 05.txt passed rejected duplicate of F1-001-A012   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B015 Operately F1-001 b The system lets a user grant specific company members direct access to a goal Direct people access for specific company members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A013   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B016 Operately F1-001 b The system lets a user grant specific contributors access to a project Contributor access for specific contributors https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A034   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B017 Operately F1-001 b The system automatically gives a person the most permissive of the applicable grants as their access to a goal A person’s final goal access comes from the most permissive applicable grant. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A050   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B018 Operately F1-001 b The system automatically gives a person the most permissive of the applicable grants as their access to a project A person’s final project access comes from the most permissive applicable grant. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A051   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B019 Operately F1-001 b The system lets a user configure company-wide access for a space Company-wide access for all company members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B020 Operately F1-001 b The system lets a user configure individual member access for explicitly added space members Individual member access for explicitly added space members https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B021 Operately F1-001 b The system automatically restricts a space to explicitly granted members when company-wide access is set to No Access Setting company-wide access to No Access makes the space secret. In that case, only explicitly granted members can see or use it. https://operately.com/help/permissions-overview 12.txt passed rejected duplicate of F1-001-A049   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B022 Operately F1-001 b The system lets a user control the access level of every space, goal, and project Control access level of every space, goal, and project. https://operately.com/features 02.txt passed rejected duplicate of F1-001-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B023 Operately F1-001 b The system lets a user make a space private You can make any space private using access management tools. https://operately.com/help/intro-to-spaces 08.txt passed rejected duplicate of F1-001-A046   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B024 Operately F1-001 b The system lets a user create additional spaces for different teams and departments Create additional spaces for different teams and departments. https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A045   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B025 Operately F1-001 b The system lets a user add members to a space Add people who actively work on your team’s initiatives. https://operately.com/help/intro-to-spaces 08.txt passed rejected duplicate of F1-001-A047   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B027 Operately F1-001 b The system lets a user see recent activity across spaces Activity Feed: See all recent activity across spaces - updates, changes, discussions, and more. https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A044   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B029 Operately F1-001 b The system lets a user see the progress and status of the ongoing goals and projects of a space Goals & Projects overview: See progress and status of ongoing work https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A053   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B030 Operately F1-001 b The system lets a user see all goals and projects across the organization on a company work map Company Work Map — The big picture. Shows all goals and projects across your entire organization. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A052   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B031 Operately F1-001 b The system lets a user see the goals and projects of a specific department or team on a space work map Space Work Map — Team focus. Shows goals and projects within a specific department or team. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A053   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B032 Operately F1-001 b The system lets a user see everything the user owns or contributes to on a personal work map, regardless of space My Work — Personal dashboard. Shows everything you own or contribute to, regardless of which space it lives in. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A054   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B033 Operately F1-001 b The system lets a user filter a work map to all work, goals only, projects only, paused work, or completed items The tabs at the top let you filter what you see: All work, just goals, just projects, paused work, or completed items. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A056   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B034 Operately F1-001 b The system lets a user switch the projects on a work map between a table view and a timeline view On Company Work Map and Space Work Map, open the projects tab to switch Work map view between Table and Timeline. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A057   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B035 Operately F1-001 b The system lets a user plan new goals and projects from a quick dialog at the bottom of a work map The + Add new item link at the bottom of any Work Map opens a quick planning dialog. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A055   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B037 Operately F1-001 b The system automatically calculates the progress of a goal from the sum of its targets Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A058   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B038 Operately F1-001 b The system automatically calculates the progress of a project from its milestones Progress bars visualize completion — for goals, this sums up all their targets; for projects, it’s based on milestones. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A058   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B039 Operately F1-001 b The system automatically updates work maps in real time when someone updates a project’s progress or adds a new milestone When someone updates a project’s progress or adds a new milestone, you’ll see it reflected immediately across all views. https://operately.com/help/work-map-overview 09.txt passed rejected duplicate of F1-001-A059   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B040 Operately F1-001 b The system lets a user create a project There are several ways to create a project in Operately: https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A025   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B041 Operately F1-001 b The system lets a user create a project from a project template Template — Optional. Choose a project template, No template, or Create a project template to open template creation for the selected space. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A026   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B042 Operately F1-001 b The system lets a user save a project as a template You can also save a project as a template later. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A027   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B045 Operately F1-001 b The system lets a user add a description to a project Project Description — Click “Add a project description…” to add context about what needs to be done and what deliverables are expected. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A029   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B046 Operately F1-001 b The system lets a user add milestones to a project Milestones — Click “Add milestone” to create key checkpoints and deadlines. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A030   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B047 Operately F1-001 b The system lets a user add tasks to a project Tasks — In the tasks tab, add specific tasks and action items that need to be completed. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A031   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B048 Operately F1-001 b The system lets a user set the champion of a project Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and start and due date in the sidebar. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A032   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B049 Operately F1-001 b The system lets a user set the reviewer of a project Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and start and due date in the sidebar. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A032   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B050 Operately F1-001 b The system lets a user set the start date of a project Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and start and due date in the sidebar. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A032   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B051 Operately F1-001 b The system lets a user set the due date of a project Team & Timeline — Set the champion (who owns it), reviewer (who provides oversight), and start and due date in the sidebar. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A032   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B052 Operately F1-001 b The system lets a user add documents to a project Docs & Files — Add documents, files, and links on the Docs & Files tab as the project grows. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A033   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B053 Operately F1-001 b The system lets a user add files to a project Docs & Files — Add documents, files, and links on the Docs & Files tab as the project grows. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A033   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B054 Operately F1-001 b The system lets a user add links to a project Docs & Files — Add documents, files, and links on the Docs & Files tab as the project grows. https://operately.com/help/create-project 06.txt passed rejected duplicate of F1-001-A033   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-B055 Operately F1-001 b The system lets a user reorder milestones and tasks Create or reorder milestones and tasks, adjust milestone deadlines and descriptions, update task status, assignees, or due dates, and open task details for notes and discussion without losing context. https://operately.com/help/quick-tour 04.txt passed rejected duplicate of F1-001-A035   rejected (duplicate upheld) duplicate upheld 0.0

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 1038.87ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University