home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

30 rows where adjudicator = "rejected", run = "b" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, verifier_reason, adjudicator_reason

app_id 16

  • ServiceNow IT Service Management 5
  • Givebutter 5
  • Operately 4
  • ZenTao (now branded Sanplex) 2
  • WeCMDB 2
  • Success.co 2
  • It's a Plan 1
  • DeskcommCRM 1
  • FOSSBilling 1
  • Asana 1
  • Userback 1
  • Pipedrive 1
  • Xero 1
  • Salesforce Field Service 1
  • Sage Intacct 1
  • Vanta 1

verifier_verdict 1

  • rejected · 30 ✖

run 1

  • b · 30 ✖

in_final_set 1

  • 0.0 30

adjudicator 1

  • rejected · 30 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-B043 Operately F1-001 b The system automatically requires a project start date when a project template is selected Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B080 Operately F1-001 b The system automatically prevents a goal from having more than one draft check-in at a time Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-B099 Operately F1-001 b The system automatically requires a name and a unit when a KPI is created Name and Unit are required. https://operately.com/help/create-kpi 07.txt passed rejected A form validation rule, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B100 Operately F1-001 b The system automatically hides the New KPI button from users who can only view or comment on the space The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-002-B077 It's a Plan F1-002 b The system automatically refuses to delete an account when it is the only owner of a project outside their own workspaces The delete is refused while they are the only owner of a project outside their own https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed rejected Describes a deletion safeguard, not a user-observable capability.   rejected Refusing deletion of a sole project owner's account is a safeguard, not a user capability. 0.0
F1-005-B060 DeskcommCRM F1-005 b The system lets a user manage notifications Profile, Notifications, Billing https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Bare screen label in a list; the excerpt does not say what a user can do with notifications.   rejected A bare settings-tab label does not say what a user can do with notifications. 0.0
F1-017-B026 ZenTao (now branded Sanplex) F1-017 b The system automatically prevents a story from being linked to a project unless the story is activated Only activated story can be linked to the projects and then to be developed. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-createstories-34 05.txt passed rejected Describes a system constraint on linking, not a user-observable capability.   rejected Allowing only activated stories to be linked is a constraint, not a user capability. 0.0
F1-017-B039 ZenTao (now branded Sanplex) F1-017 b The system automatically prevents child tasks on tasks done by multiple members Multiple tasks, tasks done by multiple members, cannot have child tasks. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-decomposetasks-37 06.txt passed rejected Describes a system constraint on child tasks, not a user-observable capability.   rejected Forbidding child tasks on multi-member tasks is a constraint, not a user capability. 0.0
F1-034-B041 WeCMDB F1-034 b The system automatically prevents users from adding, modifying or deleting system ENUM types when they try to customize them it cannot be customized adding,modifying or deleting. https://raw.githubusercontent.com/WeBankPartners/we-cmdb/HEAD/wiki/docs/wecmdb_glossary_en.md 04.txt passed rejected Glossary describes enum type constraints, not a user-observable automation or capability.   rejected The glossary entry defines that system enum types are fixed; it is a data-model constraint, not an advertised user capability or automation. 0.0
F1-034-B042 WeCMDB F1-034 b The system automatically prevents users from deleting common ENUM types when they try to delete them but cannot be deleted as it is common which can be used for other CI https://raw.githubusercontent.com/WeBankPartners/we-cmdb/HEAD/wiki/docs/wecmdb_glossary_en.md 04.txt passed rejected Glossary describes enum type constraints, not a user-observable automation or capability.   rejected The glossary entry defines that common enum types cannot be deleted; it is a data-model constraint, not an advertised user capability or automation. 0.0
F1-037-B009 FOSSBilling F1-037 b The system lets an administrator choose a product type for hosting, domains, downloads, licenses, and API keys. Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities already covered by separate statements (see F1-037-A019 to A022).   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F2-001-B071 Asana F2-001 b The system lets a user use Asana through desktop, web, and mobile apps. Asana is accessible via desktop app, web browser, and mobile app (available for both Android and iOS users). https://asana.com/product 01.txt passed rejected Availability of desktop, web and mobile apps is a delivery channel, not a capability.   rejected Access through desktop, web and mobile apps is a delivery channel, not a capability. 0.0
F2-007-B001 Userback F2-007 b The system lets a user capture screenshot annotations, session replays, console logs, and in-app surveys in one place. Userback captures screenshot annotations, session replays, console logs, and in-app surveys — all centralized in one place https://docs.userback.io/docs/welcome 01.txt passed rejected Umbrella statement; its parts are covered by A017, A049, A053 and A026.   rejected This umbrella sentence is covered piece by piece by the annotation, session replay, console log and survey statements. 0.0
F2-015-B016 Pipedrive F2-015 b The system lets a user map out projects. Map out complex projects simply and intuitively, making task management and team collaboration a breeze. https://www.pipedrive.com/en/features 01.txt passed rejected Marketing prose with no specific capability.   rejected Marketing intro to an integrations category with no specific capability. 0.0
F2-019-B050 Xero F2-019 b The system lets a user manage bookkeeping and accounting on a mobile app. Manage your business on the go with the Xero app for bookkeeping and accounting https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected Vague claim about a mobile app; no specific capability.   rejected Generic mobile-app claim with no specific capability. 0.0
F2-025-B077 Salesforce Field Service F2-025 b The system lets a user track alerts, timelines, milestones, warranties, cases, work orders, claims and activities throughout the asset lifecycle. Track alerts, timelines, milestones, warranties, cases, work orders, claims, and activities throughout the asset lifecycle. https://www.salesforce.com/service/field-service-management/asset-management/ 05.txt passed rejected Vague list of tracked record types in a vertical blurb; no specific capability.   rejected Catch-all list of record types in a vertical blurb, largely covered by the asset 360-degree view and warranty statements. 0.0
F2-043-B026 ServiceNow IT Service Management F2-043 b The system automatically redirects a user from UI16 module links to the equivalent Service Operations Workspace pages when UI16 module link redirection is enabled navigating through UI16 paths automatically redirects you to the equivalent list or record pages in SOW instead of displaying the UI16 forms or lists. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected UI navigation redirect for an upgrade/admin setting, not a business capability.   rejected Redirecting legacy UI paths to the new workspace is an upgrade navigation setting, not a business capability. 0.0
F2-043-B028 ServiceNow IT Service Management F2-043 b The system lets an agent manage incidents with contextual information and targeted actions Agents can manage incidents effectively with contextual information and targeted actions. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/IuHkukKoSrzunmpTtJoRPA/content 06.txt passed rejected Too generic to be a distinct capability; incident handling is covered by more specific statements.   rejected Too generic to name a distinct capability; incident handling is covered by the specific surviving statements. 0.0
F2-043-B060 ServiceNow IT Service Management F2-043 b The system lets a service level manager gather service requirements Gather service requirements and monitor and report on agreed service levels (SLAs). https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/kSjKycBSAxqdKWB1aGBJiA/content 09.txt passed rejected Describes a manager activity rather than a system function; the source only lists it in an application description.   rejected Gathering service requirements appears only as an application blurb and names no system function. 0.0
F2-043-B163 ServiceNow IT Service Management F2-043 b The system automatically prevents editing of change request fields after the change is authorized Authorized: The fields are set to read only to prevent unintended changes after approval. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Making fields read only after authorization is an edit restriction, not a capability. 0.0
F2-043-B164 ServiceNow IT Service Management F2-043 b The system automatically prevents setting or changing the primary configuration item of a change request after it leaves the New state You can set or change the primary configuration item (CI) only while the change request is in the New state. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Limiting changes of the primary CI to the New state is an edit restriction, not a capability. 0.0
F2-049-B038 Sage Intacct F2-049 b The system automatically prevents deleting or editing invoices when they have been paid You cannot delete nor edit invoices after they https://www.intacct.com/ia/docs/en_US/help_action/Accounts_Receivable/accounts-receivable-overview.htm 03.txt passed rejected A restriction on editing paid invoices is an accounting control, not a user capability.   rejected A lock on editing or deleting paid invoices is a restriction, not a user-observable capability. 0.0
F2-061-B084 Vanta F2-061 b The system lets a user assign access reviews independently of the system owner the ability to assign reviews independently of the system owner has been a timesaver https://www.vanta.com/products/access-reviews 08.txt passed rejected Evidenced only by a customer testimonial.   rejected Evidenced only by a customer testimonial. 0.0
F2-067-B117 Givebutter F2-067 b The system automatically prevents logging a transaction to a contact when the contact lacks a first and last name You cannot log a transaction to a contact without a first and last name. https://help.givebutter.com/en/articles/10355528-how-to-create-and-edit-contacts 03.txt passed rejected A validation constraint on transactions, not a user-facing capability.   rejected A data-validation constraint, not a capability. 0.0
F2-067-B153 Givebutter F2-067 b The system automatically limits changing a team’s name, goal, or logo, or deleting the team, to account admins once the team is created only an account admin can change the team name, goal, or logo, or delete the team. https://help.givebutter.com/en/articles/1749223-how-to-use-team-fundraising 05.txt passed rejected A permission restriction, not a capability.   rejected A permission restriction, not a capability. 0.0
F2-067-B177 Givebutter F2-067 b The system automatically withholds receipts from donors when transactions are imported Imported transactions will not trigger a receipt to the donor. https://help.givebutter.com/en/articles/2219216-how-to-manage-automatic-receipts-and-thank-you-messages 07.txt passed rejected Describes the absence of a behaviour (imports send no receipt), not a capability.   rejected Describes the absence of a behaviour, not a capability. 0.0
F2-067-B183 Givebutter F2-067 b The system automatically replaces the Other option with Enter amount when all donation amounts are removed If all donation amounts are removed, our system detects this and replaces "Other" with "Enter amount". https://help.givebutter.com/en/articles/2859751-how-to-customize-donation-amounts 08.txt passed rejected A user-interface fallback label, not a capability.   rejected A fallback label in the interface, not a capability. 0.0
F2-067-B193 Givebutter F2-067 b The system automatically prevents deleting a table that contains attendees You can only delete an empty table. https://help.givebutter.com/en/articles/11731317-how-to-create-event-seating-arrangements 09.txt passed rejected A validation constraint on deleting tables, not a capability.   rejected A validation constraint on deleting tables, not a capability. 0.0
F2-073-B060 Success.co F2-073 b The system lets a user join a team Step by step guide to join your team in Success.co https://www.success.co/docs 09.txt passed rejected Only a help-guide title; no capability is described.   rejected The only evidence is a help-guide heading for onboarding, and it describes no capability. 0.0
F2-073-B070 Success.co F2-073 b The system lets a user use the system in a desktop app and a mobile app Have Success right at your fingertips with our desktop app https://www.success.co/docs 09.txt passed rejected Platform availability of desktop and mobile apps, not a capability.   rejected Having desktop and mobile apps is platform availability, not a capability. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 775.805ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University