home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

30 rows where adjudicator = "rejected" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

app_id 13

  • Operately 5
  • DeskcommCRM 4
  • ServiceNow IT Service Management 4
  • Givebutter 4
  • Sage Intacct 3
  • ZenTao (now branded Sanplex) 2
  • Success.co 2
  • FOSSBilling 1
  • Asana 1
  • Userback 1
  • Pipedrive 1
  • Xero 1
  • Vanta 1

verifier_verdict 1

  • rejected 30

run 1

  • a · 30 ✖

in_final_set 1

  • 0.0 30

adjudicator 1

  • rejected · 30 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-A022 Operately F1-001 a The system automatically allows only one draft check-in per goal at a time when a draft is saved. Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-A028 Operately F1-001 a The system automatically requires a project start date when a user selects a project template. Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-A069 Operately F1-001 a The system automatically hides the New KPI button when a user can only view or comment on the space. The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-001-A070 Operately F1-001 a The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly. If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence. https://operately.com/help/create-kpi 07.txt passed rejected A form validation message, not a capability.   rejected A form validation prompt is not a capability. 0.0
F1-001-A072 Operately F1-001 a The system automatically requires edit access to the space, project or goal when a user creates a document. You need edit access to the space, project, or goal where you want to create a document. https://operately.com/help/create-document 10.txt passed rejected States a permission prerequisite, not a capability.   rejected A permission prerequisite for document creation is not a capability in itself. 0.0
F1-005-A035 DeskcommCRM F1-005 a The system lets an administrator reset a user's password | `reset-password.sh` | Resets a user's password | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected The excerpt is a server shell script run by the installation operator, which is IT-infrastructure administration rather than an in-app feature. 0.0
F1-005-A036 DeskcommCRM F1-005 a The system lets an administrator remove two-factor authentication for a user who lost their phone | `reset-mfa.sh` | Removes MFA for someone who lost their phone | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected MFA removal here is an operator shell script on the server, not a user-facing sign-in feature of the app. 0.0
F1-005-A056 DeskcommCRM F1-005 a The system lets an administrator back up the database and WhatsApp sessions | `backup.sh` | Backs up the database + WhatsApp sessions | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Database backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-005-A057 DeskcommCRM F1-005 a The system lets an administrator restore a backup into an empty database it only restores into an empty database https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Restoring a backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-017-A032 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents a story that is not activated from being linked to a project. Only activated story can be linked to the projects and then to be developed. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-createstories-34 05.txt passed rejected Describes a system constraint on linking, not a user-observable capability.   rejected Allowing only activated stories to be linked is a constraint, not a user capability. 0.0
F1-017-A044 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents child tasks from being created for a task assigned to multiple members. Multiple tasks, tasks done by multiple members, cannot have child tasks. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-decomposetasks-37 06.txt passed rejected Describes a system constraint on child tasks, not a user-observable capability.   rejected Forbidding child tasks on multi-member tasks is a constraint, not a user capability. 0.0
F1-037-A018 FOSSBilling F1-037 a The system lets an administrator sell hosting plans, domains, downloadable products, licenses, and API keys through product types Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities (hosting, domains, downloads, licenses, API keys) covered by separate statements.   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F2-001-A019 Asana F2-001 a The system lets a user use mobile and desktop apps to work on tasks Yes, Asana offers mobile apps for iPhone, iPad, and Android, plus desktop apps for Mac and Windows. https://asana.com/features/project-management 02.txt passed rejected Availability of mobile and desktop apps is a delivery channel, not a capability.   rejected Offering mobile and desktop apps is a delivery channel, not a capability. 0.0
F2-007-A030 Userback F2-007 a The system lets a user add rating, text, and choice questions to a survey Add any of these from the Add component dropdown at the top of the builder’s Design > Questions tab. https://support.userback.io/en/articles/16880431-survey-question-types-reference 10.txt passed rejected Compound umbrella over three question families; each is covered by A031 to A034.   rejected This umbrella statement over the question families is fully covered by A031 to A034. 0.0
F2-015-A005 Pipedrive F2-015 a The system lets a user manage, qualify and prioritize leads. Make the most of each opportunity with dedicated features that help with lead management, qualification and prioritization https://www.pipedrive.com/en/features 01.txt passed rejected Vague marketing phrase bundling lead management, qualification and prioritization without a specific capability.   rejected Vague bundle of lead management areas with no specific capability; leads inbox is covered separately. 0.0
F2-019-A044 Xero F2-019 a The system lets a user manage the business on a mobile app. Manage your business on the go with the Xero app for bookkeeping and accounting https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected Vague claim about managing the business on a mobile app; no specific capability.   rejected Generic mobile-app claim with no specific capability; specific mobile features are covered elsewhere. 0.0
F2-043-A020 ServiceNow IT Service Management F2-043 a The system automatically redirects UI16 module links to the equivalent Service Operations Workspace pages when redirection is enabled navigating through UI16 paths automatically redirects you to the equivalent list or record pages in SOW https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected UI navigation redirect for an upgrade/admin setting, not a business capability.   rejected Redirecting legacy UI paths to the new workspace is an upgrade navigation setting, not a business capability. 0.0
F2-043-A055 ServiceNow IT Service Management F2-043 a The system automatically prevents creating another record of the same task type when an incident already has an associated problem or change record If the incident already has an associated https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/Uc8KCF0LjG~p2cz7LcOYiw/content 10.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Blocking creation of a second record of the same task type is a validation rule, not a capability. 0.0
F2-043-A130 ServiceNow IT Service Management F2-043 a The system automatically prevents editing of the fields of a change request after it is authorized The fields are set to read only to prevent unintended changes after approval https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Making fields read only after authorization is an edit restriction, not a capability. 0.0
F2-043-A131 ServiceNow IT Service Management F2-043 a The system automatically prevents changing the primary configuration item of a change request after it leaves the New state You can set or change the primary configuration item (CI) only while the change request is in the New state https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Limiting changes of the primary CI to the New state is an edit restriction, not a capability. 0.0
F2-049-A040 Sage Intacct F2-049 a The system automatically prevents deleting or editing invoices when they have been paid You cannot delete nor edit invoices after https://www.intacct.com/ia/docs/en_US/help_action/Accounts_Receivable/accounts-receivable-overview.htm 03.txt passed rejected A restriction on editing paid invoices is an accounting control, not a user capability.   rejected A lock on editing or deleting paid invoices is a restriction, not a user-observable capability. 0.0
F2-049-A083 Sage Intacct F2-049 a The system automatically prevents exporting a standard application report when it has not been memorized To export a standard application report, it must be memorized first. https://www.intacct.com/ia/docs/en_US/help_action/General_Ledger/General_Ledger_reports/gl-reports-overview.htm 07.txt passed rejected A restriction on exporting unmemorized reports is a limitation, not a capability.   rejected The requirement to memorize a report before export is a precondition, not a capability. 0.0
F2-049-A087 Sage Intacct F2-049 a The system automatically prevents a user from viewing report data when the user lacks the proper permissions you must have the proper permissions to view the data in a report. https://www.intacct.com/ia/docs/en_US/help_action/Reporting/Get_started/about-standard-app-reports.htm 08.txt passed rejected A permission restriction is not a stated capability; the excerpt describes no permission feature.   rejected The excerpt states a permission precondition and describes no permission feature. 0.0
F2-061-A006 Vanta F2-061 a The system lets a user customize frameworks, control sets, policies, on- and offboarding processes, risk assessments, access reviews, and vendor security reviews you can customize frameworks, control sets, policies, on- and offboarding processes, risk assessments, access reviews, vendor security reviews https://www.vanta.com/products/workspaces 01.txt passed rejected Compound list of unrelated customizations; the individual capabilities are covered by other statements.   rejected Compound list of customizations, each already covered by separate surviving statements. 0.0
F2-067-A081 Givebutter F2-067 a The system automatically prevents logging a transaction to a contact without a first and last name You cannot log a transaction to a contact without a first and last name. https://help.givebutter.com/en/articles/10355528-how-to-create-and-edit-contacts 03.txt passed rejected A validation constraint on transactions, not a user-facing capability.   rejected A data-validation constraint, not a capability. 0.0
F2-067-A194 Givebutter F2-067 a The system automatically prevents deleting a table that contains attendees You can only delete an empty table. https://help.givebutter.com/en/articles/11731317-how-to-create-event-seating-arrangements 09.txt passed rejected A validation constraint on deleting tables, not a capability.   rejected A validation constraint on deleting tables, not a capability. 0.0
F2-067-A195 Givebutter F2-067 a The system automatically prevents seating a group at a table without capacity for the whole group If you try to seat a large group at a table without capacity for the whole group, you’ll get an error message. https://help.givebutter.com/en/articles/11731317-how-to-create-event-seating-arrangements 09.txt passed rejected A validation error condition, not a capability.   rejected An error condition, not a capability. 0.0
F2-067-A197 Givebutter F2-067 a The system lets donors and volunteers use a mobile app Bring the power of Givebutter directly to your donors and volunteers with the Givebutter Mobile App. https://givebutter.com/features 01.txt passed rejected Too vague; names no specific capability of the mobile app.   rejected Names no specific capability; the mobile app's concrete features are covered by other statements. 0.0
F2-073-A067 Success.co F2-073 a The system lets a user use the application on a mobile app Use Success on the go with our mobile app https://www.success.co/docs 09.txt passed rejected Platform availability of a mobile app, not a capability.   rejected Having a mobile app is platform availability, not a capability. 0.0
F2-073-A068 Success.co F2-073 a The system lets a user use the application on a desktop app Have Success right at your fingertips with our desktop app https://www.success.co/docs 09.txt passed rejected Platform availability of a desktop app, not a capability.   rejected Having a desktop app is platform availability, not a capability. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 684.9ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University