candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

60 rows where adjudicator = "rejected", in_final_set = "0.0" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_file

run 2

  • a 30
  • b 30

verifier_verdict 1

  • rejected · 60 ✖

in_final_set 1

adjudicator 1

  • rejected · 60 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-A022 Operately F1-001 a The system automatically allows only one draft check-in per goal at a time when a draft is saved. Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-A028 Operately F1-001 a The system automatically requires a project start date when a user selects a project template. Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-A069 Operately F1-001 a The system automatically hides the New KPI button when a user can only view or comment on the space. The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-001-A070 Operately F1-001 a The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly. If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence. https://operately.com/help/create-kpi 07.txt passed rejected A form validation message, not a capability.   rejected A form validation prompt is not a capability. 0.0
F1-001-A072 Operately F1-001 a The system automatically requires edit access to the space, project or goal when a user creates a document. You need edit access to the space, project, or goal where you want to create a document. https://operately.com/help/create-document 10.txt passed rejected States a permission prerequisite, not a capability.   rejected A permission prerequisite for document creation is not a capability in itself. 0.0
F1-001-B043 Operately F1-001 b The system automatically requires a project start date when a project template is selected Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B080 Operately F1-001 b The system automatically prevents a goal from having more than one draft check-in at a time Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-B099 Operately F1-001 b The system automatically requires a name and a unit when a KPI is created Name and Unit are required. https://operately.com/help/create-kpi 07.txt passed rejected A form validation rule, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-B100 Operately F1-001 b The system automatically hides the New KPI button from users who can only view or comment on the space The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-002-B077 It's a Plan F1-002 b The system automatically refuses to delete an account when it is the only owner of a project outside their own workspaces The delete is refused while they are the only owner of a project outside their own https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed rejected Describes a deletion safeguard, not a user-observable capability.   rejected Refusing deletion of a sole project owner's account is a safeguard, not a user capability. 0.0
F1-005-A035 DeskcommCRM F1-005 a The system lets an administrator reset a user's password | `reset-password.sh` | Resets a user's password | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected The excerpt is a server shell script run by the installation operator, which is IT-infrastructure administration rather than an in-app feature. 0.0
F1-005-A036 DeskcommCRM F1-005 a The system lets an administrator remove two-factor authentication for a user who lost their phone | `reset-mfa.sh` | Removes MFA for someone who lost their phone | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected MFA removal here is an operator shell script on the server, not a user-facing sign-in feature of the app. 0.0
F1-005-A056 DeskcommCRM F1-005 a The system lets an administrator back up the database and WhatsApp sessions | `backup.sh` | Backs up the database + WhatsApp sessions | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Database backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-005-A057 DeskcommCRM F1-005 a The system lets an administrator restore a backup into an empty database it only restores into an empty database https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Restoring a backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-005-B060 DeskcommCRM F1-005 b The system lets a user manage notifications Profile, Notifications, Billing https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Bare screen label in a list; the excerpt does not say what a user can do with notifications.   rejected A bare settings-tab label does not say what a user can do with notifications. 0.0
F1-017-A032 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents a story that is not activated from being linked to a project. Only activated story can be linked to the projects and then to be developed. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-createstories-34 05.txt passed rejected Describes a system constraint on linking, not a user-observable capability.   rejected Allowing only activated stories to be linked is a constraint, not a user capability. 0.0
F1-017-A044 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents child tasks from being created for a task assigned to multiple members. Multiple tasks, tasks done by multiple members, cannot have child tasks. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-decomposetasks-37 06.txt passed rejected Describes a system constraint on child tasks, not a user-observable capability.   rejected Forbidding child tasks on multi-member tasks is a constraint, not a user capability. 0.0
F1-017-B026 ZenTao (now branded Sanplex) F1-017 b The system automatically prevents a story from being linked to a project unless the story is activated Only activated story can be linked to the projects and then to be developed. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-createstories-34 05.txt passed rejected Describes a system constraint on linking, not a user-observable capability.   rejected Allowing only activated stories to be linked is a constraint, not a user capability. 0.0
F1-017-B039 ZenTao (now branded Sanplex) F1-017 b The system automatically prevents child tasks on tasks done by multiple members Multiple tasks, tasks done by multiple members, cannot have child tasks. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-decomposetasks-37 06.txt passed rejected Describes a system constraint on child tasks, not a user-observable capability.   rejected Forbidding child tasks on multi-member tasks is a constraint, not a user capability. 0.0
F1-034-B041 WeCMDB F1-034 b The system automatically prevents users from adding, modifying or deleting system ENUM types when they try to customize them it cannot be customized adding,modifying or deleting. https://raw.githubusercontent.com/WeBankPartners/we-cmdb/HEAD/wiki/docs/wecmdb_glossary_en.md 04.txt passed rejected Glossary describes enum type constraints, not a user-observable automation or capability.   rejected The glossary entry defines that system enum types are fixed; it is a data-model constraint, not an advertised user capability or automation. 0.0
F1-034-B042 WeCMDB F1-034 b The system automatically prevents users from deleting common ENUM types when they try to delete them but cannot be deleted as it is common which can be used for other CI https://raw.githubusercontent.com/WeBankPartners/we-cmdb/HEAD/wiki/docs/wecmdb_glossary_en.md 04.txt passed rejected Glossary describes enum type constraints, not a user-observable automation or capability.   rejected The glossary entry defines that common enum types cannot be deleted; it is a data-model constraint, not an advertised user capability or automation. 0.0
F1-037-A018 FOSSBilling F1-037 a The system lets an administrator sell hosting plans, domains, downloadable products, licenses, and API keys through product types Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities (hosting, domains, downloads, licenses, API keys) covered by separate statements.   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F1-037-B009 FOSSBilling F1-037 b The system lets an administrator choose a product type for hosting, domains, downloads, licenses, and API keys. Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities already covered by separate statements (see F1-037-A019 to A022).   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F2-001-A019 Asana F2-001 a The system lets a user use mobile and desktop apps to work on tasks Yes, Asana offers mobile apps for iPhone, iPad, and Android, plus desktop apps for Mac and Windows. https://asana.com/features/project-management 02.txt passed rejected Availability of mobile and desktop apps is a delivery channel, not a capability.   rejected Offering mobile and desktop apps is a delivery channel, not a capability. 0.0
F2-001-B071 Asana F2-001 b The system lets a user use Asana through desktop, web, and mobile apps. Asana is accessible via desktop app, web browser, and mobile app (available for both Android and iOS users). https://asana.com/product 01.txt passed rejected Availability of desktop, web and mobile apps is a delivery channel, not a capability.   rejected Access through desktop, web and mobile apps is a delivery channel, not a capability. 0.0
F2-007-A030 Userback F2-007 a The system lets a user add rating, text, and choice questions to a survey Add any of these from the Add component dropdown at the top of the builder’s Design > Questions tab. https://support.userback.io/en/articles/16880431-survey-question-types-reference 10.txt passed rejected Compound umbrella over three question families; each is covered by A031 to A034.   rejected This umbrella statement over the question families is fully covered by A031 to A034. 0.0
F2-007-B001 Userback F2-007 b The system lets a user capture screenshot annotations, session replays, console logs, and in-app surveys in one place. Userback captures screenshot annotations, session replays, console logs, and in-app surveys — all centralized in one place https://docs.userback.io/docs/welcome 01.txt passed rejected Umbrella statement; its parts are covered by A017, A049, A053 and A026.   rejected This umbrella sentence is covered piece by piece by the annotation, session replay, console log and survey statements. 0.0
F2-015-A005 Pipedrive F2-015 a The system lets a user manage, qualify and prioritize leads. Make the most of each opportunity with dedicated features that help with lead management, qualification and prioritization https://www.pipedrive.com/en/features 01.txt passed rejected Vague marketing phrase bundling lead management, qualification and prioritization without a specific capability.   rejected Vague bundle of lead management areas with no specific capability; leads inbox is covered separately. 0.0
F2-015-B016 Pipedrive F2-015 b The system lets a user map out projects. Map out complex projects simply and intuitively, making task management and team collaboration a breeze. https://www.pipedrive.com/en/features 01.txt passed rejected Marketing prose with no specific capability.   rejected Marketing intro to an integrations category with no specific capability. 0.0
F2-019-A044 Xero F2-019 a The system lets a user manage the business on a mobile app. Manage your business on the go with the Xero app for bookkeeping and accounting https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected Vague claim about managing the business on a mobile app; no specific capability.   rejected Generic mobile-app claim with no specific capability; specific mobile features are covered elsewhere. 0.0
F2-019-B050 Xero F2-019 b The system lets a user manage bookkeeping and accounting on a mobile app. Manage your business on the go with the Xero app for bookkeeping and accounting https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected Vague claim about a mobile app; no specific capability.   rejected Generic mobile-app claim with no specific capability. 0.0
F2-025-B077 Salesforce Field Service F2-025 b The system lets a user track alerts, timelines, milestones, warranties, cases, work orders, claims and activities throughout the asset lifecycle. Track alerts, timelines, milestones, warranties, cases, work orders, claims, and activities throughout the asset lifecycle. https://www.salesforce.com/service/field-service-management/asset-management/ 05.txt passed rejected Vague list of tracked record types in a vertical blurb; no specific capability.   rejected Catch-all list of record types in a vertical blurb, largely covered by the asset 360-degree view and warranty statements. 0.0
F2-043-A020 ServiceNow IT Service Management F2-043 a The system automatically redirects UI16 module links to the equivalent Service Operations Workspace pages when redirection is enabled navigating through UI16 paths automatically redirects you to the equivalent list or record pages in SOW https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected UI navigation redirect for an upgrade/admin setting, not a business capability.   rejected Redirecting legacy UI paths to the new workspace is an upgrade navigation setting, not a business capability. 0.0
F2-043-A055 ServiceNow IT Service Management F2-043 a The system automatically prevents creating another record of the same task type when an incident already has an associated problem or change record If the incident already has an associated https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/Uc8KCF0LjG~p2cz7LcOYiw/content 10.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Blocking creation of a second record of the same task type is a validation rule, not a capability. 0.0
F2-043-A130 ServiceNow IT Service Management F2-043 a The system automatically prevents editing of the fields of a change request after it is authorized The fields are set to read only to prevent unintended changes after approval https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Making fields read only after authorization is an edit restriction, not a capability. 0.0
F2-043-A131 ServiceNow IT Service Management F2-043 a The system automatically prevents changing the primary configuration item of a change request after it leaves the New state You can set or change the primary configuration item (CI) only while the change request is in the New state https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Limiting changes of the primary CI to the New state is an edit restriction, not a capability. 0.0
F2-043-B026 ServiceNow IT Service Management F2-043 b The system automatically redirects a user from UI16 module links to the equivalent Service Operations Workspace pages when UI16 module link redirection is enabled navigating through UI16 paths automatically redirects you to the equivalent list or record pages in SOW instead of displaying the UI16 forms or lists. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/ACZcXVdTEEC8UAvjvEDQ~g/content 04.txt passed rejected UI navigation redirect for an upgrade/admin setting, not a business capability.   rejected Redirecting legacy UI paths to the new workspace is an upgrade navigation setting, not a business capability. 0.0
F2-043-B028 ServiceNow IT Service Management F2-043 b The system lets an agent manage incidents with contextual information and targeted actions Agents can manage incidents effectively with contextual information and targeted actions. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/IuHkukKoSrzunmpTtJoRPA/content 06.txt passed rejected Too generic to be a distinct capability; incident handling is covered by more specific statements.   rejected Too generic to name a distinct capability; incident handling is covered by the specific surviving statements. 0.0
F2-043-B060 ServiceNow IT Service Management F2-043 b The system lets a service level manager gather service requirements Gather service requirements and monitor and report on agreed service levels (SLAs). https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/kSjKycBSAxqdKWB1aGBJiA/content 09.txt passed rejected Describes a manager activity rather than a system function; the source only lists it in an application description.   rejected Gathering service requirements appears only as an application blurb and names no system function. 0.0
F2-043-B163 ServiceNow IT Service Management F2-043 b The system automatically prevents editing of change request fields after the change is authorized Authorized: The fields are set to read only to prevent unintended changes after approval. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Making fields read only after authorization is an edit restriction, not a capability. 0.0
F2-043-B164 ServiceNow IT Service Management F2-043 b The system automatically prevents setting or changing the primary configuration item of a change request after it leaves the New state You can set or change the primary configuration item (CI) only while the change request is in the New state. https://www.servicenow.com/docs/api/khub/maps/eH2O6EPUpf09wX0~2cZBFg/topics/uXk8LEj8iwoJoS8~QkyrIA/content 21.txt passed rejected Describes a restriction or validation rule, not a user-observable capability.   rejected Limiting changes of the primary CI to the New state is an edit restriction, not a capability. 0.0
F2-049-A040 Sage Intacct F2-049 a The system automatically prevents deleting or editing invoices when they have been paid You cannot delete nor edit invoices after https://www.intacct.com/ia/docs/en_US/help_action/Accounts_Receivable/accounts-receivable-overview.htm 03.txt passed rejected A restriction on editing paid invoices is an accounting control, not a user capability.   rejected A lock on editing or deleting paid invoices is a restriction, not a user-observable capability. 0.0
F2-049-A083 Sage Intacct F2-049 a The system automatically prevents exporting a standard application report when it has not been memorized To export a standard application report, it must be memorized first. https://www.intacct.com/ia/docs/en_US/help_action/General_Ledger/General_Ledger_reports/gl-reports-overview.htm 07.txt passed rejected A restriction on exporting unmemorized reports is a limitation, not a capability.   rejected The requirement to memorize a report before export is a precondition, not a capability. 0.0
F2-049-A087 Sage Intacct F2-049 a The system automatically prevents a user from viewing report data when the user lacks the proper permissions you must have the proper permissions to view the data in a report. https://www.intacct.com/ia/docs/en_US/help_action/Reporting/Get_started/about-standard-app-reports.htm 08.txt passed rejected A permission restriction is not a stated capability; the excerpt describes no permission feature.   rejected The excerpt states a permission precondition and describes no permission feature. 0.0
F2-049-B038 Sage Intacct F2-049 b The system automatically prevents deleting or editing invoices when they have been paid You cannot delete nor edit invoices after they https://www.intacct.com/ia/docs/en_US/help_action/Accounts_Receivable/accounts-receivable-overview.htm 03.txt passed rejected A restriction on editing paid invoices is an accounting control, not a user capability.   rejected A lock on editing or deleting paid invoices is a restriction, not a user-observable capability. 0.0
F2-061-A006 Vanta F2-061 a The system lets a user customize frameworks, control sets, policies, on- and offboarding processes, risk assessments, access reviews, and vendor security reviews you can customize frameworks, control sets, policies, on- and offboarding processes, risk assessments, access reviews, vendor security reviews https://www.vanta.com/products/workspaces 01.txt passed rejected Compound list of unrelated customizations; the individual capabilities are covered by other statements.   rejected Compound list of customizations, each already covered by separate surviving statements. 0.0
F2-061-B084 Vanta F2-061 b The system lets a user assign access reviews independently of the system owner the ability to assign reviews independently of the system owner has been a timesaver https://www.vanta.com/products/access-reviews 08.txt passed rejected Evidenced only by a customer testimonial.   rejected Evidenced only by a customer testimonial. 0.0
F2-067-A081 Givebutter F2-067 a The system automatically prevents logging a transaction to a contact without a first and last name You cannot log a transaction to a contact without a first and last name. https://help.givebutter.com/en/articles/10355528-how-to-create-and-edit-contacts 03.txt passed rejected A validation constraint on transactions, not a user-facing capability.   rejected A data-validation constraint, not a capability. 0.0
F2-067-A194 Givebutter F2-067 a The system automatically prevents deleting a table that contains attendees You can only delete an empty table. https://help.givebutter.com/en/articles/11731317-how-to-create-event-seating-arrangements 09.txt passed rejected A validation constraint on deleting tables, not a capability.   rejected A validation constraint on deleting tables, not a capability. 0.0
F2-067-A195 Givebutter F2-067 a The system automatically prevents seating a group at a table without capacity for the whole group If you try to seat a large group at a table without capacity for the whole group, you’ll get an error message. https://help.givebutter.com/en/articles/11731317-how-to-create-event-seating-arrangements 09.txt passed rejected A validation error condition, not a capability.   rejected An error condition, not a capability. 0.0

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);