candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

82 rows where in_final_set = "0.0" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_file

verifier_verdict 1

run 1

in_final_set 1

candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-001-A022 Operately F1-001 a The system automatically allows only one draft check-in per goal at a time when a draft is saved. Each goal can have only one draft check-in at a time. https://operately.com/help/check-in-goal 14.txt passed rejected Describes a constraint on drafts, not a user-observable capability.   rejected A limit of one draft per goal is a constraint, not a user-observable capability. 0.0
F1-001-A028 Operately F1-001 a The system automatically requires a project start date when a user selects a project template. Project start date — Required when you select a template. https://operately.com/help/create-project 06.txt passed rejected A validation rule on a form field, not a capability.   rejected A required-field validation rule is not a capability. 0.0
F1-001-A069 Operately F1-001 a The system automatically hides the New KPI button when a user can only view or comment on the space. The New KPI button is hidden if you can only view or comment. https://operately.com/help/create-kpi 07.txt passed rejected Describes a permission-based UI restriction, not a capability.   rejected Hiding a button for view-only users is a permission restriction, not a capability. 0.0
F1-001-A070 Operately F1-001 a The system automatically asks a user to choose a cadence when the cadence is not Weekly or Monthly. If Cadence is not Weekly or Monthly, the form asks you to Choose a cadence. https://operately.com/help/create-kpi 07.txt passed rejected A form validation message, not a capability.   rejected A form validation prompt is not a capability. 0.0
F1-001-A072 Operately F1-001 a The system automatically requires edit access to the space, project or goal when a user creates a document. You need edit access to the space, project, or goal where you want to create a document. https://operately.com/help/create-document 10.txt passed rejected States a permission prerequisite, not a capability.   rejected A permission prerequisite for document creation is not a capability in itself. 0.0
F1-001-A086 Operately F1-001 a The system lets a user reuse project templates for recurring work. Reuse project templates for recurring work https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A026   rejected (duplicate upheld) duplicate upheld 0.0
F1-001-A087 Operately F1-001 a The system lets a user track KPIs for a space. Track KPIs for the numbers each space cares about https://operately.com/help/features-overview 03.txt passed rejected duplicate of F1-001-A066   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-A024 It's a Plan F1-002 a The system lets a user draw a line between two notes to show how they connect. Draw a line between two notes to show one follows from the other. https://itsaplan.dev/features/notes 06.txt passed rejected duplicate of F1-002-A023   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-A069 It's a Plan F1-002 a The system lets a user chat with each AI agent with its own conversation history. - Built-in chat with each agent, with its own conversation history https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A042   rejected (duplicate upheld) duplicate upheld 0.0
F1-005-A007 DeskcommCRM F1-005 a The system automatically blocks an AI message that promises something not in the catalogue The guardrail blocked it: that lead time doesn’t exist in your catalogue. https://deskcomm.com.br/en 02.txt passed rejected duplicate of F1-005-A006 (the promise check is one of the seven checks)   rejected (duplicate upheld) duplicate upheld 0.0
F1-005-A035 DeskcommCRM F1-005 a The system lets an administrator reset a user's password | `reset-password.sh` | Resets a user's password | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected The excerpt is a server shell script run by the installation operator, which is IT-infrastructure administration rather than an in-app feature. 0.0
F1-005-A036 DeskcommCRM F1-005 a The system lets an administrator remove two-factor authentication for a user who lost their phone | `reset-mfa.sh` | Removes MFA for someone who lost their phone | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected MFA removal here is an operator shell script on the server, not a user-facing sign-in feature of the app. 0.0
F1-005-A052 DeskcommCRM F1-005 a The system lets a user send in-app notices with severities and stuck-message alerts a notice center with severities, stuck-message alerts, send-protection controls (window/pace/cap) https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected duplicate of F1-005-A013; the notice center is system-generated, users do not send notices.   rejected (duplicate upheld) duplicate upheld 0.0
F1-005-A056 DeskcommCRM F1-005 a The system lets an administrator back up the database and WhatsApp sessions | `backup.sh` | Backs up the database + WhatsApp sessions | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Database backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-005-A057 DeskcommCRM F1-005 a The system lets an administrator restore a backup into an empty database it only restores into an empty database https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Restoring a backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-017-A032 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents a story that is not activated from being linked to a project. Only activated story can be linked to the projects and then to be developed. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-createstories-34 05.txt passed rejected Describes a system constraint on linking, not a user-observable capability.   rejected Allowing only activated stories to be linked is a constraint, not a user capability. 0.0
F1-017-A044 ZenTao (now branded Sanplex) F1-017 a The system automatically prevents child tasks from being created for a task assigned to multiple members. Multiple tasks, tasks done by multiple members, cannot have child tasks. https://www.sanplex.com/book/zentaomanual/free-open-source-project-management-software-decomposetasks-37 06.txt passed rejected Describes a system constraint on child tasks, not a user-observable capability.   rejected Forbidding child tasks on multi-member tasks is a constraint, not a user capability. 0.0
F1-034-A022 WeCMDB F1-034 a The system lets a user manage configuration item data After click a CI and the data management page is opened https://raw.githubusercontent.com/WeBankPartners/we-cmdb/HEAD/wiki/docs/wecmdb_user_guide_en.md 02.txt passed rejected duplicate of F1-034-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-037-A012 FOSSBilling F1-037 a The system lets an administrator edit the subject and content of an email template Modify the subject and content https://docs.fossbilling.org/admin-guide/email-templates/ 07.txt passed rejected duplicate of F1-037-A011   rejected (duplicate upheld) duplicate upheld 0.0
F1-037-A018 FOSSBilling F1-037 a The system lets an administrator sell hosting plans, domains, downloadable products, licenses, and API keys through product types Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities (hosting, domains, downloads, licenses, API keys) covered by separate statements.   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F1-043-A010 QloApps F1-043 a The system lets a user add and update the inventory of rooms Add and update the inventory of your rooms conveniently using the interactive interface of QloApps. https://qloapps.com/features 02.txt passed rejected duplicate of F1-043-A009   rejected (duplicate upheld) duplicate upheld 0.0
F1-043-A032 QloApps F1-043 a The system lets a user offer discount coupons and promotions Offer discount coupons and promotions and attract more guests to your hotel. https://qloapps.com/booking-engine/ 03.txt passed rejected duplicate of F1-043-A007   rejected (duplicate upheld) duplicate upheld 0.0
F1-043-A041 QloApps F1-043 a The system lets a user collect the personal details of guests with registration forms Comprehensive Registration forms to collect the personal details of your guests. https://qloapps.com/booking-engine/ 03.txt passed rejected duplicate of F1-043-A002   rejected (duplicate upheld) duplicate upheld 0.0
F1-043-A049 QloApps F1-043 a The system automatically updates the inventory on all connected channels when a booking is created on any distribution channel When a booking is created on any distribution channel, inventory of the property is updated to all connected channels. https://qloapps.com/channel-manager/ 04.txt passed rejected duplicate of F1-043-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-043-A052 QloApps F1-043 a The system automatically maps booking details and inventory to connected online travel agency channels Channel manager is already integrated with QloApps PMS which automatically maps your booking details and inventory on your connected OTA channels. https://qloapps.com/channel-manager/ 04.txt passed rejected duplicate of F1-043-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-043-A053 QloApps F1-043 a The system automatically manages inventories on all online travel agency channels when a booking or cancellation request comes from any channel or the property management system Inventories are auto-managed on all OTA channels when a booking or cancellation request comes from any OTA channel or PMS to avoid short, double, or overbookings. https://qloapps.com/channel-manager/ 04.txt passed rejected duplicate of F1-043-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A009 Probo F1-046 a The system lets a user manage cookie banners and keep consent records Cookie banner management, tracker detection, consent records https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed rejected duplicate of F1-046-A077   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A031 Probo F1-046 a The system lets a user keep records of enrolled devices and their reported posture Device records represent enrolled endpoints and their reported posture. https://www.probo.com/docs/product/getting-started/core-concepts.md 04.txt passed rejected duplicate of F1-046-A016   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A051 Probo F1-046 a The system automatically creates the next task when the deadline of a recurring task passes When the deadline passes, Probo creates the next task: https://www.probo.com/docs/product/tasks/overview 09.txt passed rejected duplicate of F1-046-A022   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A058 Probo F1-046 a The system automatically updates the other side when a linked task or issue is edited Once a task is linked, edits on either side update the other: https://www.probo.com/docs/product/tasks/overview 09.txt passed rejected duplicate of F1-046-A023   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A069 Probo F1-046 a The system lets a user create a compliance portal with a public URL Creating a portal assigns it a public URL and opens its configuration page. https://www.probo.com/docs/product/compliance-portal/quickstart 11.txt passed rejected duplicate of F1-046-A008   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A082 Probo F1-046 a The system lets a user store a consent record with the action, category choices, banner version, client context, and timestamp A consent record stores the action, category choices, banner version, client context, and timestamp reported to Probo. https://www.probo.com/docs/product/cookie-banner/overview 12.txt passed rejected duplicate of F1-046-A078   rejected (duplicate upheld) duplicate upheld 0.0
F1-047-A090 Mayan EDMS F1-047 a The system lets an administrator grant access through roles Access is granted through roles, so it scales from a handful of users https://docs.mayan-edms.com/chapters/features.html 02.txt passed rejected duplicate of F1-047-A089   rejected (duplicate upheld) duplicate upheld 0.0
F1-047-A104 Mayan EDMS F1-047 a The system automatically checks the authenticity of signatures against stored keys Authenticity is checked against stored keys, so tampering is detected. https://docs.mayan-edms.com/chapters/features.html 02.txt passed rejected duplicate of F1-047-A102   rejected (duplicate upheld) duplicate upheld 0.0
F2-001-A019 Asana F2-001 a The system lets a user use mobile and desktop apps to work on tasks Yes, Asana offers mobile apps for iPhone, iPad, and Android, plus desktop apps for Mac and Windows. https://asana.com/features/project-management 02.txt passed rejected Availability of mobile and desktop apps is a delivery channel, not a capability.   rejected Offering mobile and desktop apps is a delivery channel, not a capability. 0.0
F2-001-A049 Asana F2-001 a The system lets a user start a timer or log hours on tasks and capture estimates versus actuals Time tracking lets users start a timer or log hours, capturing estimates versus actuals for future planning. https://asana.com/features/resource-management 05.txt passed rejected duplicate of F2-001-A014   rejected (duplicate upheld) duplicate upheld 0.0
F2-007-A030 Userback F2-007 a The system lets a user add rating, text, and choice questions to a survey Add any of these from the Add component dropdown at the top of the builder’s Design > Questions tab. https://support.userback.io/en/articles/16880431-survey-question-types-reference 10.txt passed rejected Compound umbrella over three question families; each is covered by A031 to A034.   rejected This umbrella statement over the question families is fully covered by A031 to A034. 0.0
F2-007-A064 Userback F2-007 a The system automatically groups similar feedback into themes using AI AI Themes groups similar feedback into themes automatically, using AI, so you can see patterns across dozens or hundreds of items without reading each one. https://support.userback.io/en/articles/13265550-ai-features-in-userback 14.txt passed rejected duplicate of F2-007-A059   rejected (duplicate upheld) duplicate upheld 0.0
F2-015-A005 Pipedrive F2-015 a The system lets a user manage, qualify and prioritize leads. Make the most of each opportunity with dedicated features that help with lead management, qualification and prioritization https://www.pipedrive.com/en/features 01.txt passed rejected Vague marketing phrase bundling lead management, qualification and prioritization without a specific capability.   rejected Vague bundle of lead management areas with no specific capability; leads inbox is covered separately. 0.0
F2-015-A033 Pipedrive F2-015 a The system lets a user group contacts into segments based on CRM data for email campaigns. Group contacts based on CRM data for personalized emails and relevant targeting. https://www.pipedrive.com/en/features/email-integration 04.txt passed rejected duplicate of A010   rejected (duplicate upheld) duplicate upheld 0.0
F2-019-A012 Xero F2-019 a The system automatically reconciles bank transactions using rules, matches to existing records, memory of past reconciliations and predictions. JAX uses four reconciliation methods – Rule, Match, Memory, and Prediction – for a sophisticated approach. https://www.xero.com/us/accounting-software/bank-reconciliation/ 03.txt passed rejected duplicate of F2-019-A001   rejected (duplicate upheld) duplicate upheld 0.0
F2-019-A044 Xero F2-019 a The system lets a user manage the business on a mobile app. Manage your business on the go with the Xero app for bookkeeping and accounting https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected Vague claim about managing the business on a mobile app; no specific capability.   rejected Generic mobile-app claim with no specific capability; specific mobile features are covered elsewhere. 0.0
F2-019-A045 Xero F2-019 a The system lets a user connect bank feeds from financial institutions. Access bank data from 21,000+ global institutions in Xero. https://www.xero.com/us/accounting-software/all-features/ 05.txt passed rejected duplicate of F2-019-A002   rejected (duplicate upheld) duplicate upheld 0.0
F2-019-A057 Xero F2-019 a The system lets a user accept online payments by credit card, debit card, ACH debit, Apple Pay, and Google Pay. Accept online payments by credit card, debit card, ACH debit, Apple Pay, and Google Pay https://www.xero.com/us/accounting-software/send-invoices/ 06.txt passed rejected duplicate of F2-019-A032   rejected (duplicate upheld) duplicate upheld 0.0
F2-019-A083 Xero F2-019 a The system automatically calculates, files, and pays federal and state taxes, withholds deductions and generates tax forms. calculates, files, and pays your federal and state taxes for you. It also withholds any deductions and generates tax forms to save you time and help you avoid mistakes. https://www.xero.com/us/accounting-software/payroll/ 08.txt passed rejected duplicate of F2-019-A081   rejected (duplicate upheld) duplicate upheld 0.0
F2-019-A086 Xero F2-019 a The system automatically notifies employees when they have been paid. Xero instantly notifies them when they’ve been paid. https://www.xero.com/us/accounting-software/payroll/ 08.txt passed rejected duplicate of F2-019-A079   rejected (duplicate upheld) duplicate upheld 0.0
F2-025-A031 Salesforce Field Service F2-025 a The system lets a customer schedule appointments and receive real-time updates about onsite visits. Empower customers to effortlessly schedule appointments, receive real-time updates, and stay informed about their onsite visits https://www.salesforce.com/service/field-service-management/ 01.txt passed rejected duplicate of F2-025-A001   rejected (duplicate upheld) duplicate upheld 0.0
F2-025-A032 Salesforce Field Service F2-025 a The system lets a technician create new leads from the mobile app. technicians can even create new leads — turning service calls into revenue-generating opportunities https://www.salesforce.com/service/field-service-management/software/ 02.txt passed rejected duplicate of F2-025-A015   rejected (duplicate upheld) duplicate upheld 0.0
F2-025-A039 Salesforce Field Service F2-025 a The system lets a user ask natural-language questions about operations and get instant answers without building reports. Built-in conversational analytics let teams ask natural-language questions https://www.salesforce.com/service/field-service-management/software/ 02.txt passed rejected duplicate of F2-025-A026   rejected (duplicate upheld) duplicate upheld 0.0
F2-025-A058 Salesforce Field Service F2-025 a The system lets a dispatcher create and update absences and organize workers by availability and skill. Your dispatchers can create and update absences and organize workers by availability and skill to identify the best technician for the job. https://www.salesforce.com/service/field-service-management/what-is-dispatch-management/ 07.txt passed rejected duplicate of F2-025-A017   rejected (duplicate upheld) duplicate upheld 0.0

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);