home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

6 rows where app_id = "F1-005", in_final_set = "0.0" and run = "a"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, verifier_reason, adjudicator_reason

adjudicator 2

  • rejected 4
  • rejected (duplicate upheld) 2

verifier_verdict 1

  • rejected 6

run 1

  • a · 6 ✖

in_final_set 1

  • - · 6 ✖

app_id 1

  • DeskcommCRM · 6 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-005-A007 DeskcommCRM F1-005 a The system automatically blocks an AI message that promises something not in the catalogue The guardrail blocked it: that lead time doesn’t exist in your catalogue. https://deskcomm.com.br/en 02.txt passed rejected duplicate of F1-005-A006 (the promise check is one of the seven checks)   rejected (duplicate upheld) duplicate upheld 0.0
F1-005-A035 DeskcommCRM F1-005 a The system lets an administrator reset a user's password | `reset-password.sh` | Resets a user's password | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected The excerpt is a server shell script run by the installation operator, which is IT-infrastructure administration rather than an in-app feature. 0.0
F1-005-A036 DeskcommCRM F1-005 a The system lets an administrator remove two-factor authentication for a user who lost their phone | `reset-mfa.sh` | Removes MFA for someone who lost their phone | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected MFA removal here is an operator shell script on the server, not a user-facing sign-in feature of the app. 0.0
F1-005-A052 DeskcommCRM F1-005 a The system lets a user send in-app notices with severities and stuck-message alerts a notice center with severities, stuck-message alerts, send-protection controls (window/pace/cap) https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected duplicate of F1-005-A013; the notice center is system-generated, users do not send notices.   rejected (duplicate upheld) duplicate upheld 0.0
F1-005-A056 DeskcommCRM F1-005 a The system lets an administrator back up the database and WhatsApp sessions | `backup.sh` | Backs up the database + WhatsApp sessions | https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Database backup by shell script is IT-infrastructure administration that no business role uses. 0.0
F1-005-A057 DeskcommCRM F1-005 a The system lets an administrator restore a backup into an empty database it only restores into an empty database https://raw.githubusercontent.com/melgarafael/DeskcommCRM/HEAD/README.en.md 04.txt passed rejected Shell script run on the VPS by the server operator; IT-infrastructure administration, not a business-role feature.   rejected Restoring a backup by shell script is IT-infrastructure administration that no business role uses. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 97.423ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University