candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

2 rows where app_id = "F1-037", run = "a" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

verifier_verdict 1

  • rejected · 2 ✖

run 1

in_final_set 1

app_id 1

  • FOSSBilling · 2 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-037-A012 FOSSBilling F1-037 a The system lets an administrator edit the subject and content of an email template Modify the subject and content https://docs.fossbilling.org/admin-guide/email-templates/ 07.txt passed rejected duplicate of F1-037-A011   rejected (duplicate upheld) duplicate upheld 0.0
F1-037-A018 FOSSBilling F1-037 a The system lets an administrator sell hosting plans, domains, downloadable products, licenses, and API keys through product types Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities (hosting, domains, downloads, licenses, API keys) covered by separate statements.   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);