candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

2 rows where adjudicator = "rejected", app_id = "F1-037" and in_final_set = "0.0"

✎ View and edit SQL

This data as json, CSV (advanced)

run 2

verifier_verdict 1

in_final_set 1

app_id 1

  • FOSSBilling · 2 ✖

adjudicator 1

  • rejected · 2 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-037-A018 FOSSBilling F1-037 a The system lets an administrator sell hosting plans, domains, downloadable products, licenses, and API keys through product types Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities (hosting, domains, downloads, licenses, API keys) covered by separate statements.   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0
F1-037-B009 FOSSBilling F1-037 b The system lets an administrator choose a product type for hosting, domains, downloads, licenses, and API keys. Choose the right product type for hosting, domains, downloads, licenses, and API keys. https://docs.fossbilling.org/admin-guide/ 02.txt passed rejected Bundles several capabilities already covered by separate statements (see F1-037-A019 to A022).   rejected Bundles several product-type capabilities that separate surviving statements already cover. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);