candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

6 rows where app_id = "F1-046", run = "a" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

verifier_verdict 1

  • rejected · 6 ✖

run 1

in_final_set 1

app_id 1

  • Probo · 6 ✖

adjudicator 1

candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-046-A009 Probo F1-046 a The system lets a user manage cookie banners and keep consent records Cookie banner management, tracker detection, consent records https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed rejected duplicate of F1-046-A077   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A031 Probo F1-046 a The system lets a user keep records of enrolled devices and their reported posture Device records represent enrolled endpoints and their reported posture. https://www.probo.com/docs/product/getting-started/core-concepts.md 04.txt passed rejected duplicate of F1-046-A016   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A051 Probo F1-046 a The system automatically creates the next task when the deadline of a recurring task passes When the deadline passes, Probo creates the next task: https://www.probo.com/docs/product/tasks/overview 09.txt passed rejected duplicate of F1-046-A022   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A058 Probo F1-046 a The system automatically updates the other side when a linked task or issue is edited Once a task is linked, edits on either side update the other: https://www.probo.com/docs/product/tasks/overview 09.txt passed rejected duplicate of F1-046-A023   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A069 Probo F1-046 a The system lets a user create a compliance portal with a public URL Creating a portal assigns it a public URL and opens its configuration page. https://www.probo.com/docs/product/compliance-portal/quickstart 11.txt passed rejected duplicate of F1-046-A008   rejected (duplicate upheld) duplicate upheld 0.0
F1-046-A082 Probo F1-046 a The system lets a user store a consent record with the action, category choices, banner version, client context, and timestamp A consent record stores the action, category choices, banner version, client context, and timestamp reported to Probo. https://www.probo.com/docs/product/cookie-banner/overview 12.txt passed rejected duplicate of F1-046-A078   rejected (duplicate upheld) duplicate upheld 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);