home / pub10

candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

6 rows where app_id = "F1-046" and verifier_verdict = "corrected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

verifier_verdict 1

  • corrected · 6 ✖

run 1

  • a 6

in_final_set 1

  • 1.0 6

app_id 1

  • Probo · 6 ✖

adjudicator 1

  • corrected 6
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-046-A004 Probo F1-046 a The system lets a user keep a vendor inventory and track data processing agreements Vendor inventory, automated website risk assessment, DPA/BAA tracking, subprocessor discovery https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed corrected Compound statement; vendor inventory is the single capability here, contract tracking is covered by A020. The system lets a user keep an inventory of vendors. corrected Compound statement; agreement tracking is already covered by the surviving third-party contract-tracking statement. 1.0
F1-046-A005 Probo F1-046 a The system lets a user record processing activities and maintain a data inventory processing activity records, data inventory https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed corrected Compound statement; processing activities are covered separately by A026. The system lets a user maintain a data inventory. corrected Compound statement; processing activity records are covered by a separate surviving statement. 1.0
F1-046-A006 Probo F1-046 a The system lets a user collect evidence as files and URLs and track implementation state Evidence collection (files and URLs), implementation state tracking, task assignment https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed corrected Compound statement; implementation-state tracking is not a separate evidenced capability. The system lets a user collect evidence as files and URLs. corrected Compound statement; splitting keeps one capability per statement and the bare table cell gives no further detail on implementation-state tracking. 1.0
F1-046-A013 Probo F1-046 a The system lets an auditor scope audits, map controls, track findings, and generate reports Audit scoping, control mapping, finding tracking, report generation https://raw.githubusercontent.com/getprobo/probo/HEAD/README.md 01.txt passed corrected Compound statement; finding tracking is covered by A024, report generation is listed as missed. The system lets an auditor scope audits and map controls to them. corrected Compound statement; finding tracking is covered separately and report generation is accepted as a missed item. 1.0
F1-046-A014 Probo F1-046 a The system lets a user receive task and comment lifecycle events through webhooks Use GraphQL, the `prb` CLI, MCP, n8n, and webhooks instead of limiting work to the console. https://www.probo.com/docs/product/getting-started/product-overview.md 03.txt passed corrected Describes an automation, not a user action. The system automatically sends task and comment lifecycle events through webhooks when tasks or comments change. corrected The source (09.txt: 'Webhooks Receive task and comment lifecycle events') supports it, and event delivery is an automation. 1.0
F1-046-A041 Probo F1-046 a The system lets an administrator invite and role-manage members in the organization Invite and role-manage members in the organization https://www.probo.com/docs/product/identity-and-access 08.txt passed corrected Invitation is a duplicate of A017; only the role-management part is new. The system lets an administrator assign roles to organization members. corrected Inviting members is already covered by A017; only role management is new. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);
Powered by Datasette · Queries took 912.863ms · Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University