candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

11 rows where adjudicator = "corrected", app_id = "F2-061" and verifier_verdict = "corrected"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file, verifier_reason

run 2

  • a 10
  • b 1

verifier_verdict 1

  • corrected · 11 ✖

in_final_set 1

app_id 1

  • Vanta · 11 ✖

adjudicator 1

  • corrected · 11 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-061-A011 Vanta F2-061 a The system lets a user auto-approve document access requests and collect NDAs through integrations with CRM and contract management systems Speed up document access with auto-approvals and NDA collection with Salesforce, HubSpot, DocuSign, and Ironclad integrations. https://www.vanta.com/products/trust-center 02.txt passed corrected Automation described as a user action. The system automatically approves document access requests and collects NDAs when a request is made, through integrations with CRM and contract management systems corrected The source describes an automation, so the verifier's automation form is correct. 1.0
F2-061-A018 Vanta F2-061 a The system lets a user automate reminders and workflows to assess, review, and approve risks Vanta automates reminders and workflows to regularly assess, review, and approve risks https://www.vanta.com/products/risk-management 03.txt passed corrected Automation described as a user action. The system automatically sends reminders and runs workflows for regular assessment, review and approval of risks corrected The source says Vanta automates the reminders and workflows. 1.0
F2-061-A034 Vanta F2-061 a The system lets a user pull findings from vendor SOC2 reports, DPAs, and questionnaires automatically Vanta automatically pulls findings from your vendors SOC2 reports, DPAs, and questionnaires https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically pulls findings from vendors' SOC 2 reports, DPAs, and questionnaires corrected The source says Vanta pulls findings automatically. 1.0
F2-061-A036 Vanta F2-061 a The system lets a user discover newly adopted vendors through integration with existing procurement systems Discovers newly adopted vendors and integrates with your existing procurement systems to eliminate shadow IT and AI blind spots. https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically discovers newly adopted vendors through integration with procurement systems corrected Discovery is performed by the system, not by the user. 1.0
F2-061-A037 Vanta F2-061 a The system lets a user retrieve vendor documentation from first- and third-party Trust Centers Retrieves verified documentation directly from first- and third-party Trust Centers https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically retrieves vendor documentation from first- and third-party Trust Centers corrected Retrieval is performed by the system, not by the user. 1.0
F2-061-A038 Vanta F2-061 a The system lets a user identify SLAs, DPAs, and custom security terms in SOC 2 reports Identifies high-stakes SLAs, DPAs, and custom security terms in SOC 2 reports https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically identifies SLAs, DPAs, and custom security terms in vendors' SOC 2 reports corrected Identification is performed by the system, not by the user. 1.0
F2-061-A040 Vanta F2-061 a The system lets a user manage document requests and follow-ups with vendors using reminders Manages document requests and follow-ups with persistent reminders https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically sends document requests and follow-up reminders to vendors corrected The source describes the system managing requests and reminders. 1.0
F2-061-A043 Vanta F2-061 a The system lets a user add vendor findings directly to the risk register Vendor findings feed directly into your risk register and compliance posture https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action. The system automatically feeds vendor findings into the risk register corrected The source says findings feed into the register, an automation. 1.0
F2-061-A048 Vanta F2-061 a The system lets a user track vendor status changes Vanta tracks vendor status changes https://www.vanta.com/products/vendor-risk-management 04.txt passed corrected Automation described as a user action; source ties it to offboarding. The system automatically tracks vendor status changes during vendor offboarding corrected The source attributes tracking to the system and ties it to offboarding. 1.0
F2-061-A059 Vanta F2-061 a The system lets a user assign security awareness training videos to employees out-of-the-box security awareness training videos https://www.vanta.com/products/automated-compliance 05.txt passed corrected The source offers training videos, not assignment of them. The system provides security awareness training videos for employees corrected The source offers training videos but not assignment; the verifier's correction is not in either statement form, so it is reworded. 1.0
F2-061-B046 Vanta F2-061 b The system lets a user support security and privacy frameworks such as SOC 2, ISO 27001 and HIPAA, or customize their own like SOC 2, ISO 27001, HIPAA, and more (or customize your own) https://www.vanta.com/products/automated-compliance 05.txt passed corrected Badly formed; the actor and action are missing. The system lets a user manage compliance against security and privacy frameworks such as SOC 2, ISO 27001 and HIPAA, or a custom framework corrected The original lacked a proper action; the correction is supported by the excerpt. 1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);