candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

12 rows where app_id = "F1-002", run = "b" and verifier_verdict = "confirmed"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

verifier_verdict 1

  • confirmed · 12 ✖

run 1

in_final_set 1

app_id 1

  • It's a Plan · 12 ✖

adjudicator 1

candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-002-B018 It's a Plan F1-002 b The system lets a user mark documentation pages as favorites favorites, embedded files, and links to the issues they describe https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B029 It's a Plan F1-002 b The system automatically starts an agent run when the agent is mentioned in a comment, when an issue is assigned to it, or on a schedule A run starts on an @mention in a comment, on an assignment, or on a schedule https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B057 It's a Plan F1-002 b The system lets a user pan and zoom an infinite canvas of notes Notes live on an infinite pane you pan and zoom. https://itsaplan.dev/features/notes 06.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B068 It's a Plan F1-002 b The system lets a user jump to any view from a command menu Jump to any view from a fast command menu. https://itsaplan.dev/features/views 07.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B070 It's a Plan F1-002 b The system automatically creates an account when a user signs in through a single sign-on provider for the first time The first sign-in creates the account, and the registration mode under **Authentication** https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B072 It's a Plan F1-002 b The system automatically expires an invite after the number of days set by an administrator Invites expire after the days set under **Authentication** https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B073 It's a Plan F1-002 b The system lets an administrator turn off email and password sign-in once a single sign-on provider works Once a provider works, you can turn off **Authentication → Email and password**. The sign-in https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B074 It's a Plan F1-002 b The system lets an identity provider create, deactivate and delete user accounts over a provisioning protocol An identity provider can create, deactivate and delete the accounts of the instance over https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B075 It's a Plan F1-002 b The system lets an identity provider grant project access to users through its groups SCIM 2.0, and grant project access through its groups. Provisioning is set up in god mode by https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B076 It's a Plan F1-002 b The system automatically prevents a deactivated account from signing in and refuses its sessions and API keys until it is reactivated account cannot sign in, and its sessions and API keys are refused until it is reactivated. https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/self-hosting.md 08.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B078 It's a Plan F1-002 b The system lets a user enable the MCP server for a project Enable MCP for the project first, in Settings, MCP Server. It is off by default. https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/runner.md 09.txt passed confirmed     (not sent: confirmed)   1.0
F1-002-B079 It's a Plan F1-002 b The system lets a user send an external agent's tasks to an endpoint that they run The instance can also send the tasks to an endpoint that you run. https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/docs/runner.md 09.txt passed confirmed     (not sent: confirmed)   1.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);