candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

66 rows where adjudicator = "rejected (duplicate upheld)", app_id = "F1-002" and in_final_set = "0.0"

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: source_url, source_file

run 2

  • b 64
  • a 2

verifier_verdict 1

in_final_set 1

app_id 1

  • It's a Plan · 66 ✖

adjudicator 1

  • rejected (duplicate upheld) · 66 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F1-002-A024 It's a Plan F1-002 a The system lets a user draw a line between two notes to show how they connect. Draw a line between two notes to show one follows from the other. https://itsaplan.dev/features/notes 06.txt passed rejected duplicate of F1-002-A023   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-A069 It's a Plan F1-002 a The system lets a user chat with each AI agent with its own conversation history. - Built-in chat with each agent, with its own conversation history https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A042   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B001 It's a Plan F1-002 b The system lets a user configure custom fields, labels, states and issue types for each project Configure issues per project: custom fields, labels, states, and issue types https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A001   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B002 It's a Plan F1-002 b The system lets a user view issues as a Kanban board, a table, a timeline and a calendar Kanban, table, timeline, and calendar views. Save each one as a tab with its own filters, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A002   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B003 It's a Plan F1-002 b The system lets a user save a view as a tab with its own filters, display fields and two-level grouping Kanban, table, timeline, and calendar views. Save each one as a tab with its own filters, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A004   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B004 It's a Plan F1-002 b The system lets a user time-box work in cycles Cycles that time-box the work. Unfinished issues move to the next cycle https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A011   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B005 It's a Plan F1-002 b The system automatically moves unfinished issues to the next cycle when a cycle ends Cycles that time-box the work. Unfinished issues move to the next cycle https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A012   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B006 It's a Plan F1-002 b The system lets a user add subtasks to an issue Subtasks, checklists, attachments, and links between issues: blocks, relates, duplicates https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A013   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B007 It's a Plan F1-002 b The system lets a user add checklists to an issue Subtasks, checklists, attachments, and links between issues: blocks, relates, duplicates https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A013   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B008 It's a Plan F1-002 b The system lets a user attach files to an issue Subtasks, checklists, attachments, and links between issues: blocks, relates, duplicates https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A013   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B009 It's a Plan F1-002 b The system lets a user link issues to each other as blocking, related or duplicate Subtasks, checklists, attachments, and links between issues: blocks, relates, duplicates https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A014   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B010 It's a Plan F1-002 b The system lets a user discuss an issue in comment threads with replies Comment threads with replies, and @username mentions of people and agents https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A015   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B011 It's a Plan F1-002 b The system lets a user mention people and agents by username in a comment Comment threads with replies, and @username mentions of people and agents https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A016   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B012 It's a Plan F1-002 b The system lets a user view configurable project dashboards showing throughput and burnup with a projected completion date Configurable dashboards for project analytics: throughput, burnup with a projected https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A017   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B013 It's a Plan F1-002 b The system lets a user run quick actions on an issue Quick actions that run on an issue, and auto-assignment when an issue moves into a state https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A018   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B014 It's a Plan F1-002 b The system automatically assigns an issue when the issue moves into a state Quick actions that run on an issue, and auto-assignment when an issue moves into a state https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A019   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B015 It's a Plan F1-002 b The system lets a user write shared Markdown pages in a tree with revision history Docs: shared Markdown pages in a tree, with revision history, private and locked pages, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A020   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B016 It's a Plan F1-002 b The system lets a user make documentation pages private or locked Docs: shared Markdown pages in a tree, with revision history, private and locked pages, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A021   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B019 It's a Plan F1-002 b The system lets a user capture ideas as sticky notes on a freeform canvas with colors, checklists and connections Freeform notes boards: sticky notes on a canvas, with colors, checklists, and connections https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A023   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B020 It's a Plan F1-002 b The system lets a user share a view or an issue by a read-only public link without sign-in Share a view or an issue by public link, read-only and without sign-in https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A008   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B021 It's a Plan F1-002 b The system lets a user group related work into initiatives inside a project Initiatives that group and track related work inside a project https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A028   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B022 It's a Plan F1-002 b The system lets a user receive notifications in a notification inbox Auto-archive, a notification inbox, role-based access control, and more https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A036   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B023 It's a Plan F1-002 b The system lets an administrator control access with roles Auto-archive, a notification inbox, role-based access control, and more https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A038   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B024 It's a Plan F1-002 b The system lets a user add AI agents as project members with their own permissions and assigned issues Agents as project members, with their own permissions and assigned issues https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A039   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B025 It's a Plan F1-002 b The system lets a user configure an internal agent with a model, a system prompt and tools Internal agents run on the instance. Configure the model, system prompt, tools, and https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A046   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B026 It's a Plan F1-002 b The system lets a user give an agent reusable skills, written inline or imported from a source-code hosting service reusable skills, written inline or imported from a GitHub repository https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A051   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B027 It's a Plan F1-002 b The system lets a user run an external agent on their own machine that hands each task to a coding-agent command-line tool [`@itsaplan/runner`](packages/runner) and it gives every task to Claude Code, Codex, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A055   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B028 It's a Plan F1-002 b The system lets a user control the agent run queue through the API and do the work in their own implementation Or control the run queue through the API and do the work in your own implementation https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A058   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B030 It's a Plan F1-002 b The system lets a user give an agent tools for services outside the tracker, such as note-taking, messaging, social media and web-scraping services Tools for the services outside the tracker: Notion, Telegram, Threads, Instagram, Jina, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A068   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B031 It's a Plan F1-002 b The system lets a user chat with each agent and keep a separate conversation history per agent Built-in chat with each agent, with its own conversation history https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A042   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B032 It's a Plan F1-002 b The system lets a user chat with an external agent while its runner streams the reply and tool calls Chat with an external agent too. The runner answers from your machine, streams the reply https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A056   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B033 It's a Plan F1-002 b The system lets a user access the system through a REST API with API keys REST API with an OpenAPI reference and API keys https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A060   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B034 It's a Plan F1-002 b The system lets an external assistant read and change issues through an MCP server MCP server, so an external assistant can read and change issues through the same API https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A059   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B035 It's a Plan F1-002 b The system lets a user link a pull request from a code-hosting service to an issue by referencing the issue key Pull requests from GitHub, GitLab, Gitea, Forgejo, and Bitbucket. "Fixes KEY-42" links the https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A061   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B036 It's a Plan F1-002 b The system automatically moves an issue when its linked pull request opens and merges pull request to the issue, and the issue moves when the pull request opens and merges https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A062   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B037 It's a Plan F1-002 b The system lets a user subscribe external systems to events through outgoing webhooks with signed payloads and retries Outgoing webhooks: subscribe to events, signed payloads, and retries with a delivery log https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A063   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B038 It's a Plan F1-002 b The system lets a user sign in with an email or username and password, a passkey, or an external account Sign in with an email or a username and a password, a passkey, or Google https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A065   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B039 It's a Plan F1-002 b The system lets a user receive notifications by email and by messaging app, with per-member preferences Notifications by email (SMTP or Resend) and Telegram, with per-member preferences https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A066   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B040 It's a Plan F1-002 b The system lets a user use the interface in multiple languages Interface in English, Ukrainian, Russian, https://raw.githubusercontent.com/croffasia/itsaplan/HEAD/README.md 01.txt passed rejected duplicate of F1-002-A067   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B041 It's a Plan F1-002 b The system automatically calculates an initiative's progress from the states of its issues when issues change state Progress counts those issues by state, so nobody types a percentage by hand. https://itsaplan.dev/features 02.txt passed rejected duplicate of F1-002-A031   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B042 It's a Plan F1-002 b The system lets a user delegate an issue to an agent while the assignee stays the person answerable for it Set the delegate on an issue: the agent does the work, the assignee stays the person answerable for it. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A040   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B043 It's a Plan F1-002 b The system automatically replies in the comment thread when an agent is mentioned in a comment Mention the agent in a comment and it replies in the thread. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A041   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B044 It's a Plan F1-002 b The system lets a user schedule a recurring task for an agent daily, weekly or by a cron expression Give an agent a task and say when it runs: every day at nine, every Monday, or a cron you write. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A043   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B045 It's a Plan F1-002 b The system lets a user pause a scheduled agent task without deleting it you can pause one without deleting it. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A044   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B046 It's a Plan F1-002 b The system lets a user see when a scheduled agent task runs next and how its last run went The list shows when it runs next and how the last run went https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A045   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B047 It's a Plan F1-002 b The system lets a user upload a skill file or import a set of skills from a public repository Write one here, upload a file you already have, or point at a public GitHub repo and pull in the whole set. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A051   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B048 It's a Plan F1-002 b The system lets a user choose which actions an agent may take, such as creating issues, changing states, commenting and setting labels Tick what it may write: create issues, change states, comment, set labels. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A048   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B049 It's a Plan F1-002 b The system lets a user read the run history of an agent Open an agent and read what it did on each run. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A054   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B050 It's a Plan F1-002 b The system lets a user test an agent in a chat before saving it Try it in the chat before saving https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A050   rejected (duplicate upheld) duplicate upheld 0.0
F1-002-B051 It's a Plan F1-002 b The system lets a user copy an agent chat's local session id to resume the session in their own terminal The header shows the session id: copy it and open the same session in your terminal, with every tool call the agent made. https://itsaplan.dev/features/ai-agents 03.txt passed rejected duplicate of F1-002-A057   rejected (duplicate upheld) duplicate upheld 0.0

Next page

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);