candidates

Every statement both blind runs produced (3,819), with its full trail: script check → verifier verdict and reason → adjudicator ruling and reason → whether it is in the final set. Most rejections are duplicates between the two runs.

Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University

2 rows where adjudicator = "rejected", app_id = "F2-007" and verifier_verdict = "rejected"

✎ View and edit SQL

This data as json, CSV (advanced)

run 2

verifier_verdict 1

  • rejected · 2 ✖

in_final_set 1

app_id 1

  • Userback · 2 ✖

adjudicator 1

  • rejected · 2 ✖
candidate_id ▼ app_id run statement excerpt source_url source_file script_check verifier_verdict verifier_reason verifier_correction adjudicator adjudicator_reason in_final_set
F2-007-A030 Userback F2-007 a The system lets a user add rating, text, and choice questions to a survey Add any of these from the Add component dropdown at the top of the builder’s Design > Questions tab. https://support.userback.io/en/articles/16880431-survey-question-types-reference 10.txt passed rejected Compound umbrella over three question families; each is covered by A031 to A034.   rejected This umbrella statement over the question families is fully covered by A031 to A034. 0.0
F2-007-B001 Userback F2-007 b The system lets a user capture screenshot annotations, session replays, console logs, and in-app surveys in one place. Userback captures screenshot annotations, session replays, console logs, and in-app surveys — all centralized in one place https://docs.userback.io/docs/welcome 01.txt passed rejected Umbrella statement; its parts are covered by A017, A049, A053 and A026.   rejected This umbrella sentence is covered piece by piece by the annotation, session replay, console log and survey statements. 0.0

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options: 

CREATE TABLE [candidates] ([candidate_id] TEXT PRIMARY KEY, [app_id] TEXT, [run] TEXT, [statement] TEXT, [excerpt] TEXT, [source_url] TEXT, [source_file] TEXT, [script_check] TEXT, [verifier_verdict] TEXT, [verifier_reason] TEXT, [verifier_correction] TEXT, [adjudicator] TEXT, [adjudicator_reason] TEXT, [in_final_set] REAL, FOREIGN KEY ([app_id]) REFERENCES apps(app_id));
CREATE INDEX [idx_candidates_app_id] ON [candidates]([app_id]);
CREATE INDEX [idx_candidates_run] ON [candidates]([run]);
CREATE INDEX [idx_candidates_verifier_verdict] ON [candidates]([verifier_verdict]);
CREATE INDEX [idx_candidates_adjudicator] ON [candidates]([adjudicator]);