pub-10 data
Data license: Not yet licensed — internal review only · Data source: Ahmed ElBatanony, Innopolis University
| metric | value |
|---|---|
| adjudicated.confirmed | 1895.0 |
| adjudicated.corrected | 77.0 |
| adjudicated.rejected | 1847.0 |
| adjudicatorOverturned | 1.0 |
| adjudicatorReviewed | 136.0 |
| agreementExcludingDuplicates | 0.9995064165844028 |
| apps | 25.0 |
| audit.actor_ok | 0.9212985870581122 |
| audit.correct | 0.9732750563527408 |
| audit.is_capability | 0.9883116169113201 |
| audit.no_marketing | 0.9991918192314037 |
| audit.single_capability | 0.9570564626972347 |
| audit.supported_by_excerpt | 0.6217878937819561 |
| audit.supported_in_context | 0.9966518225301008 |
| candidates | 3819.0 |
| cohenKappa | 0.9964708295906939 |
| cohenKappaExcludingDuplicates | 0.9961142032965978 |
| duplicatesOverturned | 6.0 |
| duplicatesRemoved | 1787.0 |
| duplicatesReviewed | 1793.0 |
| extractedA | 1879.0 |
| extractedB | 1940.0 |
| final | 2021.0 |
| formDropped | 0.0 |
| missedAccepted | 49.0 |
| missedProposed | 56.0 |
| missedShareOfFinal | 0.024245423057892134 |
| nonDuplicatePairs | 2026.0 |
| runARecall | 0.9112576064908722 |
| runBRecall | 0.8803245436105477 |
| runChapman | 1998.4404609475032 |
| runJaccard | 0.7915821501014199 |
| runOverlap.aOnly | 236.0 |
| runOverlap.bOnly | 175.0 |
| runOverlap.both | 1561.0 |
| supportedShare | 0.9704724409448819 |
| undecidable | 0.0 |
| verbatimDropped | 0.0 |
| verbatimFailureShare | 0.0 |
| verifier.confirmed | 1890.0 |
| verifier.corrected | 76.0 |
| verifier.rejected | 1853.0 |
| verifierAdjudicatorAgreement | 0.9981670594396439 |