Review-Conditioned Reliability Cards: Making the Denominator Visible in Human–AI Review
Year: 2026
Type: preprint
Abstract: An AI system can be 90% accurate overall while only 53% of its suggestions in a human review queue are correct. Selective routing can cause this difference without model degradation. We propose a review-conditioned reliability card that names its audited population and denominator and expires after relevant context changes. We combine an implemented local prototype, a deterministic diagnostic, a descriptive reanalysis of public data from a published 198-participant study, and a prospective evaluation protocol. The reanalysis contextualizes why communication matters; it does not test our card. The candidate contribution is a narrow interface extension of established reporting and deferral work, not new probability theory or demonstrated human-performance improvement. We conducted no new human study. AI assistance. OpenAI-based AI assistants assisted research-question development, related-work search, manuscript drafting, prototype and analysis-code generation, deterministic diagnostic design, secondary-data analysis, and artifact checks. The public human-study data were produced by Bondi et al.; no new human-participant study was conducted. Exact assistant model versions are not documented in the supplied package. Materials and attribution. The manuscript includes an attributed secondary visualization of public aggregate data from Bondi et al. (2022), Role of Human-AI Interaction in Selective Prediction, https://doi.org/10.1609/aaai.v36i5.20465. Source data: DeepMind Technologies Limited, CC BY 4.0. The visualization is a modification; no endorsement is implied. Research draft, revision 3. Not peer reviewed. Release status. The uploader approved public release of this revision on 2026-11-08. Author-review and submission-approval notes in the PDFs were written during draft preparation. This is a preprint and has not been peer reviewed.
Authors: Ozdem, Musa Emin, Egri, Rumeysa
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7225570310