1. Introduction
Medicine is in the middle of a significant technological transition. Artificial intelligence (AI)-and deep learning (DL) architectures in particular-has moved from a promising research curiosity to an increasingly routine presence across diagnostic imaging, pathology, and ophthalmology (Raposo, 2025). The shift from earlier computer-aided diagnosis (CAD) systems toward deep convolutional neural networks (CNNs) and, more recently, vision transformers (ViTs) has allowed models to extract high-dimensional imaging features that even experienced clinicians would struggle to articulate, let alone perceive directly (Rafique et al., 2026; Raposo, 2025). The motivation behind this push is not abstract. Diagnostic error remains a genuine clinical problem, implicated in as many as one in ten patient deaths, and inter-observer disagreement in qualitative image interpretation can reach roughly 37% depending on modality and reader experience (Langlotz et al., 2019). Against that backdrop, the enthusiasm for AI-assisted interpretation is understandable.
Yet technical success in a controlled benchmark setting has not translated smoothly into safe, routine clinical use (Lekadir et al., 2025; Ogut, 2025). Two problems account for most of this gap. The first is a persistent reproducibility crisis: many published models cannot be reliably re-tested, re-trained, or validated by independent groups. The second is the propagation of algorithmic bias throughout the model development pipeline (Drukker et al., 2023; Sulaimanov et al., 2026). Both problems feed into what has been called the "AI chasm"-the distance between a technically impressive proof-of-concept and a tool clinicians can trust at the bedside (Keane & Topol, 2018, as cited in Bookshelf_NBK619320). Closing that gap is, in our assessment, the central task facing this field over the next several years. This manuscript addresses that task in two parts: first, a synthesis of what the published evidence currently shows about reproducibility, bias, and clinical readiness; second, a prospective protocol-not yet executed-that operationalizes the resulting research questions into testable studies.
Reproducibility is a foundational, not merely procedural, concern for scientific credibility. Independent investigators need to be able to take a published method and obtain comparable results; when they cannot, the underlying claims become difficult to trust. This is precisely where much of the biomedical AI literature falls short-poor generalization to external cohorts is common, not exceptional (Barberis et al., 2024). Several factors drive this: heterogeneous data sources, inconsistent and often undocumented data-splitting protocols, a lack of shared pre-processing standards, and a reluctance to openly share source code, trained model weights, or complete datasets (Jeon et al., 2026; Sulaimanov et al., 2026). Historically, only a small fraction of diagnostic AI studies have been validated on independent, geographically diverse cohorts; the majority instead rely on single-center retrospective data or simple k-fold cross-validation, an approach that tends to overstate apparent performance rather than test it rigorously (Jeon et al., 2026; Langlotz et al., 2019; Sulaimanov et al., 2026).
Adherence to standardized reporting frameworks compounds the problem. Guidelines such as the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) and the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis using Artificial Intelligence (TRIPOD-AI) exist precisely to prevent these gaps, yet compliance remains partial at best (Barberis et al., 2024; Sulaimanov et al., 2026). One methodological review of 91 medical imaging AI publications found that not a single study fully satisfied CLAIM or TRIPOD-AI reporting standards-details on model development, pre-processing, and calibration were routinely omitted (Sulaimanov et al., 2026). Benchmarking challenges designed specifically to allow fair cross-comparison of algorithms fare little better, often suffering from reporting gaps that make direct comparison across methods essentially impossible (Maier-Hein et al., 2020; Rafique et al., 2026).
The imaging informatics community has responded to this problem. Common Data Models (CDMs)-including the Observational Medical Outcomes Partnership (OMOP) CDM and its imaging-specific extensions, R-CDM and MI-CDM-offer a shared structure for harmonizing heterogeneous clinical and DICOM metadata across institutions (Jeon et al., 2026). These frameworks, in turn, make federated learning more feasible, allowing models to be trained across multiple decentralized databases without moving raw patient data (Jeon et al., 2026; Kidwai-Khan et al., 2024). Open-source tools such as RENOIR (REpeated random sampliNg fOr machIne leaRning) add rigor by systematically probing how model performance depends on sample size and producing transparent, reproducible reports intended to reduce research waste (Barberis et al., 2024).
Algorithmic bias differs from a simple statistical artifact that can be corrected after the fact; it is a systemic, largely non-random source of unequal model performance across patient subgroups, capable of widening existing healthcare disparities rather than narrowing them (Drukker et al., 2023; Lekadir et al., 2025). Bias rarely originates solely from the learning algorithm itself. Instead, it enters the pipeline at five distinct stages-data collection, data preparation and annotation, model development, model evaluation, and model deployment-with researchers cataloguing at least 29 overlapping and often compounding sources across these stages (Drukker et al., 2023).
Data collection bias includes acquisition and aggregation bias, which arises when training data is drawn from a single scanner model or acquisition protocol and therefore fails to generalize to other manufacturers or protocols (Drukker et al., 2023). Population bias (demographic imbalances in age, sex, or race) and temporal bias (where outdated practice patterns or evolving disease presentations render older training data less relevant) belong in the same category (Drukker et al., 2023). Further along the pipeline, data preparation and annotation bias is driven largely by annotator bias-the subjectivity, variable experience, and background of clinical labelers, which together produce what is now more accurately termed a "reference standard" rather than a "ground truth," since absolute diagnostic certainty is rare in practice (Drukker et al., 2023; Lekadir et al., 2025). Model development introduces additional vulnerabilities, notably inherited or error-propagation bias, where sequential processing steps-pre-processing, segmentation, classification-allow early mistakes to cascade downstream, and historical bias, which reflects embedded societal inequities in healthcare access (Drukker et al., 2023). At the evaluation stage, amplification bias is common: models learn to predict certain classes with more disparity than the underlying ground-truth prevalence would justify, frequently by exploiting shortcut learning (Drukker et al., 2023).
Shortcut learning is among the most pervasive threats to medical AI safety. CNNs are effective at finding statistical shortcuts that carry no clinical meaning. Models built to detect COVID-19, for example, have sometimes ended up distinguishing pediatric from adult lungs based on incidental class-age correlations, while others have achieved high accuracy by exploiting hospital-specific text markers, laterality labels, or scanner-specific noise rather than actual pathology (Gichoya et al., 2022, as cited in Bookshelf_NBK619320; Kalpathy-Cramer, 2025, as cited in Bookshelf_NBK619320; Lekadir et al., 2025). Deep learning models have also been shown to predict a patient's self-reported race from medical images with near-perfect accuracy, via mechanisms that remain poorly understood-raising the possibility that demographic bias could be encoded into clinical decisions without detection (Gichoya et al., 2022, as cited in Bookshelf_NBK619320).
Clinical readiness marks the final stage of translation-the point at which a tool must prove itself safe, effective, and ethically defensible for prospective use in routine workflows (Daye et al., 2022). There is a real mismatch between how quickly models are developed and how slowly implementation science tends to move (Nooraie et al., 2021). Clinicians raise legitimate concerns about accuracy errors, liability exposure, and the "black box" nature of complex neural networks (Daye et al., 2022). When a model offers no explainability or uncertainty quantification, trust is difficult to earn (Lekadir et al., 2025; Ogut, 2025); yet the opposite failure mode-automation complacency, where clinicians accept incorrect AI suggestions with insufficient scrutiny-carries its own diagnostic risks (Lekadir et al., 2025).
The international FUTURE-AI consensus guidelines set out 30 recommendations organized around six principles: Fairness, Universality, Traceability, Usability, Robustness, and Explainability (Lekadir et al., 2025). Under this framework, genuine clinical readiness requires external validation across independent sites, mechanisms for detecting out-of-distribution or unseen cases, and calibrated uncertainty estimates displayed alongside predictions (Lekadir et al., 2025). Implementation science frameworks such as Normalization Process Theory (NPT) are increasingly used alongside these technical guidelines to understand how clinicians come to trust, adopt, and monitor AI as a sociotechnical intervention rather than a static tool (Nooraie et al., 2021). None of this happens without institutional governance-AI governance committees establishing rubric-based scoring, shadow testing, and canary pilot deployments to assess safety, workflow fit, and cost-effectiveness, while aligning with regulatory instruments such as the European Union's AI Act and the FDA's Predetermined Change Control Plans (PCCPs) for continuously learning software as a medical device (Daye et al., 2022; Rafique et al., 2026). Adoption of these mechanisms is not universal: cost, competing and overlapping standards, and limited regulatory harmonization across jurisdictions remain practical barriers that the literature reviewed here does not fully resolve (Erickson et al., 2024).
Given these interlocking gaps, this manuscript synthesizes the current evidence and proposes a multi-institutional research agenda organized around three research questions (RQ) and corresponding research objectives (RO), detailed methodologically in Section 3.7. RQ1 (Reproducibility) asks to what extent standardized DICOM Common Data Models, such as R-CDM and MI-CDM, improve the cross-institutional generalizability of deep-learning chest radiograph classifiers relative to conventional, unstandardized local pre-processing pipelines. RQ2 (Bias Mitigation) asks whether adversarial debiasing combined with subgroup-calibrated decision thresholds can reduce demographic bias-specifically by age, sex, and ethnicity-in cardiac magnetic resonance segmentation without materially sacrificing overall technical performance. RQ3 (Clinical Readiness) asks how the real-time presentation of calibrated predictive uncertainty and post hoc explainability overlays (such as Grad-CAM and SHAP) influences radiologist diagnostic accuracy and automation complacency in high-acuity triage.

