Prediction of incident inflammatory bowel disease from routine electronic health records: development and external validation of a longitudinal machine learning model
Year: 2026
Type: preprint
Abstract: BACKGROUND & AIMS Inflammatory bowel disease (IBD) is often diagnosed months to years after symptoms begin, and diagnostic delay is associated with complications. We tested whether longitudinal machine learning using electronic health record (EHR) data can identify incident IBD before diagnosis, and quantified lead time and deployment burden. METHODS We studied adults with an IBD-compatible symptom, sign, or finding at UCSF (2012-2024). Incident cases were confirmed by structured filtering and validated large language model note review. We trained a state space model (Mamba) and comparators on pre-diagnostic EHR data, excluding diagnostic-workup features, and assessed discrimination at 6- and 12-month landmarks. We externally tested Mamba without recalibration at ZSFG, a safety-net hospital serving a demographically and socioeconomically distinct population, and simulated diagnosis-code-only deployment at UCSF. RESULTS Six months after presentation, among patients still undiagnosed (67% of UCSF test cases), Mamba achieved an AUROC of 0.969 (95% CI, 0.928-0.999) at UCSF and 0.965 (0.952-0.976) at ZSFG. Median lead time was 20 months at UCSF and 15 months at ZSFG. Among future cases with an initially normal colonoscopy (N=32) or a histological finding of acute inflammation without chronicity (N=63), the model flagged 84% and 89% of these patients, respectively, before those procedures, indicating the potential for pre-diagnostic detection. Among 358,886 symptomatic patients not used for training (60 incident cases), the diagnosis-code-only model achieved an AUROC of 0.926; reviewing 20 alerts/month identified 34 cases (PPV, 1.09%; 64-fold above baseline). CONCLUSIONS Longitudinal machine learning can identify increased IBD risk months to years before diagnosis and may define a population for prospective studies of early IBD biology. Prospective evaluation should determine whether earlier identification reduces diagnostic delay. What You Need to Know Background and Context IBD is often diagnosed months to years after symptoms begin. Whether routinely collected electronic health record data can identify future IBD before diagnosis, and at what alert burden, is unknown. New Findings A longitudinal model identified future IBD six months after first symptomatic presentation with an AUROC of 0.97 and a median lead time of 20 months, with similar external discrimination. Limitations This was a retrospective study; external case labels were inferred rather than adjudicated, and colonoscopy analyses were exploratory. Whether earlier flagging shortens time to diagnosis requires prospective evaluation. Clinical Research Relevance Routinely collected structured EHR data could support targeted gastroenterology review of recurrently symptomatic patients. Because incident IBD is rare among symptomatic patients, a service reviewing 20 flagged charts per month would identify roughly one future case every five months. Deployment should therefore begin in silent mode, with locally calibrated thresholds and prospective measurement of alert burden. Basic Research Relevance The model flagged most future cases before a pre-diagnostic colonoscopy read as normal, or before biopsies showing only acute inflammation. Patients flagged despite normal-appearing mucosa may represent a preclinical population in which the earliest immunologic, serologic, and microbial events of IBD could be studied prospectively, including through model-guided mucosal sampling. Lay Summary An AI system reviewing medical records data is able to identify people who would later be diagnosed with inflammatory bowel disease, often more than a year before doctors made the diagnosis.
Source: medRxiv
Institution: University of California, San Francisco
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7221601389