External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis
Year: 2020
Type: review
Abstract: BACKGROUND: Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting. METHODS: IPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis. RESULTS: Of 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model's calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%. CONCLUSIONS: The evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice. TRIAL REGISTRATION: PROSPERO ID: CRD42015029349 .
Source: BMC Medicine
Authors: for the IPPIC Collaborative Network, Kym I. E. Snell, John Allotey, Melanie Smuk, Richard Hooper, Claire Chan, Asif Ahmed, Lucy C. Chappell, Peter Von Dadelszen, Marcus Green, Louise Kenny, Asma Khalil, Khalid S. Khan, Ben W. Mol, Jenny Myers, Lucilla Poston, Basky Thilaganathan, Anne C. Staff, Gordon C. S. Smith, Wessel Ganzevoort, Hannele Laivuori, Anthony O. Odibo, Javier Arenas Ramírez, John Kingdom, George Daskalakis, Diane Farrar, Ahmet A. Baschat, Paul T. Seed, Federico Prefumo, Fabricio da Silva Costa, Henk Groen, Francois Audibert, Jacques Masse, Ragnhild B. Skråstad, Kjell Å. Salvesen, Camilla Haavaldsen, Chie Nagata, Alice R. Rumbold, Seppo Heinonen, Lisa M. Askie, Luc J. M. Smits, Christina A. Vinter, Per Magnus, Kajantie Eero, Pia M. Villa, Anne K. Jenum, Louise B. Andersen, Jane E. Norman, Akihide Ohkuchi, Anne Eskild, Sohinee Bhattacharya, Fionnuala M. McAuliffe, Alberto Galindo, Ignacio Herraiz, Lionel Carbillon, Kerstin Klipstein-Grobusch, Seon Ae Yeo, Joyce L. Browne, Karel G. M. Moons, Richard D. Riley, Shakila Thangaratinam
Institutions: Keele University, Queen Mary University of London, King's College London, University of Liverpool, St George's, University of London, St George’s University Hospitals NHS Foundation Trust, Monash Medical Centre, Monash University, Manchester Academic Health Science Centre, University of Manchester, Oslo University Hospital, University of Oslo, University of Cambridge, NIHR Cambridge Biomedical Research Centre, Amsterdam University Medical Centers, University of Amsterdam, University of Helsinki, Helsinki University Hospital, Tampere University, University of South Florida, Tampere University Hospital, Institute for Molecular Medicine Finland, HiLIFE – Elämäntieteiden Instituutti, Hospital Universitario De Cabueñes, Mount Sinai Hospital, University of Toronto, National and Kapodistrian University of Athens, Alexandra Hospital, Bradford Institute for Health Research, Johns Hopkins University, Johns Hopkins Medicine, University of Brescia, Universidade de São Paulo, University Medical Center Groningen, University of Groningen, Centre Hospitalier Universitaire Sainte-Justine, Université de Montréal, Université Laval, Norwegian University of Science and Technology, St Olav's University Hospital, Akershus University Hospital, National Center For Child Health and Development, South Australian Health and Medical Research Institute, The University of Adelaide, The University of Sydney, Maastricht University Medical Centre, Care and Public Health Research Institute, University of Southern Denmark, Odense University Hospital, Norwegian Institute of Public Health, Finnish Institute for Health and Welfare, Helsinki Children's Hospital, MRC Centre for Reproductive Health, University of Edinburgh, Jichi Medical University, University of Aberdeen, University College Dublin, National Maternity Hospital, Universidad Complutense de Madrid, Assistance Publique – Hôpitaux de Paris, Utrecht University, University Medical Center Utrecht, University of North Carolina at Chapel Hill, University of Birmingham
Language: English
Subfield: Obstetrics and Gynecology
Field: Medicine
Domain: Health Sciences
Open Access status: gold
Estimated APC paid: $3,490
Funders: Michigan State University, Université Laval, Johns Hopkins University, University of Dundee, Norges Teknisk-Naturvitenskapelige Universitet, Wellcome Trust, National Institute for Health and Care Research, Department of Health and Social Care, University of Oxford, University of Aberdeen, University of Bristol, University College Dublin, Universiteit Maastricht, Academisch Medisch Centrum, University of Toronto, Kementerian Pendidikan Nasional, National and Kapodistrian University of Athens, Université de Montréal, Universitetet i Oslo, Universidad de los Andes, Syddansk Universitet, College of Engineering, Michigan State University, Medical Research Council, Health Technology Assessment Programme, NIHR School for Primary Care Research, Norwegian Institute of Public Health
Awards: G1192034430, Prediction of Fetal Growth Restriction and Complications: Individual Participant Data (IPD) Meta-Analysis With Decision Curve Analysis International Prediction of Complications in Pregnancy: Fetal Growth restriction (IPPIC-FGR), Accuracy of clinical characteristics, biochemical and ultrasound markers in the prediction of pre-eclampsia: an Individual Patient Data (IPD) Meta-analysis, G27088781, The Avon Longitudinal Study of Parents and Children (ALSPAC): A multi-generation, longitudinal resource, The Avon Longitudinal Study of Parents and Children (ALSPAC): A multi- generation, longitudinal resource focusing on life course health and well- being., The Avon Longitudinal Study of Parents and Children: An international resource for population
genomics and lifecourse epidemiology. Core Programme Support 2011-2015 and Core programme support 2014-2019, Identification and treatment of women with hypertensive disorders of pregnancy: translating evidence into practice, G5278681472, Prediction and prevention of adverse pregnancy outcomes in women with chronic vascular disease, G5562631338, Improving maternal and perinatal outcomes in high-risk pregnancies
OpenAlex ID: W3096142341
