Boosting the accuracy of existing models by updating and extending: using a multicenter COVID-19 ICU cohort as a proxy

Daniek A.M. Meijs*, Laure Wynants, Sander M.J. van Kuijk, Clarissa I.E. Scheeren, Anisa Hana, Jannet Mehagnoul-Schipper, Björn Stessel, Margot Vander Laenen, Eline G.M. Cox, Jan Willem E.M. Sels, Luc J.M. Smits, Johannes Bickenbach, Dieter Mesotten, Iwan C.C. van der Horst, Gernot Marx, Bas C.T. van Bussel, CoDaP Investigators, Nanon Heijnen, Mark Mulder, Julia BelsNick Wilmes, Charlotte Hendriks, Emma Janssen, Micheline Florack, Chahinda Ghossein

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Most published prediction models for Coronavirus Disease 2019 (COVID-19) were poorly reported, at high risk of bias, and heterogeneous in model performance. To tackle methodological challenges faced in previous prediction studies, we investigated whether model updating and extending improves mortality prediction, using the Intensive Care Unit (ICU) as a proxy. All COVID-19 patients admitted to seven ICUs in the Euregio-Meuse Rhine during the first pandemic wave were included. The 4C Mortality and SEIMC scores were selected as promising prognostic models from an external validation study. Five predictors could be estimated based on cohort size. TRIPOD guidelines were followed and logistic regression analyses with the linear predictor, APACHE II score, and country were performed. Bootstrapping with backward selection was applied to select variables for the final model. Additionally, shrinkage was performed. Model discrimination was displayed as optimism-corrected areas under the ROC curve and calibration by calibration slopes and plots. The mortality rate of the 551 included patients was 36%. Discrimination of the 4C Mortality and SEIMC scores increased from 0.70 to 0.74 and 0.70 to 0.73 and calibration plots improved compared to the original models after updating and extending. Mortality prediction can be improved after updating and extending of promising models.
Original languageEnglish
Article number26344
Number of pages11
JournalScientific Reports
Volume14
Issue number1
DOIs
Publication statusPublished - 1 Nov 2024

Fingerprint

Dive into the research topics of 'Boosting the accuracy of existing models by updating and extending: using a multicenter COVID-19 ICU cohort as a proxy'. Together they form a unique fingerprint.

Cite this