A Bayesian Network Approach to Lung Cancer Screening: Assessing the Impact of Data Quantity, Quality, and the Combination of Data from Danish Electronic Health Records

Florian van Daalen, Margrethe Hostgaard Bang Henriksen*, Torben Frostrup Hansen, Lars Henrik Jensen, Claus Lohman Brasen, Ole Hilberg, Martin Ask Klausholt Andersen, Elise Humerfelt, Leonard Wee, Inigo Bermejo

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background/Objectives: Lung cancer (LC) is the leading cause of cancer mortality, making early diagnosis essential. While LC screening trials are underway globally, optimal prediction models and inclusion criteria are still lacking. This study aimed to develop and evaluate Bayesian Network (BN) models for LC risk prediction using a decade of data from Denmark. The primary goal was to assess BN performance on datasets varying in size and completeness, simulate real-world screening scenarios, and identify the most valuable data sources for LC screening. Methods: The study included 38,944 patients evaluated for LC, with 11,284 (29%) diagnosed. Data on comorbidities, medications, and general practice were available for the entire cohort, while laboratory results, smoking habits, and other variables were only available for subsets. The cohort was divided into four subsets based on data availability, and BNs were trained and validated across these subsets using cross-validation and external validation. To determine the optimal combination of variables, all possible data combinations were evaluated on the samples that contained all the variables (n = 5587). Results: A model trained on the small, complete dataset (AUC 0.78) performed similarly on a larger dataset with 21% missing data (AUC 0.78). Performance dropped when 39% of data were missing (AUC 0.67), resulting in informative variables missing completely in the dataset. Laboratory results and smoking data were the most informative, significantly outperforming models based only on age and smoking status (AUC 0.70). Conclusions: BN models demonstrated moderate to strong predictive performance, even with incomplete data, highlighting the potential value of incorporating laboratory results in LC screening programs.
Original languageEnglish
Article number3989
Number of pages16
JournalCancers
Volume16
Issue number23
DOIs
Publication statusPublished - 1 Dec 2024

Keywords

  • lung cancer
  • bayesian networks
  • prediction models
  • screening
  • early detection
  • missing data
  • risk stratification
  • TRIAL
  • RISK
  • CT
  • CRITERIA

Fingerprint

Dive into the research topics of 'A Bayesian Network Approach to Lung Cancer Screening: Assessing the Impact of Data Quantity, Quality, and the Combination of Data from Danish Electronic Health Records'. Together they form a unique fingerprint.

Cite this