Stability of FDG-PET Radiomics features: an integrated analysis of test-retest and inter-observer variability.

Ralph T H Leijenaar*, Sara Carvalho, Emmanuel Rios Velazquez, Wouter J C van Elmpt, Chintan Parmar, Otto S Hoekstra, Corneline J Hoekstra, Ronald Boellaard, André Dekker, Robert J Gillies, Hugo J W L Aerts, Philippe Lambin

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

8 Downloads (Pure)


PURPOSE: Besides basic measurements as maximum standardized uptake value (SUV)max or SUVmean derived from 18F-FDG positron emission tomography (PET) scans, more advanced quantitative imaging features (i.e. "Radiomics" features) are increasingly investigated for treatment monitoring, outcome prediction, or as potential biomarkers. With these prospected applications of Radiomics features, it is a requisite that they provide robust and reliable measurements. The aim of our study was therefore to perform an integrated stability analysis of a large number of PET-derived features in non-small cell lung carcinoma (NSCLC), based on both a test-retest and an inter-observer setup.\n\nMETHODS: Eleven NSCLC patients were included in the test-retest cohort. Patients underwent repeated PET imaging within a one day interval, before any treatment was delivered. Lesions were delineated by applying a threshold of 50% of the maximum uptake value within the tumor. Twenty-three NSCLC patients were included in the inter-observer cohort. Patients underwent a diagnostic whole body PET-computed tomography (CT). Lesions were manually delineated based on fused PET-CT, using a standardized clinical delineation protocol. Delineation was performed independently by five observers, blinded to each other. Fifteen first order statistics, 39 descriptors of intensity volume histograms, eight geometric features and 44 textural features were extracted. For every feature, test-retest and inter-observer stability was assessed with the intra-class correlation coefficient (ICC) and the coefficient of variability, normalized to mean and range. Similarity between test-retest and inter-observer stability rankings of features was assessed with Spearman's rank correlation coefficient.\n\nRESULTS: Results showed that the majority of assessed features had both a high test-retest (71%) and inter-observer (91%) stability in terms of their ICC. Overall, features more stable in repeated PET imaging were also found to be more robust against inter-observer variability.\n\nCONCLUSION: Results suggest that further research of quantitative imaging features is warranted with respect to more advanced applications of PET imaging as being used for treatment monitoring, outcome prediction or imaging biomarkers.
Original languageEnglish
Pages (from-to)1391-1397
Number of pages7
JournalActa oncologica
Issue number7
Publication statusPublished - 2013


  • Carcinoma
  • Computer-Assisted
  • Fluorodeoxyglucose F18
  • Fluorodeoxyglucose F18: diagnostic use
  • Humans
  • Image-Guided
  • Lung Neoplasms
  • Lung Neoplasms: pathology
  • Lung Neoplasms: radionuclide imaging
  • Lung Neoplasms: radiotherapy
  • Non-Small-Cell Lung
  • Non-Small-Cell Lung: pathology
  • Non-Small-Cell Lung: radionuclide imagi
  • Non-Small-Cell Lung: radiotherapy
  • Observer Variation
  • Positron-Emission Tomography
  • Prognosis
  • Radiopharmaceuticals
  • Radiopharmaceuticals: diagnostic use
  • Radiotherapy
  • Radiotherapy Planning
  • Tomography
  • X-Ray Computed

Cite this