Towards texture accurate slice interpolation of medical images using PixelMiner

W. Rogers, S. A. Keek, M. Beuque, E. Lavrova, S. Primakov, G. Wu, C. Yan, S. Sanduleanu, H. A. Gietema, R. Casale, M. Occhipinti, H. C. Woodruff, A. Jochems, P. Lambin*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Quantitative image analysis models are used for medical imaging tasks such as registration, classification, object detection, and segmentation. For these models to be capable of making accurate predictions, they need valid and precise information. We propose PixelMiner, a convolution-based deep-learning model for interpolating computed tomography (CT) imaging slices. PixelMiner was designed to produce texture-accurate slice interpolations by trading off pixel accuracy for texture accuracy. PixelMiner was trained on a dataset of 7829 CT scans and validated using an external dataset. We demonstrated the model's effectiveness by using the structural similarity index (SSIM), peak signal to noise ratio (PSNR), and the root mean squared error (RMSE) of extracted texture features. Additionally, we developed and used a new metric, the mean squared mapped feature error (MSMFE). The performance of PixelMiner was compared to four other interpolation methods: (tri-)linear, (tri-)cubic, windowed sinc (WS), and nearest neighbor (NN). PixelMiner produced texture with a significantly lowest average texture error compared to all other methods with a normalized root mean squared error (NRMSE) of 0.11 (p < .01), and the significantly highest reproducibility with a concordance correlation coefficient (CCC) >= 0.85 (p < .01). PixelMiner was not only shown to better preserve features but was also validated using an ablation study by removing auto-regression from the model and was shown to improve segmentations on interpolated slices.
Original languageEnglish
Article number106701
Number of pages11
JournalComputers in Biology and Medicine
Volume161
Issue number1
Early online date1 May 2023
DOIs
Publication statusPublished - 1 Jul 2023

Keywords

  • Generative modelling
  • PixelCNN
  • Medical imaging
  • Interpolation
  • CT

Cite this