Automatic textual description of colorectal polyp features: explainable artificial intelligence

Ayla Thijssen*, Ramon-Michel R Schreuder, Roger Fonollà, Quirine van der Zander, Thom Scheeve, Bjorn Winkens, Sharmila Subramaniam, Pradeep Bhandari, Peter de With, Ad Masclee, Fons van der Sommen, Erik Schoon

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Computer-aided diagnosis systems (CADx) can improve colorectal polyp (CRP) optical diagnosis. For integration into clinical practice, better understanding of artificial intelligence (AI) by endoscopists is needed. We aimed to develop an explainable AI CADx capable of automatically generating textual descriptions of CRPs. For training and testing of this CADx, textual descriptions of CRP size and features according to the Blue Light Imaging (BLI) Adenoma Serrated International Classification (BASIC) were used, describing CRP surface, pit pattern, and vessels. CADx was tested using BLI images of 55 CRPs. Reference descriptions with agreement by at least five out of six expert endoscopists were used as gold standard. CADx performance was analyzed by calculating agreement between the CADx generated descriptions and reference descriptions. CADx development for automatic textual description of CRP features succeeded. Gwet's AC1 values comparing the reference and generated descriptions per CRP feature were: size 0.496, surface-mucus 0.930, surface-regularity 0.926, surface-depression 0.940, pits-features 0.921, pits-type 0.957, pits-distribution 0.167, and vessels 0.778. CADx performance differed per CRP feature and was particularly high for surface descriptors while size and pits-distribution description need improvement. Explainable AI can help comprehend reasoning behind CADx diagnoses and therefore facilitate integration into clinical practice and increase trust in AI.

Original languageEnglish
Pages (from-to)E513-E518
Number of pages6
JournalEndoscopy international open
Volume11
Issue number05
DOIs
Publication statusPublished - May 2023

Cite this