TY - JOUR
T1 - Assessing the impact of deep-learning assistance on the histopathological diagnosis of serous tubal intraepithelial carcinoma (STIC) in fallopian tubes
AU - Bogaerts, Joep M. A.
AU - Steenbeek, Miranda P.
AU - Bokhorst, John-Melle
AU - van Bommel, Majke H. D.
AU - Abete, Luca
AU - Addante, Francesca
AU - Brinkhuis, Mariel
AU - Chrzan, Alicja
AU - Cordier, Fleur
AU - Devouassoux-Shisheboran, Mojgan
AU - Fernandez-Perez, Juan
AU - Fischer, Anna
AU - Gilks, C. Blake
AU - Guerriero, Angela
AU - Jaconi, Marta
AU - Kleijn, Tony G.
AU - Kooreman, Loes
AU - Martin, Spencer
AU - Milla, Jakob
AU - Narducci, Nadine
AU - Ntala, Chara
AU - Parkash, Vinita
AU - de Pauw, Christophe
AU - Rabban, Joseph T.
AU - Rijstenberg, Lucia
AU - Rottscholl, Robert
AU - Staebler, Annette
AU - van de Vijver, Koen
AU - Zannoni, Gian Franco
AU - van Zanten, Monica
AU - de Hullu, Joanne A.
AU - Simons, Michiel
AU - van Der Laak, Jeroen A. W. M.
AU - AI STIC Study Group
PY - 2024/11/1
Y1 - 2024/11/1
N2 - In recent years, it has become clear that artificial intelligence (AI) models can achieve high accuracy in specific pathology-related tasks. An example is our deep-learning model, designed to automatically detect serous tubal intraepithelial carcinoma (STIC), the precursor lesion to high-grade serous ovarian carcinoma, found in the fallopian tube. However, the standalone performance of a model is insufficient to determine its value in the diagnostic setting. To evaluate the impact of the use of this model on pathologists' performance, we set up a fully crossed multireader, multicase study, in which 26 participants, from 11 countries, reviewed 100 digitalized H&E-stained slides of fallopian tubes (30 cases/70 controls) with and without AI assistance, with a washout period between the sessions. We evaluated the effect of the deep-learning model on accuracy, slide review time and (subjectively perceived) diagnostic certainty, using mixed-models analysis. With AI assistance, we found a significant increase in accuracy (p < 0.01) whereby the average sensitivity increased from 82% to 93%. Further, there was a significant 44 s (32%) reduction in slide review time (p < 0.01). The level of certainty that the participants felt versus their own assessment also significantly increased, by 0.24 on a 10-point scale (p < 0.01). In conclusion, we found that, in a diverse group of pathologists and pathology residents, AI support resulted in a significant improvement in the accuracy of STIC diagnosis and was coupled with a substantial reduction in slide review time. This model has the potential to provide meaningful support to pathologists in the diagnosis of STIC, ultimately streamlining and optimizing the overall diagnostic process.
AB - In recent years, it has become clear that artificial intelligence (AI) models can achieve high accuracy in specific pathology-related tasks. An example is our deep-learning model, designed to automatically detect serous tubal intraepithelial carcinoma (STIC), the precursor lesion to high-grade serous ovarian carcinoma, found in the fallopian tube. However, the standalone performance of a model is insufficient to determine its value in the diagnostic setting. To evaluate the impact of the use of this model on pathologists' performance, we set up a fully crossed multireader, multicase study, in which 26 participants, from 11 countries, reviewed 100 digitalized H&E-stained slides of fallopian tubes (30 cases/70 controls) with and without AI assistance, with a washout period between the sessions. We evaluated the effect of the deep-learning model on accuracy, slide review time and (subjectively perceived) diagnostic certainty, using mixed-models analysis. With AI assistance, we found a significant increase in accuracy (p < 0.01) whereby the average sensitivity increased from 82% to 93%. Further, there was a significant 44 s (32%) reduction in slide review time (p < 0.01). The level of certainty that the participants felt versus their own assessment also significantly increased, by 0.24 on a 10-point scale (p < 0.01). In conclusion, we found that, in a diverse group of pathologists and pathology residents, AI support resulted in a significant improvement in the accuracy of STIC diagnosis and was coupled with a substantial reduction in slide review time. This model has the potential to provide meaningful support to pathologists in the diagnosis of STIC, ultimately streamlining and optimizing the overall diagnostic process.
KW - serous tubal intraepithelial carcinoma
KW - STIC
KW - high-grade serous carcinoma
KW - deep learning
KW - artificial intelligence
KW - histopathology
KW - computational pathology
KW - DIGITAL PATHOLOGY
KW - SECTIONS
KW - WOMEN
U2 - 10.1002/2056-4538.70006
DO - 10.1002/2056-4538.70006
M3 - Article
SN - 2056-4538
VL - 10
JO - Journal of Pathology Clinical Research
JF - Journal of Pathology Clinical Research
IS - 6
M1 - e70006
ER -