TY - JOUR
T1 - Chatbots Vs. Human Experts
T2 - Evaluating Diagnostic Performance of Chatbots in Uveitis and the Perspectives on AI Adoption in Ophthalmology
AU - Rojas-Carabali, William
AU - Sen, Alok
AU - Agarwal, Aniruddha
AU - Tan, Gavin
AU - Cheung, Carol Y
AU - Rousselot, Andres
AU - Agrawal, Rajdeep
AU - Liu, Renee
AU - Cifuentes-González, Carlos
AU - Elze, Tobias
AU - Kempen, John H
AU - Sobrin, Lucia
AU - Nguyen, Quan Dong
AU - de-la-Torre, Alejandra
AU - Lee, Bernett
AU - Gupta, Vishali
AU - Agrawal, Rupesh
PY - 2023/10
Y1 - 2023/10
N2 - PURPOSE: To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians' perception about utilizing artificial intelligence (AI) in ophthalmology practice. METHODS: Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. RESULTS: Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. CONCLUSIONS: ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice.
AB - PURPOSE: To assess the diagnostic performance of two chatbots, ChatGPT and Glass, in uveitis diagnosis compared to renowned uveitis specialists, and evaluate clinicians' perception about utilizing artificial intelligence (AI) in ophthalmology practice. METHODS: Six cases were presented to uveitis experts, ChatGPT (version 3.5 and 4.0) and Glass 1.0, and diagnostic accuracy was analyzed. Additionally, a survey about the emotions, confidence in utilizing AI-based tools, and the likelihood of incorporating such tools in clinical practice was done. RESULTS: Uveitis experts accurately diagnosed all cases (100%), while ChatGPT achieved a diagnostic success rate of 66% and Glass 1.0 achieved 33%. Most attendees felt excited or optimistic about utilizing AI in ophthalmology practice. Older age and high level of education were positively correlated with increased inclination to adopt AI-based tools. CONCLUSIONS: ChatGPT demonstrated promising diagnostic capabilities in uveitis cases and ophthalmologist showed enthusiasm for the integration of AI into clinical practice.
KW - Artificial intelligence
KW - ChatGPT
KW - diagnosis
KW - large language model
KW - ophthalmology
U2 - 10.1080/09273948.2023.2266730
DO - 10.1080/09273948.2023.2266730
M3 - Article
SN - 0927-3948
SP - 1
EP - 8
JO - Ocular Immunology and Inflammation
JF - Ocular Immunology and Inflammation
ER -