Comparing User Perception of Explanations Developed with XAI Methods

J. Aechtner*, L. Cabrera, D. Katwal, P. Onghena, D.P. Valenzuela, A. Wilbik

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

274 Downloads (Pure)

Abstract

Artificial Intelligence (AI) has gained notable momentum, culminating in the rise of intelligent machines that deliver unprecedented levels of performance in many application sectors across the field. In recent years, the sophistication of these systems has increased to an extent where almost no human intervention is required for their deployment. A crucial feature for the practical deployment of AI -powered systems in critical decision -making processes is the ability to understand how these systems derive their decisions. Accordingly, the AI community is confronted with the barrier of explaining the reasoning behind machine -made decisions. Paradigms underlying this problem fall within the field of eXplainable AI (XAI). Research in this field has introduced various methods to shed light into black box models such as deep neural networks. While local explanation methods explain the reasoning behind an output for a single decision, global explanations aim to describe the general behaviour of a model, i.e. for all decisions. This paper investigates users' perceptions of local and global explanations generated with popular XAI methods LIME, SHAP, and PDP by conducting a survey to find which of the explanations are preferred by different users. Meanwhile, two hypotheses are tested: first, explanations increase users' trust in a system, and second, AI novices prefer local over global explanations. The results show that explanations from PDP achieved the best user evaluation among the considered XAI methods.
Original languageEnglish
Title of host publication2022 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE)
PublisherIEEE
Number of pages7
ISBN (Print)9781665467100
DOIs
Publication statusPublished - 2022
EventIEEE International Conference on Fuzzy Systems - Padua, Italy
Duration: 18 Jul 202223 Jul 2022

Publication series

SeriesIEEE International Fuzzy Systems Conference Proceedings
ISSN1544-5615

Conference

ConferenceIEEE International Conference on Fuzzy Systems
Abbreviated titleFUZZ-IEEE 2022
Country/TerritoryItaly
CityPadua
Period18/07/2223/07/22

Cite this