Perception of Emotions in Human and Robot Faces: Is the Eye Region Enough?

Chinmaya Mishra, Gabriel Skantze, Peter Hagoort, Rinus Verdonschot

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingAcademicpeer-review

1 Downloads (Pure)

Abstract

The increased interest in developing next-gen social robots has raised questions about the factors affecting the perception of robot emotions. This study investigates the impact of robot appearances (human-like, mechanical) and face regions (full-face, eye-region) on human perception of robot emotions. A between-subjects user study (N = 305) was conducted where participants were asked to identify the emotions being displayed in videos of robot faces, as well as a human baseline. Our findings reveal three important insights for effective social robot face design in Human-Robot Interaction (HRI): Firstly, robots equipped with a back-projected, fully animated face – regardless of whether they are more human-like or more mechanical-looking – demonstrate a capacity for emotional expression comparable to that of humans. Secondly, the recognition accuracy of emotional expressions in both humans and robots declines when only the eye region is visible. Lastly, within the constraint of only the eye region being visible, robots with more human-like features significantly enhance emotion recognition.

Original languageEnglish
Title of host publicationSocial Robotics - 16th International Conference, ICSR + AI 2024, Proceedings
EditorsOskar Palinko, Leon Bodenhagen, John-John Cabibihan, Kerstin Fischer, Selma Šabanović, Katie Winkle, Laxmidhar Behera, Shuzhi Sam Ge, Dimitrios Chrysostomou, Wanyue Jiang, Hongsheng He
Chapter26
Pages290-303
Number of pages14
DOIs
Publication statusPublished - 25 Mar 2025
Event16th International Conference on Social Robotics +AI - Odense, Denmark
Duration: 23 Oct 202426 Oct 2024
https://icsr2024.dk/

Publication series

SeriesLecture Notes in Computer Science
Volume15561
ISSN0302-9743

Conference

Conference16th International Conference on Social Robotics +AI
Abbreviated titleICSR + AI 2024
Country/TerritoryDenmark
CityOdense
Period23/10/2426/10/24
Internet address

Fingerprint

Dive into the research topics of 'Perception of Emotions in Human and Robot Faces: Is the Eye Region Enough?'. Together they form a unique fingerprint.

Cite this