Exploiting sensing devices availability in AR/VR deployments to foster engagement

Nicholas Vretos, Petros Daras, Stylianos Asteriadis, Enrique Hortal, Esam Ghaleb, Evaggelos Spyrou, Helen C. Leligou, Panagiotis Karkazis, Panagiotis Trakadas*, Kostantinos Assimakopoulos

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

2 Citations (Web of Science)
19 Downloads (Pure)

Abstract

Currently, in all augmented reality (AR) or virtual reality (VR) educational experiences, the evolution of the experience (game, exercise or other) and the assessment of the user's performance are based on her/his (re)actions which are continuously traced/sensed. In this paper, we propose the exploitation of the sensors available in the AR/VR systems to enhance the current AR/VR experiences, taking into account the users' affect state that changes in real time. Adapting the difficulty level of the experience to the users' affect state fosters their engagement which is a crucial issue in educational environments and prevents boredom and anxiety. The users' cues are processed enabling dynamic user profiling. The detection of the affect state based on different sensing inputs, since diverse sensing devices exist in different AR/VR systems, is investigated, and techniques that have been undergone validation using state-of-the-art sensors are presented.

Original languageEnglish
Pages (from-to)399-410
Number of pages12
JournalVirtual Reality
Volume23
Issue number4
DOIs
Publication statusPublished - Dec 2019

Keywords

  • Affect state detection
  • Engagement
  • Interpretation of interaction
  • Multimodal affect state detection
  • EMOTION RECOGNITION
  • FEATURES
  • SPEECH

Cite this