Exploiting sensing devices availability in AR/VR deployments to foster engagement

Nicholas Vretos, Petros Daras, Stylianos Asteriadis, Enrique Hortal, Esam Ghaleb, Evaggelos Spyrou, Helen C. Leligou, Panagiotis Karkazis, Panagiotis Trakadas*, Kostantinos Assimakopoulos

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

103 Downloads (Pure)


Currently, in all augmented reality (AR) or virtual reality (VR) educational experiences, the evolution of the experience (game, exercise or other) and the assessment of the user's performance are based on her/his (re)actions which are continuously traced/sensed. In this paper, we propose the exploitation of the sensors available in the AR/VR systems to enhance the current AR/VR experiences, taking into account the users' affect state that changes in real time. Adapting the difficulty level of the experience to the users' affect state fosters their engagement which is a crucial issue in educational environments and prevents boredom and anxiety. The users' cues are processed enabling dynamic user profiling. The detection of the affect state based on different sensing inputs, since diverse sensing devices exist in different AR/VR systems, is investigated, and techniques that have been undergone validation using state-of-the-art sensors are presented.

Original languageEnglish
Pages (from-to)399-410
Number of pages12
JournalVirtual Reality
Issue number4
Publication statusPublished - Dec 2019


  • Affect state detection
  • Engagement
  • Interpretation of interaction
  • Multimodal affect state detection

Cite this