Fusing visual and behavioral cues for modeling user experience in games

Noor Shaker, Stylianos Asteriadis, Georgios N. Yannakakis, Kostas Karpouzis

Research output: Contribution to journalArticleAcademicpeer-review

15 Citations (Scopus)

Abstract

Estimating affective and cognitive states in conditions of rich human-computer interaction, such as in games, is a field of growing academic and commercial interest. Entertainment and serious games can benefit from recent advances in the field as, having access to predictors of the current state of the player (or learner) can provide useful information for feeding adaptation mechanisms that aim to maximize engagement or learning effects. In this paper, we introduce a large data corpus derived from 58 participants that play the popular Super Mario Bros platform game and attempt to create accurate models of player experience for this game genre. Within the view of the current research, features extracted both from player gameplay behavior and game levels, and player visual characteristics have been used as potential indicators of reported affect expressed as pairwise preferences between different game sessions. Using neuroevolutionary preference learning and automatic feature selection, highly accurate models of reported engagement, frustration, and challenge are constructed (model accuracies reach 91%, 92%, and 88% for engagement, frustration, and challenge, respectively). As a step further, the derived player experience models can be used to personalize the game level to desired levels of engagement, frustration, and challenge as game content is mapped to player experience through the behavioral and expressivity patterns of each player.
Original languageEnglish
Pages (from-to)1519-1531
Number of pages13
JournalIEEE Transactions on Cybernetics
Volume43
Issue number2
DOIs
Publication statusPublished - Dec 2013
Externally publishedYes

Keywords

  • Content personalization
  • Experience-driven procedural content generation
  • Multimodal interaction
  • Player experience modeling
  • Visual cues

Cite this