Assessment of facial expressions in product appreciation

M. C. Popa*, L. J. M. Rothkrantz, P. Wiggers, C. Shan

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

In the marketing area, new trends are emerging, as customers are not only interested in the quality of the products or delivered services, but also in a stimulating shopping experience. Creating and influencing customers' experiences has become a valuable differentiation strategy for retailers. Therefore, understanding and assessing the customers' emotional response in relation to products/services represents an important asset. The purpose of this paper consists of investigating whether the customer's facial expressions shown during product appreciation are positive or negative and also which types of emotions are related to product appreciation. We collected a database of emotional facial expressions, by presenting a set of forty product related pictures to a number of test subjects. Next, we analysed the obtained facial expressions, by extracting both geometric and appearance features. Furthermore, we modeled them both in an unsupervised and supervised manner. Clustering techniques proved to be efficient at differentiating between positive and negative facial expressions in 78% of the cases. Next, we performed more refined analysis of the different types of emotions, by employing different classification methods and we achieved 84% accuracy for seven emotional classes and 95% for the positive vs. negative.

Original languageEnglish
Pages (from-to)197-213
Number of pages17
JournalNeural Network World
Volume27
Issue number2
DOIs
Publication statusPublished - 2017

Keywords

  • product emotions
  • facial expression analysis
  • geometric features
  • appearance features
  • unsupervised learning
  • supervised learning
  • RECOGNITION

Cite this