Abstract
Most e-learning environments which utilize user feedback or profiles, collect such information based on questionnaires, resulting very often in incomplete answers, and sometimes deliberate misleading input. In this work, we present a mechanism which compiles feedback related to the behavioral state of the user (e.g. level of interest) in the context of reading an electronic document; this is achieved using a non-intrusive scheme, which uses a simple web camera to detect and track the head, eye and hand movements and provides an estimation of the level of interest and engagement with the use of a neuro-fuzzy network initialized from evidence from the idea of Theory of Mind and trained from expert- annotated data. The user does not need to interact with the proposed system, and can act as if she was not monitored at all. The proposed scheme is tested in an e-learning environment, in order to adapt the presentation of the content to the user profile and current behavioral state. Experiments show that the proposed system detects reading- and attention-related user states very effectively, in a testbed where children’s reading performance is tracked
Original language | English |
---|---|
Pages (from-to) | 469-493 |
Number of pages | 25 |
Journal | Multimedia Tools and Applications |
Volume | 41 |
Issue number | 3 |
DOIs | |
Publication status | Published - Feb 2009 |
Externally published | Yes |
Keywords
- Eye gaze
- Facial feature detection and tracking
- Head pose
- User attention estimation