The COGs (context, object, and goals) in multisensory processing

Sanne ten Oever, Vincenzo Romei, Nienke van Atteveldt, Salvador Soto-Faraco, Micah M. Murray, Pawel J. Matusz*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Our understanding of how perception operates in real-world environments has been substantially advanced by studying both multisensory processes and "top-down" control processes influencing sensory processing via activity from higher-order brain areas, such as attention, memory, and expectations. As the two topics have been traditionally studied separately, the mechanisms orchestrating real-world multisensory processing remain unclear. Past work has revealed that the observer's goals gate the influence of many multisensory processes on brain and behavioural responses, whereas some other multisensory processes might occur independently of these goals. Consequently, other forms of top-down control beyond goal dependence are necessary to explain the full range of multisensory effects currently reported at the brain and the cognitive level. These forms of control include sensitivity to stimulus context as well as the detection of matches (or lack thereof) between a multisensory stimulus and categorical attributes of naturalistic objects (e.g. tools, animals). In this review we discuss and integrate the existing findings that demonstrate the importance of such goal-, object- and context-based top-down control over multisensory processing. We then put forward a few principles emerging from this literature review with respect to the mechanisms underlying multisensory processing and discuss their possible broader implications.
Original languageEnglish
Pages (from-to)1307-1323
Number of pages17
JournalExperimental Brain Research
Volume234
Issue number5
DOIs
Publication statusPublished - May 2016

Keywords

  • Attention
  • Multisensory
  • Control
  • Object
  • Top-down
  • Bottom-up
  • Audio-visual
  • Brain mapping

Cite this