Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception

Emmanuel Biau*, Benjamin G. Schultz, Thomas C. Gunter, Sonja A. Kotz

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

During multisensory speech perception, slow d oscillations (;1–3 Hz) in the listener’s brain synchronize with the speech signal, likely engaging in speech signal decomposition. Notable fluctuations in the speech amplitude envelope, resounding speaker prosody, temporally align with articulatory and body gestures and both provide complementary sensations that temporally structure speech. Further, d oscillations in the left motor cortex seem to align with speech and musical beats, suggesting their possible role in the temporal structuring of (quasi)-rhythmic stimulation. We extended the role of d oscillations to audiovisual asynchrony detection as a test case of the temporal analysis of multisensory prosody fluctuations in speech. We recorded Electroencephalograph (EEG) responses in an audiovisual asynchrony detection task while participants watched videos of a speaker. We filtered the speech signal to remove verbal content and examined how visual and auditory prosodic features temporally (mis-)align. Results confirm (1) that participants accurately detected audiovisual asynchrony, and (2) increased d power in the left motor cortex in response to audiovisual asynchrony. The difference of d power between asynchronous and synchronous conditions predicted behavioral performance, and (3) decreased d-b coupling in the left motor cortex when listeners could not accurately map visual and auditory prosodies. Finally, both behavioral and neurophysiological evidence was altered when a speaker’s face was degraded by a visual mask. Together, these findings suggest that motor d oscillations support asynchrony detection of multisensory prosodic fluctuation in speech.

Original languageEnglish
Pages (from-to)2313-2326
Number of pages14
JournalJournal of Neuroscience
Volume42
Issue number11
Early online date27 Jan 2022
DOIs
Publication statusPublished - 16 Mar 2022

Keywords

  • ACTIVATION
  • AUDITORY SPEECH
  • CORTICAL OSCILLATIONS
  • GESTURES
  • INTEGRATION
  • NEURONAL OSCILLATIONS
  • PHASE ENTRAINMENT
  • TEMPORAL CORTEX
  • THETA OSCILLATIONS
  • VISUAL PROSODY
  • audio-visual asynchrony
  • delta oscillations
  • motor cortex
  • multisensory speech
  • prosody

Fingerprint

Dive into the research topics of 'Left Motor δ Oscillations Reflect Asynchrony Detection in Multisensory Speech Perception'. Together they form a unique fingerprint.

Cite this