Sensorimotor Representation of Speech Perception. Cross-Decoding of Place of Articulation Features during Selective Attention to Syllables in 7T fMRI

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Sensorimotor integration, the translation between acoustic signals and motoric programs, may constitute a crucial mechanism for speech. During speech perception, the acoustic-motoric translations include the recruitment of cortical areas for the representation of speech articulatory features, such as place of articulation. Selective attention can shape the processing and performance of speech perception tasks. Whether and where sensorimotor integration takes place during attentive speech perception remains to be explored. Here, we investigate articulatory feature representations of spoken consonant-vowel (CV) syllables during two distinct tasks. Fourteen healthy humans attended to either the vowel or the consonant within a syllable in separate delayed-match-to-sample tasks. Single-trial fMRI blood oxygenation level-dependent (BOLD) responses from perception periods were analyzed using multivariate pattern classification and a searchlight approach to reveal neural activation patterns sensitive to the processing of place of articulation (i.e., bilabial/labiodental vs. alveolar). To isolate place of articulation representation from acoustic covariation, we applied a cross-decoding (generalization) procedure across distinct features of manner of articulation (i.e., stop, fricative, and nasal). We found evidence for the representation of place of articulation across tasks and in both tasks separately: for attention to vowels, generalization maps included bilateral clusters of superior and posterior temporal, insular, and frontal regions; for attention to consonants, generalization maps encompassed clusters in temporoparietal, insular, and frontal regions within the right hemisphere only. Our results specify the cortical representation of place of articulation features generalized across manner of articulation during attentive syllable perception, thus supporting sensorimotor integration during attentive speech perception and demonstrating the value of generalization.

Original languageEnglish
Article numbere0252-17.2018
Number of pages12
JournaleNeuro
Volume5
Issue number2
DOIs
Publication statusPublished - 22 Mar 2018

Keywords

  • Journal Article
  • SYSTEM
  • 7T fMRI
  • place of articulation
  • PHONOLOGICAL FEATURES
  • CLASSIFICATION
  • speech perception
  • selective attention
  • MVPA-based cross-decoding
  • ORGANIZATION
  • PATTERN
  • IMAGE-ANALYSIS
  • sensorimotor
  • PRIMARY AUDITORY-CORTEX
  • LANGUAGE COMPREHENSION
  • SEGMENTATION
  • OSCILLATIONS

Cite this

@article{81af50016ca1434588d86a7ece659abb,
title = "Sensorimotor Representation of Speech Perception. Cross-Decoding of Place of Articulation Features during Selective Attention to Syllables in 7T fMRI",
abstract = "Sensorimotor integration, the translation between acoustic signals and motoric programs, may constitute a crucial mechanism for speech. During speech perception, the acoustic-motoric translations include the recruitment of cortical areas for the representation of speech articulatory features, such as place of articulation. Selective attention can shape the processing and performance of speech perception tasks. Whether and where sensorimotor integration takes place during attentive speech perception remains to be explored. Here, we investigate articulatory feature representations of spoken consonant-vowel (CV) syllables during two distinct tasks. Fourteen healthy humans attended to either the vowel or the consonant within a syllable in separate delayed-match-to-sample tasks. Single-trial fMRI blood oxygenation level-dependent (BOLD) responses from perception periods were analyzed using multivariate pattern classification and a searchlight approach to reveal neural activation patterns sensitive to the processing of place of articulation (i.e., bilabial/labiodental vs. alveolar). To isolate place of articulation representation from acoustic covariation, we applied a cross-decoding (generalization) procedure across distinct features of manner of articulation (i.e., stop, fricative, and nasal). We found evidence for the representation of place of articulation across tasks and in both tasks separately: for attention to vowels, generalization maps included bilateral clusters of superior and posterior temporal, insular, and frontal regions; for attention to consonants, generalization maps encompassed clusters in temporoparietal, insular, and frontal regions within the right hemisphere only. Our results specify the cortical representation of place of articulation features generalized across manner of articulation during attentive syllable perception, thus supporting sensorimotor integration during attentive speech perception and demonstrating the value of generalization.",
keywords = "Journal Article, SYSTEM, 7T fMRI, place of articulation, PHONOLOGICAL FEATURES, CLASSIFICATION, speech perception, selective attention, MVPA-based cross-decoding, ORGANIZATION, PATTERN, IMAGE-ANALYSIS, sensorimotor, PRIMARY AUDITORY-CORTEX, LANGUAGE COMPREHENSION, SEGMENTATION, OSCILLATIONS",
author = "Archila-Mel{\'e}ndez, {Mario E.} and Giancarlo Valente and Correia, {Joao M.} and Rouhl, {Rob P. W.} and {van Kranen-Mastenbroek}, {Vivianne H.} and Jansma, {Bernadette M.}",
year = "2018",
month = "3",
day = "22",
doi = "10.1523/ENEURO.0252-17.2018",
language = "English",
volume = "5",
journal = "eNeuro",
issn = "2373-2822",
publisher = "Society for Neuroscience",
number = "2",

}

TY - JOUR

T1 - Sensorimotor Representation of Speech Perception. Cross-Decoding of Place of Articulation Features during Selective Attention to Syllables in 7T fMRI

AU - Archila-Meléndez, Mario E.

AU - Valente, Giancarlo

AU - Correia, Joao M.

AU - Rouhl, Rob P. W.

AU - van Kranen-Mastenbroek, Vivianne H.

AU - Jansma, Bernadette M.

PY - 2018/3/22

Y1 - 2018/3/22

N2 - Sensorimotor integration, the translation between acoustic signals and motoric programs, may constitute a crucial mechanism for speech. During speech perception, the acoustic-motoric translations include the recruitment of cortical areas for the representation of speech articulatory features, such as place of articulation. Selective attention can shape the processing and performance of speech perception tasks. Whether and where sensorimotor integration takes place during attentive speech perception remains to be explored. Here, we investigate articulatory feature representations of spoken consonant-vowel (CV) syllables during two distinct tasks. Fourteen healthy humans attended to either the vowel or the consonant within a syllable in separate delayed-match-to-sample tasks. Single-trial fMRI blood oxygenation level-dependent (BOLD) responses from perception periods were analyzed using multivariate pattern classification and a searchlight approach to reveal neural activation patterns sensitive to the processing of place of articulation (i.e., bilabial/labiodental vs. alveolar). To isolate place of articulation representation from acoustic covariation, we applied a cross-decoding (generalization) procedure across distinct features of manner of articulation (i.e., stop, fricative, and nasal). We found evidence for the representation of place of articulation across tasks and in both tasks separately: for attention to vowels, generalization maps included bilateral clusters of superior and posterior temporal, insular, and frontal regions; for attention to consonants, generalization maps encompassed clusters in temporoparietal, insular, and frontal regions within the right hemisphere only. Our results specify the cortical representation of place of articulation features generalized across manner of articulation during attentive syllable perception, thus supporting sensorimotor integration during attentive speech perception and demonstrating the value of generalization.

AB - Sensorimotor integration, the translation between acoustic signals and motoric programs, may constitute a crucial mechanism for speech. During speech perception, the acoustic-motoric translations include the recruitment of cortical areas for the representation of speech articulatory features, such as place of articulation. Selective attention can shape the processing and performance of speech perception tasks. Whether and where sensorimotor integration takes place during attentive speech perception remains to be explored. Here, we investigate articulatory feature representations of spoken consonant-vowel (CV) syllables during two distinct tasks. Fourteen healthy humans attended to either the vowel or the consonant within a syllable in separate delayed-match-to-sample tasks. Single-trial fMRI blood oxygenation level-dependent (BOLD) responses from perception periods were analyzed using multivariate pattern classification and a searchlight approach to reveal neural activation patterns sensitive to the processing of place of articulation (i.e., bilabial/labiodental vs. alveolar). To isolate place of articulation representation from acoustic covariation, we applied a cross-decoding (generalization) procedure across distinct features of manner of articulation (i.e., stop, fricative, and nasal). We found evidence for the representation of place of articulation across tasks and in both tasks separately: for attention to vowels, generalization maps included bilateral clusters of superior and posterior temporal, insular, and frontal regions; for attention to consonants, generalization maps encompassed clusters in temporoparietal, insular, and frontal regions within the right hemisphere only. Our results specify the cortical representation of place of articulation features generalized across manner of articulation during attentive syllable perception, thus supporting sensorimotor integration during attentive speech perception and demonstrating the value of generalization.

KW - Journal Article

KW - SYSTEM

KW - 7T fMRI

KW - place of articulation

KW - PHONOLOGICAL FEATURES

KW - CLASSIFICATION

KW - speech perception

KW - selective attention

KW - MVPA-based cross-decoding

KW - ORGANIZATION

KW - PATTERN

KW - IMAGE-ANALYSIS

KW - sensorimotor

KW - PRIMARY AUDITORY-CORTEX

KW - LANGUAGE COMPREHENSION

KW - SEGMENTATION

KW - OSCILLATIONS

U2 - 10.1523/ENEURO.0252-17.2018

DO - 10.1523/ENEURO.0252-17.2018

M3 - Article

C2 - 29610768

VL - 5

JO - eNeuro

JF - eNeuro

SN - 2373-2822

IS - 2

M1 - e0252-17.2018

ER -