Interleaved lexical and audiovisual information can retune phoneme boundaries

Shruti Ullas*, Elia Formisano, Frank Eisner, Anne Cutler

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

33 Downloads (Pure)

Abstract

To adapt to situations in which speech perception is difficult, listeners can adjust boundaries between phoneme categories using perceptual learning. Such adjustments can draw on lexical information in surrounding speech, or on visual cues via speech-reading. In the present study, listeners proved they were able to flexibly adjust the boundary between two plosive/stop consonants, /p/-/t/, using both lexical and speech-reading information and given the same experimental design for both cue types. Videos of a speaker pronouncing pseudo-words and audio recordings of Dutch words were presented in alternating blocks of either stimulus type. Listeners were able to switch between cues to adjust phoneme boundaries, and resulting effects were comparable to results from listeners receiving only a single source of information. Overall, audiovisual cues (i.e., the videos) produced the stronger effects, commensurate with their applicability for adapting to noisy environments. Lexical cues were able to induce effects with fewer exposure stimuli and a changing phoneme bias, in a design unlike most prior studies of lexical retuning. While lexical retuning effects were relatively weaker compared to audiovisual recalibration, this discrepancy could reflect how lexical retuning may be more suitable for adapting to speakers than to environments. Nonetheless, the presence of the lexical retuning effects suggests that it may be invoked at a faster rate than previously seen. In general, this technique has further illuminated the robustness of adaptability in speech perception, and offers the potential to enable further comparisons across differing forms of perceptual learning.
Original languageEnglish
Pages (from-to)2018-2026
Number of pages9
JournalAttention Perception & Psychophysics
Volume82
Issue number4
Early online date22 Jan 2020
DOIs
Publication statusPublished - May 2020

Keywords

  • Phoneme boundary
  • Recalibration
  • Perceptual retuning
  • Lexical
  • Audiovisual
  • SELECTIVE ADAPTATION
  • SPEECH-PERCEPTION
  • LIPREAD SPEECH
  • VISUAL RECALIBRATION
  • AUDITORY SPEECH
  • CATEGORIZATION

Cite this