"Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech

E. Formisano*, F. de Martino, M. Bonte, R. Goebel

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

368 Citations (Web of Science)
106 Downloads (Pure)


Can we decipher speech content ("what" is being said) and speaker identity ("who" is saying it) from observations of brain activity of a listener? Here, we combine functional magnetic resonance imaging with a data- mining algorithm and retrieve what and whom a person is listening to from the neural fingerprints that speech and voice signals elicit in the listener's auditory cortex. These cortical fingerprints are spatially distributed and insensitive to acoustic variations of the input so as to permit the brain- based recognition of learned speech from unknown speakers and of learned voices from previously unheard utterances. Our findings unravel the detailed cortical layout and computational properties of the neural populations at the basis of human speech recognition and speaker identification.
Original languageEnglish
Pages (from-to)970-973
Issue number5903
Publication statusPublished - 1 Jan 2008

Cite this