Encoding of natural timbre dimensions in human auditory cortex

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Timbre, or sound quality, is a crucial but poorly understood dimension of auditory perception that is important in describing speech, music, and environmental sounds. The present study investigates the cortical representation of different timbral dimensions. Encoding models have typically incorporated the physical characteristics of sounds as features when attempting to understand their neural representation with functional MRI. Here we test an encoding model that is based on five subjectively derived dimensions of timbre to predict cortical responses to natural orchestral sounds. Results show that this timbre model can outperform other models based on spectral characteristics, and can perform as well as a complex joint spectrotemporal modulation model. In cortical regions at the medial border of Heschl's gyrus, bilaterally, and regions at its posterior adjacency in the right hemisphere, the timbre model outperforms even the complex joint spectrotemporal modulation model. These findings suggest that the responses of cortical neuronal populations in auditory cortex may reflect the encoding of perceptual timbre dimensions.

Original languageEnglish
Pages (from-to)60-70
Number of pages11
JournalNeuroimage
Volume166
DOIs
Publication statusPublished - 1 Feb 2018

Keywords

  • Auditory cortex
  • Encoding models
  • Music
  • Perception
  • Timbre
  • HUMAN BRAIN ACTIVITY
  • SOUNDS
  • PITCH
  • REPRESENTATION
  • SENSITIVITY
  • TONOTOPY
  • IMAGES
  • TONES
  • Auditory Perception/physiology
  • Humans
  • Male
  • Young Adult
  • Magnetic Resonance Imaging
  • Auditory Cortex/diagnostic imaging
  • Adult
  • Female
  • Functional Neuroimaging/methods

Cite this

@article{1d16e8e6ea624e3aa44dda7ed740c26d,
title = "Encoding of natural timbre dimensions in human auditory cortex",
abstract = "Timbre, or sound quality, is a crucial but poorly understood dimension of auditory perception that is important in describing speech, music, and environmental sounds. The present study investigates the cortical representation of different timbral dimensions. Encoding models have typically incorporated the physical characteristics of sounds as features when attempting to understand their neural representation with functional MRI. Here we test an encoding model that is based on five subjectively derived dimensions of timbre to predict cortical responses to natural orchestral sounds. Results show that this timbre model can outperform other models based on spectral characteristics, and can perform as well as a complex joint spectrotemporal modulation model. In cortical regions at the medial border of Heschl's gyrus, bilaterally, and regions at its posterior adjacency in the right hemisphere, the timbre model outperforms even the complex joint spectrotemporal modulation model. These findings suggest that the responses of cortical neuronal populations in auditory cortex may reflect the encoding of perceptual timbre dimensions.",
keywords = "Auditory cortex, Encoding models, Music, Perception, Timbre, HUMAN BRAIN ACTIVITY, SOUNDS, PITCH, REPRESENTATION, SENSITIVITY, TONOTOPY, IMAGES, TONES, Auditory Perception/physiology, Humans, Male, Young Adult, Magnetic Resonance Imaging, Auditory Cortex/diagnostic imaging, Adult, Female, Functional Neuroimaging/methods",
author = "Allen, {Emily J} and Michelle Moerel and Agust{\'i}n Lage-Castellanos and {De Martino}, Federico and Elia Formisano and Oxenham, {Andrew J}",
note = "Copyright {\circledC} 2017. Published by Elsevier Inc.",
year = "2018",
month = "2",
day = "1",
doi = "10.1016/j.neuroimage.2017.10.050",
language = "English",
volume = "166",
pages = "60--70",
journal = "Neuroimage",
issn = "1053-8119",
publisher = "Elsevier Science",

}

Encoding of natural timbre dimensions in human auditory cortex. / Allen, Emily J; Moerel, Michelle; Lage-Castellanos, Agustín; De Martino, Federico; Formisano, Elia; Oxenham, Andrew J.

In: Neuroimage, Vol. 166, 01.02.2018, p. 60-70.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Encoding of natural timbre dimensions in human auditory cortex

AU - Allen, Emily J

AU - Moerel, Michelle

AU - Lage-Castellanos, Agustín

AU - De Martino, Federico

AU - Formisano, Elia

AU - Oxenham, Andrew J

N1 - Copyright © 2017. Published by Elsevier Inc.

PY - 2018/2/1

Y1 - 2018/2/1

N2 - Timbre, or sound quality, is a crucial but poorly understood dimension of auditory perception that is important in describing speech, music, and environmental sounds. The present study investigates the cortical representation of different timbral dimensions. Encoding models have typically incorporated the physical characteristics of sounds as features when attempting to understand their neural representation with functional MRI. Here we test an encoding model that is based on five subjectively derived dimensions of timbre to predict cortical responses to natural orchestral sounds. Results show that this timbre model can outperform other models based on spectral characteristics, and can perform as well as a complex joint spectrotemporal modulation model. In cortical regions at the medial border of Heschl's gyrus, bilaterally, and regions at its posterior adjacency in the right hemisphere, the timbre model outperforms even the complex joint spectrotemporal modulation model. These findings suggest that the responses of cortical neuronal populations in auditory cortex may reflect the encoding of perceptual timbre dimensions.

AB - Timbre, or sound quality, is a crucial but poorly understood dimension of auditory perception that is important in describing speech, music, and environmental sounds. The present study investigates the cortical representation of different timbral dimensions. Encoding models have typically incorporated the physical characteristics of sounds as features when attempting to understand their neural representation with functional MRI. Here we test an encoding model that is based on five subjectively derived dimensions of timbre to predict cortical responses to natural orchestral sounds. Results show that this timbre model can outperform other models based on spectral characteristics, and can perform as well as a complex joint spectrotemporal modulation model. In cortical regions at the medial border of Heschl's gyrus, bilaterally, and regions at its posterior adjacency in the right hemisphere, the timbre model outperforms even the complex joint spectrotemporal modulation model. These findings suggest that the responses of cortical neuronal populations in auditory cortex may reflect the encoding of perceptual timbre dimensions.

KW - Auditory cortex

KW - Encoding models

KW - Music

KW - Perception

KW - Timbre

KW - HUMAN BRAIN ACTIVITY

KW - SOUNDS

KW - PITCH

KW - REPRESENTATION

KW - SENSITIVITY

KW - TONOTOPY

KW - IMAGES

KW - TONES

KW - Auditory Perception/physiology

KW - Humans

KW - Male

KW - Young Adult

KW - Magnetic Resonance Imaging

KW - Auditory Cortex/diagnostic imaging

KW - Adult

KW - Female

KW - Functional Neuroimaging/methods

U2 - 10.1016/j.neuroimage.2017.10.050

DO - 10.1016/j.neuroimage.2017.10.050

M3 - Article

C2 - 29080711

VL - 166

SP - 60

EP - 70

JO - Neuroimage

JF - Neuroimage

SN - 1053-8119

ER -