Auditory neural correlates and neuroergonomics of driving assistance in a simulated virtual environment

Halim Baqapuri*, Erik Roecher, Jana Zweerings, Stefan Wolter, Eike A. Schmidt, Ruben C. Gur, Klaus Mathiak

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Objective. Driver assistance systems play an increasingly important role in modern vehicles. In the current level of technology, the driver must continuously supervise the driving and intervene whenever necessary when using driving assistance systems. The driver's attentiveness plays an important role in this human-machine interaction. Our aim was to design a simplistic technical framework for studying neural correlates of driving situations in a functional magnetic resonance imaging (fMRI) setting. In this work we assessed the feasibility of our proposed platform. Methods. We proposed a virtual environment (VE) simulation of driver assistance as a framework to investigate brain states related to partially automated driving. We focused on the processing of auditory signals during different driving scenarios as they have been shown to be advantageous as warning stimuli in driving situations. This provided the necessary groundwork to study brain auditory attentional networks under varying environmental demands in an fMRI setting. To this end, we conducted a study with 20 healthy participants to assess the feasibility of the VE simulation. Results. We demonstrated that the proposed VE can elicit driving related brain activation patterns. Relevant driving events evoked, in particular, responses in the bilateral auditory, sensory-motor, visual and insular cortices, which are related to perceptual and behavioral processes during driving assistance. Conceivably, attentional mechanisms increased somatosensory integration and reduced interoception, which are relevant for requesting interactions during partially automated driving. Significance. In modern vehicles, driver assistance technologies are playing an increasingly prevalent role. It is important to study the interaction between these systems and drivers' attentional responses to aid in future optimizations of the assistance systems. The proposed VE provides a foundational first step in this endeavor. Such simulated VEs provide a safe setting for experimentation with driving behaviors in a semi-naturalistic environment.
Original languageEnglish
Article number046023
Number of pages16
JournalJournal of neural engineering
Volume20
Issue number4
DOIs
Publication statusPublished - 1 Aug 2023

Keywords

  • virtual environment
  • fMRI
  • driving assistance
  • simulation
  • driver
  • auditory
  • BRAIN
  • HIPPOCAMPUS
  • ACTIVATION
  • ATTENTION
  • RESPONSES
  • TACTILE
  • SIGNALS
  • FMRI

Cite this