A real-time fMRI-based spelling device immediately enabling robust motor-independent communication

Research output: Contribution to journalArticleAcademicpeer-review

42 Citations (Scopus)

Abstract

Human communication entirely depends on the functional integrity of the neuromuscular system. This is devastatingly illustrated in clinical conditions such as the so-called locked-in syndrome (LIS), in which severely motor-disabled patients become incapable to communicate naturally--while being fully conscious and awake. For the last 20 years, research on motor-independent communication has focused on developing brain-computer interfaces (BCIs) implementing neuroelectric signals for communication (e.g., [2-7]), and BCIs based on electroencephalography (EEG) have already been applied successfully to concerned patients. However, not all patients achieve proficiency in EEG-based BCI control. Thus, more recently, hemodynamic brain signals have also been explored for BCI purposes. Here, we introduce the first spelling device based on fMRI. By exploiting spatiotemporal characteristics of hemodynamic responses, evoked by performing differently timed mental imagery tasks, our novel letter encoding technique allows translating any freely chosen answer (letter-by-letter) into reliable and differentiable single-trial fMRI signals. Most importantly, automated letter decoding in real time enables back-and-forth communication within a single scanning session. Because the suggested spelling device requires only little effort and pretraining, it is immediately operational and possesses high potential for clinical applications, both in terms of diagnostics and establishing short-term communication with nonresponsive and severely motor-impaired patients.
Original languageEnglish
Pages (from-to)1333-1338
Number of pages6
JournalCurrent Biology
Volume22
Issue number14
DOIs
Publication statusPublished - 24 Jul 2012

Keywords

  • BCI
  • BRAIN-COMPUTER INTERFACE
  • CORTEX
  • DETECTING AWARENESS
  • IMAGERY
  • SELF-REGULATION
  • SIGNALS
  • TOP

Cite this

@article{3cb788ae3a29487b8e93fc5b3451d8d8,
title = "A real-time fMRI-based spelling device immediately enabling robust motor-independent communication",
abstract = "Human communication entirely depends on the functional integrity of the neuromuscular system. This is devastatingly illustrated in clinical conditions such as the so-called locked-in syndrome (LIS), in which severely motor-disabled patients become incapable to communicate naturally--while being fully conscious and awake. For the last 20 years, research on motor-independent communication has focused on developing brain-computer interfaces (BCIs) implementing neuroelectric signals for communication (e.g., [2-7]), and BCIs based on electroencephalography (EEG) have already been applied successfully to concerned patients. However, not all patients achieve proficiency in EEG-based BCI control. Thus, more recently, hemodynamic brain signals have also been explored for BCI purposes. Here, we introduce the first spelling device based on fMRI. By exploiting spatiotemporal characteristics of hemodynamic responses, evoked by performing differently timed mental imagery tasks, our novel letter encoding technique allows translating any freely chosen answer (letter-by-letter) into reliable and differentiable single-trial fMRI signals. Most importantly, automated letter decoding in real time enables back-and-forth communication within a single scanning session. Because the suggested spelling device requires only little effort and pretraining, it is immediately operational and possesses high potential for clinical applications, both in terms of diagnostics and establishing short-term communication with nonresponsive and severely motor-impaired patients.",
keywords = "BCI, BRAIN-COMPUTER INTERFACE, CORTEX, DETECTING AWARENESS, IMAGERY, SELF-REGULATION, SIGNALS, TOP",
author = "B. Sorger and J. Reithler and B. Dahmen and R. Goebel",
year = "2012",
month = "7",
day = "24",
doi = "10.1016/j.cub.2012.05.022",
language = "English",
volume = "22",
pages = "1333--1338",
journal = "Current Biology",
issn = "0960-9822",
publisher = "Cell Press",
number = "14",

}

A real-time fMRI-based spelling device immediately enabling robust motor-independent communication. / Sorger, B.; Reithler, J.; Dahmen, B.; Goebel, R.

In: Current Biology, Vol. 22, No. 14, 24.07.2012, p. 1333-1338.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - A real-time fMRI-based spelling device immediately enabling robust motor-independent communication

AU - Sorger, B.

AU - Reithler, J.

AU - Dahmen, B.

AU - Goebel, R.

PY - 2012/7/24

Y1 - 2012/7/24

N2 - Human communication entirely depends on the functional integrity of the neuromuscular system. This is devastatingly illustrated in clinical conditions such as the so-called locked-in syndrome (LIS), in which severely motor-disabled patients become incapable to communicate naturally--while being fully conscious and awake. For the last 20 years, research on motor-independent communication has focused on developing brain-computer interfaces (BCIs) implementing neuroelectric signals for communication (e.g., [2-7]), and BCIs based on electroencephalography (EEG) have already been applied successfully to concerned patients. However, not all patients achieve proficiency in EEG-based BCI control. Thus, more recently, hemodynamic brain signals have also been explored for BCI purposes. Here, we introduce the first spelling device based on fMRI. By exploiting spatiotemporal characteristics of hemodynamic responses, evoked by performing differently timed mental imagery tasks, our novel letter encoding technique allows translating any freely chosen answer (letter-by-letter) into reliable and differentiable single-trial fMRI signals. Most importantly, automated letter decoding in real time enables back-and-forth communication within a single scanning session. Because the suggested spelling device requires only little effort and pretraining, it is immediately operational and possesses high potential for clinical applications, both in terms of diagnostics and establishing short-term communication with nonresponsive and severely motor-impaired patients.

AB - Human communication entirely depends on the functional integrity of the neuromuscular system. This is devastatingly illustrated in clinical conditions such as the so-called locked-in syndrome (LIS), in which severely motor-disabled patients become incapable to communicate naturally--while being fully conscious and awake. For the last 20 years, research on motor-independent communication has focused on developing brain-computer interfaces (BCIs) implementing neuroelectric signals for communication (e.g., [2-7]), and BCIs based on electroencephalography (EEG) have already been applied successfully to concerned patients. However, not all patients achieve proficiency in EEG-based BCI control. Thus, more recently, hemodynamic brain signals have also been explored for BCI purposes. Here, we introduce the first spelling device based on fMRI. By exploiting spatiotemporal characteristics of hemodynamic responses, evoked by performing differently timed mental imagery tasks, our novel letter encoding technique allows translating any freely chosen answer (letter-by-letter) into reliable and differentiable single-trial fMRI signals. Most importantly, automated letter decoding in real time enables back-and-forth communication within a single scanning session. Because the suggested spelling device requires only little effort and pretraining, it is immediately operational and possesses high potential for clinical applications, both in terms of diagnostics and establishing short-term communication with nonresponsive and severely motor-impaired patients.

KW - BCI

KW - BRAIN-COMPUTER INTERFACE

KW - CORTEX

KW - DETECTING AWARENESS

KW - IMAGERY

KW - SELF-REGULATION

KW - SIGNALS

KW - TOP

U2 - 10.1016/j.cub.2012.05.022

DO - 10.1016/j.cub.2012.05.022

M3 - Article

VL - 22

SP - 1333

EP - 1338

JO - Current Biology

JF - Current Biology

SN - 0960-9822

IS - 14

ER -