Envelope Responses in Single-Trial EEG Indicate Attended Speaker in a "Cocktail Party"

Abstract

Recent studies have shown that neural activity in auditory cortex encodes the envelope of speech, and that this encoding is more robust for attended speech than for unattended speech during multi-speaker ("cocktail party") situations. To determine if this effect could form the basis for a novel brain-computer interface (BCI), we investigated the accuracy with which a subject's locus of attention during a "cocktail party" task could be ascertained from envelope responses present within single trials of EEG. We found that the attended speaker can be determined reliably from short periods of EEG, with accuracy improving as a function of trial length. Furthermore, we compared the performance of this envelope-based attention classifier to others based on changes in steady-state responses (elicited via 40 and 41 Hz amplitude modulations of the speech) and hemispheric lateralization of alpha power. We found that the neural responses to the speech envelopes were far more robust indicators of attention than the others. These results suggest that envelope-related signals recorded in EEG data can be used to form robust auditory BCI's that do not require artificial manipulation (e.g., amplitude modulation) of stimuli in order to function.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 20, 2013
Accession Number
ADA589014

Entities

People

  • Cort Horton
  • Michael D'zmura
  • Ramesh Srinivasan

Organizations

  • University of California, Irvine

Tags

Communities of Interest

  • Biomedical

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Amplitude
  • Amplitude Modulation
  • Behavioral Sciences
  • Brain-Computer Interfaces
  • Cognitive Science
  • Computers
  • Cross Correlation
  • Data Science
  • Frequency
  • Information Science
  • Information Transfer
  • Machine Learning
  • Modulation
  • Steady State
  • Training

Fields of Study

  • Biology
  • Psychology

Readers

  • Brain and Cognitive Science; Experimental Psychology; Cognitive Neuroscience
  • Speech Processing/Speech Recognition.