Breaking down the barriers to operator workload estimation: Advancing algorithmic handling of temporal non stationarity and cross participant differences for EEG analysis using deep learning

Abstract

This research focuses on two barriers to using EEG data for workload assessment: day-to-day variability, and cross-participant applicability. Several signal processing techniques and deep learning approaches are evaluated in multi-task environments. These methods account for temporal, spatial, and frequential data dependencies. Variance of frequency-domain power distributions for cross-day workload classification is statistically significant. Scenes and kurtosis are not significant in an environment absent workload transitions, but are salient with transitions present. LSTMs improve day-to-day feature stationarity, decreasing error by 59% compared to previous best results. A multi-path convolutional recurrent model using bi-directional, residual recurrent layers significantly increases predictive accuracy and decreases cross-participant variance. Deep learning regression approaches are applied to a multi-task environment with workload transitions. Accounting for temporal dependence significantly reduces error and increases correlation compared to baselines. Visualization techniques for LSTM feature saliency are developed to understand EEG analysis model biases.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 13, 2018
Accession Number
AD1063357

Entities

People

  • Ryan G. Hefron

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Autonomy
  • Electronic Warfare
  • Energy and Power Technologies
  • Engineered Resilient Systems
  • Human Systems

DTIC Thesaurus Topics

  • Aircrafts
  • Artificial Intelligence Software
  • Automata Theory
  • Bayesian Networks
  • Cognitive Science
  • Cognitive Workload
  • Computational Science
  • Computer Languages
  • Dimensionality Reduction
  • Human Factors Engineering
  • Information Processing
  • Information Science
  • Information Systems
  • Network Science
  • Neural Networks
  • Probabilistic Models
  • Supervised Machine Learning

Fields of Study

  • Computer science

Readers

  • Image Processing and Computer Vision.
  • Neural Network Machine Learning.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Neural Networks