What drives human behaviour-Multimodal eye fixation related brain state analysis for attention and emotion monitoring
Abstract
Over controlled laboratory scenarios ignore highly informative aspects of our natural interaction behaviour that are of great importance to make Brain Computer Interface, BCI technology useful for real world human technology interaction, HTI. We want to establish an alternative approach to real time neurophysiological signal analysis, that is to time lock these signals not to externally determined stimulus presentations but to the saccadic eye movements or fixation onsets in more naturalistic settings, yielding saccade or fixation related physiology, SRPs-FRPs for brain state classification of cognition and emotion. Recent research already showed success, e.g. during visual search for distinguishing targets from non targets using fixation onsets from extracted from eye tracking recordings in electroencephalography, EEG. With the project, we want to explore new fields of application with this co registration technique that is relevant for real time continuous monitoring of brain states during HTI. We argue that, especially when characterizing brain states that are related to emotion, including other physiological fixationrelated measures is crucial. With the proposed project, our aim is to track allocation of attentional resources, modality specific workload states and emotional processing, valencearousal during real world interactions using multimodal measures, exploiting context information as offered by relating signals to eye fixations.
Document Details
- Document Type
- DoD Grant Award
- Publication Date
- Jan 14, 2022
- Source ID
- FA95501917015
Entities
People
- Anne Marie Brouwer
Organizations
- Air Force Office of Scientific Research
- Netherlands Organisation for Applied Scientific Research
- United States Air Force