Computational Modeling of Multimodal I/O in Simulated Cockpits

Abstract

This report summarizes the results of a project on modeling the effects of localized 3-D sound to facilitate performance in a complex cockpit-like dual task. This task that had been previously observed to produce a significant automation deficit effect: when one of the tasks has to be resumed at short notice, the human operator takes some time to "catch up" and reach the normal steady-state level of performance in the task, apparently because it takes visual search and inspection to identify the proper object on the display to process. Providing a localized sound cue to identify the proper object alleviates the automation deficit effect to some extent. Constructing computational cognitive models that include representation of the perceptual-motor systems underlying performance showed that the benefit appears to be due to low-level orienting reflex eye movements rather than high-level strategic use of the sound information.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 30, 2001
Accession Number
ADA390675

Entities

People

  • David Kieras

Organizations

  • University of Michigan

Tags

Communities of Interest

  • Air Platforms
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Aircrafts
  • Artificial Intelligence
  • Automation
  • Cognition
  • Computational Modeling
  • Computer Science
  • Electrical Engineering
  • Engineering
  • Eye
  • Eye Movements
  • Human-Machine Systems
  • Mental Processes
  • Motor Skills
  • Psychology
  • Situational Awareness
  • Steady State
  • Task Performance And Analysis

Readers

  • Brain and Cognitive Science; Experimental Psychology; Cognitive Neuroscience
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.