Eye/Voice Mission Planning Interface (EVMPI).
Abstract
Pilots and other crew station operators need better ways of interacting with their systems, including more efficient human-machine dialog and better physical interface devices and interaction techniques. The goal of the Eye/Voice Mission Planning Interface (EVMPI) research is to integrate voice recognition and eye-tracking technology with aviation displays in order to reduce pilot cognitive and manual workload. The EVMPI technology allows an operator to gaze on user interface items of interest and issue verbal commands/queries that can be interpreted by the system, thus permitting hands-free operation of cockpit displays. This report describes the concept for the EVMPI, general principles for integrating eye and voice input, an EVMPI architecture, and the user interface implementation and evaluation of several aviation mission planning tasks. A primary benefit that arises from the integration of multiple input modalities to infer user intent is that robust performance can be obtained, even when the component technologies (eye and voice) are imperfect. This reduces the accuracy requirements on the individual technologies. GOMS models for eye/voice and conventional throttle/stick interaction protocols were developed for a select set of operator tasks. A preliminary comparison reveals that eye/voice interaction can significantly reduce the total number of operations that need to be performed in particular tasks. Additional empirical research is required to substantiate these findings and to generalize the results to broad classes of operator tasks.
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 01, 1995
- Accession Number
- ADA308044
Entities
People
- Eric A. Jenkins
- Franz Hatfield
- Michael W. Jennings