An Evaluation of Voice Stress Analysis Techniques in a Simulated AWACS Environment

Abstract

The purpose of this study was to determine if voice analysis algorithms are an effective measure of stress resulting from high workload. Fundamental frequency, frequency jitter, and amplitude shimmer algorithms were employed to measure the effects of stress in crewmember communications data in simulated AWACS mission scenarios. Two independent workload measures were used to identify levels of stress: (1) a predictor model developed by the simulation author based upon scenario generated stimulus events, and (2) the duration of communication for each weapons director, representative of the individual's response to the induced stress. Between eight and eleven speech samples were analyzed for each of the sixteen Air Force officers who participated in the study. Results identified fundamental frequency and frequency jitter as statistically significant vocal indicators of stress, while amplitude shimmer showed no signs of any significant relationship with workload or stress. Consistent with previous research, the frequency algorithm was identified as the most reliable measure. However, the results did not reveal a sensitive discrimination measure between levels of stress, but rather, did distinguish between the presence or absence of stress. The results illustrate a significant relationship between fundamental frequency and the effects of stress and also a significant inverse relationship with jitter, though less dramatic. Applied research in this area must investigate the predictive power, within subjects, of these measurement techniques. Thesis.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 1990
Accession Number
ADA228727

Entities

People

  • William A. Jones Jr

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Biomedical
  • Energy and Power Technologies
  • Human Systems
  • Space

DTIC Thesaurus Topics

  • Air Force
  • Airborne Warning And Control System
  • Algorithms
  • Data Reduction
  • Data Science
  • Databases
  • Environment
  • Frequency
  • Information Science
  • Measurement
  • Medical Personnel
  • Simulations
  • Situational Awareness
  • Speech Analysis
  • Stress Analysis
  • Test And Evaluation
  • Workload

Readers

  • Brain and Cognitive Science; Experimental Psychology; Cognitive Neuroscience
  • Mechanical Engineering/Mechanics of Materials.
  • Speech Processing/Speech Recognition.