A Three-Tiered Evaluation Approach for Interactive Spoken Dialogue Systems

Abstract

We describe a three-tiered approach for evaluation of spoken dialogue systems. The three tiers measure user satisfaction, system support of mission success and component performance. We describe our use of this approach in numerous fielded user studies conducted with the U.S. military.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2001
Accession Number
ADA460931

Entities

People

  • James Denny
  • Kathleen Stibler

Organizations

  • Lockheed Martin

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Active Duty
  • Automated Speech Recognition
  • Computer Languages
  • Consistency
  • Dialogue Systems
  • Efficiency
  • Errors
  • Factor Analysis
  • Formal Languages
  • Language
  • Measurement
  • Military Operations
  • Natural Language Processing
  • Natural Languages
  • Test And Evaluation

Fields of Study

  • Computer science

Readers

  • Instructional Design and Training Evaluation.
  • Speech Processing/Speech Recognition.
  • Systems Analysis and Design