Error Awareness and Recovery in Conversational Spoken Language Interfaces

Abstract

One of the most important and persistent problems in the development of conversational spoken language interfaces is their lack of robustness when confronted with understanding-errors. Most of these errors stem from limitations in current speech recognition technology, and, as a result, appear across all domains and interaction types. There are two approaches towards increased robustness: prevent the errors from happening, or recover from them through conversation, by interacting with the users. In this dissertation we have engaged in a research program centered on the second approach. We argue that three capabilities are needed in order to seamlessly and efficiently recover from errors: (1) systems must be able to detect the errors, preferably as soon as they happen, (2) systems must be equipped with a rich repertoire of error recovery strategies that can be used to set the conversation back on track, and (3) systems must know how to choose optimally between different recovery strategies at run-time, i.e. they must have good error recovery policies. This work makes a number of contributions in each of these areas.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 2007
Accession Number
ADA476845

Entities

People

  • Dan Bohus

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Artificial Intelligence Software
  • Automata Theory
  • Automated Speech Recognition
  • Bayesian Networks
  • Computational Science
  • Computer Languages
  • Computer Programming
  • Computers
  • Data Mining
  • Human Systems Integration
  • Information Science
  • Information Systems
  • Language
  • Machine Learning
  • Network Science
  • Supervised Machine Learning
  • Three Dimensional

Fields of Study

  • Computer science

Readers

  • Approximation Theory.
  • Database Systems and Applications
  • Speech Processing/Speech Recognition.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Machine Translation