BBN BYBLOS and HARC February 1992 ATIS Benchmark Results

Abstract

We present results from the February `92 evaluation on the ATIS travel planning domain for HARC, the BBN spoken language system (SLS). In addition, we discuss in detail the individual performance of BYBLOS, the speech recognition (SPREC) component. In the official Scoring, conducted by NIST, BBN's HARC system produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated. For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results were significantly better than any other speech system evaluated.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Feb 01, 1992
Accession Number
ADA460781

Entities

People

  • Chris Barry
  • David Stallard
  • Francis Kubala
  • John Makhoul
  • Long B. Nguyen
  • Madeleine Bates
  • Pascale Fung
  • Richard Schwartz
  • Robert Bobrow
  • Robert Ingria

Organizations

  • BBN Technologies

Tags

Communities of Interest

  • Cyber

DTIC Thesaurus Topics

  • Ambient Noise
  • Automated Speech Recognition
  • Boundaries
  • Detectors
  • False Alarms
  • Frequency
  • Grammars
  • Language
  • Natural Language Processing
  • Natural Language Understanding
  • Natural Languages
  • Noise
  • Recognition
  • Test And Evaluation
  • Test Sets
  • Training
  • Warning Systems

Readers

  • Speech Processing/Speech Recognition.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation