A Proposal for Incremental Dialogue Evaluation

Abstract

The SLs community has made progress recently toward evaluating SLs systems that deal with dialogu, but there is still considerable work that needs to be done in this area. Our goal is to develop incremental ways to evaluate dialogue processing, not just going from Class Dl (dialogue pairs) to Class D2 (dialogue triples), but measuring aspects of dialogue processing other than length. We present two suggestions; one for extending the common evaluation procedures for dialogues. and one for modifying the scoring metric.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1991
Accession Number
ADA457492

Entities

People

  • Damaris Ayuso
  • Madeleine Bates

Organizations

  • BBN Technologies

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Communities
  • Computers
  • Dialogue Systems
  • Information Operations
  • Language
  • Military Research
  • Natural Languages
  • Standards
  • Test And Evaluation
  • Test Sets
  • Thinking
  • Training
  • United States
  • Workshops

Readers

  • Computational Linguistics
  • Systems Analysis and Design