Design of the MUC-6 Evaluation

Abstract

The sixth in a series of "Message Understanding Conferences" which are designed to promote and evaluate research in information extraction, was held last fall. MUC-6 introduced several innovations over prior MUCs, most notably in the range of different tasks for which evaluations were conducted. We describe the development of the "message understanding" task over the course of the prior MUCs, some of the motivations for the new format, and the steps which led up to the formal evaluation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 1996
Accession Number
ADA631832

Entities

People

  • Beth Sundheim
  • Ralph David Grishman

Organizations

  • New York University

Tags

Communities of Interest

  • Biomedical
  • Engineered Resilient Systems
  • Human Systems

DTIC Thesaurus Topics

  • California
  • Computer Science
  • Databases
  • Electronic Circuits
  • Executives
  • Extraction
  • Governments
  • Information Science
  • Labor Unions
  • Language
  • National Governments
  • New Mexico
  • New York
  • Specifications
  • Standards
  • Test And Evaluation
  • United States

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Instructional Design and Training Evaluation.
  • Technical Research and Report Writing.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Information Retrieval