TIPSTER Information Extraction Evaluation: The MUC-7 Workshop

Abstract

The last of the "Message Understanding Conferences", which were designed to evaluate text extraction systems, was held in April 1998 in Fairfax, Virginia. The workshop was co-chaired by Elaine Marsh and Ralph Grishman. A group of 18 organizations, both from the United States and abroad, participated in the evaluation. MUC-7 introduced a wider set of tasks with larger sets of training and formal data than previous MUCs. Results showed that while performance on the named entity and template elements task remains relatively high, additional research is still necessary for improved performance on more difficult tasks such as coreference resolution and domain-specific template generation from textual sources.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Oct 01, 1998
Accession Number
ADA631147

Entities

People

  • Elaine Marsh

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Air Platforms

DTIC Thesaurus Topics

  • Adaptive Systems
  • Artificial Intelligence
  • Aviation Accidents
  • Data Sets
  • Extraction
  • Information Operations
  • Japanese Language
  • Language
  • Military Research
  • New York
  • Recognition
  • Template Patterns
  • Test And Evaluation
  • Test Sets
  • Training
  • United States
  • Workshops

Readers

  • Computational Linguistics
  • Instructional Design and Training Evaluation.
  • STEM Education

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval
  • AI & ML - Neural Networks