Tipster/MUC-5 Information Extraction System Evaluation

Abstract

This paper describes the Tipster/MUC-5 information extraction system evaluation. Three information extraction system evaluations using Tipster data were conducted in the context of Phase 1 of the Tipster Text program. Interim evaluations were conducted in September 1992, and February 1993; the final evaluation was conducted in July 1993. The final evaluation included not only the Tipster-supported information extraction contractors but thirteen other participants as well. This evaluation was the topic of the Fifth Message Understanding Conference (MUC-5) in August 1993. With particular respect to the research and development tasks of the Tipster contractors, the goal of these evaluations has been to assess success in terms of the development of systems to work in both English and Japanese (BBN, GE/CMU, and NMSU/Brandeis) and/or in both the joint ventures and microelectronics domains (BBN, GE/CMU, NMSU/ brandeis, and UMass/Hughes). Natural language processing, Test and evaluation, Text understanding.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 1993
Accession Number
ADA281138

Entities

People

  • Beth M. Sundheim

Organizations

  • Naval Command, Control and Ocean Surveillance Center

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Artificial Intelligence
  • Automated Speech Recognition
  • Contractors
  • Extraction
  • Language
  • Microelectronics
  • Motor Skills
  • Natural Language Processing
  • Natural Languages
  • Ocean Surveillance
  • Standards
  • Statistics
  • Terrorists
  • Test And Evaluation
  • Test Methods
  • Test Sets

Readers

  • Computational Linguistics
  • Technical Research and Report Writing.

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval
  • Microelectronics