IBM's PIQUANT in TREC2003

Abstract

For the most part, the system we used for TREC2003 was a smooth evolution of the one we ran in TREC2002. We continued to use our multi-source and multi-agent architecture. For Factoid questions we used all of our previous answering agents with an additional pattern-based agent, an enhanced answer resolution algorithm, and increased coverage of the Cyc sanity checker. We will devote a portion of this paper to performing a post-mortem of our experiences with Cyc this year. For List questions, which we did not attempt previously, we ran our Factoid system with different parameters. For Definition questions we took an entirely new approach, which we call QA-by-Dossier, and which will be the other focus of this paper. While we think that our system performed reasonably well in this subtask, the NIST evaluation results do not reflect this, raising some questions about the Definition subtask specification and evaluation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2003
Accession Number
ADA456325

Entities

People

  • Abraham Ittycheriah
  • Christopher Welty
  • Jennifer Chu-carroll
  • John Prager
  • Krzysztof Czuba
  • Ruchi Mahindru

Organizations

  • IBM Thomas J. Watson Research Center

Tags

Communities of Interest

  • Weapons Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Algorithms
  • Classification
  • Education
  • Everglades
  • Failure Analysis
  • Florida
  • Geography
  • Information Operations
  • Language
  • Life Cycles
  • Named Entity Recognition
  • Natural Language Processing
  • Precision
  • Reasoning
  • Test And Evaluation
  • Training

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Database Systems and Applications
  • Systems Analysis and Design