H5 at TREC 2008 Legal Interactive: User Modeling, Assessment & Measurement

Abstract

Treating the information retrieval task as one of classification has been shown to be the most effective way to achieve high performance on a particular task. In this paper, we describe a hybrid human-computer system that addresses the problem of achieving high performance on IR tasks by systematically and replicably creating large numbers of document assessments. We demonstrate how User Modeling, Document Assessment and Measurement combine to provide a shared understanding of relevance, a means for representing that understanding to an automated system, and a mechanism for iterating and correcting such a system so as to converge on a desired result.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 01, 2008
Accession Number
ADA512968

Entities

People

  • Christopher Hogan
  • Dan Brassil
  • Jennifer Reinhart
  • Misti Gerber
  • Shana M. Rugani
  • Teresa Jade

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Abstracts
  • Algorithms
  • Classification
  • Closed Loop Systems
  • Computers
  • Control Systems
  • Errors
  • Feedback
  • Guidance
  • Information Retrieval
  • Information Science
  • Information Transfer
  • Machine Learning
  • Measurement
  • Quality Control
  • Standards
  • Supervised Machine Learning

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computational Modeling and Simulation
  • Information Retrieval

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval