Minimal Test Collections for Relevance Feedback

Abstract

The Information Retrieval Lab at the University of Delaware participated in the Relevance Feedback track at TREC 2009. We used only the Category B subset of the ClueWeb collection; our preprocessing and indexing steps are described in our paper on ad hoc and diversity runs. The second year of the Relevance Feedback track focused on selection of documents for feedback. Our hypothesis is that documents that are good at distinguishing systems in terms of their effectiveness by mean average precision will also be good documents for relevance feedback. Thus we have applied the document selection algorithm MTC (Minimal Test Collections) developed by Carterette et al. that is used in the Million Query Track for selecting documents to be judged to find the right ranking of systems. Our approach can therefore be described as "MTC for Relevance Feedback".

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 01, 2009
Accession Number
ADA517815

Entities

People

  • Aparna Kailasam
  • Ben Carterette
  • Divya Muppaneni
  • Lekha Thota
  • Praveen Chandar

Organizations

  • University of Delaware

Tags

DTIC Thesaurus Topics

  • Abstracts
  • Algorithms
  • Delaware
  • Feedback
  • Information Operations
  • Information Retrieval
  • Information Science
  • Judgment
  • Language
  • Machine Learning
  • Probability
  • Standards
  • Test And Evaluation
  • Universities

Fields of Study

  • Computer science

Readers

  • Information Retrieval
  • Regression Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval