Aspect Windows, 3-D Visualizations, and Indirect Comparisons of Information Retrieval Systems

Abstract

We built two Information Retrieval systems that were targeted for the TREC-6 "aspect oriented" retrieval track. The systems were built to test the usefulness of different visualizations in an interactive IR setting-in particular, an "aspect window" for the chosen task, and a 3-D visualization of document inter-relationships. We studied 24 users of the system in order to investigate: whether the systems were more effective than a control system, whether experienced users outperformed novices, whether spatial reasoning ability was a good predictor of effective use of 3-D, and whether the systems could be compared indirectly via a control system. Our results show substantial differences in user performance are related to spatial reasoning ability and to a lesser degree other traits. We also obtained markedly different results from the direct and indirect comparisons.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1997
Accession Number
ADA341759

Entities

People

  • James Allan
  • Russell C. Swan

Organizations

  • University of Massachusetts Amherst

Tags

DTIC Thesaurus Topics

  • Analysis Of Variance
  • Combinatorial Analysis
  • Computer Science
  • Control Systems
  • Data Science
  • Databases
  • Education
  • Experimental Design
  • Human-Machine Interaction
  • Information Retrieval
  • Information Science
  • Predictive Modeling
  • Questionnaires
  • Statistical Analysis
  • Three Dimensional
  • User Interface
  • Web Browsers

Fields of Study

  • Computer science

Readers

  • Information Retrieval
  • Instructional Design and Training Evaluation.
  • Theoretical Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Information Retrieval