How to Analyze Paired Comparison Data

Abstract

Thurstone's Law of Comparative Judgment provides a method to convert subjective paired comparisons into one-dimensional quality scores. Applications include judging quality of different image reconstructions, or different products, or different web search results, etc. This tutorial covers the popular Thurstone-Mosteller Case V model and the Bradley-Terry logistic variant. We describe three approaches to model- fitting: standard least-squares, maximum likelihood, and Bayesian approaches. This tutorial assumes basic knowledge of random variables and probability distributions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 2011
Accession Number
ADA543806

Entities

People

  • Kristi Tsukida
  • Maya R. Gupta

Organizations

  • University of Washington

Tags

DTIC Thesaurus Topics

  • Algorithms
  • Computations
  • Distribution Functions
  • Electrical Engineering
  • Engineering
  • Estimators
  • Gaussian Distributions
  • Image Processing
  • Intervals
  • Judgment
  • Least Squares Method
  • Maximum Likelihood Estimation
  • Probability
  • Random Variables
  • Simulations
  • Standards
  • Stochastic Processes

Readers

  • Regression Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference