Testing for Agreement Between Two Groups of Judges.
Abstract
The 'problem of m rankings' so named by Kendall and studied extensively by Kendall, Babington Smith, and others, considers the relationship between the rankings that a group of m judges assigns to a set of k objects. Suppose there are two groups of judges ranking the objects. Given that there is agreement within each group of judges, how can we test for evidence of agreement between the two groups. This question, recently posed to us by Kendall, has been studied by Schucany, Frawley and Li. In this paper we show that the test of agreement proposed by Schucany and Frawley, and further advanced by Li and Schucany, is misleading and does not provide a satisfactory answer to Kendall's question. After pinpointing various defects of the Schucany-Frawley test, we adapt a procedure, proposed by Wald and Wolfowitz in a slightly different context, to furnish a new test for agreement between two groups of judges.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 1977
- Accession Number
- ADA037666
Entities
People
- Jayaram Sethuraman
- Myles Hollander
Organizations
- Florida State University