Predictions of Reliability Coefficients and Standard Errors of Measurement Using the Test Information Function and Its Modifications

Abstract

There seems to be a concensus that two main measures in classical mental test theory are the reliability and validity coefficients of a test. Although these measures have widely been accepted by psychologists and test users in the past decades, they are actually the attributes of a specified group of examinees as well as of a given test, since the correlation coefficient is used in either case. In addition, representation of these measures by single numbers results in over-simplification and the lack of useful information for both theorists and actual users of tests. The same applies for the standard error of measurement also. In latent trait models, the item and test information functions provide us with abundant information about the local accuracy of estimation, a concept which is totally missing in classical mental test theory. These functions do not depend upon any specific group of examinees as the reliability coefficient does, or we can say that they are population-free. By virtue of this characteristic, adding further information about the MLE bias function of the test and the ability distribution of the examinee group, we can provide the tailored reliability coefficient and standard error of measurement in the classical mental test theory's sense for each and every specified group of examinees who have taken the same test.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 05, 1990
Accession Number
ADA224696

Entities

People

  • Fumiko Samejima

Organizations

  • University of Tennessee

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Accuracy
  • Artificial Intelligence
  • Classification
  • Cognitive Science
  • Estimators
  • Measurement
  • Military Research
  • Normal Distribution
  • Numbers
  • Plastic Explosives
  • Psychology
  • Reliability
  • Security
  • Square Roots
  • Tennessee
  • United States
  • Universities

Readers

  • Psychometric Testing or Psychological Assessment.
  • Regression Analysis.
  • Theoretical Analysis.