The Relationship Between Reliability and Validity in a Bayesian World.

Abstract

While the relationship between internal consistency and validity in traditional tests is well established, little is available for tests that predict dichotomous diagnostic outcomes. An understanding of such a relationship is important in cases such as the prediction of clinician diagnoses by psychological tests. Tests such as the MCMI are validated against such clinical diagnoses. The limiting effects on positive predictive powers given levels of Kappa are developed. The current work provides the relationship between Kappa and Positive Predictive Power for use with tests and applies it specifically to a test of psychopathology as an example. This may be applied to any situation where judgements are predicted by tests such as in mental health, medicine, or selection and training.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1997
Accession Number
ADA328636

Entities

People

  • Paul D. Retzlaff
  • William G. Jackson

Organizations

  • Armstrong Laboratory

Tags

Communities of Interest

  • Biomedical

DTIC Thesaurus Topics

  • Air Force
  • Diseases And Disorders
  • Flight Training
  • Governments
  • Health
  • Judgment
  • Mental Disorders
  • Mental Health
  • New York
  • Personality Disorders
  • Psychological Tests
  • Reliability
  • Social Sciences
  • Statistics
  • Training
  • United States

Fields of Study

  • Psychology

Readers

  • Computational Modeling and Simulation
  • Psychological Intervention/Treatment for Stress, Anxiety, PTSD, and Related Emotional and Cognitive Health Symptoms.
  • Psychometric Testing or Psychological Assessment.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference