A Note on Validity Generalization Procedures.

Abstract

Validity generalization procedures are reviewed and found to be subject to the logical fallacy of affirming the consequent. Alternative models may explain variation in validity coefficients as well as the cross-situational consistency model espoused by proponents of validity generalization. Moreover, many of the assumptions that form the statistical foundation for validity generalization are false. It is recommended that (a) the conditionality of inferences based on validity generalization analyses be explicitly stated, (b) the decision rule for the validity generalization ratio be changed from .75 to .90, and (c) validity generalization analyses employ Fisher z coefficients rather than (Pearson) correlation coefficients. (Author).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1985
Accession Number
ADA150065

Entities

People

  • L. R. James
  • R. G. Demaree
  • S. A. Mulaik

Organizations

  • Georgia Tech

Tags

Communities of Interest

  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Accuracy
  • Applied Psychology
  • Behavioral Sciences
  • Chi Square Test
  • Consistency
  • Correlation Analysis
  • Data Science
  • Industrial Psychology
  • Military Research
  • New York
  • Organizational Structure
  • Personnel Selection
  • Psychological Tests
  • Psychology
  • Reliability
  • Sampling
  • United States

Fields of Study

  • Psychology

Readers

  • Psychometric Testing or Psychological Assessment.
  • Regression Analysis.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference