Integrating Cognitive and Psychometric Models to Measure Document Literacy

Abstract

The Survey of Young Adult Literacy conducted in 1985 by the National Assessment of Educational Progress included sixty-three items that elicited skills in acquiring and using information from written documents. These items were analyzed in two distinct ways: 1) with an item response theory (IRT) model, which characterized items' difficulties and respondents' proficiencies as revealed simply by tendencies toward correct response; and 2) a qualitative cognitive model, which characterized items in terms of the processing tasks they required. This paper demonstrates how a generalization of Fischer and Scheiblechner's Linear Logistic Test Model can be used to integrate information from the cognitive analysis into the IRT analysis. Keywords: Psychometrics; Cognition; Information processing; Bayesian estimation; Cognitive processing models; Literacy assessment. (EDC)

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Oct 01, 1989
Accession Number
ADA215504

Entities

People

  • Kathleen Sheehan
  • Robert J. Mislevy

Organizations

  • Educational Testing Service

Tags

DTIC Thesaurus Topics

  • Cardiovascular Physiological Phenomena
  • Cognition
  • Cognitive Science
  • Education
  • Information Processing
  • Information Science
  • Materials
  • Maximum Likelihood Estimation
  • Military Research
  • Plastic Explosives
  • Psychology
  • Regression Analysis
  • Standards
  • Statistics
  • Students
  • Surveys
  • Test And Evaluation

Fields of Study

  • Education

Readers

  • Brain and Cognitive Science; Experimental Psychology; Cognitive Neuroscience
  • Computational Modeling and Simulation
  • Instructional Design and Training Evaluation.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Information Retrieval