Computer-Based and Paper-Based Measurement of Semantic Knowledge

Abstract

Seventy-five subjects were administered computer-based and paper- based tests of threat-parameter knowledge represented as a semantic network in order to determine the relative reliabilities and validities of these two assessment modes. Estimates of internal consistencies, equivalences, and discriminant validities were computed. It was established that (a) computer- based and paper-based measures, i.e., test score and average degree of confidence, are not significantly different in reliability or internal consistency; (b) for computer-based and paper-based measures, average degree of confidence has a higher reliability than average response latency which in turn has a higher reliability than the test score; (c) a few of the findings are ambivalent since some results suggest equivalence estimates for computer-based and paper-based measures, i.e., test score and average degree of confidence, are about the same, and another suggests these estimates are different; and (d) the discriminant validity of the computer-based measures was superior to paper-based measures. The results of this research supported the findings of some studies, but not others. As discussed, the reported literature on this subject is contradictory and inconclusive. (SDW)

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1989
Accession Number
ADA202152

Entities

People

  • Nina L. Liggett
  • Pat-anthony Federico

Tags

Communities of Interest

  • Human Systems
  • Weapons Technologies

DTIC Thesaurus Topics

  • Applied Psychology
  • Cognition
  • Cognitive Science
  • Computers
  • Consistency
  • Data Science
  • Databases
  • Electronic Countermeasures
  • Experimental Design
  • Information Science
  • Instructors
  • Psychology
  • Reliability
  • Statistical Analysis
  • Statistics
  • Students
  • Training

Readers

  • Instructional Design and Training Evaluation.
  • Psychometric Testing or Psychological Assessment.
  • Regression Analysis.