An Investigation of the Reliability of Knowledge Measures Through Relational Mapping in Joint Military Environments: Knowledge, Models and Tools to Improve the Effectiveness of Naval Distance Learning

Abstract

This report describes research conducted by the UCLA National Center for Research on Evaluation, Standards, and Student Testing (CRESST) on the effectiveness of online knowledge mapping as a method to assess high-level understanding of specific military domains and tasks. Using the Human Performance Knowledge Mapping Tool (HPKMT), CRESST assessed individual trainee knowledge and then examined the psychometric properties of knowledge mapping scores to evaluate the suitability of knowledge mapping as an assessment of trainees' understanding of joint mission-essential tasks. Analyses of scoring techniques yielded important information about the quality of the knowledge maps, and the assessments provided valuable information regarding student understanding of course content. The student maps were analyzed using three methods: automated criterion-based (expert) assessment, propositional analysis, and structural mapping analysis.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2006
Accession Number
ADA450131

Entities

People

  • Alicia M. Cheak
  • Eva L. Baker
  • Gregory K. Chung
  • John J. Lee
  • Karen Ellis
  • William L. Bewley

Organizations

  • University of California, Los Angeles

Tags

Communities of Interest

  • Biomedical
  • C4I

DTIC Thesaurus Topics

  • Air Force
  • Department Of Defense
  • Distance Learning
  • Doctrine
  • Education
  • Information Operations
  • Instructions
  • Instructors
  • Military Operations
  • Military Personnel
  • Military Science
  • Motor Skills
  • Reliability
  • Students
  • Task Forces
  • Test And Evaluation
  • Warfare

Fields of Study

  • Education

Readers

  • Artificial Intelligence
  • Geodesy
  • Instructional Design and Training Evaluation.