Interrater Reliability: The Development of an Automated Analysis Tool,

Abstract

The Comprehensive Occupational Data Analysis Programs (CODAP) system is a basic tool in both operational job analysis and in occupational research. This system of programs is augmented and enhanced to meet changing requirements from the research community. In particular, this paper discusses the development and evolution of interrater reliability procedures. The history of these procedures is traced from techniques in use prior to its inclusion in the CODAP system through to the present time. This paper explains the programs capabilities in terms of the research requirements which necessitated the enhancements and may be used as an analyst's guide in the future. The paper closes by examining current research streams, potential applications, and the operational use of the newest version of this program aimed at fulfilling these anticipated needs.

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1981
Accession Number
ADP001380

Entities

People

  • Johnny J. Weissmuller
  • Michael R. Staley

Organizations

  • Air Force Research Laboratory

Tags

Communities of Interest

  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Communities
  • Computer Program Reliability
  • Data Analysis
  • Inclusions
  • Job Analysis
  • Personal Information Managers
  • Reliability
  • Virginia

Readers

  • Computer Science.
  • Instructional Design and Training Evaluation.
  • Military History / Militaries and War Studies