Familiarity Effects on Task Difficulty Ratings.

Abstract

This report examines interrater reliability estimates for task difficulty raters having differing levels of familiarity with rated tasks. Data were collected from 455 NCO supervisors who rated the difficulty and familiarity of 424 tasks in the Aircraft Electrical Repair career ladder task inventory. The results showed that the interrater reliability estimates (R sub KK) decreased from .930 to .802 for six task difficulty rating scale conditions in which ratings were eliminated due to levels of familiarity. This finding suggests that little is to be gained from eliminating task difficulty ratings based upon an experienced judge's level of familiarity with tasks. (Author)

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1977
Accession Number
ADA043079

Entities

People

  • Kenneth G. Koym

Organizations

  • Brooks Air Force Base

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Air Force
  • Air Force Facilities
  • Coefficients
  • Computational Science
  • Data Analysis
  • Education
  • Governments
  • Human Resources
  • Inventory
  • Manpower
  • Personnel Management
  • Reliability
  • Specifications
  • Supervisors
  • Task Performance And Analysis
  • Test And Evaluation
  • Training

Fields of Study

  • Psychology

Readers

  • Brain and Cognitive Science; Experimental Psychology; Cognitive Neuroscience
  • Psychometric Testing or Psychological Assessment.