The Use of Videotape Technology to Train Administrators of Walk-Through Performance Testing.
Abstract
When assessing the performance of individuals with work sample tests, it is essential that test administrators observe and rate performance accurately. The present effort used videotapes of work sample test performance with known target scores both as a training device to improve observational and rating skills as well as an evaluation tool to determine level of rater accuracy and identify type and frequency of rating errors. Data were collected from nine test administrators at two workshops held 2 1/2 months apart in a field test conducted in the interim between the two workshops. Rater accuracy and interrater agreement were measured for both workshops; only interrater agreement was measured during the field test. Results indicated high levels of accuracy and interrater agreement for the test administrators. Analyses of types and frequency of rating errors suggested that errors resulted most often from failure to identify correct performance when it occurred. Results are discussed in terms of the training and evaluation benefits of using videotape technology in work sample testing. Keywords: Interrater reliability, Job performance measurement, Performance measurement, Rater accuracy, Rater training, Walk through performance testing. (WTPT). (SDW)
Document Details
- Document Type
- Technical Report
- Publication Date
- Jul 01, 1988
- Accession Number
- ADA195944
Entities
People
- Jerry W. Hedge
- Sheryl A. Bierstedt
- Terry L. Dickinson
Organizations
- Air Force Research Laboratory