Performance Evaluation of Expert Team Members

Abstract

We found that CWS can do a reasonable job of capturing expertise in arithmetic compared to indices that incorporate correct answers. We also found (in conjunction with Rick Thomas and Alex Kirlik) similar results for a performance domain, putting a golf ball. In addition, we initiated the development of designs that allow the extraction of individual performance from team scores. We used the CTEAM simulation to study the development of expertise of teams of simulated air traffic controllers. CWS served as the primary index of performance, although traditional measures were examined as well. As a performance measure, CWS (based on time through sector) was observed to be more sensitive to improvement over practice than operational errors. Experts make too few errors to provide differential accuracy information, while CWS attends to aspects of performance that can always be observed, whether errors are made or not.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 18, 2007
Accession Number
ADA469702

Entities

People

  • David J. Weiss
  • James Shanteau

Organizations

  • California State University, Los Angeles

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Air Traffic
  • Air Traffic Controllers
  • Applied Psychology
  • Arithmetic
  • Cognitive Systems Engineering
  • Commerce
  • Contracts
  • Errors
  • New York
  • Personnel Management
  • Psychology
  • Simulations
  • Social Sciences
  • Test And Evaluation
  • Traffic
  • Training

Readers

  • Astronomy/Astrophysics
  • Aviation Safety and Air Traffic Management
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.