Selecting Measures to Evaluate Complex Sociotechnical Systems: An Empirical Comparison of a Task-based and Constraint-based Method

Abstract

Researchers need better measures for evaluating human performance in complex socio-technical systems. A constraint-based and a task-based method were compared for their effectiveness in identifying measures that would be sensitive to a system modification. Working in an advanced simulator, aircrews conducted tactical missions with or without a modification to a specific aircraft system. Across two experiments there was no significant difference between the methods in the sensitivity or suitability of the measures that they suggested. Nonetheless, observations made during the program of research suggested that the constraint-based method for identifying measures is a viable alternative to the task-based method.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 2013
Accession Number
ADA591910

Entities

People

  • David J. Crone

Organizations

  • Defence Science and Technology Group

Tags

Communities of Interest

  • Air Platforms
  • Biomedical
  • Electronic Warfare
  • Engineered Resilient Systems
  • Human Systems
  • Space
  • Weapons Technologies

DTIC Thesaurus Topics

  • Airframes
  • Cognition
  • Cognitive Systems Engineering
  • Cognitive Workload
  • Department Of Defense
  • Engineers
  • Human Factors Engineering
  • Human Systems Integration
  • Human-Machine Interfaces
  • Personnel Management
  • Psychology
  • Situational Awareness
  • Systems Engineering
  • Task Performance And Analysis
  • Test And Evaluation
  • Warfare
  • Warning Systems

Readers

  • Small Business Innovation Research Program (SBIR) EDI Research and Innovation.
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.