Assessing the Performance of Human-Automation Collaborative Planning Systems

Abstract

Planning and Resource Allocation (P/RA) Human Supervisory Control (HSC) systems utilize the capabilities of both human operators and automated planning algorithms to schedule tasks for complex systems. In these systems, the human operator and the algorithm work collaboratively to generate new scheduling plans, each providing a unique set of strengths and weaknesses. A systems engineering approach to the design and assessment of these P/RA HSC systems requires examining each of these aspects individually as well as examining the performance of the system as a whole in accomplishing its tasks. An obstacle in this analysis is the lack of a standardized testing protocol and a standardized set of metric classes that define HSC system performance. An additional issue is the lack of a comparison point for these revolutionary systems, which must be validated with respect to current operations before implementation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2011
Accession Number
ADA559023

Entities

People

  • Jason C. Ryan

Organizations

  • Massachusetts Institute of Technology

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • Engineered Resilient Systems
  • Ground and Sea Platforms
  • Human Systems
  • Space

DTIC Thesaurus Topics

  • Aircraft Carriers
  • Aircrafts
  • Autonomous Systems
  • Cognitive Systems Engineering
  • Cognitive Workload
  • Command And Control
  • Complex Systems
  • Control Systems
  • Human Supervisory Control
  • Information Processing
  • Linear Programming
  • Microarchitecture
  • Systems Engineering
  • Task Performance And Analysis
  • Test Methods
  • Unmanned Aerial Vehicles
  • Unmanned Systems

Fields of Study

  • Computer science

Readers

  • Fire Suppression Systems Design.
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.