COSMO I: Human Guided Machine Learning for Cognitive State Modeling

Abstract

The proliferation of Army systems enabled with artificial intelligence (AI) has enhanced warfighter capabilities at the strategic, operational, and tactical levels. One limitation of these systems is that they lack awareness of the warfighters cognitive state, which can lead to inappropriate interventions that negatively impact overall human-AI collaboration. Adaptive automation is one approach towards more context-sensitive interventions however, some insight into the humans state is still needed. Recent advances in sensor technologies and modeling techniques have created new opportunities in this area, yet more research is needed to mature these technologies and techniques so they can be used in operational settings. To meet this need, Aptima and partners at University of Colorado-Boulder and Sophia Speira are developing COSMO to provide Human-Guided Machine Learning for Cognitive State Modeling. COSMO is a diagnostic toolset for cost-effectively assessing human performance and predicting human cognitive states while integrating those insights into adaptive AI systems. Advanced, precise physiological sensors (e.g., fNIRS) will be used to create models in a lab environment which can then be used to develop and validate similar cognitive state models using less-intrusive sensors (e.g., smartwatch-based sensors). COSMO will accurately detect cognitive state changes in real-time and provide contextually relevant information that allows AI systems to adapt and intervene appropriately. When complete, COSMO will provide insights into warfighter cognitive state and mission context to improve the quality of AI interventions and increase human-AI system performance

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 10, 2023
Accession Number
AD1205102

Entities

People

  • Flowers Adrian

Organizations

  • Aptima (United States)

Tags

DTIC Thesaurus Topics

  • Accuracy
  • Biological Phenomena
  • Buildings And Structures
  • Commerce
  • Contract Administration
  • Contracts
  • Ecological And Environmental Phenomena
  • Environment
  • Governments
  • Photographic Materials
  • Photographs
  • Photography
  • Small Business

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy