Sensemaking Research Roadmap

Abstract

On 2-3 May 2018, the Systems Engineering Research Center (SERC) convened a workshop of experts to examine current research trends, challenges, and open science questions in artificial intelligence (AI)-enabled sensemaking technologies. Consensus from the workshop was that two most pertinent research thrusts that are needed for developing a higher form of sensemaking are (1) multi-modal analysis for sensemaking and (2) hybrid systems for sensemaking. Within these thrust areas exist several research tracks. We discuss these in Sections 3 and 4, respectively. Currently, four elements influence multi-modal sensemaking systems: (1) volume of information generated by both conventional and social media sensors; (2) intentional corruption of information in these modalities; (3) different speeds at which information propagates over the internet, (4) the often contradictory information about the same topic from different sources. These tend to be more on intra-modal or cross-modal modalities, using a few subsets of data. Significant research is required to progress from these analytics to true multi-modal sensemaking systems. We propose the following research tracks: interoperability issues, reliability, and trustworthiness, next-generation AI and sensemaking algorithms, and assessing and closing the loop for multi-modal sensemaking systems. In Section 5, we provide a projected timeline for the research. We believe these tracks are crucial to developing the science of holistic sensemaking. Hybrid sensemaking faces its own set of challenges. The goal of HS2 is to explore the possibilities for human-machine hybrid systems. We seek to eventually develop a networked ecosystem of human analysts and machines. The HS2 research tracks are: HS2 taxonomy and performance measures, interactive and continuous sensemaking, HS2 autonomy and trust, HS2 as networks: organizational sciences perspective, and HS2 interfaces. We project much of the HS2 research to be 5-10 years out or more.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Oct 31, 2018
Accession Number
AD1063331

Entities

People

  • Aram Galstyan
  • Charles Clancy
  • K. P. Subbalakshmi
  • Rama Chellappa

Organizations

  • Stevens Institute of Technology
  • Systems Engineering Research Center
  • University of Maryland
  • University of Southern California
  • Virginia Tech

Tags

Communities of Interest

  • Autonomy
  • Cyber
  • Energy and Power Technologies
  • Engineered Resilient Systems
  • Human Systems

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Computational Science
  • Computer Languages
  • Computer Vision
  • Data Mining
  • Detectors
  • Human-Machine Systems
  • Information Science
  • Intelligence Community (United States)
  • Internet
  • Machine Learning
  • Network Science
  • Online Communications
  • Ontologies
  • Pattern Recognition
  • Reliability
  • Social Media
  • Supervised Machine Learning
  • Warning Systems

Fields of Study

  • Computer science

Readers

  • Defense Technology Research and Development.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.
  • Trauma Surgery or Emergency Medicine.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy