Developing Scene Understanding Neural Software for Realistic Autonomous Outdoor Missions

Abstract

We present a deep learning neural network model software implementation for improving scene understanding of realistic autonomous outdoor missions in complex and changing environments. Scene understanding for realistic outdoor missions has been considered an unsolved problem due to the uncertainty of inferring the mutual context of detected objects and the changing weather, terrain, and environmental surroundings. We report proof-of-principle progress in autonomously searching for and recognizing key activities or scenarios by identifying both salient objects and relevant environmental settings depicted in outdoor scenes. Importantly, we demonstrate autonomous detection of targeted scenarios using neural network models separately trained on both objects and places image databases. In addition, using instructive analysis of 5 representative real-world mission scenarios, we show that adding dynamic environmental data and physics-based modeling could minimize unpredictably by constraining neural predictions to physically realizable solutions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2017
Accession Number
AD1041261

Entities

People

  • Arnold D. Tunick
  • Ronald E. Meyers

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Autonomy
  • C4I

DTIC Thesaurus Topics

  • Artificial Intelligence Software
  • Autonomous Navigation
  • Central Processing Units
  • Climate Change
  • Cognitive Science
  • Computational Science
  • Computer Languages
  • Computer Programming
  • Computer Programs
  • Computer Vision
  • Computers
  • Deep Learning
  • Information Processing
  • Information Science
  • Information Systems
  • Machine Learning
  • Neural Networks

Fields of Study

  • Computer science

Readers

  • Computer Vision.
  • Distributed Systems and Data Platform Development
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Neural Networks