Deep Learning Techniques to Estimate 3D Position in Stereoscopic Imagery

Abstract

Current AAR efforts utilize machine vision algorithms to estimate the pose of a receiver aircraft. However, these algorithms are dependent on several conditions such as the availability of precise 3D aircraft models; the accuracy of the pipeline significantly degrades in the absence of high-quality information given beforehand. We propose a deep learning architecture that estimates the 3D position of an object based on stereoscopic imagery. We investigate the use of both machine learning techniques and neural networks to directly regress the 3D position of the receiver aircraft. We present a new position estimation framework that is based on the differences between two stereoscopic images without relying on the stereo block matching algorithm. We analyze the speed and accuracy of its predictions and demonstrate the effectiveness of the architecture in mitigating various visual occlusions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 24, 2022
Accession Number
AD1166906

Entities

People

  • Jonathan I Nicholson

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Air Platforms
  • Autonomy

DTIC Thesaurus Topics

  • Air Force
  • Aircrafts
  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Computational Science
  • Computer Languages
  • Computer Vision
  • Convolutional Neural Networks
  • Deep Learning
  • Information Science
  • Information Systems
  • Machine Learning
  • Neural Networks
  • Probabilistic Models
  • Recurrent Neural Networks
  • Stereo Cameras
  • Supervised Machine Learning
  • Tanker Aircraft
  • Unmanned Aerial Vehicles

Fields of Study

  • Computer science

Readers

  • Computer Vision.
  • Neural Network Machine Learning.
  • Positioning, Navigation, and Timing (PNT) Technology.

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks