Motion Estimation from Image and Inertial Measurements

Abstract

Robust motion estimation from image measurements would be an enabling technology for Mars rover, micro air vehicle, and search and rescue robot navigation; modeling complex environments from video; and other applications. While algorithms exist for estimating six degree of freedom motion from image measurements, motion from image measurements suffers from inherent problems. These include sensitivity to incorrect or insufficient image feature tracking; sensitivity to camera modeling and calibration errors; and long-term drift in scenarios with missing observations, i.e., where image features enter and leave the field of view. The integration of image and inertial measurements is an attractive solution to some of these problems. Among other advantages, adding inertial measurements to image-based motion estimation can reduce the sensitivity to incorrect image feature tracking and camera modeling errors. On the other hand, image measurements can be exploited to reduce the drift that results from integrating noisy inertial measurements, and allows the additional unknowns needed to interpret inertial measurements, such as the gravity direction and magnitude, to be estimated. This work has developed both batch and recursive algorithms for estimating camera motion, sparse scene structure, and other unknowns from image, gyro, and accelerometer measurements. A large suite of experiments uses these algorithms to investigate the accuracy, convergence, and sensitivity of motion from image and inertial measurements. Among other results, these experiments show that the correct sensor motion can be recovered even in some cases where estimates from image or inertial estimates alone are grossly wrong, and explore the relative advantages of image and inertial measurements and of omnidirectional images for motion estimation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 01, 2004
Accession Number
ADA461118

Entities

People

  • Dennis W. Strelow

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Advanced Electronics
  • Ground and Sea Platforms
  • Sensors
  • Space

DTIC Thesaurus Topics

  • Accuracy
  • Aerospace Industry
  • Aircrafts
  • Autonomous Underwater Vehicles
  • Coordinate Systems
  • Data Sets
  • Detection
  • Geometry
  • Kalman Filtering
  • Kalman Filters
  • Mathematical Filters
  • Measurement
  • Micro Air Vehicles
  • Navigation
  • Simultaneous Localization And Mapping
  • Three Dimensional
  • Two Dimensional

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Computer Vision.
  • Inertial Navigation Systems.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • Autonomy