Sensor Data Fusion Framework to Improve Holographic Object Registration Accuracy for a Shared Augmented Reality Mission Planning Scenario

Abstract

Accurate 3-D holographic object registration for a shared augmented reality application is a challenging proposition with Microsoft HoloLens. We investigated using a sensor data fusion framework, which uses both sensor data from an external positional tracking system and the Microsoft HoloLens to reduce augmented reality registration errors. In our setup, positional tracking data from the OptiTrack motion capture system was used to improve the registration of the 3-D holographic object for a shared augmented reality application running on three Microsoft HoloLens displays. We showed an improved and more accurate 3-D holographic object registration in our shared augmented reality application compared to the shared augmented reality application using Holo Toolkit Sharing Service released by Microsoft. The result of our comparative study of the two applications also showed participants responses consistent with our initial assessment on the improved registration accuracy using our sensor data fusion framework. Using our sensor data fusion framework, we developed a shared augmented reality application to support a mission planning scenario using multiple holographic displays to illustrate details of the mission.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 18, 2018
Accession Number
AD1055034

Entities

People

  • Simon Su
  • Sue Kase

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Materials and Manufacturing Processes
  • Sensors

DTIC Thesaurus Topics

  • Accuracy
  • Augmented Reality
  • Coordinate Systems
  • Data Fusion
  • Data Visualization
  • Department Of Defense
  • Detectors
  • Environment
  • Errors
  • Fuel Injection
  • Fuel Injectors
  • Military Research
  • Motion Capture
  • Sensor Fusion
  • Simulations
  • Three Dimensional
  • Visualizations

Fields of Study

  • Physics

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Database Systems and Applications
  • Sensor Fusion and Tracking Systems.