NICOP - Interactive Exploration of 3D Indoor Environments for Scene Understanding and Training using Immersive Virtual Reality
Abstract
a. TECHNICAL: TU Vienna proposes to develop an innovative system capable of interactive real time localization and mapping integrated with an immersive three dimension (3D) virtual reality device and novel localization device with haptics. This system facilitates natural locomotion and 3 D egocentric scene interaction that will enable users to obtain a comprehensive real-time view in a GPS-denied environment. A variety of haptic interfaces will be researched, including robotic arms that could be operated locally or remotely. This one year preliminary research effort will accomplish the following: 1) develop the algorithms to expand upon existing simultaneous localization and mapping (SLAM) capabilities into a variety of unmanned aerial vehicles; 2) conduct research to incorporate SLAM capabilities into an immersive 3D environment; 3) conduct research and develop the algorithms to integrate the localization device with 3D virtual reality capability; 4) do preliminary research for the development of haptic devices such as robotic arms to incorporate into the localization device and develop the algorithms for remote operation. When fully mature, this system will be customizable for a variety of uses beneficial to the US Navy; the initial intent is for a variety of Sailor and Marine training and there are also obvious applications for Intelligence, Surveillance and reconnaissance (ISR) which will be explored while the research is underway. b. NRE RELEVANCE: The project goals are strongly aligned with the Naval S&T focus areas including Information Dominance, Autonomy and Unmanned Systems, and Expeditionary and Irregular Warfare, and Warfighter Performance. This system has the possibility to offer unprecedented capabilities for training and Warfighter ISR. c. COLLABORATION: Program Officers from ONR Codes 30 and 34 are supportive of this effort and have indicated interest in the follow on effort. NRL Program Officers have also indicated interest and possible future support. d. DESIRED OUTCOME: The SLAM algorithms developed will be shared with the research community. Results of this research will be published in leading journals and presented at international conferences. The PI will travel to ONR to provide a brief about the research progress and discuss areas for future collaboration.
Document Details
- Document Type
- DoD Grant Award
- Publication Date
- Nov 23, 2016
- Source ID
- N629091612234
Entities
People
- Hannes Kaufmann
Organizations
- Institute of Software, Chinese Academy of Sciences
- Office of Naval Research
- United States Navy