Multi-Input Control in Mobile Augmented Reality
Abstract
Building on prior ONR-sponsored work on real-time 3D scene understanding and Glanceable Augmented Reality (AR), we propose to study,technical and user experience components enabling context-aware input interfaces for future mobile AR users. Our work is geared towa,rds enhancing the interaction abilities of decision makers in the field. Two groups of Navy personnel might specifically benefit fro,m "always-on" interactive AR knowledge enhancements: dismounted Marine squad leaders in training or combat environments, and small c,ommand-post teams who aggregate, interpret, and plan with, information coming in from various sources, including highly mobile AR-su,pported squads. Addressing the needs of dismounted Marines, this fundamental context modeling and augmented reality interaction rese,arch will be demonstrated in civilian search-and-rescue and emergency response scenarios that involve emergency workers and field-wo,rk supervisors in natural and urban environment, task, and user contexts.Three interdependent research questions define the core of,this proposal. For Research Question 1 (RQ1: Input Modalities), we will assess what input modalities are available for mobile AR con,trol and how we can best utilize user and environment sensing for AR interaction. For RQ2 (Input Techniques), we will design and imp,lement novel mobile AR input techniques. We will design and conduct controlled experiments to determine how input modalities can be,best combined into novel interaction techniques relevant to our emergency response use cases. For RQ3 (Seamless Control and Task Swi,tching), we will enable mobile AR users to seamlessly choose and combine different input modalities and switch among their tasks. O,ur work will culminate in an integrated proof-of-concept demonstration of context-aware input methodologies for mobile AR, increasin,g mobile users situational interaction capabilities towards increased knowledge and awareness.
Document Details
- Document Type
- DoD Grant Award
- Publication Date
- Dec 06, 2022
- Source ID
- N000142312118
Entities
People
- Tobias Hollerer
Organizations
- Office of Naval Research
- United States Navy
- University of California, Santa Barbara