Multimodal Command Interaction: Scientific and Technical
Abstract
The objective of this Phase I SBIR was to demonstrate, through the development of a proof-of-concept, that a combined paper/digital system for capturing, sharing, and understanding command, control, communications, computers, intelligence, surveillance, and reconnaissance (C4ISR) information sketched on paper maps was feasible. In this final report, we discuss 1. an introduction to the set of C4ISR problems in command-posts and elsewhere that such technology would aid in solving, 2. background research that our small business, Natural Interaction Systems, LLC., brings to bear in designing and developing software solutions that enable multimodal interaction on various types of computing displays and architectures, 3. the designs and successful implementations of these prototypes, 4. the demonstrations that have resulted in follow-on work. The interim results of Phase I were so promising that an extension was granted, allowing us to add spoken language as another possible input modality when working with the paper maps. Ultimately, a Phase II contract was granted. This work will be featured in the forthcoming January special issue on Multimodal Interaction in the Communications of the ACM.
Document Details
- Document Type
- Technical Report
- Publication Date
- Nov 25, 2003
- Accession Number
- ADA418922
Entities
People
- David R. Mcgee
- Philip R. Cohen