Use What You've Got: Steps Toward Opportunistic Computing

Abstract

We define opportunistic computing environments as augmented reality environments that attempt to minimally perturb existing work practices and allow users to opportunistically take advantage of them. In this paper, we present Rasa, an opportunistic computing environment for military command and control that augments the physical objects on a command post map by observing and understanding the users' speech, pen, and touch- based multimodal language. We give a thorough account of Rasa's underlying multiagent framework, recognition, understanding, and multimodal integration components. Finally, we examine three properties of language- generativity, comprehensibility, and compositionality- that render it suitable as an augmentation scheme, and we compare these properties to those of current tagging technologies and approaches.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2000
Accession Number
ADA420066

Entities

People

  • David R. Mcgee
  • Philip R. Cohen

Organizations

  • Oregon Health & Science University

Tags

Communities of Interest

  • C4I

DTIC Thesaurus Topics

  • Augmented Reality
  • Automated Speech Recognition
  • Command And Control
  • Command And Control Systems
  • Computational Science
  • Computers
  • Databases
  • Digital Data
  • Grammars
  • Human Systems Integration
  • Integrators
  • Language
  • Military Personnel
  • Natural Language Processing
  • Natural Languages
  • Physical Properties
  • User Interface

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computational Linguistics
  • Nanoscale Plasmonic Nanotechnology

Technology Areas

  • Fully Networked C3
  • Fully Networked C3 - Command and Control