An Augmented Virtual Reality Interface for Assistive Monitoring of Smart Spaces

Abstract

Large sensor networks in applications such as surveillance and virtual classrooms, have to deal with the explosion of sensor information. Coherent presentation of data coming from such large sets of sensors becomes a problem. Thus there is a need to summarize events while retaining the spatial relationship between sensors. Also, such systems are prone to routine failures influenced by hardware, software, or the environment. To recover from such failures, fault containment can be achieved by using redundant sensors. In this paper, we define Fault Containment Unit (FCU), which has built-in alternative actions in the event of failures. However, the combinatorial explosion of alternatives in large scale sensor networks dictates that the design of FCU is hard. Our strategy is to provide an augmented virtual reality interface to a human user by projecting the current state of the system, including camera orientation and objects being tracked, onto a virtual 3D world. We present an interface that : (i) offers different levels of detail when presenting information to user, (ii) allows the user to maintain a good spatial sense during sensor transitions, (iii) enables the user to dynamically assemble Fault Containment Units in response to emergencies, (iv) adapts to the current bandwidth availability, (v) provides mobility to the user, and (vi) allows shared interaction among users by immersing them in the same virtual workspace. Finally, we demonstrate three scenarios highlighting the above mentioned features.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 04, 2003
Accession Number
ADA438902

Entities

People

  • Andrew H. Fagg
  • Deepak R. Karuppiah
  • Edward M. Riseman
  • Roderic Grupen
  • Shichao Ou

Organizations

  • University of Massachusetts Amherst

Tags

Communities of Interest

  • Autonomy
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Augmented Reality
  • Computer Science
  • Computers
  • Detectors
  • Failure Mode And Effect Analysis
  • Hierarchies
  • Human-Computer Interfaces
  • Mixed Reality
  • Monitoring
  • Networks
  • Recognition
  • Sensor Networks
  • Situational Awareness
  • Supervisors
  • User Interface
  • Virtual Reality

Fields of Study

  • Computer science

Readers

  • Database Systems and Applications
  • Sensor Fusion and Tracking Systems.
  • Systems Analysis and Design

Technology Areas

  • Space