Multimodal Communication with Networked Information Systems

Abstract

On-going research is implementing user interfaces that transcend the capabilities of mouse and keyboard and provide enhanced flexibility, functionality and naturalness. The sensory dimensions of sight, sound and touch are employed simultaneously and in combination to expand human/machine communication. The client stations are networked on a system designed for collaboration over wire and wireless transport. Dynamic control and allocation of resources (bandwidth, computing, storage) for heterogeneous user platforms are features of the network. Application areas under study include: (a) crisis management/disaster relief, (b) remote telemedicine/telerehabilitation; and, (c) mobile offices/wearable computers. Advanced command center featuring networked collaboration, conferencing, and multimodal interfaces for participants. 2D and 3D displays permit object placement and manipulation by eye cursor, speech recognition, and virtual grasp.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 25, 1999
Accession Number
ADA513015

Entities

People

  • A. Medl
  • I Marsic
  • J. Flanagan

Organizations

  • Rutgers University–New Brunswick

Tags

DTIC Thesaurus Topics

  • Abstracts
  • Automated Speech Recognition
  • Command Centers
  • Computers
  • Contracts
  • Crisis Management
  • Disasters
  • Human-Machine Interaction
  • Humanitarian Assistance
  • Information Operations
  • Information Systems
  • New Jersey
  • Standards
  • Teamwork
  • Universities
  • User Interface
  • Wearable Computers

Fields of Study

  • Computer science

Readers

  • Computer Networking
  • Distributed Systems and Data Platform Development
  • Human-Computer Interaction (HCI).

Technology Areas

  • AI & ML