Gestural Communication With Accelerometer-Based Input Devices and Tactile Displays

Abstract

In this work, we introduce a communication system for common military hand and arm gestures which does not require a visual connection between the transmitter and receivers. Specifically, we present a computer mediated gesture recognition system that employs a wireless, accelerometer-based input device for collecting and classifying one- and two-hand and arm gestures. This system delivers message output through an audible channel and through a tactile display. The tactile display emulates the hand and arm signal's spatial qualities through a sequence of vibrations delivered via an elastic belt worn around the soldier's waist. Initial results show promise for this novel way to communicate with multimodal messages to augment visual messaging in challenging and stressful environments where visual messaging may not always be possible.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2008
Accession Number
ADA503579

Entities

People

  • James L. Merlo
  • Paul D. Varcholik

Organizations

  • University of Central Florida

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • Human Systems
  • Sensors

DTIC Thesaurus Topics

  • Accelerometers
  • Communication Channels
  • Communication Systems
  • Computational Science
  • Computers
  • Computing Devices
  • Hidden Markov Models
  • Human-Machine Interaction
  • Machine Learning
  • Military Research
  • Neural Networks
  • Operating Systems
  • Personal Computers
  • Recognition
  • Stress (Physiology)
  • Three Dimensional
  • User Interface

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Human-Computer Interaction (HCI).