Digit-Eyes: Vision-Based Human Hand Tracking

Abstract

Passive sensing of human hand and limb motion is important for a wide range of applications from human-computer interaction to athletic performance measurement. High degree of freedom articulated mechanisms like the human hand are difficult to track because of their large state space and complex image appearance. This article describes a model-based hand tracking system, called Digit Eyes, that can recover the state of a 27 DOF hand model from gray scale images at speeds of up to 10 Hz. We employ kinematic and geometric hand models, along with a high temporal sampling rate, to decompose global image patterns into incremental, local motions of simple shapes. Hand pose and joint angles are estimated from line and point features extracted from images of unmarked, unadorned hands, taken from one or more viewpoints. We present some preliminary. results on a 3D mouse interface based on the DigitEyes sensor. Human motion analysis, Human-Computer interaction, Nonrigid motion, Gesture recognition, Visual tracking, Model-based vision

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 31, 1993
Accession Number
ADA276417

Entities

People

  • James M. Rehg
  • Takeo Kanade

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • C4I
  • Space

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Cognitive Systems Engineering
  • Computer Graphics
  • Computer Science
  • Computer Vision
  • Feature Extraction
  • Graphics
  • Human-Computer Interaction
  • Human-Machine Interaction
  • Image Processing
  • Kalman Filtering
  • Kalman Filters
  • Measurement
  • Recognition
  • Robots
  • Three Dimensional
  • Translations

Fields of Study

  • Computer science

Readers

  • Computer Vision.
  • Robotics and Automation.

Technology Areas

  • AI & ML
  • Space
  • Space - Space Objects
  • Space - Spacecraft Maneuvers