The Perception of Articulated Motion: Recognizing Moving Light Displays

Abstract

Recognition of motion sequences is a crucial ability for biological and robot vision systems. We present an architecture for the higher level processes involved in recognition of complex structured motion. The work is focused on modeling human recognition of Moving Light Displays. MLDs are image sequences that contain only motion information at a small number of locations. Despite the extreme paucity of information in these displays, humans can recognize MLDs generated from a variety of common human movements. This dissertation explores the high level representations and computational processes required for the recognition task. The structures and algorithms are articulated in the language of structured connectionist models. The implemented network can discriminate three human gaits from data generated by several actors. Recognition of any motion involves indexing into stored models of movement. We present a representation for such models, called scenarios, based on coordinated sequences of discrete motion events. A method for indexing into this representation is described. We develop a parallel model of spatial and conceptual attention that is essential for disambiguating the spatially and temporally diffuse MLD data. The major computational problems addressed are (1) representation of time varying visual models (2) integration of visual stimuli over time (3) gestalt formation in and between spatially-localized feature maps and central movement representations (4) contextual feedback to lower levels and (5) the use of attention to focus processing on particular spatial locations and particular high level representations. Several novel connectionist mechanisms are developed and used in the implementation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1992
Accession Number
ADA256046

Entities

People

  • Nigel H. Goddard

Organizations

  • University of Rochester

Tags

Communities of Interest

  • Energy and Power Technologies
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Cognitive Science
  • Computational Science
  • Computer Languages
  • Computer Programming
  • Computer Science
  • Computer Vision
  • Computers
  • Debugging
  • Information Science
  • Neural Networks
  • Pattern Recognition
  • Psychology
  • Three Dimensional
  • Two Dimensional

Fields of Study

  • Computer science

Readers

  • Computer Vision.
  • Neural Network Machine Learning.
  • Ocean-Atmosphere Mesoscale Modeling, Data Assimilation, and Flux Boundary Layers

Technology Areas

  • AI & ML
  • Autonomy
  • Autonomy - Autonomous System Control