From First Contact to Close Encounters: A Developmentally Deep Perceptual System for a Humanoid Robot

Abstract

This thesis presents a perceptual system for a humanoid robot that integrates abilities such as object localization and recognition with the deeper developmental machinery required to forge those competences out of raw physical experiences. It shows that a robotic platform can build up and maintain a system for object localization, segmentation, and recognition, starting from very little. What the robot starts with is a direct solution to achieving figure/ground separation: it simply 'pokes around' in a region of visual ambiguity and watches what happens. If the arm passes through an area, that area is recognized as free space. If the arm collides with an object, causing it to move, the robot can use that motion to segment the object from the background. Once the robot can acquire reliable segmented views of objects, it learns from them, and from then on recognizes and segments those objects without further contact. Both low-level and high-level visual features can also be learned in this way, and examples are presented for both: orientation detection and affordance recognition, respectively.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2003
Accession Number
ADA434779

Entities

People

  • Paul M. Fitzpatrick

Organizations

  • Massachusetts Institute of Technology

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Cognitive Science
  • Computational Science
  • Computer Graphics
  • Computer Languages
  • Computer Programming
  • Computer Vision
  • Computers
  • Control Systems
  • Electrical Engineering
  • Human-Machine Interaction
  • Information Science
  • Machine Learning
  • Medical Personnel
  • Psychology

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computer Vision.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • Autonomy
  • Space
  • Space - Space Objects
  • Space - Spacecraft Maneuvers