Local Spatial Frequency Analysis for Computer Vision

Abstract

A sense of vision is a prerequisite for a robot to function in an unstructured environment. However, real-world scenes contain many interacting phenomena that lead to complex images which are difficult to interpret automatically. Typical computer vision research proceeds by analyzing various effects in isolation (e.g. shading, texture, stereo, defocus), usually on images devoid of realistic complicating factors. This leads to specialized algorithms which fail on real-world images. Part of this failure is due to the dichotomy of useful representations for these phenomena. Some effects are best described in the spatial domain, while others are more naturally expressed in frequency. In order to resolve this dichotomy, we present the combined space/frequency representation which, for each point in an image, shows the spatial frequencies at that point. Within this common representation, we develop a set of simple, natural theories describing phenomena such as texture, shape, aliasing and lens parameters. We show these theories lead to algorithms for shape from texture and for dealiasing image data. The space/frequency representation should be a key aid in untangling the complex interaction of phenomena in images, allowing automatic understanding of real-world scenes.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 1990
Accession Number
ADA222496

Entities

People

  • John Krumm
  • Steven Arthur Shafer

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • Energy and Power Technologies
  • Materials and Manufacturing Processes
  • Space

DTIC Thesaurus Topics

  • Algorithms
  • Artificial Intelligence
  • Cameras
  • Computer Stereo Vision
  • Computer Vision
  • Detectors
  • Frequency
  • Frequency Domain
  • Geometry
  • Image Processing
  • Images
  • Jet Propulsion
  • Pattern Recognition
  • Recognition
  • Signal Processing
  • Three Dimensional
  • Two Dimensional

Fields of Study

  • Computer science

Readers

  • Computer Vision.
  • Theoretical Analysis.

Technology Areas

  • AI & ML
  • Autonomy
  • Space