Shape, Illumination, and Reflectance from Shading

Abstract

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely on multiple observations of the same scene to overconstrain the problem. Recovering these same properties from a single image seems almost impossible in comparison there are an infinite number of shapes, paint, and lights that exactly reproduce a single image. However, certain explanations are more likely than others: surfaces tend to be smooth, paint tends to be uniform, and illumination tends to be natural. We therefore pose this problem as one of statistical inference, and define an optimization problem that searches for the most likely explanation of a single image. Our technique can be viewed as a superset of several classic computer vision problems (shape-from-shading, intrinsic images, color constancy, illumination estimation, etc) and outperforms all previous solutions to those constituent problems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 29, 2013
Accession Number
ADA586648

Entities

People

  • Jitendra Malik
  • Jonathan Barron

Organizations

  • University of California, Berkeley

Tags

Communities of Interest

  • Air Platforms
  • Sensors

DTIC Thesaurus Topics

  • Algorithms
  • Computer Science
  • Computer Vision
  • Computers
  • Curvature
  • Data Science
  • Equations
  • Geometry
  • Illumination
  • Information Science
  • Materials
  • Observation
  • Optimization
  • Reflectance
  • Reliability
  • Statistical Inference
  • Statistics

Fields of Study

  • Computer science

Readers

  • Artificial Intelligence
  • Computer Vision.
  • Educational Psychology

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms