Efficient Estimation of Spatially Varying Subsurface Scattering Parameters for Relighting

Abstract

We present an image-based technique to rapidly acquire spatially varying subsurface reflectance properties of a human face. The estimated properties can be used directly to render faces with spatially varying scattering, or can be used to estimate a robust average across the face. We demonstrate our technique with renderings of peoples faces under novel, spatially-varying illumination and provide comparisons with current techniques. Our captured data consists of images of the face from a single viewpoint under two small sets of projected images. The first set, a sequence of phase shifted periodic stripe patterns, provides a per-pixel profile of how light scatters from adjacent locations. The second set contains structured light and is used to obtain face geometry. We match the observed reflectance profiles to scattering properties predicted by a scattering model using a lookup table. From these properties we can generate images of the face under any incident illumination, including local lighting. The rendered images exhibit realistic subsurface transport, including light bleeding across shadow edges. Our method works more than an order of magnitude faster than current techniques for capturing subsurface scattering information, and makes it possible for the first time to capture these properties over an entire face.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 27, 2006
Accession Number
AD1158469

Entities

People

  • Andrew Gardner
  • Andrew K. Jones
  • Greg Turk
  • Ignacio Llamas
  • Paul Debevec
  • Sarah Tariq

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Absorption
  • Absorption Coefficients
  • Acquisition
  • Boltzmann Equation
  • Cameras
  • Coefficients
  • Computer Graphics
  • Equations
  • Geometry
  • Graphics
  • Images
  • Light Sources
  • Materials
  • Measurement
  • Optical Properties
  • Reflectance
  • Reflection
  • Scattering

Fields of Study

  • Physics

Readers

  • Image Processing and Computer Vision.
  • Systems Analysis and Design
  • Wave Propagation and Nonlinear Chaotic Dynamics.