Facial Cartography: Interactive Scan Correspondence

Abstract

We present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions without requiring intermediate pose sequences such that they can be used, together with reflectance maps, to create high-quality blend shape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 05, 2011
Accession Number
AD1158621

Entities

People

  • Abhijeet Ghosh
  • Arno Hartholt
  • Borom Tunwattanapong
  • Cyrus A. Wilson
  • Jay Busch
  • Oleg Alexander
  • Paul Debevec
  • Pieter Peers

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Cartography
  • Computations
  • Computer Graphics
  • Computers
  • Conformal Mapping
  • Cross Correlation
  • Geometry
  • High Resolution
  • Image Processing
  • Maps
  • Military Research
  • Shape
  • Surface Properties
  • Three Dimensional
  • Visualizations

Readers

  • Computer Vision.
  • Database Systems and Applications