Real-time Geometry and Reflectance Capture for Digital Face Replacement
Abstract
In this work, we develop a real-time geometry capture approach to digital face replacement for a dynamic performance. Digital face replacement has major applications in visual effects for motion pictures as well as interactive applications such as videogames and simulation and training environments. Our approach looks into extending the 3D face scanning technology developed at the ICT Graphics Lab [Ma 2008] to support seamless face replacement along with separated diffuse and specular albedo textures and surface normals for high quality post-production relighting of the captured performance (see Figure 1). Such an approach goes beyond the traditional scope of face replacement techniques that are either completely image based and hence view dependent or typically capture a performance under a fixed lighting condition and hence cannot be relit for usage in other performances [Zhang and Yau 2006].
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 19, 2008
- Accession Number
- AD1171451
Entities
People
- Abhijeet Ghosh
- Andrew K. Jones
- Jay Busch
- Jen-yuan Chiang
- Magnus Lang
- Matthias Hullin
- Paul Debevec
Organizations
- University of Southern California