Estimating image depth using shape collections
Abstract
Images, while easy to acquire, view, publish, and share, they lack critical depth information. This poses a serious bottleneck for many image manipulation, editing, and retrieval tasks. In this paper we consider the problem of adding depth to an image of an object, effectively 'lifting' it back to 3D, by exploiting a collection of aligned 3D models of related objects. Our key insight is that, even when the imaged object is not contained in the shape collection, the network of shapes implicitly characterizes a shape-specific deformation subspace that regularizes the problem and enables robust diffusion of depth information from the shape collection to the input image. We evaluate our fully automatic approach on diverse and challenging input images, validate the results against Kinect depth readings, and demonstrate several imaging applications including depth-enhanced image editing and image relighting.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- Jul 27, 2014
- Source ID
- 10.1145/2601097.2601159
Entities
People
- Hao Su
- Leonidas J. Guibas
- Niloy J. Mitra
- Qixing Huang
- Yangyan Li
Organizations
- Adobe
- Air Force Office of Scientific Research
- Division of Information and Intelligent Systems
- European Research Council
- Motorola
- National Natural Science Foundation of China
- National Science Foundation Division of Mathematical Sciences
- Seventh Framework Programme
- Stanford University
- University College London