Compressive epsilon photography for post-capture control in digital imaging

Abstract

A traditional camera requires the photographer to select the many parameters at capture time. While advances in light field photography have enabled post-capture control of focus and perspective, they suffer from several limitations including lower spatial resolution, need for hardware modifications, and restrictive choice of aperture and focus setting. In this paper, we propose "compressive epsilon photography," a technique for achieving complete post-capture control of focus and aperture in a traditional camera by acquiring a carefully selected set of 8 to 16 images and computationally reconstructing images corresponding to all other focus-aperture settings. We make the following contributions: first, we learn the statistical redundancies in focal-aperture stacks using a Gaussian Mixture Model; second, we derive a greedy sampling strategy for selecting the best focus-aperture settings; and third, we develop an algorithm for reconstructing the entire focal-aperture stack from a few captured images. As a consequence, only a burst of images with carefully selected camera settings are acquired. Post-capture, the user can then select any focal-aperture setting of choice and the corresponding image can be rendered using our algorithm. We show extensive results on several real data sets.

Document Details

Document Type
Pub Defense Publication
Publication Date
Jul 27, 2014
Source ID
10.1145/2601097.2601207

Entities

People

  • Ashok Veeraraghavan
  • Aswin C. Sankaranarayanan
  • Atsushi Ito
  • Kaushik Mitra
  • Salil Tambe

Organizations

  • Carnegie Mellon University
  • Division of Computing and Communication Foundations
  • Division of Information and Intelligent Systems
  • Office of Naval Research
  • Rice University
  • Sony Corporation of America
  • Sony Group

Tags

Fields of Study

  • Computer science
  • Physics

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Computer Vision.
  • Systems Analysis and Design