Compressive light field sensing

S. Derin Babacan*, Reto Ansorge, Martin Luessi, Pablo Ruiz Mataran, Rafael Molina, Aggelos K. Katsaggelos

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

90 Scopus citations

Abstract

We propose a novel design for light field image acquisition based on compressive sensing principles. By placing a randomly coded mask at the aperture of a camera, incoherent measurements of the light passing through different parts of the lens are encoded in the captured images. Each captured image is a random linear combination of different angular views of a scene. The encoded images are then used to recover the original light field image via a novel Bayesian reconstruction algorithm. Using the principles of compressive sensing, we show that light field images with a large number of angular views can be recovered from only a few acquisitions. Moreover, the proposed acquisition and recovery method provides light field images with high spatial resolution and signal-to-noise-ratio, and therefore is not affected by limitations common to existing light field camera designs. We present a prototype camera design based on the proposed framework by modifying a regular digital camera. Finally, we demonstrate the effectiveness of the proposed system using experimental results with both synthetic and real images.

Original languageEnglish (US)
Article number6248701
Pages (from-to)4746-4757
Number of pages12
JournalIEEE Transactions on Image Processing
Volume21
Issue number12
DOIs
StatePublished - 2012

Funding

Manuscript received March 29, 2011; revised June 12, 2012; accepted June 27, 2012. Date of publication July 25, 2012; date of current version November 14, 2012. This work was supported in part by the Beckman Institute’s Post-Doctoral Fellowship, the Ministerio de Ciencia e Innovacion under Contract TIN2010-15137, the Spanish Research Program Consolider Ingenio 2010: MIPRCV under Grant CSD2007-00018, and the Department of Energy under Grant DE-NA0000457. Preliminary results of this paper appeared at the IEEE Conference on Image Processing, Cairo, Egypt, 2009 [2]. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Xin Li.

Keywords

  • Bayesian methods
  • coded aperture
  • compressive sensing
  • computational photography
  • image reconstruction
  • light fields

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Compressive light field sensing'. Together they form a unique fingerprint.

Cite this