Light field transfer: Global illumination between real and synthetic objects

Oliver Cossairt*, Shree Nayar, Ravi Ramamoorthi

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Scopus citations


We present a novel image-based method for compositing real and synthetic objects in the same scene with a high degree of visual realism. Ours is the first technique to allow global illumination and near-field lighting effects between both real and synthetic objects at interactive rates, without needing a geometric and material model of the real scene. We achieve this by using a light field interface between real and synthetic components-thus, indirect illumination can be simulated using only two 4D light fields, one captured from and one projected onto the real scene. Multiple bounces of inter-reflections are obtained simply by iterating this approach. The interactivity of our technique enables its use with time-varying scenes, including dynamic objects. This is in sharp contrast to the alternative approach of using 6D or 8D light transport functions of real objects, which are very expensive in terms of acquisition and storage and hence not suitable for real-time applications. In our method, 4D radiance fields are simultaneously captured and projected by using a lens array, video camera, and digital projector. The method supports full global illumination with restricted object placement, and accommodates moderately specular materials. We implement a complete system and show several example scene compositions that demonstrate global illumination effects between dynamic real and synthetic objects. Our implementation requires a single point light source and dark background.

Original languageEnglish (US)
Title of host publicationSIGGRAPH'08
Subtitle of host publicationInternational Conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2008 Papers 2008
StatePublished - Dec 18 2008
EventACM SIGGRAPH 2008 Papers 2008, SIGGRAPH'08 - Los Angeles, CA, United States
Duration: Aug 11 2008Aug 15 2008


OtherACM SIGGRAPH 2008 Papers 2008, SIGGRAPH'08
Country/TerritoryUnited States
CityLos Angeles, CA


  • Augmented reality
  • Global illumination
  • Image-based relighting
  • Light field

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction


Dive into the research topics of 'Light field transfer: Global illumination between real and synthetic objects'. Together they form a unique fingerprint.

Cite this