Incident Light Fields
 


Lighting is a key component in the process of rendering realistic and visually interesting images. This has motivated the development of advanced methods for modeling and simulating the lighting in virtual scenes. However, it has proven difficult and time-consuming to realistically model the complex illumination found in most real world environments. Therefore, image based methods have been proposed where Light Probes, omnidirectional High Dynamic Range (HDR) images capturing real world lighting, are used for lighting synthetic objects. This project aims at developing image based lighting techniques and take them to the next level.

In recent years, image based lighting techniques have been successfully incorporated in commercial renderers and production pipelines. By using lighting measurements from the real world, referred to as light probes, in combination with physically based material models, a high level of realism can be achieved. Light probes are measured by capturing omni-directional images of the environment. This is usually done by photographing a curved mirror, such that a 360 degree panoramic image of the environment is registered by the camera. In order to capture the full dynamic range of the illumination in the scene high dynamic range (HDR) imaging techniques are used. 

A light probe measures the light incident at a single point in space. Using image-based lighting techniques this captured lighting can be used to render objects as if illuminated by the real world lighting found at that point at the time of capture. However, limited by the time it takes to capture an HDR image, the practice today is to use a single light probe captured at a single point in space at a single instant in time.

This means that traditional techniques cannot capture and recreate spatially or temporally varying lighting conditions such as dappled lighting or moving light sources. In order to extend this technique we have developed HDR video imaging systems for rapidly capturing large numbers of light probes. The captured light probes are then used to create HDR light fields that describes the illumination in the scene. We call such 4D illumination data sets Incident Light Fields, (ILF). Using our light capture apparatus we can capture illumination varying in time or space and use it as lighting information within global illumination rendering frameworks.  

Related Publications

Publications in 2017
Gabriel Eilertsen, Per-Erik Forssén, Jonas Unger
Proceedings of the Scandinavian Conference on Image Analysis (SCIA17) - 2017

Gabriel Eilertsen, Rafał Mantiuk, Jonas Unger
Computer Graphics Forum (Proceedings of Eurographics 2017), Volume 36, Number 2 - 2017
 
Publications in 2016
Gabriel Eilertsen, Rafał Mantiuk, Jonas Unger
IEEE International Conference on Image Processing (ICIP) - 2016

Apostolia Tsirikoglou, Joel Kronander, Per Larsson, Tanaboon Tongbuasirilai, Andrew Gardner, Jonas Unger
ACM SIGGRAPH 2016 Talks - 2016

Gabriel Eilertsen, Jonas Unger, Rafał Mantiuk
High Dynamic Range Video: From Acquisition, to Display and Applications, Elsevier, page 185-206 - 2016

Gabriel Eilertsen, Rafał Mantiuk, Jonas Unger
ACM SIGGRAPH 2016 Talks - 2016

Ehsan Miandji, Jonas Unger
IEEE International Conference on Image Processing (ICIP) - 2016

Gabriel Eilertsen, Rafał Mantiuk, Jonas Unger
IEEE International Conference on Image Processing (ICIP) - 2016

Jonas Unger, Francesco Banterle, Gabriel Eilertsen, Rafał Mantiuk
Eurographics 2016 Tutorials - may 2016

Andrew Jones, Jonas Unger, Koki Nagano, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Joseph Barreto, Oleg Alexander, Paul Debevec, Mark Bolas
CVPR workshop on Computational Cameras and Displays 2016 - 2016

Jonas Unger, Joel Kronander, Saghi Hajisharif
High Dynamic Range Video: From Acquisition, to Display and Applications, Elsevier, page 62--83 - 2016
 
Publications in 2015
Johan Dahlin, Fredrik Lindsten, Joel Kronander, Thomas B. Schön
arXiv preprint (Under preparation for Journal of Econometrics) - 2015

Saghi Hajisharif, Joel Kronander, Jonas Unger
EURASIP Journal on Image and Video Processing, Volume 2015, Number 41 - dec 2015

Andrew Jones, Jonas Unger, Koki Nagano, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Oleg Alexander, Mark Bolas, Paul Debevec
ACM SIGGRAPH 2015 Emerging Technologies, Number 6, page 6:1--6:1 - 2015

Jonas Unger, Andrew Gardner, Per Larsson, Francesco Banterle
ACM SIGGRAPH Asia 2015 Courses, Number 7 - 2015

Ehsan Miandji, Joel Kronander, Jonas Unger
Eurographics 2015 - May 2015

Joel Kronander, Francesco Banterle, Andrew Gardner, Ehsan Miandji, Jonas Unger
Computer Graphics Forum (Proceedings of Eurographics 2015) - 2015

Joel Kronander
PhD thesis from Linköping University - 2015

Joel Kronander, Thomas B. Schön, Jonas Unger
Proceedings of SIGGRAPH ASIA Technical Briefs - 2015

Gabriel Eilertsen, Rafał Mantiuk, Jonas Unger
ACM Transactions on Graphics (TOG), Volume 34, Number 6 - 2015
 
Publications in 2014
Joel Kronander, Stefan Gustavson, Gerhard Bonnet, Anders Ynnerman, Jonas Unger
Signal Processing : Image Communications, Volume 29, Number 2, page 203 -- 215 - 2014

Joel Kronander, Thomas B. Schön, Johan Dahlin
Proceedings of the IEEE Statistical Signal Processing Workshop (SSP), Gold Coast, Australia - July 2014

Andrew Jones, Jonas Unger, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Oleg Alexander, Paul Debevec
ACM SIGGRAPH 2014 Talks - August 2014

Andrew Gardner, Jonas Unger
Proceeding DigiPro 14 Proceedings of the Fourth Symposium on Digital Productin, page 19 -- 24 - 2014

Saghi Hajisharif, Joel Kronander, Jonas Unger
Eurographics 2014 Short Papers - May 2014

Gabriel Eilertsen, Jonas Unger, Robert Wanat, Rafał Mantiuk
ACM SIGGRAPH 2014 Talks - August 2014

Joel Kronander, Johan Dahlin, Daniel Jönsson, Manon Kok, Thomas B. Schön, Jonas Unger
Eusipco 2014 - 2014

Joel Kronander, Thomas B. Schön
Proceedings of the IEEE Statistical Signal Processing Workshop (SSP), Gold Coast, Australia - July 2014

Apostolia Tsirikoglou, Simon Ekeberg, Johan Vikström, Joel Kronander, Jonas Unger
SIGRAD 2014 - 2014
 
Publications in 2013
Reiner Lenz, Vasileios Zografos, Martin Solli
Springer New York, page 119-145 - 2013

Gabriel Eilertsen, Robert Wanat, Rafał Mantiuk, Jonas Unger
Computer Graphics Forum (Proceedings of Pacific Graphics 2013), Volume 32, Number 7, page 275 - 284 - October 2013

Reiner Lenz, Vasileios Zografos
Computational Color Imaging Workshop (CCIW 2013) - 2013

Ehsan Miandji, Joel Kronander, Jonas Unger
ACM SIGGRAPH 2013 Posters - 2013

Ehsan Miandji, Joel Kronander, Jonas Unger
Proceedings of SIGGRAPH ASIA Technical Briefs - November 2013

Thord Andersson, Gunnar Läthén, Reiner Lenz, Magnus Borga
IEEE Transactions on Image Processing, Volume 22, Number 2, page 621--630 - 2013

Jonas Unger, Joel Kronander, Per Larsson, Stefan Gustavson, Joakim Löw, Anders Ynnerman
Computers and Graphics, Volume 37, Number 7 - November 2013

Gabriel Eilertsen, Jonas Unger, Robert Wanat, Rafał Mantiuk
ACM SIGGRAPH 2013 Talks - 2013

Jonas Unger, Joel Kronander, Per Larsson, Stefan Gustavson, Anders Ynnerman
Proceedings of EUSIPCO 13: Special Session on HDR-video - September 2013

Joel Kronander, Stefan Gustavson, Gerhard Bonnet, Jonas Unger
IEEE International Conference on Computational Photography (ICCP) - 2013
 
Publications in 2012
Gunnar Läthén, Stefan Lindholm, Reiner Lenz, Anders Persson, Magnus Borga
IEEE Transactions on Visualization and Computer Graphics (TVCG), Volume 18, Number 12, page 2345--2354 - 2012

Joakim Löw, Joel Kronander, Anders Ynnerman, Jonas Unger
ACM Transactions on Graphics (TOG), Volume 31, Number 1, page 9:1--9:14 - January 2012

Joel Kronander, Daniel Jönsson, Joakim Löw, Patric Ljung, Anders Ynnerman, Jonas Unger
IEEE Transactions on Visualization and Computer Graphics (TVCG), Volume 18, Number 3, page 447--462 - 2012

Daniel Jönsson, Joel Kronander, Timo Ropinski, Anders Ynnerman
IEEE Transactions on Visualization and Computer Graphics (TVCG), Volume 18, Number 12, page 2364 - 2371 - 2012

Joel Kronander, Stefan Gustavson, Jonas Unger
ACM SIGGRAPH 2012 Posters - 2012

Saghi Hajisharif, Joel Kronander, Ehsan Miandji, Jonas Unger
SIGRAD 2012 - 2012
 
Publications in 2011
Martin Solli, Reiner Lenz
Electronic Letters on Computer Vision and Image Analysis, Volume 10, Number 1, page 24-41 - 2011

Gabriel Eilertsen, Per Larsson, Jonas Unger
SIGRAD 2011 - 2011


Stefan Gustavson, Robin Strand
Pattern Recognition Letters, Volume 32, Number 2, page 252--257 - 2011

Martin Solli, Reiner Lenz
Color Research & Application, Volume 36, Number 3, page 210--221 - 2011

Freddie Astrom, Michael Felsberg, Reiner Lenz
Proceedings of the 17th Scandinavian conference on Image analysis (SCIA), page 262--272 - 2011

Martin Solli, Reiner Lenz
Proceedings of the 17th Scandinavian conference on Image analysis (SCIA), page 218--227 - 2011


Jonas Unger, Stefan Gustavson, Joel Kronander, Per Larsson, Gerhard Bonnet, Gunnar Kaiser
ACM SIGGRAPH 2011 Talks - 2011

Vasileios Zografos, Reiner Lenz
Proceedings of the 17th Scandinavian conference on Image analysis (SCIA), page 579--591 - 2011
 
Publications in 2010
Gunnar Läthén, Jimmy Jonasson, Magnus Borga
Pattern Recognition Letters, Volume 31, Number 8, page 762--767 - 2010

Martin Solli, Reiner Lenz
CGIV 2010: 5th European Conference on Colour in Graphics, Imaging, and Vision, page 353--358 - 2010

Martin Solli, Reiner Lenz
Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR) - 2010

Joel Kronander, Jonas Unger, Torsten Möler, Anders Ynnerman
Computer Graphics Forum (Proceedings of EuroVis 2010), Volume 29, Number 3, page 893--902 - 2010

Gunnar Läthén, Olivier Cros, Hans Knutsson, Magnus Borga
Proceedings of the 20th International Conference on Pattern Recognition (ICPR), page 233--236 - 2010

Toko Kohei, Jinhui Chao, Reiner Lenz
CGIV 2010: 5th European Conference on Colour in Graphics, Imaging, and Vision, page 393--398 - 2010
 
Publications in 2009
Thord Andersson, Gunnar Läthén, Reiner Lenz, Magnus Borga
Proceedings of the 16th Scandinavian conference on Image analysis (SCIA), page 400--409 - 2009

Joakim Löw, Anders Ynnerman, Per Larsson, Jonas Unger
Proceedings of the 2009 Spring Conference on Computer Graphics, page 43--50 - 2009

Jonas Unger
PhD thesis from Linköping Studies in Science and Technology - 2009

Gunnar Läthén, Thord Andersson, Reiner Lenz, Magnus Borga
Scale Space and Variational Methods in Computer Vision, Second International Conference, SSVM 2009, June 1-5, Voss, Norway, page 124--136 - 2009

Ehsan Miandji, Mohammad H. Sargazi M., Faramarz Samavati, Mohammad Emadi
Visual Computer, Volume 25, page 697-705 - 2009
 
Publications in 2008
Jonas Unger, Stefan Gustavson, Per Larsson, Anders Ynnerman
Computer Graphics Forum (Proceedings of EGSR 2008), Volume 27, Number 4, page 12931301 - 2008

Gunnar Läthén, Jimmy Jonasson, Magnus Borga
Proceedings of 19th International Conference on Pattern Recognition (ICPR) - 2008
 
Publications in 2007
Jonas Unger, Stefan Gustavson
ACM SIGGRAPH 2007 Posters - 2007

Gunnar Läthén, Ken Museth, Hamish Carr
Proceddings of EuroVis07 Joint Eurographics: IEEE VGTC Symposium on Visualization, page 179--186 - 2007

Jonas Unger, Stefan Gustavson
Sensors, Cameras, and Systems for Scientific/Industrial Applications VIII (SPIE) 2007, Volume 6501 - 2007

Jonas Unger, Stefan Gustavson, Anders Ynnerman
The Visual Computer, Volume 23, Number 7, page 453--465 - 2007
 
Publications in 2006
Jonas Unger, Stefan Gustavson, Anders Ynnerman
Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia (GRAPHITE), page 341--347 - 2006

Gunnar Läthén, Ola Nilsson, Andreas Söderström, Ken Museth
SIGRAD 2006. The Annual SIGRAD Conference, Special Theme: Computer Games, page 7--11 - 2006
 
Publications in 2005
Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, Paul Debevec
ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005), Volume 24, Number 3, page 756--764 - 2005