Computational Interferometric Imaging

Presenters

Description

This course provides an overview of recent developments in computational interferometric imaging. We provide background on interferometric imaging and describe emerging technologies capable of unprecedented micrometer depth and femtosecond timing resolutions. We show applications on active and passive 3D imaging, transient imaging, non-line-of-sight imaging, and imaging through scattering media.

Agenda

Times are approximate. Slides for each course section are available below.

Recording

Slides

The slides for this course are available on the ACM Digital Library and locally.

SIGGRAPH blog

The SIGGRAPH blog featured our course! You can read our interview here.

References

The following is a list of references to papers we highlight in each section of the course. It is not an exhaustive, or even representative, bibliography for the corresponding research areas. For pointers to additional resources, we recommend perusing the bibliography of these references.

Background on interferometry

• Computational Interferometric Imaging
  Alankar Kotwal
  PhD thesis, Robotics Institute, Carnegie Mellon University, 2023
• Reflections about the holographic and non-holographic acquisition of surface topography: where are the limits?
  G. Häusler, F. Willomitzer
  Light: Advanced Manufacturing, 2023
• Synthetic Wavelength Imaging -- Utilizing Spectral Correlations for High-Precision Time-of-Flight Sensing
  Florian Willomitzer
  Computational Imaging for Scene Understanding - Transient, Spectral, and Polarimetric Analysis, ISTE Sciences, 2023

Synthetic wavelength interferometry

• SH-ToF: Micro resolution time-of-flight imaging with superheterodyne interferometry
  Fengqiang Li, Florian Willomitzer, Prasanna Rangarajan, Adreas Velten, Mohit Gupta, Oliver Cossairt
  IEEE International Conference on Computational Photography (ICCP), 2018
• Mega-pixel time-of-flight imager with GHz modulation frequencies
  Fengqiang Li, Florian Willomitzer, Prasanna Rangarajan, Oliver Cossairt
  OSA Computational Optical Sensing and Imaging (COSI), 2019
• WISHED: Wavefront imaging sensor with high resolution and depth ranging
  Yicheng Wu^*, Fengqiang Li^*, Florian Willomitzer, Ashok Veeraraghavan, Oliver Cossairt
  IEEE International Conference on Computational Photography (ICCP), 2020
• Exploiting wavelength diversity for high resolution time-of-flight 3D imaging
  Fengqiang Li^*, Florian Willomitzer^*, Muralidhar M. Balaji, Prasanna Rangarajan, Oliver Cossairt
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
• Swept-angle synthetic wavelenght interferometry
  Alankar Kotwal, Anat Levin, Ioannis Gkioulekas
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Partially-coherent interferometry

• Interferometric transmission probing with coded mutual intensity
  Alankar Kotwal, Anat Levin, Ioannis Gkioulekas
  ACM Transactions on Graphics (SIGGRAPH), 2020

Non-line-of-sight imaging

• A theory of Fermat paths for non-line-of-sight shape reconstruction
  Shumian Xin, Sotiris Nousias, Kiriakos N. Kutulakos, Aswin C. Sankaranarayanan, Srinivasa G. Narasimhan, Ioannis Gkioulekas
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2019
• Synthetic wavelength holography: An extension of Gabor's holographic principle to imaging with scattered wavefronts
  Florian Willomitzer, Prasanna Rangarajan, Fengqiang Li, Muralidhar M. Balaji, Marc P. Christensen, Oliver Cossairt
  arXiv Preprint, 2019
• High reoslution non-line-of-sight imaging with superheterodyne remote digital holography
  Florian Willomitzer, Fengqiang Li, Muralidhar M. Balaji, Prasanna Rangarajan, Oliver Cossairt
  OSA Computational Optical Sensing and Imaging (COSI), 2019
• Fast non-line-of-sight imaging with high-resolution and wide field of biew using synthetic wavelength holography
  Florian Willomitzer, Prasanna Rangarajan, Fengqiang Li, Muralidhar M. Balaji, Marc P. Christensen, Oliver Cossairt
  Nature Communications, 2021

Transient imaging

• Micron-scale light transport decomposition using interferometry
  Ioannis Gkioulekas, Anat Levin, Frédo Durand, Todd Zickler
  ACM Transactions on Graphics (SIGGRAPH), 2015
• Towards synthetic light-in-flight
  Patrick Cornwall, Manuel Ballester, Heming Wang, Florian Willomitzer
  Optica Computational Optical Sensing and Imaging (COSI), 2023

Single-shot acquisition of synthetic fields

• Single-shot ToF sensing with sub-mm precision using conventional CMOS sensors
  Manuel Ballester^*, Heming Wang^*, Jiren Li, Oliver Cossairt, Florian Willomitzer
  arXiv Preprint, 2022
• Dynamic high-Precision 3D measurements with an interferometric single-shot ToF camera
  Manuel Ballester^*, Heming Wang^*, Jiren Li, Oliver Cossairt, Florian Willomitzer
  Optica Computational Optical Sensing and Imaging (COSI), 2023

Passive interferometry

• Passive micron-scale time-of-flight with sunlight interferometry
  Alankar Kotwal, Anat Levin, Ioannis Gkioulekas
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2023

Speckle rendering

• A Monte Carlo framework for rendering speckle statistics in Scattering Media [code]
  Chen Bar, Marina Alterman, Ioannis Gkioulekas, Anat Levin
  ACM Transactions on Graphics (SIGGRAPH), 2019
• Rendering near-field speckle statistics in scattering media
  Chen Bar, Ioannis Gkioulekas, Anat Levin
  ACM Transactions on Graphics (SIGGRAPH Asia), 2020

Sponsors

This course was supported by NSF awards 1730147, 2008123, 2047341, a Sloan Research Fellowship for Ioannis Gkioulekas, and an OPTICA 20th Anniversary Challenge Winner Grant for Florian Willomitzer. We are also grateful to the sponsors of the individual research projects presented in this course (NSF, ONR, DARPA, OPTICA, Sloan Foundation, Amazon Web Services).