Matthew P. O'Toole

Robotics Institute & Computer Science Department
School of Computer Science
Carnegie Mellon University

Status:Assistant Professor
Email:mpotoole [at] cmu [dot] edu
Office:Smith Hall, Rm. 215, 4800 Forbes Ave.
Pittsburgh, Pennsylvania 15213

Link to course website for 16385: Computer Vision

Want to schedule a meeting? Please check my calendar first to suggest an appropriate time.

Hi there! I am an Assistant Professor with the Robotics Institute and Computer Science Department in the School of Computer Science at Carnegie Mellon University. My research interests span many topics across computer graphics and computer vision, but I'm particularly interested in computational imaging: a field that combines optics, electronics, and computational processing to capture or display new forms of visual information.

Prior to joining CMU, I was a Banting Postdoctoral Scholar with the Department of Electrical Engineering at Stanford University, and received my Ph.D. in Computer Science at the University of Toronto. My thesis titled "Optical Linear Algebra for Computational Light Transport" received the ACM SIGGRAPH Outstanding Thesis Honourable Mention award in 2017. I'm also the recipient of an NSF CAREER award, best paper awards at SIGGRAPH 2023, CVPR 2022, CVPR 2014, and ICCV 2007, and best demo awards at ICCP 2023, CVPR 2015, and ICCP 2015.

Publications  [Google Scholar]

Light-Efficient Holographic Illumination for Continuous-Wave Time-of-Flight Imaging

Dorian Chan, Matthew O'Toole. ACM SIGGRAPH Asia, 2023.
Paper

Neural Fields for Structured Lighting

Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole. Proc. of IEEE International Conference on Computer Vision (ICCV), 2023.
Project page

SpinCam: High-Speed Imaging via a Rotating Point-Spread Function

Dorian Chan, Mark Sheinin, Matthew O'Toole. Proc. of IEEE International Conference on Computer Vision (ICCV), 2023.
Project page

Split-Lohmann Multifocal Displays

Yingsi Qin, Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan. ACM SIGGRAPH, 2023.
Project page (Awarded "Best Paper" at SIGGRAPH, and "Best Demo" at ICCP 2023)

ST-MVDNet++: Improve Vehicle Detection with Lidar-Radar Geometrical Augmentation via Self-Training

Yu-Jhe Li, Matthew O'Toole, Kris Kitani. ICASSP, 2023.
Paper

Enhancing speckle statistics for imaging inside scattering tissue

Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan, Anat Levin. Optica, 2022.
Paper

Azimuth Super-Resolution for FMCW Radar in Autonomous Driving

Yu-Jhe Li, Shawn Hunt, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2023.
Paper

Analyzing Physical Impacts using Transient Surface Wave Imaging

Tianyuan Zhang, Mark Sheinin, Dorian Chan, Mark Rau, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2023.
Project page

Implicit Neural Head Synthesis via Controllable Local Deformation Fields

Chuhan Chen, Matthew O'Toole, Gaurav Bharaj, Pablo Garrido. CVPR, 2023.
Project page

HyperReel: High-fidelity 6-DoF video with ray-conditioned sampling

Benjamin Attal, Jia-Bin Huang, Christian Richardt, Michael Zollhoefer, Johannes Kopf, Matthew O'Toole, Changil Kim. CVPR, 2023. (Highlight)
Project page

Adjoint Nonlinear Ray Tracing

Arjun Teh, Matthew O'Toole, Ioannis Gkioulekas. ACM SIGGRAPH, 2022.
Project page

Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators

Suyeon Choi*, Manu Gopakumar*, Yifan (Evan) Peng, Jonghyun Kim, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2022.
Project page

Towards Mixed-State Coded Diffraction Imaging

Benjamin Attal, Matthew O'Toole. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
Project page

Holocurtains: Programming Light Curtains via Binary Holography

Dorian Chan, Srinivas Narasimhan, Matthew O'Toole. Computer Vision and Pattern Recognition (CVPR), 2022.
Project page

Dual-Shutter Optical Vibration Sensing

Mark Sheinin, Dorian Chan, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2022. (Oral) (Awarded "Best Paper Honourable Mention")
Project page

Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection

Yu-Jhe Li, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2022.
Paper

TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis

Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Project page

Multi-Echo LiDAR for 3D Object Detection

Yunze Man, Xinshuo Weng, Prasanna Sivakumar, Matthew O'Toole, Kris Kitani. Internal Conference on Computer Vision (ICCV), 2021.
Paper

Deconvolving Diffraction for Fast Imaging of Sparse Scenes

Mark Sheinin, Matthew O'Toole, Srinivasa Narasimhan. International Conference on Computational Photography (ICCP), 2021.
Project page

Reference Wave Design for Wavefront Sensing

Wei-Yu Chen, Anat Levin, Matthew O'Toole, Aswin C. Sankaranarayanan. International Conference on Computational Photography (ICCP), 2021.
Paper

All-In-One Drive: A Comprehensive Perception Dataset with High-Density Long-Range Point Clouds

Xinshuo Weng, Yunze Man, Jinhyung Park, Ye Yuan, Matthew O'Toole, Kris Kitani. arXiv, 2020.
Project page

Diffraction Line Imaging

Mark Sheinin, Dinesh Reddy, Matthew O'Toole, Srinivasa Narasimhan. European Conference on Computer Vision (ECCV), 2020. (Oral)
Project page

Efficient Non-Line-of-Sight Imaging from Transient Sinograms

Mariko Isogawa, Dorian Chan, Ye Yuan, Kris Kitani, Matthew O'Toole. European Conference on Computer Vision (ECCV), 2020.
Project page

Efficient Non-Line-of-Sight Imaging with Computational Single-Photon Imaging

David B. Lindell, Matthew O'Toole, Gordon Wetzstein. SPIE, 2020. (Invited paper)
Paper

An Extensible Multi-Sensor Fusion Framework for 3D Imaging

Talha Ahmad Siddiqui, Rishi Madhok, Matthew O'Toole. CVPR Workshop on Autonomous Driving, 2020.
Paper

Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation

Mariko Isogawa, Ye Yuan, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2020.
Project page

Wave-based Non-Line-of-Sight Imaging using Fast f-k Migration

David B. Lindell, Gordon Wetzstein, Matthew O'Toole. ACM SIGGRAPH, 2019.
Project page

Non-Line-of-Sight Imaging with Partial Occluders and Surface Normals

Felix Heide, Matthew O'Toole, Kai Zang, David B. Lindell, Steven Diamond, Gordon Wetzstein. ACM Trans. on Graphics, 2019.
Project page

Single-Photon 3D Imaging with Deep Sensor Fusion

David B. Lindell, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2018.
Project page

Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging

Brandon M. Smith, Matthew O'Toole, Mohit Gupta. Computer Vision and Pattern Recognition (CVPR), 2018. (Spotlight)
Project page

Towards Transient Imaging at Interactive Rates with Single-Photon Sensors

David B. Lindell, Matthew O'Toole, Gordon Wetzstein. International Conference on Computational Photography (ICCP), 2018.
Project page

Confocal Non-Line-of-Sight Imaging Based on the Light Cone Transform

Matthew O'Toole, David B. Lindell, Gordon Wetzstein. Nature, 2018.
Project page

Reconstructing Transient Images from Single-Photon Sensors

Matthew O'Toole, Felix Heide, David B. Lindell, Kai Zang, Steven Diamond, Gordon Wetzstein. Computer Vision and Pattern Recognition (CVPR), 2017. (Spotlight)
Project page

Primal-Dual-Coding CMOS Image Sensor Architecture

Navid Sarhangnejad, Hyunjoong Lee, Nikola Katic, Matthew O'Toole, Kiriakos N. Kutulakos, Roman Genov. International Image Sensor Workshop (IISW), 2017.
Paper

Ph.D. Thesis: Optical Linear Algebra for Computational Light Transport

Matthew O'Toole. University of Toronto, 2016. (Awarded "ACM SIGGRAPH Outstanding Thesis, Honourable Mention")
Thesis (35.4 MB)

3D Shape and Indirect Appearance by Structured Light Transport

Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016.
Paper

Homogeneous Codes for Energy-Efficient Illumination and Imaging

Matthew O'Toole, Supreeth Achar, Srinivasa G. Narasimhan, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2015. (Awarded "Best Demo" at ICCP 2015 and CVPR 2015)
Project page
Episcan3D

Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras

Lei Xiao, Felix Heide, Matthew O'Toole, Andreas Kolb, Matthias B. Hullin, Kiriakos N. Kutulakos, Wolfgang Heidrich. Computer Vision and Pattern Recognition (CVPR), 2015.
Project page

Transport-aware imaging

Kiriakos N. Kutulakos and Matthew O'Toole. SPIE OPTO, 2015. (Invited paper)
Paper

Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport

Matthew O'Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2014.
Project page

Course: Computational Cameras and Displays

Matthew O'Toole and Gordon Wetzstein. ACM SIGGRAPH Course, 2014.
Course page

3D Shape and Indirect Appearance by Structured Light Transport

Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. Computer Vision and Pattern Recognition (CVPR), 2014. (Oral) (Awarded "Best Paper Honourable Mention")
Project page

Decomposing Global Light Transport using Time of Flight Imaging

Di Wu, Andreas Velten, Matthew O'Toole, Belen Masia, Amit Agrawal, Qionghai Dai, Ramesh Raskar. International Journal of Computer Vision (IJCV), 2013.
Paper

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Di Wu, Gordon Wetzstein, Christopher Barsi, Thomas Willwacher, Matthew O'Toole, Nikhil Naik, Qionghai Dai, Kiriakos N. Kutulakos, Ramesh Raskar. European Conference on Computer Vision (ECCV), 2012.
Project page

Primal-Dual Coding to Probe Light Transport

Matthew O'Toole, Ramesh Raskar, and Kiriakos N. Kutulakos. ACM SIGGRAPH, 2012.
Project page

Decomposing Global Light Transport using Time of Flight Imaging

Di Wu, Matthew O'Toole, Andreas Velten, Amit Agrawal, and Ramesh Raskar. Computer Vision and Pattern Recognition (CVPR), 2012. (Oral)
Paper

Optical Computing for Fast Light Transport Analysis

Matthew O'Toole and Kiriakos N. Kutulakos. ACM SIGGRAPH Asia, 2010.
Project page

A Basis Illumination Approach to BRDF Measurement

Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole. International Journal of Computer Vision (IJCV), 2010.
Paper

M.Sc. Report: Light Transport Analysis by Krylov Subspace Illumination

Matthew O'Toole. University of Toronto, 2009. (Uploaded on September 2018.)
Report

BRDF Acquisition with Basis Illumination

Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole. Proc. of IEEE International Conference on Computer Vision (ICCV), 2007. (Oral) (Awarded "Marr Prize Honourable Mention")
Project page

Undergraduate Honours Thesis: Real-time Rendering of Acquired BRDF Data Sets

Matthew O'Toole. University of British Columbia, 2007.
Paper