Chao Liu

PhD Student

Robotics Institute
Carnegie Mellon University
5000 Forbes Ave
Pittsburgh, PA 15213








Office: Smith Hall 117
Email: chaoliu1 AT cs.cmu.edu

I am a PhD student in Robotics Institute at Carnegie Mellon University. Before coming to CMU, I received Master degree from Imaging Science Department at Rochester Institute of Technology working with Jinwei Gu and Bachelor degree from University of Electronic Science and Technology of China. I am advised by Srinivasa Narasimhan and Artur Dubrawski. My research interest is in computational photography, computer vision and medical imaging.

Research

Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera

We propose a deep learning method to estimate per-pixel depth and its uncertainty continuously from a monocular video stream, with the goal of effectively turning an RGB camera into an RGB-D camera. Unlike prior DL-based methods, we estimate a depth probability distribution for each pixel rather than a single depth value, leading to an estimate of a 3D depth probability volume for each input frame. These depth probability volumes are accumulated over time under a Bayesian filtering framework as more incoming frames are processed sequentially, which effectively reduces depth uncertainty and improves accuracy, robustness, and temporal stability.

Near-Light Photometric Stereo using Circularly Placed Point Light Sources [project]

In this work, we propose a two-stage near-light photometric stereo method using circularly placed point light sources (commonly seen in recent consumer imaging devices like NESTcam, Amazon Cloudcam, etc). Because of the small light source baseline, the change of image intensity for the input image is small. In addition, in the near-light condition, the distant light assumption fails. So the light directions and intensities are not evenly distributed across the scene. Our proposed method tackles both issues.

Matting and Depth Recovery of Thin Structures using a Focal Stack [project]

Thin structures such as fences, grass and vessels are common in photography and scientific imaging. They contribute complexity to 3D scenes with sharp depth variations/discontinuities and mutual occlusions. In this work, we develop a method to estimate the occlusion matte and depths of thin structures from a focal image stack, which is obtained either by varying the focus/aperture of the lens or computed from a one-shot light field image.

Real-time Analysis of Microvascular Blood Flow for Critical Care [project]

We develop real time tools to capture and analyze blood circulation in micro vessels that is important for critical care applications. The tools provide highly detailed blood flow statistics for bedside and surgical care.

Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions [project]

We present a computational imaging method for raw material classification using features of Bidirectional Texture Functions (BTF). We proposed to learn discriminative illumination patterns and texture filters, with which we can directly measure optimal projections of BTFs for classification.

Classifying Raw Materials with Discriminative Illumination [project]

We propose to use coded illumination to directly measure discriminative features for material classification. Optimal illumination patterns---which we call ``discriminative illumination"---are learned from training samples, after projecting to which, the spectral reflectance of different materials are maximally separated.

Publications


Chao Liu , Jinwei Gu, Kihwan Kim, Srinivasa Narasimhan and Jan Kautz
Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera
CVPR 2019 [oral] [pdf]

Chao Liu, Srinivasa G. Narasimhan and Artur W. Dubrawski.
Near-Light Photometric Stereo using Circularly Placed Point Light Sources
ICCP 2018 [Oral] [pdf]

Chao Liu, Artur W. Dubrawski and Srinivasa G. Narasimhan.
Matting and Depth Recovery of Thin Structures using a Focal Stack.
CVPR 2017 [pdf]

Chao Liu, Hernando Gomez, Srinivasa G. Narasimhan, Artur Dubrawski Michael R. Pinsky and Brian Zuckerbraun.
Real-time Visual Analysis of Microvascular Blood Flow for Critical Care.
CVPR 2015 [pdf]

Chao Liu and Jinwei Gu. Discriminative Illumination: Per-Pixel
Classification of Raw Materials based on Optimal Projections of Spectral BRDF.
PAMI 2014 [pdf]

Chao Liu and Jinwei Gu.
Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions.
CVPR 2013 [pdf]

Jinwei Gu and Chao Liu.
Discriminative Illumination: Per-Pixel Classification of Raw Materials based on Optimal Projections of Spectral BRDFs.
CVPR 2012 [Oral] [pdf]