All Research Projects (most recent first)

Programmable Automotive Headlights
The goal is to build vehicular headlight that can be programmed to perform many tasks with a single design to improve driver and traffic safety. Example tasks include producing glare free high beams, reducing visibility of rain and snow, improving visibility of the road and highlighting obstacles.
Inexpensive method to directly estimate Turblence Strength field
This project explores an inexpensive method to directly estimate Turblence Strength field by using only passive multiview observations of a background.
Single-Shot Structured Light Reconstruction that Works for Highly Textured Objects
The goal is to allow structured light system to capture dense shape information of highly textured objects
Model Reducing Deformable Scenes
Novel mathematical framework to extend Galerkin projection to non-polynomial functions with applications to fast fluid simulation and radiosity rendering of deformable scenes.
Radiosity of Translucent Scenes
The goal of the project is to efficiently render both the subsurface scattering of light within objects and the diffuse interreflections between them.
A Headlight that Sees through Rain and Snow
The goal is to build a smart vehicular headlight that can reduce visibility of rain and snow, making it less stressful and more safe for us to drive at night. This website describes the prototype built in 2011-2012.
Human Poses
David Marr inspired hierarchical model of part mixtures is used to sample natural looking human poses. The model is learned from a human image dataset and can be used to estimate human pose from a single test image.
Turbulence
The project aims to model the optical turbulence through hot air and exploits the model to remove turbulence effects from images as well as recover depth cues in the scene.
Structured Light in Sunlight
We have built a structured light sensor for 3D reconstruction that works in sunlight using an off-the-shelf low-power laser projector.
Structured light 3D under Global Illumination
The goal is to recover 3D shapes of complex objects using structured lighting that is robust to interreflections, sub-surface scattering and defocus.
Document Rectification
The image of a deformed document is rectified by tracing the text and recovering the 3D deformation.
Vineyard management
Imaging and measurement of crop and canopy in vineyards.
Multi-layered Display with Water drops
By using precisely controlled valves and a projector-camera system, we create a vibrant, multi-layered water drop display. The display can show static or dynamically generated images on each layer, such as text, videos, or even interactive games.
Flexible Voxels for Motion-Aware Videography
We wish to build video cameras whose spatial and temporal resolutions can be adjusted post-capture depending on the motion in the scene.
Optimal Coded Sampling for Temporal Super-Resolution
Multiple coded exposure cameras are used to obtain temporal super-resolution.
Theoretical guarantees for undistortion
The deformation field between a distorted image and the corresponding template is estimated. Global optimality criteria for the estimation are derived.
Ground Shadow Detector
We have developed a detector to identify shadow boundaries on the ground in low quality consumer photographs.
(De)Focused Illumination and Global Light Transport
Our goal is to recover scene properties in the presence of global illumination. To this end, we study the interplay between global illumination and the depth cue of illumination defocus.
Webcam clipart
We introduce a new, high-quality dataset of calibrated time-lapse sequences. Illumination conditions are estimated in a physically-consistent way and HDR environment maps are generated for each image.
Illumination from a single outdoor image
Given a single outdoor image, we present a method for estimating the likely illumination conditions of the scene.
Undistorting images captured through water fluctuations.
We estimate the shape of the water surface and recover the underwater scene without using any calibration patterns, multiple viewpoints or active illumination.
Display with Water drops
We design a Projector-Camera system for creating a display with water drops that form planar and curved screens.
Shadow Cameras
We generalize dual photography for all types of light-sources using opaque, occluding masks.
Illustrating Motion through DLP Photography
We process photographs taken under DLP lighting to either summarize a dynamic scene or illustrate its motion.
Temporal Dithering of Illumination
We present a framework for fast active vision using Digital Light Processing (DLP) projectors.
What do the sun and sky tell us about the camera?
We analyze two sources of information available within the visible portion of the sky region: the sun position, and the sky appearance.
Optimal placement of cameras and sources in scattering media
Optimal positioning of light sources and cameras for best visibility in impure waters.
Coplanar Shadowgram Imaging
We present a practical approach to SFS using a novel technique called coplanar shadowgram imaging, that allows us to use dozens to even hundreds of views for visual hull reconstruction.
Novel Depth Cues
In this paper, we analyze what kinds of depth cues are possible under uncalibrated near point lighting.
Bone Reconstruction
We present a novel technique to reconstruct the surface of the bone by applying shape-from-shading to a sequence of endoscopic images, with partial boundary in each image.
Endoscopic Imaging
We present a complete calibration of oblique endoscopes.
Frequency Space Analysis of Rain and Snow
Removing rain and snow from videos using a frequency space analysis.
Legendre Fluids
We present a unified framework for reduced space modeling and rendering of dynamic and non-homogenous participating media, like snow, smoke, dust and fog.
Surface Normal Clustering
Scene points can be clustered according to their surface normals, even when the geometry, material and lighting are all unknown.
Scattering Properties by Dilution
We have developed a simple device and technique for robustly estimating the properties of a broad class of participating media.
Single Scattering Model
We are interested in analyzing and rendering the visual effects due to scattering of light by participating media such as fog, mist and haze.
Structured Light in Scattering Media
Laser range finding and photometric stereo in impure waters.
Shedding light on the weather
Estimating visibility and weather condition from light source appearances.
Photometric Invariants
We derive a new class of photometric invariants that can be used for a variety of vision tasks including lighting invariant material segmentation, change detection and tracking, as well as material invariant shape recognition.
Vision through Fog and Haze
Models and algorithms for recovering scene properties from images captured in fog and haze.
WILD Database
Calibrated and HDR time-lapse images of an outdoor scene for a year.
Assorted Pixels: Multidimensional Imaging
This page describes a new technology developed at Columbia's Computer Vision Laboratory that can be used to enhance the dynamic range (range of measurable brightness values) of virtually any imaging system.