.: FAQ :: How it Works :: Presentations :: Publications :: Posters :: Acknowledgements :.

Toward a Smart Automotive Headlight for
Seeing Through Rain and Snow


 
Standard vehicle headlights improve driver visibility at night by illuminating the road and the surrounding environment. Unfortunately, they also illuminate raindrops and snowflakes making them appear as bright flickering streaks that are distracting to the driver. We propose a headlight capable of avoiding precipitation to improve driver visibility while adequately illuminating the road. This reduces driver stress and makes roads more safe during rain and snow storms. We have conducted simulations and built a prototype system to show that the approach is feasible and effective. Demonstration of the prototype system with an artificial rain drop generator is encouraging making the falling rain disappear in front of the observer.

  Distracting snow streaks while driving with high and low beams (download video).

Media requests: Please read the FAQ first.
Contact: Prof. Srinivasa Narasimhan

How it Works


systemCollocatedSketch_th.png Overall Approach: The headlight is a co-located imaging and illumination system consisting of a projector, camera, and 50/50 beamsplitter. The camera images the precipitation at the top of the field of view, the processor determines the future locations of the particles and the projector reacts to dis-illuminate the particles. The entire process from capture to reaction takes about 13 ms.
colocated_system_th.jpg Prototype System: Components of our prototype co-located imaging and illumination system.
 
Detecting, predicting and tracking drops: The video on the left showcases our algorithm first acting on a single drop and then on 16 falling drops per second (download video).
 
system_TestbedOnOff2_dark_th.jpg System at Work: Naive illumination on left and fast reactive illumination on right during equivalent of heavy rainfall. Photos captured with long exposure time (2.5s).
 
Making Rain Disappear: Increasing observer visibility by successfully deactivating light rays intersecting generated drops (download video).
Particles System Simulator: Simulator emulates properties of rain, snow, and hail, in addition to the properties of a camera, projector, and processor to measure system performance. Left video shows simulation with moderate rain with vehicle stationary and in motion (download video).
 
plot_our_system_th.jpg plot_ideal_system.jpg Simulation Results: Plots of simulation results with parameters of our prototype system (left) and an ideal system (right).
colocsys_gen_th.jpg Raindrop Generator: Artificial raindrop generator shown with co-location system.

Presentations


ICCP 2012 (Microsoft Research, download)
Research@Intel 2012 (download)

Publications


"Fast Reactive Control for Illumination through Rain and Snow"
Raoul de Charette, Robert Tamburo, Peter Barnum, Anthony Rowe, Takeo Kanade and Srinivasa G. Narasimhan, Proceedings of IEEE Conference on Computational Photography (ICCP), 2012. Winner of the Best Paper Honorable Mention Award


Paper (pdf)
Supplementary video (download)
Presentation slides (pdf, html)

Posters


"Fast Reactive Control for Illumination through Rain and Snow"
Raoul de Charette, Robert Tamburo, Peter Barnum, Anthony Rowe, Takeo Kanade and Srinivasa G. Narasimhan, Presented at 3rd Workshop on SoCs, Heterogeneous Architectures and Workloads at the 18th International Symposium on High Performance Computer Architecture, New Orleans, LA, Feb 2012.

Poster (pdf)

Acknowledgements


This research was supported in parts by an ONR grant N00014-11-1-0295 and an NSF CAREER award IIS-0643628. Robert Tamburo is supported by an Intel Science and Technology Center-Embedded Computing grant. Narasimhan was partly supported by a Samsung Advanced Institute of Technology grant.

back to projects back to top