SCS Faculty Candidate Talk

  • Gates&Hillman Centers
  • ASA Conference Room 6115
  • Systems Scientist
  • Robotics Institute
  • Carnegie Mellon University

First-Person Vision

The number of wearable cameras will account for nearly 1/3 of the consumer camera market in a few years. As a result, there has been an increasing interest in the application of computer vision technology to videos recorded by wearable cameras, also called first-person vision. In my talk, I will give a review of the state-of-the-art in this re-emerging area of research and describe my vision for research in the area of first-person vision. Specifically, I will describe how the first-person point-of-view can be used to help computers understand how people (1) interact with the environment and (2) interact with other people. The presented work will show how the wearable nature of the camera allows for detailed analysis of hand use and the subtleties of social interactions. Furthermore, I will give an example of how the mobile nature of the camera can be used to understand the functionality of large physical spaces to enable large-scale scene understanding. Finally, I will describe how the technologies developed through my work can be integrated into several assistive applications such as navigation for the blind and post-stroke rehabilitation.

Kris Kitani is a Systems Scientist in the Robotics Institute at Carnegie Mellon University. He specializes in the area of human activity understanding from video. His work on learning actions from video was awarded the Best Paper Award at the Meeting on Image Recognition and Understanding (MIRU) 2008, the largest computer vision conference in Japan, and the Best Journal Paper Award from the Institute of Electronics, Information and Communications Engineers (IEICE) in 2010. His work on activity forecasting was awarded the Best Paper Honorable Mention Award at the European Conference on Computer Vision (ECCV) in 2012. He is currently an Associate Editor of the IEEE THMS journal special issue on Wearable and Ego-vision Systems for Augmented Experience and has organized several workshops on Egocentric (First-Person) Vision at CVPR. His work has been featured in the popular press such as the Wall Street Journal, Washington Post and ABC news.

For More Information, Please Contact: