Associate Research Professor in the Robotics Institute, School of Computer Science;
Courtesy Professor in the Electrical and Computer Engineering (ECE) department;
Director of the Master of Science Computer Vision (MSCV) Program
Carnegie Mellon University

Research Fellow in the Institute of Industrial Science at the
University of Tokyo

Keywords: computer vision, human activity forecasting, first-person vision, inverse reinforcement learning, deep learning, assistive technologies for the blind
Research Focus:
The vision of our lab is to realize robust autonomous systems built for real-world perception and interactive decision-making. The key focus areas of our lab are perception, decision-making and interaction. Our focus is broad because we believe that innovating at the system-level requires expertise and integration at the component level.

We innovate across the full spectrum of perception including vision-based human pose estimation, action recognition, object detection/tracking/forecasting, 3D scene understanding. We formulate models for decision-making including approaches such as reinforcement learning, inverse reinforcement learning, imitation learning and game-theoretic modeliing. We develop real-world systems to enable cyber-physical interaction including wearable camera systems, multi-modal sensors, portable navigational aides and assistive mobile robots.

Hiring Information:
(July 2019) CMU students: I will be hiring at all levels in the Fall. Please contact me during orientation week to setup a brief intervew.
(July 2019) Postdoc position available in computer vision, inverse reinforcement learning or accessibility.

Short Bio
Associate Research Professor at CMU (2019-present)
MSCV Program Director (2018-present)
Assistant Research Professor at CMU (2016-2019)
Systems Scientist at CMU (2013-2016)
Postdoctoral Research Fellow at CMU with Martial Hebert and Drew Bagnell (2011-2013)
Jyokyo (Research Associate / Assistant Professor) at UEC Tokyo (2008-2011)
Visiting scholar at UCSD with Serge Belongie (2010)
University of Tokyo (MS 2005, PhD 2008)
Engineer at KLA-Tencor (2000-2003)
University of Southern California (BS, Electrical Engineering 2000)


Research Projects

Research Sponsors
Shimizu Construction
Facebook Reality Labs
Highmark / Allegheny General Hospital