|
Associate Research Professor in the Robotics Institute,
School of Computer Science;
Courtesy Professor in the Electrical and Computer Engineering (ECE) department; Director of the Master of Science Computer Vision (MSCV) Program Carnegie Mellon University Research Fellow in the Institute of Industrial Science at the University of Tokyo Keywords: computer vision, human activity forecasting, first-person vision, inverse reinforcement learning, deep learning, assistive technologies for the blind |
The vision of our lab is to realize robust autonomous systems built for real-world perception and interactive decision-making. The key focus areas of our lab are perception, decision-making and interaction. Our focus is broad because we believe that innovating at the system-level requires expertise and integration at the component level.
We innovate across the full spectrum of perception including vision-based human pose estimation, action recognition, object detection/tracking/forecasting, 3D scene understanding. We formulate models for decision-making including approaches such as reinforcement learning, inverse reinforcement learning, imitation learning and game-theoretic modeliing. We develop real-world systems to enable cyber-physical interaction including wearable camera systems, multi-modal sensors, portable navigational aides and assistive mobile robots.
Hiring Information:
(July 2019) CMU students: I will be hiring at all levels in the Fall. Please contact me during orientation week to setup a brief intervew.
(July 2019) Postdoc position available in computer vision, inverse reinforcement learning or accessibility.
 |
 |
 |
 |
Short Bio
Associate Research Professor at CMU (2019-present)
MSCV Program Director (2018-present)
Assistant Research Professor at CMU (2016-2019)
Systems Scientist at CMU (2013-2016)
Postdoctoral Research Fellow at CMU with Martial Hebert and Drew Bagnell (2011-2013)
Jyokyo (Research Associate / Assistant Professor) at UEC Tokyo (2008-2011)
Visiting scholar at UCSD with Serge Belongie (2010)
University of Tokyo (MS 2005, PhD 2008)
Engineer at KLA-Tencor (2000-2003)
University of Southern California (BS, Electrical Engineering 2000)
News
Aug. 2019 3 Papers Accepted to ICCV 2019!
Feb. 2019 Paper on Network Compression using BO accepted to ICLR 2019!
Dec. 2018 Two papers accepted to CHI2019!
Dec. 2018 Cognitive Assistance Lab website updated!
Nov. 2018 Two papers accepted to WACV2019!
Sep. 2018 Two papers accepted to CORL 2018!
Jul. 2018 Two papers accepted to ECCV2018!
Jul. 2018 Paper on Deep Image Hashing accepted to BMVC 2018!
May. 2018 Paper on Network Compression using RL accepted to ICLR 2018!
Jan. 2018 4 papers accepted to WACV 2018!
Nov. 2017 2 papers accepted to AAAI 2018!
Oct. 2017 Paper awarded Marr Prize honorable mention at ICCV!
Jul. 2017 Two papers accepted to ICCV 2017!
Apr. 2017 Paper on Multi-Agent Forecasting accepted to CVPR 2017!
Feb. 2017 Best Paper Honorable Mention at CHI 2017!
Research Projects
|
Online Inverse Reinforcement Learning for First-Person Vision |
|
Navigation for the Blind |
|
First-person Vision Activity Recognition |
|
Learning Actions Maps |
|
Game Theoretic Multi-Agent Forecasting |
|
Forecasting Wide Receiver Trajectories |
|
Pedestrian Detection by Synthesis |
|
Visual Grasp Analysis |
|
EgoAction Analysis |
|
BallCam! |
|
Activity Forecasting |
|
Forecasting Interactions |
|
Hand Detection and Analysis |
Research Sponsors
CATERPILLAR
Shimizu Construction
DENSO
Facebook Reality Labs
Amazon
Highmark / Allegheny General Hospital
NSF NRI
IARPA DIVA
NIDILRR
DHS