YASER SHEIKH
Associate Research Professor (Robotics Institute, Carnegie Mellon University)
Office: EDSH 221 (Smith Hall), Phone: (412) 268-1138, Email: yas...@cs.cmu.edu

Publications | Students | Courses | Software/Data | Press | Sponsors | Short Bio | Miscellaneous

 

 

 

Publications

2014

Pose Machines: Articulated Pose Estimation via Inference Machines (oral)
Varun Ramakrishna, Daniel Munoz, Drew Bagnell, Martial Hebert, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2014.

Separable Spatiotemporal Priors for Convex Reconstruction of Time-Varying 3D Point Clouds
Tomas Simon, Jack Valmadre, Iain Matthews, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2014.

Optimal Visibility Estimation for Large-Scale Dynamic 3D Reconstruction (oral) [ project page ]
Hanbyul Joo, Hyun Soo Park, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2014.

3D Object Manipulation in a Single Image using Stock 3D Models [ project page ]
Natasha Kholgade, Tomas Simon, Alexei Efros, and Yaser Sheikh
ACM SIGGRAPH, 2014.

Automatic Video-Editing of Footage from Multiple Social Cameras [ project page ]
Ido Arev, Hyun Soo Park, Yaser Sheikh, Jessica Hodgins, and Ariel Shamir
ACM SIGGRAPH, 2014.

Gaze-based Video-Editing
Eakta Jain, Yaser Sheikh, Ariel Shamir, and Jessica Hodgins
ACM Transactions on Graphics (TOG), (minor revisions).

3D Pose-by-Detection of Vehicles via Discriminatively Reduced Ensembles of Correlation Filters
Yair Movshovitz-Attias, Vishnu Boddeti, Zijun Wei, Yaser Sheikh
British Machine Vision Conference (BMVC), 2014.

Physical Querying with Multi-Modal Sensing - MARVIN: An Intelligent Retailing Assistant
Iljoo Baek, Taylor Stine, Denver Dash, Fanyi Xiao, Yair Movshovitz-Attias, Mei Chen, Yaser Sheikh, Martial Hebert, and Takeo Kanade
IEEE Winter Conference on Application of Computer Vision (WACV), 2014.

Separating Texture and Illumination for Single-Shot Structured Light Reconstruction
Minh Vo, Srinivasa Narasimhan, and Yaser Sheikh
IEEE Workshop on Computational Cameras and Displays (CCD), 2014.

2013

Predicting Primary Gaze Behavior using Social Saliency Fields [ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
IEEE International Conference on Computer Vision (ICCV), 2013

Tracking Human Pose by Tracking Symmetric Parts [ pdf ]
Varun Ramakrishna, Yaser Sheikh, and Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.

Representing and Discovering Adversarial Team Behaviors using Player Roles [ project page ]
Patrick Lucey, Alina Bialkowski, Peter Carr, Iain Matthews, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.

One-Man-Band: A Touch Screen Interface for Producing Live Multi-Camera Sports Broadcasts [ project page ]
Peter Carr, Patrick Lucey, Iain Matthews, Eric Foote, and Yaser Sheikh
ACM International Conference on Multimedia (MM), 2013

3D Point Cloud Reduction Using Mixed-Integer Quadratic Programming
Hyun Soo Park, Yu Wang, Eriko Nurvitadhi, James C Hoe, Yaser Sheikh, and Mei Chen
IEEE Computer Vision and Pattern Recognition Workshop (CVPRW), 2013.

2012

Three-dimensional Proxies for Hand-drawn Characters [ pdf ] [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
ACM Transactions on Graphics (TOG), 2012.

Bilinear Spatiotemporal Basis Models [ project page ] [ code ]
Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, and Yaser Sheikh
ACM Transactions on Graphics (TOG), 2012.

3D Social Saliency from Head-mounted Cameras [ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
Neural Information Processing Systems (NIPS), 2012.

Monocular Object Detection using 3D Geometric Primitives [ pdf ] [ video ]
Peter Carr, Yaser Sheikh, and Iain Matthews
European Conference on Computer Vision (ECCV), 2012.

Reconstructing 3D Human Pose from 2D Image Landmarks [ project page ]
Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2012.

Inferring Artistic Intention in Comic Art through Viewer Gaze[ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
ACM Symposium on Applied Perception (SAP)
, 2012. Best paper honorable mention!

Point-less Calibration: Camera Parameters from Gradient- Based Alignment to Edge Images [ pdf ]
Peter Carr, Yaser Sheikh, and Iain Matthews
IEEE Workshop on the Applications of Computer Vision (WACV), 2012. Best paper award!

2011

Motion Capture from Body-Mounted Cameras [ project page ]
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica Hodgins
ACM SIGGRAPH, 2011.

Trajectory Space: A Dual Representation for Nonrigid Structure from Motion [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2011.

Linearized Motion Estimation for Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2011.

Structure from Motion Blur in Low Light [ pdf ]
Yali Zheng, Shohei Nobuhara, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2011.

3D Reconstruction of a Smooth Articulated Trajectory from a Monocular Image Sequence [ project page ]
Hyun Soo Park and Yaser Sheikh
IEEE International Conference on Computer Vision (ICCV), 2011.

Content Retargeting Using Parameter-Parallel Facial Layers [ project page ]
Natasha Kholgade, Iain Matthews, and Yaser Sheikh
Symposium on Computer Animation (SCA), 2011.

2010

3D Reconstruction of a Moving Point from a Series of 2D Projections (oral) [ project page ]
Hyun Soo Park, Takaaki Shiratori, Iain Matthews, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2010.

Augmenting Hand Animation with Three Dimensional Secondary Motion [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2010. Best paper award!

2009

Matching Trajectories of Anatomical Landmarks under Viewpoint Anthropometric, and Temporal Transforms [ pdf ]
Alexei Gritai, Yaser Sheikh, Cen Rao, and Mubarak Shah
International Journal of Computer Vision (IJCV), 2009.

In Defense of Orthonormality Constraints for Nonrigid Structure from Motion (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, and Sohaib Khan
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2009. (oral)

Modeling the Product Manifold of Posture and Motion
Ankur Datta, Yaser Sheikh, and Takeo Kanade
Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences (THEMIS), 2009. Best paper award!

Dynamic Seethroughs: Synthesizing Hidden Views of Moving Objects [ project page ]
Peter Barnum, Yaser Sheikh, Ankur Datta, and Takeo Kanade
International Symposium of Mixed and Augmented Reality (ISMAR), 2009.

Background Subtraction for Freely Moving Cameras [ pdf ]
Yaser Sheikh, Omar Javed, and Takeo Kanade
IEEE International Conference on Computer Vision (ICCV), 2009.

Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation [ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2009.

2008

Trajectory Association Across Multiple Airborne Cameras
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2008.

Nonrigid Structure from Motion in Trajectory Space (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
Neural Information Processing Systems (NIPS)
, 2008.

On the Sustained Tracking of Human Motion (oral) [ pdf ]
Yaser Sheikh, Ankur Datta, and Takeo Kanade
IEEE International Conference on Automatic Face and Gesture Recognition (FG)
, 2008.

Linear Motion Estimation for Systems of Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)
, 2008.

2007

Mode-seeking by Medoidshifts (oral) [ pdf ]
Yaser Sheikh, Erum Khan, and Takeo Kanade,
IEEE International Conference on Computer Vision (ICCV), 2007.

On the Spacetime Geometry of Galilean Cameras [ pdf ]
Yaser Sheikh, Alexei Gritai, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007

Trajectory Association across Non-overlapping Moving Cameras in Planar Scenes
Yaser Sheikh, Xin Li, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007

2006

Model Generation for Video-based Object Recognition
Humera Noor, Shahid Hafeez Mirza, Yaser Sheikh, Amit Jain, and Mubarak Shah
ACM International Conference on Multimedia, 2006.

Shape from Dynamic Textures for Planes [ pdf ]
Yaser Sheikh, Niels Haering, and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2006.

2005

Bayesian Modeling of Dynamic Scenes for Object Detection [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2005.

On the Use of Computable Features for Film Classification [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
IEEE Transactions on Circuit and System for Video Technology (TCSVT)
, 2005.

Object Tracking Across Multiple Independently Moving Airborne Cameras [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.

Exploring the Space of a Human Action [ pdf ]
Yaser Sheikh, Mumtaz Sheikh, and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.

Bayesian Object Detection in Dynamic Scenes, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2005.

Establishing a Common View from Multiple Moving Aerial Sensors
Yaser Sheikh, Alexei Gritai, Imran Junejo, Robert Muise, Abhijit Mahalanobis, and Mubarak Shah
SPIE Symposium on Defense and Security
, 2005.

Earlier

Feature-based Georegistration of Aerial Images [ pdf ]
Yaser Sheikh, Sohaib Khan, and Mubarak Shah
In Geosensor Networks, 2004.

On the use of Anthropometry in the Invariant Analysis of Human Actions, (oral) [ pdf ]
Alexei Gritai, Yaser Sheikh, and Mubarak Shah
IAPR International Conference on Pattern Recognition (ICPR), 2004.

CASEE: A Hierarchical Event Representation for the Analysis of Videos, [ pdf ]
Asaad Hakeem, Yaser Sheikh, and Mubarak Shah
American Association for Artificial Intelligence (AAAI)
, 2004.

Aligning Dissimilar Images Directly, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah,
Asian Conference on Computer Vision (ACCV), 2004.

Accumulative Alignment of an Image Stream [ pdf ]
Yaser Sheikh, Yun Zhai, and Mubarak Shah
Asian Conference on Computer Vision (ACCV), 2004.

Visual Monitoring of Railroad Grade Crossing [ pdf ]
Yaser Sheikh, Khurram Shafique, Yun Zhai, and Mubarak Shah
SPIE Symposium on Defense and Security, 2004.

Geodetic Alignment of Aerial Video Frames [ pdf ]
Yaser Sheikh, Sohaib Khan, Mubarak Shah, and Richard Cannata
In Video Registration, Video Computing Series, 2003.

Semantic Film Preview Classification Using Low-Level Computable Features [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
Workshop on Multimedia and Document Engineering, Berlin, Germany, 2003.

Students

Natasha Kholgade

Natasha Kholgade

Varun

Varun Ramakrishna
(co-advised by Takeo Kanade)

tomas

Tomas Simon Kreuz
(co-advised by Iain Matthews)

Yair

Yair Movshovitz-Attias
(co-advised by Takeo Kanade)

Hanbyul

Hanbyul Joo

minh

Minh Vo
(co-advised by Srinivas Narasimhan)

Former Doctoral Students

Hyun Soo Park

Hyun Soo Park (Mechanical Engg., Ph.D. 2014)
Postdoctoral Fellow at the University of Pennsylvania
Ph.D. Thesis: Understanding Social Scenes from Social Cameras

Ijaz Akhter

Ijaz Akhter (LUMS, Ph.D. 2012)
Postdoctoral Fellow at MPI Tuebingen
(co-advised by Sohaib Khan)
PhD Thesis: Modeling Spatiotemporal Regularity in Deformable Structures

Eakta Jain Eakta Jain (Robotics Institute, Ph.D. 2012)
Faculty at the University of Florida
(co-advised by Jessica Hodgins)
PhD Thesis: Attention-guided Algorithms to Retarget and Augment Animations, Stills and Videos
Ankur Datta

Ankur Datta (Robotics Institute, Ph.D. 2010)
Amazon
(co-advised with Takeo Kanade)
PhD Thesis: Closed-Form Analysis of Human Motion in Monocular Videos

Courses

15-369 Perceptual Computing 2013
15-869 Human Motion Modeling and Analysis 2012
15-381 Artificial Intelligence 2010

Software and Data

Terms of use: The code is supplied with no warranty and Carnegie Mellon or the authors will not be held responsible for the correctness of the code. The software will not be transferred to outside parties without the authors' permission and will be used only for research purposes. In particular, the code will not be included as part of any commercial software package or product without the consent of the authors.

ECCV 2012 3D Human Pose from 2D Image Landmarks Paper to Reference: "Reconstructing 3d Human Pose from 2d Image Landmarks", Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh, European Conference on Computer Vision, 2012.
[ project page ]
bsb Bilinear Spatiotemoporal Basis Models (MATLAB toolbox) Paper to Reference: "Bilinear Spatiotemporal Basis Models", Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, Yaser Sheikh, ACM Transactions on Computer Graphics, 2012.
[ project page ]
HAI Jumping jacks (Original Hand Drawn Animations)
Jumping jacks with dots (Virtual markers specified)
Jumping jacks domain data (3D motion captured markers)
Demo code
Paper to Reference: "Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation" Eakta Jain, Yaser Sheikh, Jessica Hodgins. Proceedings of Symposium on Computer Animation, 2009. [ project page ]
hw MATLAB code
Image-sets: Rock climbing (131 MB), Dance (62 MB),
Hand wave (80 MB), Meeting (41 MB), Speech (84 MB)
Reconstruction results
Paper to Reference: "3D Reconstruction of a Moving Point from a Series of 2D Projections" Hyun Soo Park, Takaaki Shiratori, Iain Matthews, Yaser Sheikh. European Conference on Computer Vision, 2010. [ project page ]
MATLAB code Paper to Reference: "Linearized Motion Estimation for Articulated Planes"  
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011. [ pdf ]
NIPS MATLAB code
Matrix Sequence: [mat] [result]
Dinosaur Sequence: [mat] [result] [images] (90MB)
Cubes Sequence: [mat] [result] [images] (30MB)
Paper to Reference: "Nonrigid Structure from Motion in Trajectory Space"
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, Takeo Kanade
Neural Information Processing Systems, 2008. [ project page ]
Medoidshift MATLAB code Paper to Reference: "Mode-seeking via Medoidshifts",
Yaser Ajmal Sheikh, Erum Arif Khan, Takeo Kanade.
IEEE International Conference on Computer Vision, 2007. [ pdf ]
BODIDS

MATLAB code
"Groundtruthed" Sequence
Ducks Sequence
Fountain Sequences

Paper to Reference: "Bayesian Modeling of Dynamic Scenes for Object Detection"
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005. [ pdf ]

Press Coverage

Sponsors

Short Biography

Yaser Sheikh is an Associate Research Professor at the Robotics Institute, Carnegie Mellon University, with appointments in the Mechanical Engineering Department and the Quality of Life Technology Center. He received his PhD in 2006 from the University of Central Florida advised by Prof. Mubarak Shah. His research interests span computer vision, computer graphics, and robotics, and are focused on the machine perception of social behavior. He has won the Honda Initiation Award (2010), best paper awards at SAP (2012), WACV (2012), SCA (2010), and ICCV THEMIS (2009), and the Hillman Fellowship for Excellence in Computer Science Research (2004). He has over 50 publications in leading conferences in computer vision, computer graphics, and machine learning, and holds four patents on his research. Yaser has served as a senior committee member at leading conferences in computer vision, computer graphics, and robotics including ICCP (2011), SIGGRAPH (2013, 2014), CVPR (2014), and ICRA (2014). His research is sponsored by various government research offices, including NSF and DARPA, and several industrial partners including the Intel corporation, the Walt Disney Company, Nissan, Honda, and the Samsung Group. His research has been covered by various media outlets including BBC, MSNBC, New Scientist, slashdot, and WIRED.

Miscellaneous

Project Topi

STEP: Science, Technology, and Education in Pakistan

Ideas for Research

Cappucheerios!