Yaser Sheikh  

Yaser Ajmal Sheikh

Assistant Research Professor
Robotics Institute, Carnegie Mellon University
Email: yas...@cs.cmu.edu
Phone: (412) 268-1138; Office: EDSH (Smith Hall) 221, 5000 Forbes Avenue, Pittsburgh, PA 15213
[ DBLP ] [ Google Scholar ]

2012 2011 2010 2009 ...
Motion Understanding from Body Mounted Cameras

3D Social Saliency from Head-mounted Cameras
[ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
Neural Information Processing Systems (NIPS), 2012.

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Motion Capture from Body Mounted Cameras
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, Jessica Hodgins,
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2011 [ more ]

     
Reconstructing 3D Events

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Bilinear Spatiotemporal Basis Models
Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, Yaser Sheikh
ACM Transactions on Computer Graphics, 2012. [ more ]

Trajectory Space: A Dual Representation for Nonrigid Structure from Motion
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2011. [ pdf ] [ more ]

3D Reconstruction of a Smooth Articulated Trajectory from a Monocular Image Sequence
Hyun Soo Park and Yaser Sheikh,
IEEE International Conference on Computer Vision (ICCV), 2011. [ more ]

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

3D Reconstruction of a Moving Point from a Series of 2D Projections, Hyun Soo Park, Takaaki Shiratori, Iain Matthews, and Yaser Sheikh, European Conference on Computer Vision (ECCV) , 2010. [ more ]

In Defense of Orthonormality Constraints for Nonrigid Structure from Motion,
Ijaz Akhter, Yaser Sheikh, and Sohaib Khan
IEEE Conference on Computer Vision and Pattern Recognition
(CVPR), 2009. [ pdf ]
[ earlier work ]
Augmenting Animation

Three-dimensional Proxies for Hand-drawn Characters,
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins, Transactions on Computer Graphics (TOG) , 2012.
[ more ]

 

 

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Augmenting Hand Animation with Three-dimensional Secondary Motion, Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins, Symposium on Computer Animation (SCA), 2010 Best Paper Winner!

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation,Eakta Jain, Yaser Sheikh, Jessica Hodgins, Symposium on Computer Animation (SCA), 2009 [ more ]

 
 
Structure from Motion Blur

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Structure from Motion Blur in Low Light
Yali Zheng, Shohei Nobuhara, and Yaser Sheikh
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.

     
 
Facial Content Retargeting

Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

Content Retargeting Using Parameter-Parallel Facial Layers
Natasha Kholgade, Iain Matthews, and Yaser Sheikh
Symposium on Computer Animation (SCA), 2011.
[ project page ]

     
     
Dynamic Seethroughs

Dynamic Seethroughs: Synthesizing Hidden Views of Moving Objects,
Peter Barnum, Yaser Sheikh, Ankur Datta, Takeo Kanade
International Symposium of Mixed and Augmented Reality (ISMAR)

 
     
Background Subtraction in Dynamic Scenes
Background Subtraction for Freely Moving Cameras
Yaser Sheikh, Omar Javed, and Takeo Kanade
IEEE International Conference on Computer Vision (ICCV), 2009. [ more ]
[ earlier work ]
         

Publications

2013

Tracking Human Pose by Tracking Symmetric Parts
Varun Ramakrishna, Yaser Sheikh, Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.

Representing and Discovering Adversarial Team Behaviors using Player Roles
Patrick Lucey, Alina Bialkowski, Peter Carr, Iain Matthews, Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2013.

2012

Three-dimensional Proxies for Hand-drawn Characters [ pdf ] [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
ACM Transactions on Graphics (TOG), 2012.

Bilinear Spatiotemopral Basis Models [ project page ] [ code ]
Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, Yaser Sheikh
ACM Transactions on Graphics (TOG), 2012.

3D Social Saliency from Head-mounted Cameras [ project page ]
Hyun Soo Park, Eakta Jain, and Yaser Sheikh
Neural Information Processing Systems (NIPS), 2012.

Monocular Object Detection using 3D Geometric Primitives [ pdf ] [ video ]
Peter Carr, Yaser Sheikh, and Iain Matthews
European Conference on Computer Vision (ECCV), 2012.

Reconstructing 3D Human Pose from 2D Image Landmarks [ project page ]
Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2012.

Inferring Artistic Intention in Comic Art through Viewer Gaze[ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
ACM Symposium on Applied Perception (SAP)
, 2012. Best paper honorable mention!

Point-less Calibration: Camera Parameters from Gradient- Based Alignment to Edge Images [ pdf ]
Peter Carr, Yaser Sheikh, Iain Matthews
IEEE Workshop on the Applications of Computer Vision (WACV), 2012. Best paper award!

2011

Motion Capture from Body-Mounted Cameras [ project page ]
Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, and Jessica Hodgins
ACM Transactions on Graphics (SIGGRAPH), 2011.

Trajectory Space: A Dual Representation for Nonrigid Structure from Motion [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2011.

Linearized Motion Estimation for Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2011.

Structure from Motion Blur in Low Light [ pdf ]
Yali Zheng, Shohei Nobuhara, and Yaser Sheikh
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2011.

3D Reconstruction of a Smooth Articulated Trajectory from a Monocular Image Sequence [ project page ]
Hyun Soo Park and Yaser Sheikh
IEEE International Conference on Computer Vision (ICCV), 2011.

Content Retargeting Using Parameter-Parallel Facial Layers [ project page ]
Natasha Kholgade, Iain Matthews, and Yaser Sheikh
Symposium on Computer Animation (SCA), 2011.

2010

3D Reconstruction of a Moving Point from a Series of 2D Projections (oral) [ project page ]
Hyun Soo Park, Takaaki Shiratori, Iain Matthews, and Yaser Sheikh
European Conference on Computer Vision (ECCV), 2010.

Augmenting Hand Animation with Three Dimensional Secondary Motion [ project page ]
Eakta Jain, Yaser Sheikh, Moshe Mahler, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2010. Best paper award!

2009

Matching Trajectories of Anatomical Landmarks under Viewpoint Anthropometric, and Temporal Transforms [ pdf ]
Alexei Gritai, Yaser Sheikh, Cen Rao, and Mubarak Shah
International Journal of Computer Vision (IJCV), 2009.

In Defense of Orthonormality Constraints for Nonrigid Structure from Motion (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, and Sohaib Khan
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2009. (oral)

Modeling the Product Manifold of Posture and Motion
Ankur Datta, Yaser Sheikh, and Takeo Kanade
Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences (THEMIS), 2009. Best paper award!

Dynamic Seethroughs: Synthesizing Hidden Views of Moving Objects [ project page ]
Peter Barnum, Yaser Sheikh, Ankur Datta, and Takeo Kanade
International Symposium of Mixed and Augmented Reality (ISMAR), 2009.

Background Subtraction for Freely Moving Cameras [ pdf ]
Yaser Sheikh, Omar Javed, and Takeo Kanade
IEEE International Conference on Computer Vision (ICCV), 2009.

Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation [ project page ]
Eakta Jain, Yaser Sheikh, and Jessica Hodgins
Symposium on Computer Animation (SCA), 2009.

2008

Trajectory Association Across Multiple Airborne Cameras
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2008.

Nonrigid Structure from Motion in Trajectory Space (oral) [ pdf ]
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, and Takeo Kanade
Neural Information Processing Systems (NIPS)
, 2008.

On the Sustained Tracking of Human Motion (oral) [ pdf ]
Yaser Sheikh, Ankur Datta, and Takeo Kanade
IEEE International Conference on Automatic Face and Gesture Recognition (FG)
, 2008.

Linear Motion Estimation for Systems of Articulated Planes [ pdf ]
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)
, 2008.

2007

Mode-seeking by Medoidshifts (oral) [ pdf ]
Yaser Sheikh, Erum Khan, and Takeo Kanade,
IEEE International Conference on Computer Vision (ICCV), 2007.

On the Spacetime Geometry of Galilean Cameras [ pdf ]
Yaser Sheikh, Alexei Gritai, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007

Trajectory Association across Non-overlapping Moving Cameras in Planar Scenes
Yaser Sheikh, Xin Li, and Mubarak Shah,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2007

2006

Model Generation for Video-based Object Recognition
Humera Noor, Shahid Hafeez Mirza, Yaser Sheikh, Amit Jain, and Mubarak Shah
ACM International Conference on Multimedia, 2006.

Shape from Dynamic Textures for Planes [ pdf ]
Yaser Sheikh, Niels Haering, and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2006.

2005

Bayesian Modeling of Dynamic Scenes for Object Detection [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2005.

On the Use of Computable Features for Film Classification [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
IEEE Transactions on Circuit and System for Video Technology (TCSVT)
, 2005.

Object Tracking Across Multiple Independently Moving Airborne Cameras [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.

Exploring the Space of a Human Action [ pdf ]
Yaser Sheikh, Mumtaz Sheikh, and Mubarak Shah
IEEE International Conference on Computer Vision (ICCV), 2005.

Bayesian Object Detection in Dynamic Scenes, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2005.

Establishing a Common View from Multiple Moving Aerial Sensors
Yaser Sheikh, Alexei Gritai, Imran Junejo, Robert Muise, Abhijit Mahalanobis, and Mubarak Shah
SPIE Symposium on Defense and Security
, 2005.

2004

Feature-based Georegistration of Aerial Images [ pdf ]
Yaser Sheikh, Sohaib Khan, and Mubarak Shah
In Geosensor Networks, 2004.

On the use of Anthropometry in the Invariant Analysis of Human Actions, (oral) [ pdf ]
Alexei Gritai, Yaser Sheikh, and Mubarak Shah
IAPR International Conference on Pattern Recognition (ICPR), 2004.

CASEE: A Hierarchical Event Representation for the Analysis of Videos, [ pdf ]
Asaad Hakeem, Yaser Sheikh, and Mubarak Shah
American Association for Artificial Intelligence (AAAI)
, 2004.

Aligning Dissimilar Images Directly, (oral) [ pdf ]
Yaser Sheikh and Mubarak Shah,
Asian Conference on Computer Vision (ACCV), 2004.

Accumulative Alignment of an Image Stream [ pdf ]
Yaser Sheikh, Yun Zhai, and Mubarak Shah
Asian Conference on Computer Vision (ACCV), 2004.

Visual Monitoring of Railroad Grade Crossing [ pdf ]
Yaser Sheikh, Khurram Shafique, Yun Zhai, and Mubarak Shah
SPIE Symposium on Defense and Security, 2004.

2003

Geodetic Alignment of Aerial Video Frames [ pdf ]
Yaser Sheikh, Sohaib Khan, Mubarak Shah, and Richard Cannata
In Video Registration, Video Computing Series, 2003.

Semantic Film Preview Classification Using Low-Level Computable Features [ pdf ]
Zeeshan Rasheed, Yaser Sheikh, and Mubarak Shah
Workshop on Multimedia and Document Engineering, Berlin, Germany, 2003.

Doctoral Students

Hyun Soo Park Hyun Soo Park
Mechanical Engineering, CMU
Natasha Kholgade Natasha Kholgade
Robotics Institute, CMU
Varun Varun Ramakrishna
Robotics Institute, CMU
(co-advised by Takeo Kanade)
tomas Tomas Simon Kreuz
Robotics Institute, CMU
(co-advised by Iain Matthews)
Yair Yair Movshovitz-Attias
Computer Science Department, CMU
(co-advised by Takeo Kanade)
Hanbyul Hanbyul Joo
Robotics Institute, CMU
minh

Minh Vo
Robotics Institute, CMU
(co-advised by Srinivas Narasimhan)

Masters Students

Fanyi Fanyi Xiao
Robotics Institute, CMU
(co-advised by Martial Hebert)
  Taylor Stine
Mechanical Engineering, CMU

Former Students

Ijaz Akhter

Ijaz Akhter (LUMS, PhD 2012)
MPI Tuebingen
(co-advised by Sohaib Khan)
PhD Thesis: Modeling Spatiotemporal Regularity in Deformable Structures

Eakta Jain Eakta Jain (Robotics, Institute, PhD 2012)
Texas Instruments
(co-advised by Jessica Hodgins)
PhD Thesis: Attention-guided Algorithms to Retarget and Augment Animations, Stills and Videos
Ankur Datta

Ankur Datta (Robotics Institute, PhD 2010)
IBM Research
(co-advised with Takeo Kanade)
PhD Thesis: Closed-Form Analysis of Human Motion in Monocular Videos

Terms of use: The code is supplied with no warranty and Carnegie Mellon or the authors will not be held responsible for the correctness of the code. The software will not be transferred to outside parties without the authors' permission and will be used only for research purposes. In particular, the code will not be included as part of any commercial software package or product without the consent of the authors.

ECCV 2012 3D Human Pose from 2D Image Landmarks Paper to Reference: "Reconstructing 3d Human Pose from 2d Image Landmarks", Varun Ramakrishna, Takeo Kanade, and Yaser Sheikh, ECCV 2012.
[ project page ]
bsb Bilinear Spatiotemoporal Basis Models (MATLAB toolbox) Paper to Reference: "Bilinear Spatiotemporal Basis Models", Ijaz Akhter, Tomas Simon, Sohaib Khan, Iain Matthews, Yaser Sheikh, ACM Transactions on Computer Graphics (TOG), 2012.
[ project page ]
HAI Jumping jacks (Original Hand Drawn Animations)
Jumping jacks with dots (Virtual markers specified)
Jumping jacks domain data (3D motion captured markers)
Demo code
Paper to Reference: "Leveraging the Talent of Hand Animators to Create Three-Dimensional Animation" Eakta Jain, Yaser Sheikh, Jessica Hodgins. Proceedings of Symposium on Computer Animation (SCA), 2009. [ project page ]
hw MATLAB code
Image-sets: Rock climbing (131 MB), Dance (62 MB),
Hand wave (80 MB), Meeting (41 MB), Speech (84 MB)
Reconstruction results
Paper to Reference: "3D Reconstruction of a Moving Point from a Series of 2D Projections" Hyun Soo Park, Takaaki Shiratori, Iain Matthews, Yaser Sheikh. European Conference on Computer Vision (ECCV), 2010. [ project page ]
MATLAB code Paper to Reference: "Linearized Motion Estimation for Articulated Planes"  
Ankur Datta, Yaser Sheikh, and Takeo Kanade
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
, 2011. [ pdf ]
NIPS MATLAB code
Matrix Sequence: [mat] [result]
Dinosaur Sequence: [mat] [result] [images] (90MB)
Cubes Sequence: [mat] [result] [images] (30MB)
Paper to Reference: "Nonrigid Structure from Motion in Trajectory Space"
Ijaz Akhter, Yaser Sheikh, Sohaib Khan, Takeo Kanade
Annual Conference on Neural Information Processing Systems, 2008. [ project page ]
Medoidshift MATLAB code Paper to Reference: "Mode-seeking via Medoidshifts",
Yaser Ajmal Sheikh, Erum Arif Khan, Takeo Kanade.
IEEE International Conference on Computer Vision, 2007. [ pdf ]
BODIDS

MATLAB code
"Groundtruthed" Sequence
Ducks Sequence
Fountain Sequences

Paper to Reference: "Bayesian Modeling of Dynamic Scenes for Object Detection"
Yaser Sheikh and Mubarak Shah
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2005. [ pdf ]

Last Updated: August 21, 2012