The Robotics Institute

Search the site

RI | Research | Projects | 3D Head Motion Recovery in Real Time

Text only version of this site

Feature-based 3D Head Tracking
Head: Takeo Kanade
Contact: Jun-Su Jang (jsjang@cs.cmu.edu)

Mailing address:
Carnegie Mellon University
Robotics Institute
5000 Forbes Avenue
Pittsburgh, PA 15213

Associated center: VASC

Associated lab/group: People Image Analysis Consortium

 

Jump to: Project Description | Personnel | Publications

Project Description

We develop a feature-based tracking method to recover the full-motion (3 rotations and 3 translations) of the head using a cylindrical model. We introduce the SIFT features as a universal matching technique in tracking process. Tracking by detection approach can overcome a divergence problem, which frequently occurs in previous work (Region-based optical flow approach). Our system automatically generates view-based head model. It contains regions of the facial features, such as eyebrows, eyes, nose, mouth and also ears when they are visible. A set of SIFT features is stored and updated for each reference pose while tracking sequences. These templates are employed to rectify error accumulation and to avoid divergence in tracking. The robustness of the proposed system is experimentally shown in video sequences with occlusion and fast motion.

 Examples:

AVI Movie (xvid codec)

 

Personnel [Past Members]

 

 

Name

Title

Email Address

Jun-Su Jang

Postdoctoral Fellow

jsjang@cs.cmu.edu

Takeo Kanade

U.A. and Helen Whitaker University Prof.

tk@cs.cmu.edu

 

Publications


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu