(German) Kong-man Cheung ------------------------------------------------------------------- Robotics Institute, Carnegie Mellon University 5000 Forbes Avenue Pittsburgh PA 15213 Phone: 412-268-3127 Fax: 412-268-5571 Email: german@ux2.sp.cs.cmu.edu Web: www.cs.cmu.edu/~german Education 1996-2003 Robotics Institute PhD in Robotics (June 2003) Carnegie Mellon University PhD Thesis: ``Visual Hull Construction, Alignment and Refinement for Human Body Modeling, Motion Capture and Rendering'' Thesis Advisors: Professors Takeo Kanade and Simon Baker 1992-1994 Hong Kong University of M.Phil in Electrical and Electronic Engineering (1994) Science and Technology Master Thesis (with Distinction): Perturbation Analysis and Compensating Algorithm for Subspace Fitting Array Signal Processing Methods'' Thesis Advisor: Professor Mark S.F. Yau 1989-1992 The University of Hong Kong B.Eng in Electrical and Electronic Engineering (1992) Graduated with First Class Honors Research Experience 1998-present Virtualized Reality Laboratory Hardware set up and maintenance, Carnegie Mellon University software development, virtualized reality video production 1997-1998 Medical Robotics Laboratory 3D reconstruction of skeletal Carnegie Mellon University anatomy of mouse fetuses 1996-1997 Computational Sensor Laboratory Research in computational sensors Carnegie Mellon University 1994-1995 Department of Electrical and Electronics Engineering Motion and path planning Hong Kong University of Science and Technology for CNC machines 1992-1994 Department of Electrical and Electronics Engineering Direction-of-Arrival estimation Hong Kong University of Science and Technology and blind deconvolution Related Working Experience November 2003 Postdoctoral Fellow Honda Asimo Laboratory Director: Manage -present Robotics Institute the Honda humanoid robot Asimo and conduct Carnegie Mellon University computer vision and graphics research June-August Visual Interactivity Group Summer Internship 1999 Microprocessor Research Laboratory Project: Real-time 3D human voxel model Intel Corporation reconstruction and motion fitting 1995-1996 Visual Inspection Center Assistant Computer Engineer Hong Kong University of Science Factory inspection of IC label markings and Technology Research Interests I am interested in computer vision with applications in other fields such as computer graphics, surveillance and robotics. Particularly I am interested in 3D shape/reflectance reconstruction from single/multiple videos, motion across time, building digital humans (detailed human kinematic modeling, marker-less motion tracking, skin deformation estimation and realistic rendering), visual effects for movies and games, image based rendering and virtual reality. Research Projects (1) Temporal Shape-From-Silhouette: reconstruct 3D shape and appearance models of objects from multiple video sequences. Details can be found at http://www.cs.cmu.edu/~german. (2) Human Kinematic Modeling, Motion Capture and Rendering: construct detailed human kinematic models (with both shape and joint information) from multiple video sequences. The models are then used for non-invasive (no optical or magnetic markers) human motion tracking and video-based motion re-rendering. Details can be found at http://www.cs.cmu.edu/~german. (3) Virtualized Reality: create photo-realistic images of a recorded dynamic event from any viewpoint of virtual fly-through. Responsibilities include hardware maintenance of a synchronized real-time video capturing system (with 48 cameras), software development for 3D shape/appearance reconstruction and virtualized reality video production from scene/data capture to data processing to final rendering Details of the Virtualized Reality Laboratory can be found at http://www.cs.cmu.edu/~virtualizedr. Related Computer Skills Proficient in: Programming languages: C/C++, OpenGL, Matlab, Mathematica. Operating Systems: Windows, Linux, IRIX, Solaris, OSX. Softwares: Microsoft Visual Studio, Microsoft PowerPoint, LaTeX. Graphical User Interface Development Packages: Fast Light ToolKit (FLTK), X-forms, Microsoft Foundation Class (MFC). Reference Contacts (1) Professor Takeo Kanade, Robotics Institute, Carnegie Mellon University Phone: 412-268-3016, Email: tk+@cs.cmu.edu (2) Professor Simon Baker, Robotics Institute, Carnegie Mellon University Phone: 412-268-5746, Email: simonb@cs.cmu.edu (3) Professor Jessica Hodgins, Computer Science Department, Carnegie Mellon University Phone 412-268-6795, Email: jkh@cs.cmu.edu (4) Professor Steve Seitz, Department of Computer Science and Engineering, University of Washington Phone: 206-616-9431, Email: seitz@cs.washington.edu (5) Professor Bob Collins, Robotics Institute, Carnegie Mellon University Phone: 412-268-6186, Email: rcollins@cs.cmu.edu (6) Dr. Gary Bradski, Intel Corporation Email: gary.bradski@intel.com Publications (1) German K.M. Cheung, S. Baker, J. Hodgins and T. Kanade. ``Markerless Human Motion Transfer'', to be appeared in the Second International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT 04), September, 2004. (2) German K.M. Cheung, S. Baker and T. Kanade. ``Shape-From-Silhouette Across Time Part I: Theory and Algorithms'', accepted by International Journal of Computer Vision. (3) German K.M. Cheung, S. Baker and T. Kanade. ``Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking'', submitted to International Journal of Computer Vision. (4) German K.M. Cheung, ``Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling, Motion Tracking and Rendering'', PhD Thesis, Technical Report CMU-RI-TR-03-44, Robotics Institute, Carnegie Mellon University, October, 2003. (5) German K.M. Cheung, S. Baker and T. Kanade, ``Visual Hull Alignment and Refinement Across Time: A 3D Reconstruction Algorithm Combining Shape-From-Silhouette with Stereo'', in Proceedings of 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Vol. 2, pages 375-382, Madison WI, June 2003. (6) German K.M. Cheung, S. Baker and T. Kanade, ``Shape-From-Silhouette of Articulated Object and its Use for Human Body Kinematics Estimation and Motion Capture'', in Proceedings of 2003 IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Vol. 1, pages 77-84, Madison WI, June 2003. (7) German K.M. Cheung, ``Visual Hull Construction, Alignment and Refinement Across Time'', Thesis Proposal, Technical Report CMU-RI-TR-02-05, Robotics Institute, Carnegie Mellon University, January 2002. (8) K.M. Cheung, T. Kanade, J. Bouguet, and M. Holler, ``A Real Time System for Robust 3D Voxel Reconstruction of Human Motions'', in Proceedings of 2000 IEEE Conference on Computer Vision and Pattern Recognition (CVPR '00), Vol. 2, pages 714 - 720, Hilton Head Island SC, June 2000. (9) S. Baba, H. Saito, S. Vedula, K.M. Cheung and T.Kanade, ``Appearance-Based Virtual-View Generation for Fly Through in a Real Dynamic Scene'', in Proceedings of Joint Eurographics IEEE TCVG Symposium on Visualization (VisSym'00), May 2000. (10) K.M. Cheung and S.F. Yau, ``Statistical Analysis and CRB Study of Modified MUSIC under DOA- Dependent Perturbations'', in Proceedings of Fourth International Symposium on Signal Processing and Its Applications, pages 349-352, Gold Coast Australia, August 1996. (11) K.M. Cheung and S.F. Yau, ``A Compensation Method for Model Deviations in Parametric Estimation by ESPRIT'', in Proceedings of International Conference on Neural Network and Signal Processing}, Vol. II, pages 1079-1082, Nanking China, December 1995. (12) K.M. Cheung and S.F. Yau, ``Improved ESPRIT for DOA Estimation in the Presence of DOA Dependent and Independent Deviations'', in Proceedings of International Conference on Signal and Image Processing, (SIP'95), Las Vegas United States, November 14-17 1995. (13) K.M. Cheung and S.F. Yau, ``Blind Deconvolution of System with Unknown Response Excited by Cyclostationary Impulses'', in Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP'95), Detroit MI, May 8-12 1995. (14) K.M. Cheung. ``Perturbation Analysis and Compensating Algorithm for Subspace Fitting Array Signal Processing Methods'', Master's Thesis, Hong Kong University of Science and Technology, Hong Kong, May 1994. (15) K.M. Cheung and S.F. Yau, ``A Novel Method in Compensating Random Perturbations in Eigen-based Subspace Methods'', in Proceedings of International Symposium on Circuits And Systems (ISCAS'94), London England, May 31-June 2 1994.