Stony Brook University - the Center for Visual Computing

• 3D Facial Modeling and Analysis Project. Joint work with Prof. Dimitris Metaxas and Prof. Ahmed Elgammal in Rutgers University and with Prof. Dimitris Samaras, Prof. David Xianfeng Gu, and Prof. Peisen Huang in Stony Brook University to build an end-to-end system including structured light based real-time 3D shape acquisition, range data registration, 3D facial motion tracking, and novel facial expression synthesis.

• Brookhaven National Laboratory (BNL) BME Project. Developing an integrated CCD-based image capture and motion tracking system, a core research of novel technologies for Positron Emission Temography (PET) and functional Magnetic Resonance Imaging (fMRI) that will allow imaging of the awake animal brain in real-time and in natural physiological conditions.

• Virtual Building Project. Building a mobile camera scanning system as a part of advanced technologies for high-speed acquisition of 3D digital models of indoor environments, such as a museum.

• Illumination Modeling Project. Developing a method for the detection and estimation of multiple directional illuminants, using only one single image of an object of arbitrary known geometry, by integrating information from shadows, shading and specularities in the presence of strong directional sources of illumination, even when significant non-directional sources exist in the scene.

Microsoft Research, Redmond, WA

• Face Image Relighting and Recognition Project. Joint work with Dr. Zicheng Liu to investigate techniques for more accurate lighting estimation from images, and develop systems to estimate and modify the lighting conditions of an image for better visual perception and machine recognition.

Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA

• High Resolution Facial Feature Analysis Project. Joint work with Dr. Hanspeter Pfister and Dr. Michael Jones in MERL and Prof. Dimitris Samaras in Stony Brook University to develop appropriate statistical features to describe the intra- and extra-personal variations of high resolution face images, and to evaluate the performance of high-resolution facial feature analysis.

Publications

Journal Papers

• Yang Wang, Lei Zhang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, Dimitris Samaras. Face Re-Lighting from a Single Image under Arbitrary Unknown Lighting Conditions. IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 31, Number 11, Pages 1968-1984, November 2009. [ demo:mov]

• Yang Wang, Mohit Gupta, Song Zhang, Sen Wang, Xianfeng Gu, Dimitris Samaras, Peisen Huang. High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps. International Journal of Computer Vision, Volume 76, Number 3, Pages 283-300, March, 2008.

• Sen Wang, Yang Wang, Miao Jin, Xianfeng Gu, Dimitris Samaras. Conformal Geometry and Its Applications on 3D Shape Matching, Recognition and Stitching . IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 29, Issue 7, Pages: 1209-1220, July 2007.

• Yang Wang, Xiaolei Huang, Chan-Su Lee, Song Zhang, Zhiguo Li, Dimitris Samaras, Dimitris Metaxas, Ahmed Elgammal, Peisen Huang. High Resolution Acquisition, Learning and Transfer of Dynamic 3D Facial Expressions. Computer Graphics Forum, Volume 23, Issue 3, 2004.

• Yang Wang, Dimitris Samaras. Estimation of Multiple Directional Light Sources for Synthesis of Augmented Reality Images. Graphical Models, Volume 65, Issue 4, Pages 185-205, July 2003.

• Yang Wang, Dimitris Samaras. Estimation of Multiple Directional Illuminants from a Single Image. Image and Vision Computing, Volume 26, Issue9, Pages 1179-1195, September 2008.

• Simon Lucey, Yang Wang, Mark Cox, Sridha Sridharan, and Jeffery F. Cohn. Efficient constrained local model fitting for non-rigid face alignment. Image and Vision Computing, Volume 27, Number 12, Pages 1803-1813, December 2009.

• Simon Lucey, Yang Wang, Jason Saragih, and Jeffery F. Cohn. Non-Rigid Face Tracking with Enforced Convexity and Local Appearance Consistency Constraint Image and Vision Computing, Volume 28, Number 5, Pages 781-789, May 2010.

• Razvan Ionasec, Ingmar Voigt, Bogdan Georgescu, Yang Wang, Helene Houle, Fernando Vega-Higuera, Nassir Navab, and Dorin Comaniciu. Patient-Specific Modeling and Quantification of the Aortic and Mitral Valves from 4D Cardiac CT and TEE IEEE Transactions on Medical Imaging, in press.

Referred Conferences and Workshops

• Yun Zeng, Chaohui Wang, Yang Wang, Xianfeng Gu, Dimitris Samaras, Nikos Paragios. Dense Non-rigid Surface Registration Using High-Order Graph Matching.. Proceedings of the Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 15-17, 2010.

• Yang Wang, Bogdan Georgescu, Dorin Comaniciu, Helene Houle. Learning-Based 3D Myocardial Motion Flow Estimation Using High Frame Rate Volumetric Ultrasound Data. Proceedings of IEEE International Symposium on Biomedical Imaging - ISBI , Rotterdam, The Netherlands, April 2010 (Oral Presentation).

• Razvan Ionasec, Yang Wang, Bogdan Georgescu, Ingmar Voigt, Nassir Navab, Dorin Comaniciu. Robust Motion Estimation Using Trajectory Spectrum Learning: Application to Aortic and Mitral Valve Modeling from 4D TEE. Proceedings of the 12th IEEE International Conference on Computer Vision, Kyoto, Japan, September 2009.

• Razvan Ionasec, Ingmar Voigt, Bogdan Georgescu, Yang Wang, Helene Houle, Joachim Hornegger, Nassir Navab, Dorin Comaniciu. Personalized Modeling and Assessment of the Aortic-Mitral Coupling from 4D TEE and CT. Proceedings of Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2009, London, UK, September 2009.

• Yang Wang, Simon Lucey, Jeffrey Cohn, Jason Saragih. Non-rigid Face Tracking with Local Appearance Consistency Constraint. Proceedings of 8th IEEE International Conference on Automatic Face and Gesture Recognition, Amsterdam, The Netherlands, September 2008.

• Wei Zeng, Yun Zeng, Yang Wang, Xianfeng Gu, Dimitris Samaras. 3D Non-rigid Surface Matching and Registration Based on Holomorphic Differentials.. Proceedings of the 10th European Conference on Computer Vision, Marseille, France, October 2008 (Oral Presentation).

• Yang Wang, Simon Lucey, Jeffrey Cohn. Enforcing Convexity for Improved Alignment with Constrained Local Models. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2008, Anchorage, AK, June 2008.

• Yang Wang, Simon Lucey, Jeffrey Cohn. Non-Rigid Object Alignment with a Mismatch Template Based on Exhaustive Local Search. IEEE Workshop on Non-rigid Registration and Tracking through Learning - NRTL 2007 (in conjunction with ICCV 2007), Rio de Janeiro, Brazil, October 2007.

• Xianfeng Gu, Sen Wang, Junho Kim, Yun Zeng, Yang Wang, Hong Qin, Dimitris Samaras. Ricci Flow for 3D Shape Analysis. Proceedings of IEEE International Conference on Computer Vision 2007, Rio de Janeiro, Brazil, October 2007.

• Yang Wang, Zicheng Liu, Gang Hua, Zhen Wen, Zhengyou Zhang, Dimitris Samaras. Face Re-Lighting from a Single Image under Harsh Lighting Conditions. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2007, Minneapolis, MN June 2007.

• Chan-Su Lee, Yang Wang, Zhiguo Li, Atul Kanaujia, Ahmed Elgammal, Dimitris Samaras, Dimitris Metaxas, Xiangfeng Gu, Peisen Huang. Subtle Facial Expression Synthesis using Motion Manifold Embedding and Nonlinear Decomposiable Generative Models. ACM SIGGRAPH / Eurographics Symposium on Computer Animation Poster, 2006, Vienna, Austria Sept. 2006.

• Sen Wang, Yang Wang, Miao Jin, Xianfeng Gu, Dimitris Samaras. 3D Surface Matching and Recognition Using Conformal Geometry. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2006, New York, NY June 2006.

• Yang Wang, Mohit Gupta, Song Zhang, Sen Wang, Xianfeng Gu, Dimitris Samaras, Peisen Huang. High Resolution Tracking of Non-Rigid 3D Motion of Densely Sampled Data Using Harmonic Maps. Proceedings of IEEE International Conference on Computer Vision 2005, Beijing, China, October 2005 (Oral Presentation).

• Lei Zhang, Yang Wang, Sen Wang, Song Zhang, Peisen Huang, Dimitris Samaras. Image-Driven Re-targeting and Relighting of Facial Expressions. Proceeding of Computer Graphics International 2005, Stony Brook, NY, June 2005.

• Yang Wang, Xiaolei Huang, Chan-Su Lee, Song Zhang, Zhiguo Li, Dimitris Samaras, Dimitris Metaxas, Ahmed Elgammal, Peisen Huang. High Resolution Acquisition, Learning and Transfer of Dynamic 3D Facial Expressions. Proceeding of Eurographics 2004, Grenoble, France, August 2004 (Oral Presentation).

• Xiaolei Huang, Song Zhang, Yang Wang, Dimitris Metaxas, Dimitris Samaras. A Hierarchical Framework for High Resolution Facial Expression Tracking. Proc. of IEEE Workshop on Articulated and Nonrigid Motion, ANM 2004 (in conjunction with CVPR 2004), June 2004.

• Yang Wang, Dimitris Samaras. Multiple Directional Illuminant Estimation from a Single Image. IEEE Workshop on Color and Photometric Methods in Computer Vision, CPMCV 2003 (in conjunction with ICCV 2003), October 2003.

• Yang Wang, Dimitris Samaras. Estimation of Multiple Directional Light Sources for Synthesis of Mixed Reality Images. Proceedings of Pacific Graphics 2002, pages 38-47, October 2002 (Oral Presentation).

• Yang Wang, Dimitris Samaras. Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry. Proceedings of European Conference on Computer Vision 2002, pp. III:272-288, May 2002.

Other Publications

• Non-Rigid Face Tracking with Enforced Convexity and Local Appearance Consistency Constraint. The Eighteenth Wireless and Optical Communications Conference, May, 2009 (Invited Talk).

• Dimitris Samaras, Yang Wang, Lei Zhang, Sen Wang, Mohit Gupta. Face Modeling and Analysis in Stony Brook University. Video Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2005, San Diego, CA, June 2005.

• Yang Wang, Dimitris Samaras. High Resolution Acquisition, Learning and Transfer of Dynamic 3D Facial Expressions. Graduate Research Conference 2004, Stony Brook, NY, May 2004.