Multimodal People ID

==========

People identification is essential for many applications. If people are allowed complete freedom of movement, then any given identification technique will falter in some situations. For example, a face ID module will fail if a person's head is turned away from the camera. A speaker ID module will not work well when a person is far removed from the nearest microphone, or when, for example, their voice if muffled by an obstructing hand. To compensate, visual characteristics such as color distribution and patterns are helpful for "locking on" to a person once they have already been identified. We have been developing technologyfor people identification from multiple cues.

Related Publications:

  • R. Stiefelhagen, X. Chen, J. Yang, Capturing Interactions in Meetings with Omnidirectional Cameras, International Journal of Distance Education Technologies(in press).
  • R. Yan, J. Zhang, J. Yang and A. Hauptmann, A Discriminative Learning Framework with Pairwise Constraints for Video Object Classification, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2 , pp. 284-291, 2004.
  • R. Yan, J. Yang, A. Hauptmann, Automatically Labeling Video Data Using Multi-class Active Learning, Proceedings of ICCV 2003.
  • J. Yang, X. Chen, W. Kunz, H. Kundra, Face as an index: Knowing who is who using a PDA, International Journal of Imaging Systems and Technology, Vol. 13, No. 1, pp. 33-41, 2003.
  • J. Yang, X. Chen, W. Kunz, A PDA-based Face Recognition System, Proceedings of WACV 2002, Orlando, Fl. December, 2002.
  • H. Yu and J. Yang, A Direct LDA Algorithm for High-dimensional Data - with Application to Face Recognition, Pattern Recognition, Vol. 34 (2001), pp 2067-2070.
  • J. Yang, H. Yu, W. Kunz, An Efficient LDA Algorithm for Face Recognition, International Conference on Automation, Robotics, and Computer Vision (ICARCV'2000), Singapore, December, 2000.
  • R.Gross, J. Yang, A. Waibel, Growing Gaussian Mixture Model for Pose Invariant Face Recognition, International Conference on Pattern Recognition (ICPR 2000), Barcelona, Spain, Sept. 2000.
  • R. Gross, J. Yang, A. Waibel, Face Recognition in a Meeting Room, Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition (FG'2000).
  • J. Yang, X. Zhu, R. Gross, J. Kominek, Y. Pan, A. Waibel, Multimodal People ID for a Multimedia Meeting Browser, Proceedings of ACM Multimedia 99.

    Back to the previous page

    Last updated August, 2004

    ----------