Zakia Hammal, PhD
Project Scientist (CMU)

 

Robotics Institute, Carnegie Mellon University.

4323 Sennott Square, 210 S. Bouquet Street,

Pittsburgh, PA 15260

http://www.ri.cmu.edu/

E-mail: zakia_hammal@yahoo.fr

 

image.png

 

Education

PhD in Cognitive Science.

Master of Artificial Intelligence and Algorithmic (specialisation: Image processing).

Engineer in Computer Science (Specialisation: Computer systems).

 

Research

My research focuses on the understanding of human-human social interaction for the development of an automatic and multimodal affective human-machine interaction system, similar to everyday life human-human social communication. My main research includes computer vision, machine learning and visual perception applied to human-machine interaction. I am particularly motivated by medical-context applications such as pain monitoring and the development of pain assessment tools for individuals who are not able to communicate pain verbally. My current work includes dynamic recognition of facial expressions in video sequences, pain and depressed behavior assessment and human-human social behavior applied to human-machine interaction.

 

News

The FG 2011 Facial Expression Recognition and Analysis Challenge (FERA2011)

 

Current Project

Automatic Analysis and Recognition of Depressive Behavior:

The aim of the project is the use of the Automated Facial Image Analysis (AFA) developed at the CMU/Pitt as reliable, valid, and efficient measurement of emotion expression and related nonverbal behavior for assessment of symptom severity in depression. AFA is capable of extracting both the type and timing of nonverbal indicators of depression. Such automatic system could improve clinical assessment of symptom severity and evaluation of treatment outcomes when combined with information from interviews and self-report questionnaires. Joint work with Jeff Cohn, Takeo Kanade, Simon Lucey, Fernando De la Torre, and Zara Ambadar.

Progress report

 

Previous Link

zhammal

 

Publications

PhD Thesis in Cognitive Science

     Zakia Hammal Facial Features Segmentation, Analysis and Recognition of Facial Expressions (PDF). (EURASIP 2006)

Book Chapters

    Z. Hammal and C. Massot, Chapter YY:  Gabor-like Image Filtering for Transient Feature Detection and Global Energy Estimation Applied to Multi-Expression Classification. Pages yy-yy. In "Communications in Computer and Information Science" (CCIS)  (eds. Springer-Verlag 2010, In press) 

    Z. Hammal. Chapter 12: From Face to Facial Expression. Pages 217-238. In "Advances in Face Image Analysis: Techniques and Technologies", Yu-Jin Zhang    (edsIGI Global 2010).

LN Computer Science Papers 

    Z. Hammal Context based Recognition of Pain Expression Intensities.  The 5th Workshop on Emotion in Human-Computer Interaction - Real World Challenges -held at the 23rd BCS HCI Group conference.  Cambridge University, Cambridge, UK, September 2009. 8 Pages (Oral presentation).  ISBN 978-3-8396-0088-7,  (Fraunhofer VERLAG, 2010), 

    Hammal Z., Massot C. Dynamic Facial Expression Classification Based on Human Visual Cues Information. Workshop series: Emotion and Computing – Current Research and Future Impact-held in the framework of the 32nd Annual Conference on
Artificial Intelligence KI 2009.  10 Pages (Oral presentation). (LNCS, 2009) 

    Z. Hammal, A. Martin and F. Gosselin Comparing a Transferable Belief Model Capable of Recognizing Facial Expressions with the Latest Human Data. in ADVANCES IN VISUAL COMPUTING. Lecture Notes in Computer Science, 2007, Volume 4841/2007, pages 509-520, DOI: 10.1007/978-3-540-76858-6_50  (LNCS 2007)   

    Hammal Z., Massot C., Bedoya G., Caplier A.  Eyes Segmentation Applied to Gaze Direction and Vigilance Estimation.  PATTERN RECOGNITION AND IMAGE ANALYSIS. Lecture Notes in Computer Science, 2005, Volume 3687/2005, pages 236-246, DOI: 10.1007/11552499_27(LNCS 2005). 

    Hammal Z., Couvreur L., Caplier A., Rombaut M.  Facial Expressions Recognition Based on The Belief Theory: Comparison with Diferent Classifiers. IMAGE ANALYSIS AND PROCESSING. Lecture Notes in Computer Science, 2005, Volume 3617/2005, pages 743-752, DOI: 10.1007/11553595_91 (LNCS 2005)   

    Hammal Z., Caplier A., Rombaut M  Belief Theory Applied to Facial Expressions Classification. PATTERN RECOGNITION AND IMAGE ANALYSIS.Lecture Notes in Computer Science, 2005, Volume 3687/2005, pages 183-191, DOI: 10.1007/11552499_21 (LNCS 2005)

Journal Papers

    Hammal, Z., Gosselin, F., Peretz, I., & Hébert, S. Music to my eyes: Spatial frequencies mediating music reading

    Z. Hammal and C. Massot. Holistic and Features Based Processing for Dynamic Detection and Interpretation of Emotional Segments

    Z. Hammal and M. Kunz. Pain Monitoring: A Dynamic and Context-sensitive System   

    Hammal Z., M. Arguin, and F. Gosselin. Comparing a Novel Model Based on the Transferable Belief Model with Humans During the Recognition of Partially Occluded Facial Expressions. December 2008 (Journal of Vision), 9(2):22, 1-19, http://journalofvision.org/9/2/22/, doi:10.1167/9.2.22.   

    Hammal Z., Couvreur L., Caplier A., Rombaut M. Facial Expressions Classification: A new approach based on Transferable Belief Model.  INTERNATIONAL JOURNAL OF APPROXIMATE REASONING (Elsevier). 46(3):542-567, 2007, [PDF].

    Z. Hammal, N. Eveno, A. Caplier, and P-Y Coulon  Parametric models for facial features segmentation.  (Signal processing), vol 86 , pp 399-413, 2006 [PDF].  

     Hammal Z., Eveno N, Caplier A., Coulon P.-Y Extraction des traits caracteristiques du visage à l'aide de modèle paramétriques adaptés. Traitement du signal (TS 2005),vol 22, num 01, pp 59-71, 2005. PDF Selected as from the best papers of  the 19ème colloque sur le traitemant du signal et des images Gretsi 2003.

Proceeding Papers

    Hammal Z., Massot C. Holistic and Feature-Based Information Towards Dynamic Multi-Expressions Recognition. Selected as from the best papers of VISAPP 2010, to be published in the book ("Communications in Computer and Information Science" (CCIS) published by Springer-Verlag) 10 pages (LNCS: in press)

    Z. Hammal, F. Gosselin, I.Peretz and S. Hebert. Spatial Frequencies Mediating Music Reading. Proc. Vision Science Society (VSS 2010). 7-12 May 2010 Naples Grand Hotel, Floride (JoV 2010), [PDF].

    Z. Hammal, F. Gosselin and I. Fortin How efficient are the recognition of dynamic and static facial expressions? Proc. Vision Science Society (VSS 2009). 9-14 May 2009 Naples Grand Hotel, Floride (JoV 2009) [PDF]   

    Z. Hammal, M. Kunz, M. Arguin, and F. Gosselin. Spontaneous Pain Expression Recognition in Video Sequences. Proc. BCS Int’l Conf. on Visions of Computer Science (BCS-Visions 2008). Imperial College London September 22-24, 2008, 20 pages (oral presentation). Selected as from the best papers of the BCS-Visions 2008.   

    Z. Hammal, N. Tsuchiya, R. Adolphs, M. Arguin, P. G. schyns and F. Gosselin. What does the activity in the Amygdala and the Insula correlate with in fearful and disgusted faces. Proc. Vision Science Society (VSS 2008). 9-14 May 2008, Naples Grand Hotel, Floride (oral presentation) (JoV 2008)   

    S. Roy, C. Roy, Z. Hammal, D. Fiset, C.Blais, B. Jemel, F. Gosselin. The use of Spatio-temporal Information in decoding facial expression of emotions. Proc. Vision Science Society (VSS 2008). 9-14 May 2008, Naples Grand Hotel, Floride (Poster) (JoV 2008)   

    C. Roy, S. Roy, D. Fiset,, Z. Hammal, P. Rainvill, F. Gosselin. Recognizing static and dynamic facial expressions of Pain: Gaze-tracking and Bubbles experiments. Proc. Vision Science Society (VSS 2008). 9-14 May 2008, Naples Grand Hotel, Floride (Poster) (JoV 2008)

    I. Buciu, Z. Hammal, A. Caplier, N. Nikolaidis and I. Pitas Enhencing Facial Expression Classification By Information Fusion. Proc. 14 th European Signal Processing Conference (Eusipco 2006), 5 pages (oral presentation).

    Z. Hammal Dynamic facial expression understanding based on temporal modeling of transferable belief model. Proc. International conference on computer vision theory and application. (Visapp 2006).25-28 February 2006, Setubal, Portugal. PDF. 12 pages (oral presentation).

    Hammal Z., Bozkurt B., Couvreur L., Unay D., Caplier A., Dutoit T  Passive versus Active: Vocal Classification System. Proc. 13 th European Signal Processing Conference. (EUSIPCO 2005). Turkey ,PDF, 4 pages (oral presentation).

    Hammal Z., Caplier A., Rombaut M. A fusion process based on belief theory for classification of facial basic emotions. Proc. IEEE Fusion'2005 the 8th International Conference on Information fusion. (ICIF2005) ,PDF, 8 pages (oral presentation) (link).

    Hammal Z., Caplier A.  Eyes and eyebrows parametric models for automatic segmentation. Proc. IEEE Southhwest Symposium on Image Analysis and Interpretation. (IEEE) (SSIAI04). Turkey ,PDF, 4 pages , oral presentation (link).

    Hammal Z., Bozkurt B., Couvreur L., Unay D., Caplier A., Dutoit T  Classification bimodale d'expressons vocales. 20ème colloque sur le traitemant du signal et des images (Gretsi'2005), Louvain-la-Neuve , belgique, Septembre 2005.

    Hammal Z., Caplier A., Rombaut M. Classification d'expressions faciales par la theorie de l'évidence Rencontre Francophones sur la Logique Floue et ses Applications (LFA2004), Nantes, 18-19 Nouvembre 2004 PDF.

    Hammal Z., Caplier A. Analyse dynamique des transformations des traits du visage lors de la production d'une emotion. Atelier sur l'analyse du geste (RFIA 2004), Toulouse, 2004 <[PDF]-

    Hammal Z., Eveno N., Caplier A., Coulon P.-Y  Extraction réaliste des traits caractéristiques du visage à l'aide de modèles paramétriques adaptés 19ème colloque sur le traitemant du signal et des images (Gretsi'2003), Paris, Septembre 2003 PDF

Selected Official Seminars and Invited Talks

    Z . Hammal, titre à venir, conférence chez Bell Canada, Montréal, 20 Septembre 2010.

    Z . Hammal, Music to my eyes : Spatial frequencies mediating music reading, conférence aux séminaires du CERNEC, université de Montréal, 17 Septembre 2010.

    Z . Hammal, titre à venir, Summer School on Affective Computing and Social Signal Processing (ACSSP10), 30 August to 2 September 2010, Edinburgh, UK.

    Z. Hammal, Automatic Analysis and Interpretation of Human Facial Behavior, McGill University, 23 Juin 2010, Montréal.

    Z. Hammal, Segmentation et Interprétation d'indices Visuels pour la Reconnaissance Séquentielle des Expressions Faciales.  Institut TELECOM -(Abstract, TELECOM ParisTech.) 27 Mai 2010, Paris, France Chez Catherine Pelachaud.

    Z. Hammal, . The Computer Sciences Laboratory for Mechanics and Engineering Sciences (CNRS-LIMSI), 25 Mai 2010, Paris, France Chez Jean-Claude Martin.

    Z. Hammal, F. Gosselin, I. Peretz, S. Hébert, Spatial Frequencies Mediating Music and Text Reading. BRAMS Annual Scientific Day, (BRAMS April 2010) [PDF].

    Z. Hammal, Du visage à l'expression: segmentation et interprétation d'indices visuels pour la reconnaissance des expressions faciales.  Orateur invit au : Colloquium Statistiques pour le traitement de l'Image. 11-12 Mars 2010  Paris  [STATIMRISC].

    Z. Hammal, F. Gosselin, I. Peretz, S. Hébert, Spatial Frequencies Mediating Music Reading. BRAMS Annual Scientific Day, (BRAMS May 2009) [PDF].

    Hammal Z., Arguin M., Gosselin F COMPARING A TRANSFERABLE BELIEF MODEL CAPABLE OF RECOGNIZING FACIAL EXPRESSIONS WITH HUMAN DATA La 17ième Journée Scientifique du CERNEC Plasticité et réorganisation cérébrale, (CERNEC Avril 2008)

    Hammal Z.. (Séminaire invité, Evry), Juin 2005 

    Hammal Z., Caplier A., Rombaut M. (Réunion Française sur les Fonctions de Croyance), Compiègne, 23-24 Mars 2005

    Hammal Z., Caplier A., Rombaut M., Reconnaissance d'expressions faciales en utilisant la théorie de l'évidence Journée Analyse de visages (GdR ISIS 2005), Paris, 20 janvier 2005

    Z. Hammal, N. Eveno, A. Caplier, P-Y Coulon,Journées

 du GDR ISIS & AS 70 du département STIC du CNRS "Perception, Modélisation et Interprétation du Geste HumainTitre "Extraction réaliste des traits caractéristiques du visage"Grenoble, 2003