Po-Yao (Bernie) Huang

School of Computer Science, Carnegie Mellon University. poyaoh@cs.cmu.edu

Greetings! I am Po-Yao (Bernie) Huang. I am a research scientist of Facebook AI Research (FAIR). I obtained my Ph.D. degree in the Language Technologies Institute (LTI) of School of Computer Science (SCS) at Carnegie Mellon University (CMU) in 2021. My research interest is multimodal machine learning. I am particularly interested in bridging computer vision and natural language processing for the tasks of multimodal machine translation, cross-modal search and retrieval, and large-scale multimodal data mining and analysis.


Carnegie Mellon University

Ph.D. in Computer Science - Language and Information Technologies Aug 2016 - Jul 2021

GPA: 4.33/4.33

M.S. in Computer Science - Language Technologies Aug 2014 - Jul 2016

GPA: 4.21/4.33

National Taiwan University

M.S. in Computer Engineering Aug 2007 - Jul 2009

GPA: 4.00/4.00

B.S. in Electrical Engineering Sep 2003 - Jul 2007

GPA: 3.78/4.00

Work Experience


Research Scientist (Facebook AI Research) Aug 2021 - present
Research Intern May 2020 - May 2021


Research Intern (Microsoft Research) Jun 2017 - Aug 2017


Senior Software Engineer Jun 2012 - Jun 2014
Software Engineer Sep 2010 - May 2012


  • Entity Hierarchy Embedding
    Zhi-Ting Hu, Po-Yao Huang, Yuntian Deng, Yingkai Gao, and Eric Xing [supp]
    The 53rd Annual Meeting of the Association for Computational Linguistics (ACL), 2015.


  • 1st Place in the TREC Incident Streams challenge 2019
  • 1st Place in the TRECVID ActEV (Activities in Extended Videos) challenge 2019
  • 2nd Place in the Kinetics-800 Action Recognition challenge in ActivityNet 2019
  • 1st Place in the ActEV challenge in ActivityNet 2019
  • 2nd Place in the TRECVID Ad-hoc Video Search challenge 2018
  • 2nd Place in the Youtube 8M challenge 2017
  • Named Siebel Scholar (Top CS/Business students in top graduate schools worldwide) 2016


  • ACL, ICMR, AAAI, ACM MM, CVPR travel awards/grants, 2015-2019
  • NSF travel awards, 2015-2019
  • CMU Research Fellowship 2014-2019
  • Taiwan's Study Abroad Scholarship, 2016
  • Siebel Scholarship, 2016
  • Din-Jing Memorial Scholarship, 2009