synopsis: My principal research interests lie
in the development of machine learning and statistical methodology,
and large-scale computational
system and architecture, for solving problems involving automated learning,
reasoning, and decision-making in high-dimensional, multimodal, and
dynamic possible worlds in artificial, biological, and social systems.
Current Students and Postdocs:
Past Students and Postdocs:
Ahmed, Research Scientist, Google
- Ross Curtis, Software Engineer, AncestryDNA
- Wei Dai, Senior Director of Engineering, Petuum Inc.
- Jacob Eisenstein, Assistant
Professor, Georgia Institute of Technology
- Wenjie Fu, Software Engineer, Facebook
- Anuj Goyal, Software Engineer, LinkedIn
- Steve Hanneke, Visiting Assistant
Professor, Carnegie Mellon University
Hetunandan, Research Scientist, Facebook
- Qirong Ho, Scientist, A*STAR, Singapore; CTO, Petuum Inc.
- Judie Howrylak, Assistant Professor, Penn State University
Kim, Assistant Professor, Seoul National University
- Jin Kyu Kim
- Abhimanu Kumar, Senior Research Engineer, LinkedIn
- Seyoung Kim, Assistant Professor, Carnegie Mellon University
- Mladen Kolar, Assistant Professor, University of Chicago
Lee, Research Scientist, Facebook
- Xiaodan Liang, Associate Professor, Zhongshan University
Martins, Research Scientist, Priberam Labs and
Instituto Superior Técnico
Parikh, Research Scientist, Google
Puniyani, Research Scientist, Google
- Pradipta Ray,
Research Scientist, University of Taxes Dallas
- Suyash Shringarpure, Postdoctoral researcher, Stanford University
- Kyung-Ah Sohn, Assistant Professor, Ajou University
Song, Associate Professor, Georgia Institute
Wang, Research Scientist, Google
Williamson, Assistant Professor, University of
Wilson, Assistant Professor, Cornell Unicersity
- Pengtao Xie, Senior Director of Engineering, Petuum Inc.
Yin, Assistant Professor, University of
Yu, Assistant Professor, University of Waterloo
Zhao, Co-founder and CEO of PanOptus
- Bing Zhao, Research Scientist, SRI
- Jun Zhu, Professor, Tsinghua University
In 2016, I founded Petuum Inc. to pursue standardization and industrialization of general-purpose AI platform and building blocks. I have been serving as CEO and Chief Scientist of Petuum, which was recognized as a Technology Pioneer by the World Economic Forum in 2018.
Research and Development:
On December 25th, 2013, we made an initial
open-source release of Petuum,
framework for distributed machine learning with massive data, big
models, and a wide spectrum of algorithms. Updates on Petuum are released every
three months. The latest release (version 1.1) was made in July, 2015.
I am teaching Probabilistic Graphical Models
(10708) again in Spring 2019! Half of the contents will be NEW!
Video lectures of Probabilistic Graphical
(10708), made in Spring 2014.
In Fall 2014, I taught Advanced Machine
Learning (10715), a newly created required
course for ML Ph.D. students, with Prof.
I regularly teach Graduate
Machine Learning (10701), which is a
general Ph.D.-level intro. ML for CMU students from all majors.
"A New Look at the System, Algorithm and Theory Foundations of Distributed Machine LearningA Statistical Machine Learning Perspective of Deep Learning: Algorithm, Theory, and Scalable Computing" [slides],
at the International Summer School on Deep Learning, Genova, Italy, 2018.
"System and Algorithm Co-Design, Theory and Practice, for Distributed Machine Learning" [video],
at the Simons Institute for the Theory of Computing, Berkeley, 2017.
"A New Look at the System, Algorithm and Theory Foundations of Distributed Machine Learning" [slides],
with Dr. Qirong Ho at the 21st ACM SIGKDD Conference on knowledge Discovery and Data Mining (KDD 2015).
"Big ML Software for Modern ML Algorithms" [slides],
with Dr. Qirong Ho at the 2014 IEEE International Conference on Big Data (IEEE BigData 2014).
"Topic Models, Latent Space Models, Sparse Coding, and All That: A systematic understanding of probabilistic semantic extraction in large corpus" [slides], at the 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012).
"Modern Statistical Methods for Genetic Association Study: Structured
Genome-Transcriptome-Phenome Association Analysis" [slides],
With Dr. Seyoung Kim, at the Nineteenth International
Conference on Intelligence Systems for Molecular Biology
Board Member, The International Machine Learning Society
Program Committee Chair, ICML
General Chair, ICML 2019.
Action Editor/Associate Editor: JASA, AOAS,
JMLR, MLJ, and PAMI.