I am a first-year PhD student at Stanford University under the supervision of Emma Brunskill. I am interested in various branches of machine learning. I work on leveraging learning theory to understand and advance interactive learning provably and practically. Before moving to Stanford, I was a Ph.D. student at CMU, also working with Emma Brunskill. Previously I worked with Prof. Liwei Wang before I received my Bechelor's degree from Peking University in 2016.
I have moved to Stanford, so this page may be no longer maintained.
Education
- Stanford University
- Ph.D. Student in Computer Science
- Computer Science Department
- Carnegie Mellon University
- Ph.D. Candidate in Computer Science
- Computer Science Department, School of Computer Science
- Peking University
- B.S. in Machine Intelligence, Summa Cum Laude, 2016
- Department of Machine Intelligence, School of EECS
- Zhengzhou Foreign Language School
- High School Diploma, 2012
Publications
- PAC Continuous State Online Multitask Reinforcement Learning with Identification [pdf] [supplementary]
Yao Liu, Zhaohan Guo, Emma Brunskill
In International Conference on Autonomous Agents and Multi-agent Systems (AAMAS), 2016. Oral [slides]
Experience
Research Intern at CMU
- Jul. 2015 to Sept. 2015, Dept. of Computer Science, CMU
- Supervisor: Prof. Emma Brunskill
- Collaborator: Zhaohan (Daniel) Guo
- Worked on sample complexity of transfer reinforcement learning.
- Proposed a new multi-task reinforcement learning algorithm in continuous space, which is the first PAC bounded algorithm in this settings.
Research Assistant at PKU
- May. 2014 to Now, Dept. of Machine Intelligence, PKU
- Supervisor: Prof. Liwei Wang, Prof. Tong Lin
- Worked on computational learning theory, optimization, manifold learning and differential privacy.
Teaching Assistant at PKU: Algorithm Design and Analysis
- Spring Semester, 2015
- Instructor: Prof. Yizhou Wang