Jean Oh, Ph.D.

Systems Scientist
The Robotics Institute, Carnegie Mellon University

Jean Oh is a faculty member at the Robotics Institute at Carnegie Mellon University. Jean is passionate about creating persistent robots that can co-exist and collaborate with humans in shared environments, continuously learning to improve themselves over time through training, exploration, and interactions. Toward this general goal, her current research is focused on the topics at the intersection among vision, language, and planning in robotics. Jean has been leading several robot intelligence tasks in government, defense, and commercial projects in various problem domains including soldier-robot teaming, self-driving cars, disaster response, eldercare, and arts. Jean heads an interdisciplinary research group, Bot Intelligence Group (BIG), that currently includes 10 graduate and 2 undergraduate students from the Robotics Institute, Language Technologies Institute, Computer Science Department, Machine Learning Department, School of Information Science, and Mechanical Engineering Department. Jean's team has won two Best Paper Awards in Cognitive Robotics at IEEE International Conference on Robotics and Automation (ICRA) in 2015 and 2018 for the works on following natural language directions in unknown environments and socially-compliant robot navigation in human crowds, in 2015 and 2018, respectively. Jean received her Ph.D. in Language and Information Technologies at Carnegie Mellon University, M.S. in Computer Science at Columbia University, and B.S. in Biotechnology at Yonsei University in South Korea.

Best way to reach me:   Email (
Assistant:   Stephanie Matvey (
The Robotics Institute,
Carnegie Mellon University
5000 Forbes Ave.
Pittsburgh, PA 15213
Office: Newell Simon Hall 4521
National Robotics Engineering Center (NREC)
10 40th Street,
Pittsburgh, PA 15201
Office: 275

16-785: Integrated Intelligence in Robotics: Vision, Language, and Planning, Spring 2018, Spring 2019
16-995: Independent Study, Fall 2018, Spring 2019
10-737: Creative AI, Fall 2019
This is a new course co-taught with Prof. Eunsu Kang at Machine Learning Department.

Xinjie Yao, a senior student from the Hong Kong University of Science and Technology, worked with Ji Zhang and me on social navigation. Below is the video showing her demo at the Robotics Institute Summer Scholars (RISS) final presentation session. Xinjie's work will also be presented at International Conference on Intelligent Robots and Systems (IROS) at the Late Breaking Results poster session in Macau in October, 2019.
August 8th, 2018. Brandon Trabucco from UC Berkeley, co-mentored by Ralph Hollis and myself, presented his work on detailed image captioning at the Robotics Institute Summer Scholars (RISS) poster session. Brandon is definitely a student with many talents; he also performed "My Way" at the program's final ceremony. (photo: with another summer student, Kai-Chi Huang from UT Austin, and an RI PhD student, Roberto Shu.)

A. Vemula, K. Muelling, J. Oh. Social Attention: Modeling Attention in Human Crowds. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Brisbane, Australia, 2018. (Best Paper Award in Cognitive Robotics) [ArXiv].

A. Boularias, F. Duvallet, J. Oh, and A. Stentz. Learning to ground spatial relations for outdoor robot navigation. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Seattle, WA, 2015. (Best Paper Award in Cognitive Robotics). [pdf].