Jean Oh, Ph.D.
Associate Research Professor
The Robotics Institute, Carnegie Mellon University

Jean Oh is an Associate Research Professor at the Robotics Institute at Carnegie Mellon University. Jean is passionate about creating persistent robots that can co-exist and collaborate with humans in shared environments, continuously learning to improve themselves over time through training, exploration, and interactions. Toward this general goal, her current research is focused on the topics at the intersection among vision, language, and planning in robotics. Jean has been leading several robot intelligence tasks in government, defense, and commercial projects in various problem domains including human-robot teaming, self-driving cars, disaster response, eldercare, and arts. Jean heads an interdisciplinary research group, Bot Intelligence Group (BIG), that includes postdoctoral researchers, PhD, MS, and undergraduate students from the Robotics Institute, Language Technologies Institute, Computer Science Department, Machine Learning Department, School of Information Science, and Mechanical Engineering Department. Jean's team has won two Best Paper Awards in Cognitive Robotics at IEEE International Conference on Robotics and Automation (ICRA) in 2015 and 2018 for the works on following natural language directions in unknown environments and socially-compliant robot navigation in human crowds, in 2015 and 2018, respectively. Jean received her Ph.D. in Language and Information Technologies at Carnegie Mellon University, M.S. in Computer Science at Columbia University, and B.S. in Biotechnology at Yonsei University in South Korea.

Best way to reach me:   Email (
Assistant:   Carly Siedt (
The Robotics Institute,
Carnegie Mellon University
5000 Forbes Ave.
Pittsburgh, PA 15213
Office: NSH 2216
Carnegie Mellon University
1723 Murray Ave.
Pittsburgh, PA 15213
Office: F2 (2nd Floor)
National Robotics Engineering Center (NREC)
10 40th Street,
Pittsburgh, PA 15201
Office: 275

16-785: Integrated Intelligence in Robotics: Vision, Language, and Planning, Spring 2023 (Special Theme: Film Making using AI & Robotics).
16-995: Independent Study Fall, Spring (Email me for more information).
10-737: Creative AI, Fall.


August 2021. I am co-organizing a Frontiers session at SIGGRAPH 2021, Measurable Creative AI (more information coming up soon). .

July 2021. I am co-organizing a workshop at RSS 2021, Robotics x Arts Exhibition: Opportunities and Issues in Robotics Applied in the Arts. .

June 2021. I am co-organizing the second Creative AI workshop, Computational Measurements of Machine Creativity (CMMC): Bridging the Gap between Subjective and Computational Measurements of Machine Creativity at Conference on Computer Vision and Pattern Recognition (CVPR 2021).

March 22-24, 2021. I am co-organizing a symposium, Machine Learning for Mobile Robot Navigation in the Wild (ML4NAV), at the AAAI 2021 Spring Symposium Series.

Summer 2019. Xinjie Yao, a senior student from the Hong Kong University of Science and Technology, worked with Ji Zhang and me on social navigation. Below is the video showing her demo at the Robotics Institute Summer Scholars (RISS) final presentation session. Xinjie's work will also be presented at International Conference on Intelligent Robots and Systems (IROS) at the Late Breaking Results poster session in Macau in October, 2019.

Summer 2018. Brandon Trabucco from UC Berkeley, co-mentored by Ralph Hollis and myself, presented his work on detailed image captioning at the Robotics Institute Summer Scholars (RISS) poster session. Brandon is definitely a student with many talents; he also performed "My Way" at the program's final ceremony. (photo: with another summer student, Kai-Chi Huang from UT Austin, and an RI PhD student, Roberto Shu.)

Summer 2017. A Robotics Institute Summer Scholars (RISS) student, Matthew Wilson from University of Utah, co-mentored by Ralph Hollis and myself, worked on the "Go, Look, and Tell" project where he developed a speech interface to command a Shmoo (ballbot) to navigate autonomously, recognize semantic objects, and report what it has seen back to the user.

May 2018. A. Vemula, K. Muelling, J. Oh. Social Attention: Modeling Attention in Human Crowds. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Brisbane, Australia, 2018. (Best Paper Award in Cognitive Robotics) [ArXiv].

May 2015. A. Boularias, F. Duvallet, J. Oh, and A. Stentz. Learning to ground spatial relations for outdoor robot navigation. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Seattle, WA, 2015. (Best Paper Award in Cognitive Robotics). [pdf].