Hanbyul Joo
Ph.D. student
The Robotics Institute
School of Computer Science
Carnegie Mellon University
Pittsburgh, PA 15213, USA

Office: 201 Smith Hall
Email: hanbyulj at cs dot cmu dot edu

Curriculum Vitae (updated in Jan. 2015)

I am a Ph.D. student in the Robotics Institute at Carnegie Mellon University, under the supervision of Yaser Sheikh. During summer 2015, I interned at Disney Research Zurich where I worked with Thabo Beeler and Derek Bradley. Before joining CMU, I spent three years as a researcher at ETRI, a government-funded research organization in Korea. I received my M.S. in Electrical Engineering and B.S. in Computer Science, both from KAIST, Korea. The Samsung Scholarship is supporting my graduate study.


My main research interests are in computer vision, computer graphics, and machine perception of social behavior. My work focuses on analyzing and understanding dynamic scenes using more than 500 synchronized cameras in the Panoptic Studio at CMU.

Social Interaction Capture in the Panoptic Studio


  • Sep 2016 Our New Panoptic Studio dataset website is open (link). All dataset including videos from 500+ cameras and 3D skeltons reconstruction results, and a Toolbox are available.

  • Dec 2015 Our Social Motion Capture paper has been covered in the press: SPIEGEL ONLINE (German) and Co.DESIGN.

  • Jun-Oct 2015 I have finished my internship at Disney Research Zurich, and came back to CMU.

  • Sep 2015 Our "Social Motion Capture" paper has been accepted as an oral presentation in ICCV 2015.

  • Apr 2015 Our massively multiple view system and dynamic 3D reconstruction has been featured on the and . Click the links to see the articles.

  • Jan 2015 Our massively multiple view system and dynamic 3D reconstruction has been featured on , Daily Planet TV Show. You can see the segment in Daily Planet website.

  • Aug 2014 The dataset of our dynamic 3D reconstruction paper is now available in this webpage.

  • July 2014 Our dynamic 3D reconstruction paper is featured on , , , and so on. Check out the project page.


Panoptic Studio: A Massively Multiview System for Social Motion Capture
Hanbyul Joo, Hao Liu, Lei Tan, Lin Gui, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara, and Yaser Sheikh
In ICCV 2015   (Oral) - Acceptance ratio: 56/1698~3.3%
[Paper(PDF)] [Supplementary Material] [Project Page] [Dataset]
Press Coverage:

MAP Visibility Estimation for Large-Scale Dynamic 3D Reconstruction
Hanbyul Joo, Hyun Soo Park, and Yaser Sheikh
In CVPR 2014   (Oral) - Acceptance ratio: 104/1807~5.8%
[Paper(PDF)] [Project Page] [Dataset]
Press Coverage: ...

Graph-based Shape Matching for Deformable Objects
Hanbyul Joo, Yekeun Jeong, Olivier Duchenne, and In So Kweon
In ICIP 2011

Graph-Based Robust Shape Matching for Robotic Application
Hanbyul Joo, Yekeun Jeong, Olivier Duchenne, Seong-Young Ko, and In So Kweon
In ICRA 2009

Statistical Background Subtraction Based on the Exact Per-pixel Distributions
Youngbae Hwang, Hanbyul Joo, Jun-sik Kim, and In So Kweon
In IAPR workshop on Machine Vision Applications (MVA) 2007


CMU Panoptic Studio Dataset


  • "The Panoptic Studio: A Massively Multiview System for Social Interaction Capture (ICCV15)"

    • CMU, Machine Learning Lunch Seminar, Oct 2016.
    • ICCV Oral Talk, Dec 2015 (video link).
    • CMU, VASC Seminar, Dec 2015.
    • ETH Zurich, Computer Vision and Geometry lab, Oct 2015 (hosted by Prof. Marc Pollefeys).
    • Seoul National University, June 2015 (hosted by Prof. Kyoung Mu Lee).
    • ETRI, CG Team, May 2015 (hosted by Dr. Seong-Jae Lim).
    • KAIST, May 2015 (hosted by Prof. In So Kweon).
  • "The Panoptic Studio (CVPR14)"

    • Graduate Seminar, Civil & Environmental Engineering, CMU, Feb 2015 (hosted by Prof. Hae Young Noh).
    • People Image Analysis Consortium, CMU, Nov 2014.
    • Reality Computing Meetup, Autodesk, Nov 2014.
  • "MAP Visibility Estimation for Large-Scale Dynamic 3D Reconstruction"

Press Coverage


  • Motion capture apparatus and method (Patent No.: US 8805024 B2)
    Hanbyul Joo, Seong-Jae Lim, Ji-Hyung Lee, Bon-Ki Koo

  • Method for automatic rigging and shape surface transfer of 3D standard mesh model based on muscle and nurbs by using parametric control (Patent No.: US 7171060 B2)
    Seong Jae Lim, Ho Won Kim, Hanbyul Joo, Bon Ki Koo

  • 3D model shape transformation method and apparatus (Patent Application No.: US 20120162217 A1)
    Seong-Jae Lim, Hanbyul Joo, Seung-Uk Yoon, Ji-Hyung Lee, Bon-Ki Koo.