I am a Ph.D. student in the Robotics Institute at Carnegie Mellon University, under the supervision of Prof. Yaser Sheikh. I am also actively collaborating with Prof. Mina Cikara in Harvard University and Prof. Hyun Soo Park in UMN. During summer 2015, I interned at Disney Research Zurich where I worked with Thabo Beeler and Derek Bradley. Before joining CMU, I spent three years as a researcher at ETRI, a government-funded research organization in Korea. I received my M.S. in Electrical Engineering and B.S. in Computer Science, both
from KAIST, Korea. The Samsung Scholarship is supporting my graduate study.
My main research interests are in computer vision, computer graphics, and machine perception of social behavior. My work focuses on analyzing and understanding dynamic scenes using more than 500 synchronized cameras in the Panoptic Studio at CMU.
(Left) A media coverage well describing our research direction; (Right) Social interaction capture results
Dec 2016 I will be co-organizing a tutorial on "DIY: A Multiview Camera System" in conjunction with CVPR 2017. Stay tuned for the details.
Dec 2016 I gave talks in Bay Area (Stanford, UC Berkeley, and Adobe Research) to present our recent progress in social interaction capture using our Panoptic Studio.
Dec 2016 Our recent progress on the Panoptic Studio is featured on . You can also see the video version here.
Nov 2016 I gave a talk about our Panoptic Studio system in ASSP4MI workshop of ICMI.
Sep 2016 Our brand new Panoptic Studio dataset website is open (link). All dataset including videos from 500+ cameras and 3D skeltons reconstruction results, and a Toolbox are available.
Hand Keypoint Detection in Single Images using Multiview Bootstrapping
Tomas Simon, Hanbyul Joo, Iain Mattews, and Yaser Sheikh
In CVPR 2017 (accepted)
Panoptic Studio: A Massively Multiview System for Social Interaction Capture Hanbyul Joo, Tomas Simon, Xulong Li, Hao Liu, Lei Tan, Lin Gui, Sean Banerjee, Timothy Godisart, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara, and Yaser Sheikh
Under review (Extended version of ICCV15) [arXiv][Dataset]
Panoptic Studio: A Massively Multiview System for Social Motion Capture Hanbyul Joo, Hao Liu, Lei Tan, Lin Gui, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara,
and Yaser Sheikh
In ICCV 2015   (Oral) - Acceptance ratio: 56/1698~3.3%
[Paper(PDF)] [Supplementary Material][Project Page]
MAP Visibility Estimation for Large-Scale Dynamic 3D Reconstruction Hanbyul Joo, Hyun Soo Park, and Yaser Sheikh
In CVPR 2014   (Oral) - Acceptance ratio: 104/1807~5.8%
[Paper(PDF)] [Project Page][Dataset]
Graph-based Shape Matching for Deformable Objects Hanbyul Joo,
Yekeun Jeong, Olivier Duchenne, and In So Kweon
In ICIP 2011
Graph-Based Robust Shape Matching for Robotic Application Hanbyul Joo,
Yekeun Jeong, Olivier Duchenne, Seong-Young Ko, and In So Kweon
In ICRA 2009
Statistical Background Subtraction Based on the Exact Per-pixel Distributions
Youngbae Hwang, Hanbyul Joo, Jun-sik Kim, and In So Kweon
In IAPR workshop on Machine Vision Applications (MVA) 2007
"The Panoptic Studio: A Massively Multiview System for Social Interaction Capture"
UC Berkeley, Computer Vision Group, Dec 2016 (hosted by Prof. Alexei A. Efros).
Stanford, Computer Vision and Geometry Lab (CVGL), Dec 2016 (hosted by Prof. Silvio Savarese).
Adobe Research, Dec 2016 (hosted by Dr. Joon-Young Lee).
Motion capture apparatus and method (Patent No.: US 8805024 B2) Hanbyul Joo, Seong-Jae Lim, Ji-Hyung Lee, Bon-Ki Koo
Method for automatic rigging and shape surface transfer of 3D standard mesh model based on muscle and nurbs by using parametric control (Patent No.: US 7171060 B2)
Seong Jae Lim, Ho Won Kim, Hanbyul Joo, Bon Ki Koo
3D model shape transformation method and apparatus (Patent Application No.: US 20120162217 A1) Seong-Jae Lim, Hanbyul Joo, Seung-Uk Yoon, Ji-Hyung Lee, Bon-Ki Koo.