Takaaki Shiratori

Project Scientist
The Robotics Institute
School of Computer Science
Carnegie Mellon University

4615 Forbes Avenue, Suite 420
Pittsburgh PA 15213 USA
E-Mail: siratori (AT) cs.cmu.edu

Resume (pdf)

I am a Project Scientist in the Robotics Institute at Carnegie Mellon University. Currently I am working with Prof. Jessica K. Hodgins in the Computer Graphics Lab and partly in the Disney Research, Pittsburgh.

I obtained B.E. in Information and Communication Engineering from The University of Tokyo in 2002, and M.E. and Ph.D. in Information Science and Technology from The University of Tokyo in 2004 and 2007, respectively. I worked in the Robotics Group of Computer Vision Laboratory (CVL) under the supervision of Prof. Katsushi Ikeuchi.

My research interests are in computer graphics and robotics. Particularly, I am interested in analysis and synthesis of human motion for character animation, humanoid robots, and biomechanics. At the University of Tokyo, I developed fundamental methods to realize the sound-feedback system for the dancing humanoid robot (Youtube video). At CMU, I am developing user interfaces to intuitively control a human-like character using various sensors.

Selected Projects

Simulating Balance Recovery Responses to Trips Based on
Biomechanical Principles
[project] [SCA 2009] [Youtube]
Accelerometer-based User Interfaces for the Control of
a Physically Simulated Character
[project] [SIGGRAPH Asia 2008] [Youtube]
Temporal Scaling of Upper Body Motion for
Sound-Feedback System of a Dancing Humanoid Robot
[project][IROS 2007] [Youtube]
Summary: [pdf] [poster]
Dancing-to-Music Character Animation
[project] [EG 2006] [ICRA 2006] [Youtube]
Summary: [pdf] [poster]
Web application:
Video Completion by Motion Field Transfer
[project] [CVPR 2006]
Detecting Dance Motion Structure Using
Motion Capture and Musical Information
[VSMM 2004] [FGR 2004]
Summary: [pdf] [poster]

Publication List

Journal Papers

  • Takaaki Shiratori, Jessica K. Hodgins
    "Accelerometer-based User Interfaces for the Control of a Physically Simulated Character"
    ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2008), December 2008
    [project] [paper]
  • Takaaki Shiratori, Katsushi Ikeuchi
    "Synthesis of Dance Performance Based on Analyses of Human Motion and Music"
    IPSJ Transactions on Computer Vision and Image Media, Vol. 1, No. 1, pp. 34-47, June 2008
    [IPSJ]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Dancing-to-Music Character Animation"
    Computer Graphics Forum, Vol. 25, No. 3 (Proc. Eurographics 2006), pp. 449-458, Sep. 2006
    [project] [paper]
  • Katsushi Ikeuchi, Takaaki Shiratori, Shunsuke Kudoh, Hirohisa Hirukawa, Shin'ichiro Nakaoka, Fumio Kanehiro
    "Robots that Learn to Dance from Observation"
    IEEE Intelligent Systems, Vol. 23, No. 2, pp. 74-76, March/April 2008
    [IEEE]
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Task Recognition and Person Identification in Cyclic Dance Sequences with Multi Factor Tensor Analysis"
    IEICE Trans. on Information and Systems, May 2008
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Motions using Motion Capture"
    The Journal of Three Dimensional Images, Vol. 17, No. 4, pp. 77-84, December 2003
(in Japanese)
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Automatic Synthesis of Dance Performance Using Motion and Musical Features"
    IEICE Trans. on Information and Systems D-II, Vol. J88-D-II, No. 8, pp. 2242-2252, August 2007
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "The Structure Analysis of Dance Motions using Motion Capture and Musical Information"
    IEICE Trans. on Information and Systems D-II, Vol. J88-D-II, No. 8, pp. 1583-1590, August 2005
  • Shunsuke Kudoh, Shin'ichiro Nakaoka, Takaaki Shiratori
    "Motion Understanding for Acquiring Dance Performance"
    Journal of Robotics Society of Japan, Vol.25, No.5, pp.15 – 20, July 2007
  • Katsushi Ikeuchi, Atsushi Nakazawa, Shunsuke Kudoh, Shinichiro Nakaoka, Takaaki Shiratori
    "Reproducing Dance Performance with Humanoids Based on Learning From Observation Paradigm"
    Japanese Journal of Biomechanics in Sports & Exercise, Vol. 10, No.3, pp190-202, 2006
  • Katsushi Ikeuchi, Atsushi Nakazawa, Koichi Ogawara, Jun Takamatsu, Shunsuke Kudoh, Shinichiro Nakaoka, Takaaki Shiratori
    "Digitally Archiving Intangible Cultural Heritages with Humanoid Robots"
    Journal of Virtual Reality Society of Japan, Vol. 9, No. 2, pp. 14-20, June 2004

Conference / Workshop

  • Takaaki Shiratori, Brooke Coley, Rakié Cham, Jessica K. Hodgins
    "Simulating Balance Recovery Responses to Trips Based on Biomechanical Principles"
    In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation, August 2009
    [project] [paper]
  • Takaaki Shiratori, Brooke Coley, Rakié Cham, Jessica K. Hodgins
    "Modeling and Simulation of Balance Recovery Responses to Tripping"
    In Proc. Annual Meeting for the American Society of Biomechanics, August 2009 (conference abstract)
  • Takaaki Shiratori, Jessica K. Hodgins
    "Accelerometer-based User Interfaces for the Control of a Physically Simulated Character"
    In Proc. SIGGRAPH Asia 2008, December 2008
    [project] [paper]
  • Takaaki Shiratori, Atsushi Nakazawa, Shin'ichiro Nakaoka, Shunsuke Kudoh, Katsushi Ikeuchi
    "Task Models of Upper Body Motion for a Dancing Humanoid Robot Based on Motion and Music Features"
    In Proc. International Workshop on Art and Robots in conjunction with IROS 2008, September 2008
  • Takaaki Shiratori, Shunsuke Kudoh, Shin'ichiro Nakaoka, Katsushi Ikeuchi
    "Temporal Scaling of Upper Body Motion for Sound Feedback System of a Dancing Humanoid Robot"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
    [project] [paper]
  • Miti Ruchanurucks, Shunsuke Kudoh, Koichi Ogawara, Takaaki Shiratori, Katsushi Ikeuchi
    "Humanoid Robot Painter: From Object to Trajectory"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Multilinear Analysis for Task Recognition and Person Identification"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
  • Jun Takamatsu, Takaaki Shiratori, Shin'ichiro Nakaoka, Shunsuke Kudoh, Atsushi Nakazawa, Fumio Kanehiro, Katsushi Ikeuchi
    "Entertainment Robot: Learning from Observation Paradigm for Humanoid Robot Dancing"
    In Proc. International Workshop on Art and Robots in conjunction with IROS 2007, October 2007
  • Miti Ruchanurucks, Shunsuke Kudoh, Koichi Ogawara, Takaaki Shiratori, Katsushi Ikeuchi
    "Humanoid Robot Painter: Visual Perception and High-Level Planning"
    In Proc. IEEE International Conference on Robotics and Automation (ICRA 2007), April 2007
  • Daisuke Miyazaki, Mawo Kamakura, Tomoaki Higo, Yasuhide Okamoto, Rei Kawakami, Takaaki Shiratori, Akifumi Ikari, Shintaro Ono, Yoshihiro Sato, Mina Oya, Masayuki Tanaka, Katsushi Ikeuchi, Masanori Aoyagi
    "3D Digital Archive of the Burghers of Calais,"
    In Proc. International Conference on Virtual Systems and Multimedia (VSMM 2006), Lecture Notes in Computer Science (LNCS), October 2006
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Dancing-to-Music Character Animation"
    In Proc. Eurographics 2006, September 2006
    [project] [paper]
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Task Recognition and Style Analysis in Dance Sequences"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2006), September 2006
  • Takaaki Shiratori, Yasuyuki Matsushita, Sing Bing Kang, Xiaoou Tang
    "Video Completion by Motion Field Transfer"
    In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), June 2006
    [project] [paper] [poster]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Synthesizing Dance Performance Using Musical and Motion Features"
    In Proc. IEEE International Conference on Robotics and Automation (ICRA 2006), May 2006
    [project] [paper]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Structure Detection of Dance Sequence using Motion Capture and Musical Information"
    In Proc. International Symposium on CREST Digital Archiving Project, March 2005
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Detecting Dance Motion Structure using Motion Capture and Musical Information"
    In Proc. International Conference on Virtual Systems and Multimedia (VSMM 2004), November 2004
    [paper]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Detecting Dance Motion Structure through Music Analysis"
    In Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2004), May 2004
    [paper]
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Motions using Motion Capture"
    In Proc. International Conference on Humans and Computers (HC 2003), August 2003
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Rhythmic Motion Analysis using Motion Capture and Musical Information"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2003), July 2003
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Dance Motions"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2003), July 2003

Ph.D. Dissertation

  • Takaaki Shiratori, "Synthesis of Dance Performance Based on Analyses of Human Motion and Music", Ph.D. Dissertation, The University of Tokyo, March 2007

Misc