CORAL Research Publications

By DateBy Publication TypeBy Research CategoryBy Author (Currently at CMU)By Author (Past and Current CORAL Contributors)

A Team of Humanoid Game Commentators

Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth and Douglas Vail. A Team of Humanoid Game Commentators. In International Conference on Humanoid Robots, Genoa, Italy, December 2006.

Download

[PDF]300.7kB  

Abstract

We contribute an approach for interactive policy learning through expert demonstration that allows an agent to actively request and effectively represent demonstration examples. In order to address the inherent uncertainty of human demonstration, we represent the policy as a set of Gaussian mixture models (GMMs), where each model, with multiple Gaussian components, corresponds to a single action. Incrementally received demonstration examples are used as training data for the GMM set. We then introduce our confident execution approach, which focuses learning on relevant parts of the domain by enabling the agent to identify the need for and request demonstrations for specific parts of the state space. The agent selects between demonstration and autonomous execution based on statistical analysis of the uncertainty of the learned Gaussian mixture set. As it achieves proficiency at its task and gains confidence in its actions, the agent operates with increasing autonomy, eliminating the need for unnecessary demonstrations of already acquired behavior, and reducing both the training time and the demonstration workload of the expert. We validate our approach with experiments in simulated and real robot domains.

BibTeX Entry

@inproceedings{Veloso06humanoids,
  title="A Team of Humanoid Game Commentators",
  author="Manuela Veloso, Nicholas Armstrong-Crews, Sonia Chernova, Elisabeth Crawford, Colin McMillen, Maayan Roth and Douglas Vail",
  booktitle="International Conference on Humanoid Robots",
  place="Genova, Italy", month="December",
  year="2006",
  abstract={We contribute an approach for interactive policy learning through expert demonstration that allows an agent to actively request 
and effectively represent demonstration examples.  In order to address the inherent uncertainty of human demonstration, we represent the 
policy as {\it a set of Gaussian mixture models} (GMMs), where each model, with multiple Gaussian components, corresponds to a single action. 
Incrementally received demonstration examples are used as training data for the GMM set.  We then introduce our {\it confident execution} 
approach, which focuses learning on relevant parts of the domain by enabling the agent to identify the need for and request demonstrations for 
specific parts of the state space.  The agent selects between demonstration and autonomous execution based on statistical analysis of the 
uncertainty of the learned Gaussian mixture set.  As it achieves proficiency at its task and gains confidence in its actions, the agent 
operates with increasing autonomy, eliminating the need for unnecessary demonstrations of already acquired behavior, and reducing both the 
training time and the demonstration workload of the expert.  We validate our approach with experiments in simulated and real robot domains.},
  bib2html_pubtype = {Refereed Conference},
  bib2html_rescat = {Robot Perception, Multi-Robot Systems, RoboCup, RoboCup Legged Soccer},
  bib2html_dl_pdf = {http://www.cs.cmu.edu/~soniac/files/CMCast.pdf},
}

Generated by bib2html.pl (written by Patrick Riley ) on Tue Oct 09, 2007 00:00:13

 

 
[home] [news] [people] [robosoccer] [projects] [multimedia] [download] [publications] [contact us]