Bibliography

Andre & Teller, 1999

Andre and Teller][1999]Darwin98 Andre, D., & Teller, A. (1999).
Evolving team Darwin United.
In M. Asada and H. Kitano (Eds.), RoboCup-98: Robot soccer world cup ii. Berlin: Springer Verlag.

Asada & Kitano, 1999

Asada and Kitano][1999]RoboCup98-proceedings Asada, M., & Kitano, H. (Eds.). (1999).
RoboCup-98: Robot soccer world cup ii.
Lecture Notes in Artificial Intelligence 1604. Berlin: Springer Verlag.

Dayan & Hinton, 1993

Dayan and Hinton][1993]Dayan93 Dayan, P., & Hinton, G. E. (1993).
Feudal reinforcement learning.
In S. J. Hanson, J. D. Cowan and C. L. Giles (Eds.), Advances in neural information processing systems 5. San Mateo, CA: Morgan Kaufmann.

Dietterich, 1998

Dietterich][1998]Dietterich98 Dietterich, T. G. (1998).
The MAXQ method for hierarchical reinforcement learning.
Proceedings of the Fifteenth International Conference on Machine Learning.
Morgan Kaufmann.

Digney, 1996

Digney][1996]Dig96 Digney, B. L. (1996).
Emergent hierarchical control structures: Learning reactive/hierarchical relationships in reinforcement environments.
Proceedings of the 4th International Conference of Simulation of Adaptive Behavior (pp. 363-372).
MIT Press.

Kaelbling et al., 1996

Kaelbling et al.][1996]Kaelbling96 Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996).
Reinforcement learning: A survey.
Journal of Artificial Intelligence Research, 4, 237-285.

Kitano, 1998

Kitano][1998]RoboCup97-proceedings Kitano, H. (Ed.). (1998).
RoboCup-97: Robot soccer world cup i.
Berlin: Springer Verlag.

Kitano et al., 1997

Kitano et al.][1997]software-challenge97 Kitano, H., Tambe, M., Stone, P., Veloso, M., Coradeschi, S., Osawa, E., Matsubara, H., Noda, I., & Asada, M. (1997).
The RoboCup synthetic agent challenge 97.
Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (pp. 24-29).
San Francisco, CA: Morgan Kaufmann.

Koza, 1992

Koza][1992]Koza92 Koza, J. R. (1992).
Genetic programming.
MIT Press.

Lin, 1993

Lin][1993]Lin93 Lin, L.-J. (1993).
Reinforcement learning for robots using neural networks.
Doctoral dissertation, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA.

Luke et al., 1998

Luke et al.][1998]Luke97 Luke, S., Hohn, C., Farris, J., Jackson, G., & Hendler, J. (1998).
Co-evolving soccer softbot team coordination with genetic programming.
RoboCup-97: Robot Soccer World Cup I (pp. 398-411).
Berlin: Springer Verlag.

Maes & Brooks, 1990

Maes and Brooks][1990]Maes90 Maes, P., & Brooks, R. A. (1990).
Learning to coordinate behaviors.
Proceedings of the Eighth National Conference on Artificial Intelligence (pp. 796-802).
Morgan Kaufmann.

Mahadevan & Connell, 1991

Mahadevan and Connell][1991]Mahadevan91 Mahadevan, S., & Connell, J. (1991).
Scaling reinforcement learning to robotics by exploiting the subsumption architecture.
Proceedings of the Eighth International Workshop on Machine Learning (pp. 328-332).

Noda et al., 1998

Noda et al.][1998]Noda98 Noda, I., Matsubara, H., Hiraki, K., & Frank, I. (1998).
Soccer server: A tool for research on multiagent systems.
Applied Artificial Intelligence, 12, 233-250.

Quinlan, 1993

Quinlan][1993]Quinlan93 Quinlan, J. R. (1993).
C4.5: Programs for machine learning.
San Mateo, CA: Morgan Kaufmann.

Shapire, 1990

Shapire][1990]Schapire90 Shapire, R. E. (1990).
The strength of weak learnability.
Machine Learning, 5, 197-227.

Stone, 2000

Stone][2000]Stone:thesisbook Stone, P. (2000).
Layered learning in multiagent systems: A winning approach to robotic soccer.
Intelligent Robotics and Autonomous Agents. MIT Press.

Stone & Veloso, 1998

Stone and Veloso][1998]AAI97 Stone, P., & Veloso, M. (1998).
A layered approach to learning client behaviors in the RoboCup soccer server.
Applied Artificial Intelligence, 12, 165-188.

Stone & Veloso, 1999a

Stone and Veloso][1999a]AIJ99 Stone, P., & Veloso, M. (1999a).
Task decomposition, dynamic role assignment, and low-bandwidth communication for real-time strategic teamwork.
Artificial Intelligence, 110, 241-273.

Stone & Veloso, 1999b

Stone and Veloso][1999b]AA99-tpot-rl Stone, P., & Veloso, M. (1999b).
Team partitioned, opaque transition reinforcement learning.
Proceedings of the Third Annual Conference on Autonomous Agents (pp. 206-212).
ACM Press.

Stone et al., 1999

Stone et al.][1999]LNAI98-simulator Stone, P., Veloso, M., & Riley, P. (1999).
The CMUnited-98 champion simulator team.
In M. Asada and H. Kitano (Eds.), RoboCup-98: Robot soccer world cup ii. Berlin: Springer Verlag.

Veloso et al., 2000

Veloso et al.][2000]RoboCup99-proceedings Veloso, M., Pagello, E., & Kitano, H. (Eds.). (2000).
RoboCup-99: Robot soccer world cup iii.
Berlin: Springer Verlag. To appear.

Wolpert, 1992

Wolpert][1992]Wolpert92 Wolpert, D. H. (1992).
Stacked generalization.
Neural Networks, 5, 241-259.