15-887*: Planning, Execution, and Learning
Homework Assignments
Fall 2012

Policy on Collaboration

It is OK, and you are encouraged, to discuss the homework problems with others. The readings and the class notes should provide the best resource for solving the homework problems. You must write up your own homework solutions. If you find that it is needed, you may write the names of anyone you discussed the problems with on your submission. Reading papers not on the reading list and searching the web for related topics may sometimes help you gain a better understanding of the ideas involved. If some reference helps you directly with a problem, please explain this in your solutions.

Late Policy: You will be allowed up to 7 late days, in total, to hand in the homeworks/project without penalty. You can apportion those days how you like, except that no single homework/project can be more than 3 days late. After using up your allotment, penalties will be assessed at 10% per extra day. Homeworks/projects are considered on time if handed in (or emailed) by the end of class on the due date. Any time after that counts as a full day. So, for instance, if the homework is due on Wednesday, handing it in by 2:50pm is considered on time, handing it in any time up until 2:50pm on Thursday is considered one day late, after that it is at least two days late, etc.

Homeworks

• Homework 1
  Out: Wednesday, September 19
  Due: Wednesday, October 3, in class
  
  • Solution
    
  • Planner implementation in Java
    
  
  
• Homework 2
  Out: Wednesday, October 10
  Due: Wednesday, October 24, in class
  
  • HSP
    
  • Solution
    
  
  
• Homework 3
  Out: Monday, October 29
  Due: Monday, November 12, in class
  
  • Note: Updated on November 07 to include the missing figure of the 3x3 grid referred to in Problem 3.
  • Download the appropriate version of the simulator. See the README in the mdp-rl directory for simple instructions.
    • 64-bit Linux Simulator
      
    • 32-bit Linux Simulator
      
  • Solution
    
  
  
• Project
  Proposals due: Monday, November 5
  
  • 1 page briefly describing: (i) the problem, (ii) why is it a planning problem, (iii) your approach, and (iv) evaluation.
  Proposal feedback: Monday, November 12
  Due: Monday, December 3, in class
  
  • The report should be 4-6 pages and include descriptions of (1) the problem, (2) your approach, and (3) your results. Please highlight the planning aspects and other course concepts in all of the sections. You may want to include some references to related work in the background for your problem description or in the evaluation of your results, but you do not need to include a separate related work survey.
  • Please submit a printed report in class on Monday (or Wednesday), or as a PDF by email to all three of us, i.e., {reids|mmv|ppr}@cs.cmu.edu.