Temporal Difference Learning Model

Dave Touretzky
Computational Models of Neural Systems

  1. You can find the source for his demo at /afs/cs/academic/class/15883-s01/matlab/td or on the web at: http://www.cs.cmu.edu/afs/cs/academic/class/15883-s01/matlab/td/

  2. Type run to run the demo.

  3. Set pause_every_step = 1 if you want to single-step through each trial.

  4. In the file td.m, remove the % sign in the line % stimpat(4,2) = 1; to add a second stimulus.

  5. you could instead try adding an earlier reward, by setting reward(5) = 1.

Dave Touretzky
Last modified: Mon Mar 19 14:58:24 EST 2001