|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: INNER | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object | +--EDU.gatech.cc.is.learning.i_ReinforcementLearner_id | +--EDU.gatech.cc.is.learning.i_SLearner_id
An object that learns to select from several actions based on a reward. Uses the S-learning method as defined by Mataric. "S" is for "single-step."
The module will learn to select a discrete output based on state and a continuous reinforcement input. The "i"s in front of and behind the name imply that this class takes integers as input and output. The "d" indicates a double for the reinforcement input (i.e. a continuous value).
Copyright (c)2000 Tucker Balch
Fields inherited from class EDU.gatech.cc.is.learning.i_ReinforcementLearner_id |
logging,
numactions,
numstates,
policyfilename |
Constructor Summary | |
i_SLearner_id(int numstatesin,
int numactionsin)
Instantiate an S learner using default parameters. |
|
i_SLearner_id(int numstatesin,
int numactionsin,
int criteriain)
Instantiate an S learner. |
Method Summary | |
void |
endTrial(double Vn,
double rn)
Called when the current trial ends. |
double |
getAvgReward()
Report the average reward per step in the trial. |
int |
getPolicyChanges()
Report the number of policy changes in the trial. |
int |
getQueries()
Report the number of queries in the trial. |
int |
initTrial(int s)
Called to initialize for a new trial. |
int |
query(int yn,
double rn)
Select an output based on the state and reward. |
void |
readPolicy()
Read the policy from a file. |
void |
savePolicy()
Write the policy to a file. |
void |
saveProfile(java.lang.String profile_filename)
Write the policy profile to a file. |
Methods inherited from class EDU.gatech.cc.is.learning.i_ReinforcementLearner_id |
log,
loggingOff,
loggingOn,
loggingOn,
setPolicyFileName,
toString |
Methods inherited from class java.lang.Object |
clone,
equals,
finalize,
getClass,
hashCode,
notify,
notifyAll,
wait,
wait,
wait |
Constructor Detail |
public i_SLearner_id(int numstatesin, int numactionsin, int criteriain)
numstates
- int, the number of states the system could be in.numactions
- int, the number of actions or outputs to
select from.criteria
- int, IGNORED, but retained for compatibility.public i_SLearner_id(int numstatesin, int numactionsin)
numstates
- int, the number of states the system could be in.numactions
- int, the number of actions or outputs to
select from.Method Detail |
public int query(int yn, double rn)
statein
- int, the current state.rewardin
- double, reward for the last output, positive
numbers are "good."public void endTrial(double Vn, double rn)
Vn
- double, the value of the absorbing state.reward
- double, the reward for the last output.public int initTrial(int s)
statein
- int, the current state.public double getAvgReward()
public int getQueries()
public int getPolicyChanges()
public void saveProfile(java.lang.String profile_filename) throws java.io.IOException
filename
- String, the name of the file to write to.public void readPolicy()
filename
- String, the name of the file to read from.public void savePolicy()
filename
- String, the name of the file to write to.
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: INNER | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |