Hi:
I think the comments that explain the meaning of the actions in the mine-sarsa-* examples are wrong. For example this is from
svn/trunk/projects/packages/examples/mines-sarsa-python/sample_mines_environment.py :
(lines 177 to 187)
if (theAction == 0):#move down
newCol = self.agentCol - 1;
if (theAction == 1): #move up
newCol = self.agentCol + 1;
if (theAction == 2):#move left
newRow = self.agentRow - 1;
if (theAction == 3):#move right
newRow = self.agentRow + 1;
I think changing the value of the columns corresponds to left/right movement, and changing the value of the rows corresponds to up/down movements (the opposite of what the comments say).
Alejandro.