RLPark FSGAgentState

[Sam]

Hi Thomas,

The FSGAgentState in RLPark explicitly computes the solution in "computeSolution" method. ​

There are a couple of line in the implementation that I have a hard time to understand. If you wouldn't mind, would you be able to point me to a reference  or a book chapter that I can use to further understand the implementation details. I really appreciate it. 

Thank you!

Sam

[Thomas Degris-Dard]

Hello Sam,

this code was implemented with Hamid Reza Maei. The derivation might be in his PhD thesis (perhaps in chapter 5?):

http://webdocs.cs.ualberta.ca/~sutton/papers/maei-thesis-2011.pdf

If I remember correctly, the idea was to take the point where the gradient is equal to 0 and solve the equation for V.

I hope this help,

Thomas

--

---
You received this message because you are subscribed to the Google Groups "RLPark" group.
To unsubscribe from this group and stop receiving emails from it, send an email to githubrlpark...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.