Store agent state

77 views
Skip to first unread message

Javier Alfonso

unread,
Jul 6, 2016, 1:11:35 PM7/6/16
to BURLAP Discussion
How can I store the agent state among program executions? I want to preserve my agent training among program executions, i can't find a suitable way of doing this
PD: i'm very new to BURLAP

James MacGlashan

unread,
Jul 6, 2016, 2:01:03 PM7/6/16
to BURLAP Discussion
Hi,

Which agent are you using? Part of the changes in BURLAP 3 were based around making serialization much more trivial, but not all of the algorithms have default methods implemented just yet to take advantage of that and would require a bit of more manual serialization (but probably something that wouldn't be too hard to implement).

QLearning and SARSA, however, do currently have default serialization methods for their Q-functions, which is the primary statistic you would want to load between sessions. See the writeQTable and loadQTable methods:

Javier Alfonso

unread,
Jul 6, 2016, 2:43:18 PM7/6/16
to BURLAP Discussion
i'm using Q-Learning. To preserve what my agent has learned i should use the writeQTable and loadQTable methods

James MacGlashan

unread,
Jul 6, 2016, 2:47:25 PM7/6/16
to BURLAP Discussion
Yep!

James

fifi.alf...@gmail.com

unread,
May 2, 2018, 9:16:52 AM5/2/18
to BURLAP Discussion

Dear James,

I am very new to Burlap. I am sorry if my question sound so basic. Can you give me an example on how to use the writeQTable and loadQTable methods? Thank you.
Reply all
Reply to author
Forward
0 new messages