Information about GameState and Rewards in MicroRTS

42 views
Skip to first unread message

Shiron Manandhar

unread,
Feb 8, 2021, 6:20:51 PM2/8/21
to microRTS
Hi Everyone, 

My name is Shiron Manandhar and I am currently doing my Masters in Computer Science. I am using microRTS as a platform to perform RL experiments. 

I am using pythonRTS to train my agent, and it uses SocketAI to communicate with the actual game. In order to perform RL trainings, I would need to send rewards associated with action from gameState to agent. I think SocketAI.java sends the information in JSON to pythonRTS from gs.toJSON(), where gs is GameState. The information that is sent to pythonRTS contains playerID, actions and time, but is it possible to send rewards to pythonRTS? 

I would appreciate if I could get some guidance. 

Sincerely, 
Shiron Manandhar

Santiago Ontanon

unread,
Feb 9, 2021, 12:29:46 AM2/9/21
to Shiron Manandhar, microRTS
Hi Shiron, 

Although I am not familiar with pythonRTS, I created the SocketAI class. It was never intended for actual use, and it was just intended to be an example of how you can create your own socket-based AI to communicate with your AI coded in a language different than Java. So, the easiest is if you create your own version of the SocketAI class and add to the json/xml message whichever information you want to add.

Another option is to use a microRTS framework for Python that is already designed for RL, for example check out: https://github.com/vwxyzjn/gym-microrts

I hope this helps!

santi

--
You received this message because you are subscribed to the Google Groups "microRTS" group.
To unsubscribe from this group and stop receiving emails from it, send an email to microrts+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/microrts/76e4ea97-5457-47bb-a3c2-e1e5c8bc2704n%40googlegroups.com.

Reply all
Reply to author
Forward
0 new messages