Re: strange error in rl_glue
Brian Tanner
where you got the agent from? Did those come with the rl-competition
distribution (if so, what year/website), what language is the agent in
(looks like Python?).
Also, please send these questions to the rl-glue mailing list
(rl-...@googlegroups.com) or the rl-library list
(rl-li...@googlegroups.com) depending on if the question seems to be
mostly about the core rl-glue functionality or on how certain pre-made
agents or environments available through the library work together.
Thanks!
On Wed, Nov 30, 2011 at 9:18 AM, alekhya mandali
<alekhya...@gmail.com> wrote:
> Hi Tanner
>
> I am trying for code random agent for polyathlon problem , where i am
> encountering this problem . Would be grateful if you could help ..
>
> ??? Error using ==> subsindex
> Function 'subsindex' is not defined for values of class
> 'org.rlcommunity.rlglue.codec.types.Observation'.
>
> Error in ==> randomagent>randomagent_start at 71
> polyathlon_vars.Qvaluefunction(1:6,1)=polyathlon_vars.valuefunction(1:6,lastObservation);
>
> Error in ==> runAgentLoop at 79
> action = theAgent.agent_start(observation);
>
> Error in ==> runAgent at 27
> shouldStop=runAgentLoop();
>
> On Tue, Nov 29, 2011 at 10:23 PM, Brian Tanner <br...@tannerpages.com>
> wrote:
>>
>> Hi there! Good place to start is the RL-Glue website:
>> http://glue.rl-community.org
>>
>> There are many different software components so the site is quite large.
>> Great place to start is the RL-Glue Core page:
>> http://glue.rl-community.org/wiki/RL-Glue_Core
>>
>> It links to overview docs:
>>
>> HTML http://rl-glue.googlecode.com/svn/trunk/docs/html/index.html
>> PDF http://rl-glue.googlecode.com/svn/trunk/docs/Glue-Overview.pdf
>>
>> From there you can branch out to the technical documentation for whatever
>> component/language you need to look at.
>>
>> There are some examples in the code downloads that should be ready to run
>> and fairly well documented.
>>
>> Good luck, please ask if you have any more questions!
>>
>> --
>> Brian Tanner
>> br...@fireplan.ca
>> 204-663-9272 Extension 2
>>
>> Fire Plan Strategies: We provide fire safety training, planning, signs,
>> and supplies across Canada!
>>
>> Our business grows by referrals. If you have any associates who may be
>> interested in our services, we would appreciate your referral.
>>
>> WHEN THE FIRE TRUCKS ROLL, IT'S TOO LATE TO PLAN!
>>
>> On 2011-11-29, at 10:48 AM, alekhya wrote:
>>
>> Hi
>>
>> I am a new to RL glue , can you please tell me if there is tutorial
>> knd of thing where syntax and all are specified , it wpuld be great if
>> you could suggest me one.
>>
>> On Mar 25, 6:16 am, Brian Tanner <br...@fireplan.ca> wrote:
>>
>> I don't want to overgeneralize, but typically this sort of problem happens
>> when you try to call something out of sequence... like if you call RL_step
>> after an episode has terminated, that sort of stuff. It should actually be
>> robust to that, but that's my best guess. Otherwise it happens when there is
>> a bug in the agent or environment and they mess up the action or observation
>> structures. Or it could be a legit bug: stranger things have happened.
>>
>>
>> Can you tell me a few things:
>>
>> - Is everything in Python?
>>
>> - What agent, environment, and experiment are you running? Did you design
>> them all yourself or are some from the RL-Library or something?
>>
>> - How easily can you reproduce this error? Does it happen during an
>> episode or at the end of an episode? Does it take a long time or does it
>> happen fast? Is it random when it happens or very deterministic?
>>
>>
>> These are the questions we'll have to think about to track down a
>> solution.
>>
>>
>> --
>>
>> Brian Tanner
>>
>> br...@fireplan.ca
>>
>> Cell: 204.228.1683
>>
>>
>> Fire Plan Strategies: We provide fire safety training, planning, signs,
>> and supplies across Canada!
>>
>>
>> Our business grows by referrals. If you have any associates who may be
>> interested in our services, we would appreciate your referral.
>>
>>
>> WHEN THE FIRE TRUCKS ROLL, IT'S TOO LATE TO PLAN!
>>
>>
>> On 2011-03-24, at 7:36 PM, Anand wrote:
>>
>>
>>
>>
>>
>>
>>
>>
>> A bit more information (should have given it before) -- I'm running
>>
>> the python codec. This is the error I get in my experiment
>>
>> "RL-Glue Python Experiment Codec Version: 2.02 (Build 738)
>>
>> Connecting to 127.0.0.1 on port 4096...
>>
>> Set epsilon as 0.01
>>
>> Traceback (most recent call last):
>>
>> File "MC_onpolicy_agent.py", line 384, in <module>
>>
>> AgentLoader.loadAgent(MC_agent())
>>
>> File
>> "/usr/local/lib/python2.6/dist-packages/rlglue/agent/AgentLoader.py",
>>
>> line 58, in loadAgent
>>
>> client.runAgentEventLoop()
>>
>> File
>> "/usr/local/lib/python2.6/dist-packages/rlglue/agent/ClientAgent.py",
>>
>> line 144, in runAgentEventLoop
>>
>> switch[agentState](self)
>>
>> File
>> "/usr/local/lib/python2.6/dist-packages/rlglue/agent/ClientAgent.py",
>>
>> line 139, in <lambda>
>>
>> Network.kAgentStep: lambda self: self.onAgentStep(),
>>
>> File
>> "/usr/local/lib/python2.6/dist-packages/rlglue/agent/ClientAgent.py",
>>
>> line 67, in onAgentStep
>>
>> self.network.putAction(action)
>>
>> File "/usr/local/lib/python2.6/dist-packages/rlglue/network/Network.py",
>>
>> line 216, in putAction
>>
>> self.putAbstractType(action)
>>
>> File "/usr/local/lib/python2.6/dist-packages/rlglue/network/Network.py",
>>
>> line 223, in putAbstractType
>>
>> self.sendBuffer.write(struct.pack("!%di" %
>>
>> (len(theItem.intArray)),*(theItem.intArray)))
>>
>> struct.error: required argument is not an integer"
>>
>>
>> I get the error
>>
>> "ERROR -- more than a million of ints, doubles, or chars in the buffer
>>
>> (-1074790400 0 1), probably corrupt datastream, exiting"
>>
>> from rl_glue
>>
>>
>> Thanks,
>>
>> Anand
>>
>>
>> On 24 March 2011 19:31, Anand <anand.eter...@gmail.com> wrote:
>>
>> When I try to run an experiment with rl_glue running in the background
>>
>> I get an error saying
>>
>> "ERROR -- more than a million of ints, doubles, or chars in the buffer
>>
>> (-1074790400 0 1), probably corrupt datastream, exiting"
>>
>>
>> I've tried changing the port and running it on a different computer.
>>
>>
>> For some strange reason this happens only for specific values of a
>>
>> parameter (epsilon)
>>
>> When epsilon is 0.1 things run perfectly fine. But when I set it to
>>
>> 0.01 I get this error.
>>
>>
>> Any help will be greatly appreciated.
>>
>>
>> Thanks,
>>
>> Anand
>>
>>
>> --
>>
>> You received this message because you are subscribed to the Google Groups
>> "RL-Glue" group.
>>
>> To post to this group, send email to rl-...@googlegroups.com.
>>
>> To unsubscribe from this group, send email to
>> rl-glue+u...@googlegroups.com.
>>
>> For more options, visit this group
>> athttp://groups.google.com/group/rl-glue?hl=en.
>>
>>
>
>
>
> --
> Thanks & Regards..
>
> Alekhya Mandali
>
>
--
Brian Tanner
Ph.D Student
University of Alberta
br...@tannerpages.com