Installing the RL-competition software

[Gijs]

Hello!

I'm trying to install the RL competition software but i get the
following error when i type make:


cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/
RL_glue.c -o
system/build/RL_glue.o
/tmp/cckK8brW.s: Assembler messages:
/tmp/cckK8brW.s:8: Error: `total_reward(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:17: Error: `num_steps(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:26: Error: `num_episodes(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:35: Error: bad register name `%rbx'
/tmp/cckK8brW.s:38: Error: bad register name `%rdi'
/tmp/cckK8brW.s:40: Error: bad register name `%rbx'
/tmp/cckK8brW.s:41: Error: bad register name `%rbx'
/tmp/cckK8brW.s:66: Error: bad register name `%rbx'
/tmp/cckK8brW.s:69: Error: bad register name `%rdi'
/tmp/cckK8brW.s:71: Error: bad register name `%rbx'
/tmp/cckK8brW.s:72: Error: bad register name `%rbx'
/tmp/cckK8brW.s:106: Error: bad register name `%rsp'
/tmp/cckK8brW.s:111: Error: bad register name `%rsp'
/tmp/cckK8brW.s:120: Error: bad register name `%rbx'
/tmp/cckK8brW.s:122: Error: bad register name `%rdi'
/tmp/cckK8brW.s:123: Error: bad register name `%rsp'
/tmp/cckK8brW.s:125: Error: `last_action(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:126: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:127: Error: bad register name `%rax'
/tmp/cckK8brW.s:128: Error: `last_action+8(%rip)' is not a valid
base/index expression
/tmp/cckK8brW.s:129: Error: bad register name `%rax'
/tmp/cckK8brW.s:130: Error: `last_action+16(%rip)' is not a valid
base/index expression
/tmp/cckK8brW.s:131: Error: bad register name `%rax'
/tmp/cckK8brW.s:133: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:134: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:135: Error: `total_reward(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:136: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:137: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:138: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:139: Error: `last_reward(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:140: Error: `last_state+4(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:141: Error: `roa+12(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:143: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:144: Error: `roa(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:145: Error: bad register name `%rsi'
/tmp/cckK8brW.s:146: Error: bad register name `%rcx'
/tmp/cckK8brW.s:147: Error: `last_state(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:148: Error: `roa+56(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:149: Error: `is_terminal(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:151: Error: bad register name `%rsi'
/tmp/cckK8brW.s:152: Error: bad register name `%rcx'
/tmp/cckK8brW.s:153: Error: `total_reward(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:154: Error: `roa+8(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:156: Error: `last_state(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:157: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:158: Error: bad register name `%rcx'
/tmp/cckK8brW.s:160: Error: bad register name `%rsi'
/tmp/cckK8brW.s:161: Error: bad register name `%rax'
/tmp/cckK8brW.s:163: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:164: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:165: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:166: Error: `num_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:167: Error: bad register name `%rcx'
/tmp/cckK8brW.s:168: Error: bad register name `%rdx'
/tmp/cckK8brW.s:169: Error: bad register name `%rax'
/tmp/cckK8brW.s:170: Error: bad register name `%rcx'
/tmp/cckK8brW.s:171: Error: bad register name `%rdx'
/tmp/cckK8brW.s:172: Error: bad register name `%rax'
/tmp/cckK8brW.s:174: Error: `roa(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:175: Error: bad register name `%rax'
/tmp/cckK8brW.s:176: Error: `roa+8(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:177: Error: bad register name `%rax'
/tmp/cckK8brW.s:178: Error: `roa+16(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:179: Error: bad register name `%rax'
/tmp/cckK8brW.s:180: Error: `roa+24(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:181: Error: bad register name `%rax'
/tmp/cckK8brW.s:182: Error: `roa+32(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:183: Error: bad register name `%rax'
/tmp/cckK8brW.s:184: Error: `roa+40(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:185: Error: bad register name `%rax'
/tmp/cckK8brW.s:186: Error: `roa+48(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:187: Error: bad register name `%rax'
/tmp/cckK8brW.s:188: Error: `roa+56(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:189: Error: bad register name `%rax'
/tmp/cckK8brW.s:190: Error: bad register name `%rbx'
/tmp/cckK8brW.s:191: Error: bad register name `%rsp'
/tmp/cckK8brW.s:192: Error: bad register name `%rbx'
/tmp/cckK8brW.s:196: Error: `num_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:197: Error: `num_episodes(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:198: Error: `total_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:209: Error: bad register name `%rbx'
/tmp/cckK8brW.s:211: Error: bad register name `%rdi'
/tmp/cckK8brW.s:213: Error: bad register name `%rsp'
/tmp/cckK8brW.s:215: Error: `num_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:216: Error: `is_terminal(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:217: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:218: Error: `total_reward(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:220: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:221: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:222: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:223: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:224: Error: bad register name `%rcx'
/tmp/cckK8brW.s:225: Error: bad register name `%rdx'
/tmp/cckK8brW.s:226: Error: bad register name `%rax'
/tmp/cckK8brW.s:227: Error: bad register name `%rcx'
/tmp/cckK8brW.s:228: Error: bad register name `%rdx'
/tmp/cckK8brW.s:229: Error: bad register name `%rax'
/tmp/cckK8brW.s:231: Error: `last_state+8(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:232: Error: `last_state(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:233: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:234: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:235: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:236: Error: bad register name `%rax'
/tmp/cckK8brW.s:237: Error: `last_state+16(%rip)' is not a valid
base/index expression
/tmp/cckK8brW.s:238: Error: bad register name `%rdi'
/tmp/cckK8brW.s:239: Error: bad register name `%rsi'
/tmp/cckK8brW.s:240: Error: bad register name `%rcx'
/tmp/cckK8brW.s:241: Error: bad register name `%rdi'
/tmp/cckK8brW.s:242: Error: bad register name `%rax'
/tmp/cckK8brW.s:243: Error: bad register name `%rsi'
/tmp/cckK8brW.s:244: Error: bad register name `%rcx'
/tmp/cckK8brW.s:245: Error: bad register name `%rdx'
/tmp/cckK8brW.s:246: Error: bad register name `%rdx'
/tmp/cckK8brW.s:247: Error: `oa+8(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:248: Error: bad register name `%rax'
/tmp/cckK8brW.s:249: Error: `oa+16(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:250: Error: bad register name `%rax'
/tmp/cckK8brW.s:251: Error: `oa+24(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:252: Error: bad register name `%rax'
/tmp/cckK8brW.s:253: Error: `oa+32(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:254: Error: bad register name `%rax'
/tmp/cckK8brW.s:255: Error: `oa+40(%rip)' is not a valid base/index
expression
/tmp/cckK8brW.s:256: Error: bad register name `%rax'
/tmp/cckK8brW.s:257: Error: bad register name `%rbx'
/tmp/cckK8brW.s:258: Error: bad register name `%rsp'
/tmp/cckK8brW.s:259: Error: bad register name `%rbx'
/tmp/cckK8brW.s:268: Error: bad register name `%rbp'
/tmp/cckK8brW.s:270: Error: bad register name `%rbx'
/tmp/cckK8brW.s:273: Error: bad register name `%r12'
/tmp/cckK8brW.s:275: Error: bad register name `%r13'
/tmp/cckK8brW.s:277: Error: bad register name `%rsp'
/tmp/cckK8brW.s:279: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:282: Error: `is_terminal(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:286: Error: bad register name `%r12b'
/tmp/cckK8brW.s:287: Error: bad register name `%r12b'
/tmp/cckK8brW.s:294: Error: bad register name `%rsp'
/tmp/cckK8brW.s:296: Error: `is_terminal(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:302: Error: bad register name `%r12b'
/tmp/cckK8brW.s:305: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:306: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:307: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:308: Error: bad register name `%rsp)'
/tmp/cckK8brW.s:309: Error: bad register name `%rsp'
/tmp/cckK8brW.s:323: Error: bad register name `%rsp'
/tmp/cckK8brW.s:327: Error: bad register name `%rax'
/tmp/cckK8brW.s:330: Error: `num_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:331: Error: `is_terminal(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:332: Error: bad register name `%rax'
/tmp/cckK8brW.s:333: Error: bad register name `%rax'
/tmp/cckK8brW.s:334: Error: `total_steps(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:335: Error: `num_episodes(%rip)' is not a valid base/
index
expression
/tmp/cckK8brW.s:336: Error: bad register name `%rsp'
make: *** [system/build/RL_glue.o] Error 1


I have checked my versions of java and c but these seem ok. The OS is
Linux, and i´m not a linux expert..

Any help would be appreciated.

[Brian Tanner]

Hi Gijs. Thanks for posting your question.

I have not seen this error before. Can you please tell me where you
got the software distribution from:
1) The competition website download section
2) The google code site download section
3) Checkout from subversion
- if so, what revision? (try doing `svn info` in the competition
directory

Also, if you look at the top of the README.txt file, it might have a
release name in the title at the top of the file.

Is this your computer, or a university machine? Do you know what
flavor of linux it is?
Can you please report:
make --version
cc --version

Thanks very much!

I'll also take this chance to tell you that the competition software
is based on RL-Glue, and RL-Glue is currently undergoing a major
shakeup - partially to address issues like this. We're currently
updating the project and all of the cross-language codecs. The new
version will hopefully be used in next-year's competition (that will
be up to the technical chair, and I am not doing that job next year).

So, you might want to look at that software and the related projects
there if you want to get familiar with things for next year:
http://rl-glue.googlecode.com
http://glue.rl-community.org
http://rl-glue-ext.googlecode.com



--
Brian Tanner
Ph.D Student, University of Alberta
br...@tannerpages.com

[Gijs Pannebakker]

Hi Brian, thanks for the response.

The software was downloaded from the competition website download
section. The top of the README.txt file says "RL-Competition 2008
Testing Distribution" without any version number. I'm trying to
install it on a computer from the university (of Amsterdam), these
have Fedora. I tried different computers, but all gave the same error.
I let someone else try it on his own account and for him it worked, so
i think it must be something with my account. That person had the same
versions of java and gcc, but i didn't check for his make and cc
versions.

my make version:
GNU Make 3.81 Copyright (C) 2006 Free Software Foundation, Inc.

cc version:
cc (GCC) 4.1.2 20070925 (Red Hat 4.1.2-33)
Copyright (C) 2006 Free Software Foundation, Inc.

Thanks,

Gijs

On Sep 25, 4:53 pm, Brian Tanner <br...@tannerpages.com> wrote:
> Hi Gijs. Thanks for posting your question.
>
> I have not seen this error before. Can you please tell me where you
> got the software distribution from:
> 1) The competition website download section
> 2) The google code site download section
> 3) Checkout from subversion
> - if so, what revision? (try doing `svn info` in the competition
> directory
>
> Also, if you look at the top of the README.txt file, it might have a
> release name in the title at the top of the file.
>
> Is this your computer, or a university machine? Do you know what
> flavor of linux it is?
> Can you please report:
> make --version
> cc --version
>
> Thanks very much!
>
> I'll also take this chance to tell you that the competition software
> is based on RL-Glue, and RL-Glue is currently undergoing a major
> shakeup - partially to address issues like this. We're currently
> updating the project and all of the cross-language codecs. The new
> version will hopefully be used in next-year's competition (that will
> be up to the technical chair, and I am not doing that job next year).
>
> So, you might want to look at that software and the related projects

> there if you want to get familiar with things for next year:http://rl-glue.googlecode.comhttp://glue.rl-community.orghttp://rl-glue-ext.googlecode.com

> ...
>
> read more »

[Brian Tanner]

This is quite odd. We never had any problems like this (reported at
least) all year.

It sounds like it is a problem with your account... I'd check things
like your path and environment variables compared to your friend's...
probably you are missing something or have something extra which is
confusing the compiler.

Please let me know if you are able to resolve it.

--
Brian Tanner
Ph.D Student, University of Alberta
br...@tannerpages.com

[Gijs Pannebakker]

Thanks Brian, by comparing versions and checking the paths we found
out that my account used some old version of assembler. I fixed it and
installed the rest of the package (including the RTS part) without any
errors. When i run the RTS part, i am able to run the experiment step
by step (clicking on the step button), however, when i click start,
the application freezes. Do you have any idea what could cause this?

Thanks,

Gijs

> ...
>
> read more »- Hide quoted text -
>
> - Show quoted text -

[Brian Tanner]

No, I don't know what the problem might be, exactly.

I'm assuming you where using the GUI trainer to step through the
experiment. I've never had problems with that for RTS.

How did you start things? Did you start the agent, environment, and
gui trainer all separately. If so, was there any interesting output
on the console?

Which agent were you using?

--
Brian Tanner
Ph.D Student, University of Alberta
br...@tannerpages.com

[Gijs Pannebakker]

I will try to describe it more precise. The java-console application
seems to run ok. The c++ RLVizApp application however freezes.

I first start up the application by doing bash run.bash in
guiTrainerRealTimeStrategy. The output is:

Starting up Real Time Strategy - PID=26456
Connecting to host=127.0.0.1 on port=4096...Starting up RL-glue -
PID=26462
-- Starting up Gui Trainer
Connected
environment connected.

Then in shell number 2 i'm in .../domains/realTimeStrategy/bins and i
do ./rlgagent
The shell says:

Connecting to host=127.0.0.1 on port=4096...Connected

The first shell says "agent connected."

Then i go to the RLVizApp and click "load experiment", the first shell
says "experiment connected". Now, if i keep clicking on "Step" i will
see the RTS go on step by step (building a building, workers, etc),
however if i press "Start" then RLVizApp freezes. It disables Start
and enables Stop, but whereever i click it doesnt respond. The shells
don't give a message. If i also connect the environment myself seems
to make no difference. If i press "unload experiment" it freezes too
in the same way.

If there is anything i forgot please let me know, or anything i can
double check..

Gijs

> ...
>
> read more »

[Brian Tanner]

You are not forgetting anything. Seems odd though.

I'm going to install RTS on my laptop and see what happens for me.

Ok, I downloaded the code and installed it. Everything works fine
when I follow your instructions. I can start/top, speed up, slow
down, stop, unload, load again, etc.

Maybe you could make clean the RTS stuff and build it again. Were
there any warnings? How about warnings when you compiled the main
competition code in the competition root directory.

Try the console RTS trainer also in:
trainers/consoleTrainerRealTimeStrategyJava

When I run that one, and use rlgagent, I get the output at the end of
this e-mail.

Oh, something else would be to (instead of the rlgagent), try the java
agent in agents/realTimeStrategyAgentJava

That also works for me with the gui and console trainers.

So, there are a few different combinations to try. Depending on which
of those (if any) work, we will know who to blame and might know how
to fix it.

Thanks for your patience Gijs!


Console Java Trainer Output with RLGAgent
-----------------------------------------------------------------
bt-macBook:consoleTrainerRealTimeStrategyJava btanner$ ./run.bash
Starting up Real Time Strategy - PID=64136

Connecting to host=127.0.0.1 on port=4096...Starting up RL-glue -

PID=64142
experiment connected.
agent connected.
Connected
environment connected.
Running: 100 episodes (each one is a .)
....................................................................................................
-----------------------------------------------

Number of episodes: 100
Average number of steps per episode: 429.05
Average return per episode: 36.0
-----------------------------------------------

Running: 100 episodes (each one is a .)
....................................................................................................
-----------------------------------------------

Number of episodes: 100
Average number of steps per episode: 648.7605
Average return per episode: 12.36
-----------------------------------------------

-- Waiting for Real Time Strategy to die...
++ Real Time Strategy terminated
-- Waiting for RL_glue to die...
++ RL_glue terminated

--
Brian Tanner
Ph.D Student, University of Alberta
br...@tannerpages.com

[Gijs Pannebakker]

Hi Brian,

When i do "bash runDemo.bash" in the main directory of the rl-
competition software I apparently get the same problem, namely the
application freezes when running the experiment by pressing Start or
Unload. I'm sorry i didn't say this earlier, i guess i overlooked it
because i've tried to install the software on three different systems
now, which all gave me problems but different ones :) Still this one
seems to be the closest to being compiled successfully.

When i do make in the main directory of the rl-competition software i
get the following output (i don't think it contains any warnings or
errors):

gpanneba@pc-ow-38 rl-competition $ make

cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/
RL_glue.c -o system/build/RL_glue.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/

Utilities/C_TaskSpec_Parser.c -o system/build/C_TaskSpec_Parser.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_server_agent.c -o system/build/RL_server_agent.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_network_agent.c -o system/build/RL_network_agent.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_server_environment.c -o system/build/RL_server_environment.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_network_environment.c -o system/build/RL_network_environment.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_server_experiment.c -o system/build/RL_server_experiment.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_network_experiment.c -o system/build/RL_network_experiment.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
RL_network.c -o system/build/RL_network.o
cc -c -I./system/RL-Glue/RL-Glue -O2 ./system/RL-Glue/RL-Glue/Network/
Glue/RL_network_glue.c -o system/build/RL_network_glue.o
cc -o ./system/RL_glue system/build/RL_glue.o system/build/
C_TaskSpec_Parser.o system/build/RL_server_agent.o system/build/
RL_network_agent.o system/build/RL_server_environment.o system/build/
RL_network_environment.o system/build/RL_server_experiment.o system/
build/RL_network_experiment.o system/build/RL_network.o system/build/
RL_network_glue.o -lm
cd ./agents/randomAgentJava/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/randomAgentJava'
javac -source 5 -d bin -cp ../../system/libraries/RLVizLib.jar src/
RandomAgent/RandomAgent.java
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/randomAgentJava'
cd ./agents/randomAgentCPP/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/randomAgentCPP'
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g src/RandomAgent.cpp -o bin/RandomAgent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/../Utils/Glue_utilities.c -o bin/
Glue_utilities.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/Network/Agent/RL_client_agent.c -o
bin/RL_client_agent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/Network/RL_network.c -o bin/
RL_network.o
g++ -o ./bin/RL_agent bin/RandomAgent.o bin/Glue_utilities.o bin/
RL_client_agent.o bin/RL_network.o -lm
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/randomAgentCPP'
cd ./agents/mountainCarAgentCPP/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/mountainCarAgentCPP'
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src src/MountainCarAgent.cpp -o bin/MountainCarAgent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/../Utils/Glue_utilities.c -o bin/
Glue_utilities.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src src/tiles.cpp -o bin/tiles.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src src/RLStruct_util.cpp -o bin/RLStruct_util.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/Network/Agent/RL_client_agent.c -o
bin/RL_client_agent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/Network/RL_network.c -o bin/
RL_network.o
g++ -o ./bin/RL_agent bin/MountainCarAgent.o bin/Glue_utilities.o bin/
tiles.o bin/RLStruct_util.o bin/RL_client_agent.o bin/RL_network.o -lm
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/mountainCarAgentCPP'
cd ./agents/realTimeStrategyAgentJava/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/realTimeStrategyAgentJava'
javac src/**/*.java -d bin -cp ../../system/libraries/RLVizLib.jar
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/realTimeStrategyAgentJava'
cd ./agents/helicopterAgentCPP/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/helicopterAgentCPP'
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src src/weak_baseline_controller.cpp -o bin/weak_baseline_controller.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/../Utils/Glue_utilities.c -o bin/
Glue_utilities.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/Network/Agent/RL_client_agent.c -o
bin/RL_client_agent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src ../../system/RL-Glue/RL-Glue/Network/RL_network.c -o bin/
RL_network.o
g++ -o ./bin/RL_agent bin/weak_baseline_controller.o bin/
Glue_utilities.o bin/RL_client_agent.o bin/RL_network.o -lm
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/helicopterAgentCPP'
cd ./agents/zeroAgentCPP/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
agents/zeroAgentCPP'
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g src/ZeroAgent.cpp -o bin/ZeroAgent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/../Utils/Glue_utilities.c -o bin/
Glue_utilities.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/Network/Agent/RL_client_agent.c -o
bin/RL_client_agent.o
g++ -c -I../../system/RL-Glue/RL-Glue -I../../system/RL-Glue/Utils -I./
src -g ../../system/RL-Glue/RL-Glue/Network/RL_network.c -o bin/
RL_network.o
g++ -o ./bin/RL_agent bin/ZeroAgent.o bin/Glue_utilities.o bin/
RL_client_agent.o bin/RL_network.o -lm
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
agents/zeroAgentCPP'
cd ./trainers/consoleTrainerJava/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerJava'
javac -source 5 -d bin -cp ../../system/libraries/RLVizLib.jar src/
*.java
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerJava'
cd ./trainers/consoleTrainerPython/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerPython'
echo -e "#! /bin/bash\n PYTHONPATH=../../system/RL-Glue/RL-Glue/
Python:../../system/includes:./src python ./src/consoleTrainer.py " |
cat > RL_experiment
chmod u+x RL_experiment
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerPython'
cd ./trainers/consoleTrainerCPP/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerCPP'
g++ -c -ansi -pedantic -Wall -I../../system/RL-Glue/RL-Glue -I../../
system/includes src/consoleTrainer.cpp -o bin/consoleTrainer.o
g++ -c -ansi -pedantic -Wall -I../../system/RL-Glue/RL-Glue -I../../
system/includes ../../system/includes/ParameterHolder.cpp -o bin/
ParameterHolder.o
g++ -c -ansi -pedantic -Wall -I../../system/RL-Glue/RL-Glue -I../../
system/includes ../../system/RL-Glue/RL-Glue/Network/Experiment/
RL_client_experiment.c -o bin/RL_client_experiment.o
g++ -c -ansi -pedantic -Wall -I../../system/RL-Glue/RL-Glue -I../../
system/includes ../../system/RL-Glue/RL-Glue/Network/RL_network.c -o
bin/RL_network.o
g++ -c -ansi -pedantic -Wall -I../../system/RL-Glue/RL-Glue -I../../
system/includes src/consoleTrainerHelper.cpp -o bin/
consoleTrainerHelper.o
g++ bin/consoleTrainer.o bin/consoleTrainerHelper.o bin/
ParameterHolder.o bin/RL_client_experiment.o bin/RL_network.o -o bin/
consoleTrainer
rm -fr bin/*.o
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerCPP'
cd ./trainers/consoleTrainerRealTimeStrategyJava/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerRealTimeStrategyJava'
javac src/*.java -d bin -cp ../../system/libraries/RLVizLib.jar
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleTrainerRealTimeStrategyJava'
cd ./trainers/consoleMultiTrainers/ && make
make[1]: Entering directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleMultiTrainers'
javac -source 5 -d bin -cp ../../system/libraries/RLVizLib.jar src/
*.java
make[1]: Leaving directory `/home/gpanneba/RTS/new/rl-competition/
trainers/consoleMultiTrainers'


The console java trainer seems to work fine. This is its output:

gpanneba@pc-ow-38 consoleTrainerRealTimeStrategyJava $ bash run.bash
Starting up Real Time Strategy - PID=31634
Starting up RL-glue - PID=31640

Connecting to host=127.0.0.1 on port=4096...Connected

environment connected.
experiment connected.
agent connected.

Running: 100 episodes (each one is a .)
....................................................................................................
-----------------------------------------------

Number of episodes: 100

Average number of steps per episode: 756.75
Average return per episode: 9.0

-----------------------------------------------

Running: 100 episodes (each one is a .)
....................................................................................................
-----------------------------------------------

Number of episodes: 100

Average number of steps per episode: 845.4275
Average return per episode: 8.08

-----------------------------------------------

-- Waiting for Real Time Strategy to die...
++ Real Time Strategy terminated
-- Waiting for RL_glue to die...
++ RL_glue terminated

So its got to be something with the RLVizApp.

I must say that your patience is quite remarkable as well ;)

Thanks,

Gijs

> ...
>
> read more »

[Brian Tanner]

On 6-Oct-08, at 6:46 AM, Gijs Pannebakker wrote:

> So its got to be something with the RLVizApp.
>
> I must say that your patience is quite remarkable as well ;)

When you spend thousands of hours on building some software, it seems
dumb not to invest a few more to make sure people can use it :)

I think you're right that RLVizApp is to blame. This has me a bit
worried. Did I ask you already what version of Java you have?

Try:

>$ java -version

I'm still working on RLVizApp and RLVizLib that it's built on, so I
need to see if I can reproduce the problem and get to the bottom of
it. Those project have evolved beyond what was distributed with the
competition code, because they are now compatible with RL-Glue 3.0....
but they haven't changed in any way that I can imagine that they would
have fixed your problem.

Maybe we can get Marc Lanctot to bring his RTS game up to be
compatible with RL-Glue 3.0 and then life will be easier.

[Gijs Pannebakker]

My java version is 1.7.0.

I've installed linux on my pc at home now and the whole thing works
there, so i'm pretty much out of trouble for the moment. However if
there is still something i can do to help out fixing the problem let
me know! Thank you for the help :-)

Gijs