missing RL-Library environments

[W Bradley Knox]

Hi, Brian.

I've noticed that the RL-Library wiki still doesn't have Octupus Arm
listed. Has that been made available from the RL-Competition version?
How about Adversarial Tetris or Cat and Mouse from the 2006
RL-Competition?

And thanks for continuing to support all of this. It's incredibly helpful.

- Brad

[Brian Tanner]

Hi Brad.

I feel like this has come up before, but I can't remember who I was talking to.

There are a wealth of environments from the 2008 and 2009 competitions that are just sitting around not being used in the rl-competition.googlecode.com project. It would take a relatively minor effort to clean some of them up a little bit (ie: make sure they compile outside of the competition project) and get them "into" the RL-Library.

Nobody has stepped up to make an effort of it (which is understandable of course, we're all busy). I would love to have them in the library but I'm right now trying hard to get my thesis together.

If you have an interest in helping with a couple of these environments, I would help. I just don't want to be the lead. Octopus, Tetris, Helicopter, Mario, Acrobot could all go in from 2009. Some of the 2008 domains like RTS or KeepAway would be more work and probably are not interesting to you, but they could go also.

> --
> You received this message because you are subscribed to the Google Groups "rl-library" group.
> To post to this group, send email to rl-li...@googlegroups.com.
> To unsubscribe from this group, send email to rl-library+...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/rl-library?hl=en.
>

--
Brian Tanner
PhD Student, University of Alberta
br...@tannerpages.com

[jkscholz]

Ah, this would indeed be awesome. I was planning to bundle a few of
them up as standalone domains just for my own research, so I can
contribute to this effort as it happens. So far I've just been doing
some work on the Mario domain here with some people at Georgia Tech.
I got the 2009 competition source from John Asmuth a while back, and
have been adding features to allow it to function as a platform for
interactive ML work. Also added more params on top of what John
initially provided to customize gameplay.
Anyway, I'd be glad to submit code but I don't have commit access
yet.

> > For more options, visit this group athttp://groups.google.com/group/rl-library?hl=en.

[Brian Tanner]

I'm happy to provide commit access to anyone that wants it. Not only that, but the code doesn't have to be located in the rl-library.googlecode.com project (the back end) in order to be listed on the library.rl-community.org website (the front end).

There are several levels of integration/standardization possible when putting things in the library. At the most basic, you can just create a wiki page and linked to a download or other website. Or, you could choose to integrate with our current rl-library build system a bit which lets you easily push out updated builds when some of the supporting libraries are updated and also automatically update the wiki page with up-to-date instructions and download links (substituting versions in file names and things like that automatically).

I'm happy to give wiki and/or svn access to whoever asks. Just send me an e-mail and let me know how you want to contribute!

> For more options, visit this group at http://groups.google.com/group/rl-library?hl=en.

[W Bradley Knox]

I apologize for letting this thread drop. Brian, thanks for the link
to the competition code. I might take the lead on porting over some
environments in the next few months. I'm getting a lot of mileage out
of some of the environments already in RL-Library, so I'll hold off
for now. I'll let you know if that I do port any environments over,
though.