Bicycle simulator in Java

[Judah]

Hello,
My name is Kshitij Judah and I am a PhD student in Computer Science
department at Oregon State University. Lately I have been using the
Java version of Cart pole domain which I obtained from the RL library.
I also wanted to use Bicycle domain implemented in Java but it is not
there at the RL library. However, I obtained a Matlab code that
implements bicycle simulator from a colleague of mine and ported it to
Java. While porting, I used the cart pole code from RL library as
starting point resulting in Java version of Bicycle domain which
implements RL glue interface. I was wondering if you anyone is willing
to work on this then we can finalize the Java Bicycle simulator and
add it to the RL library. Code is almost like cartpole but I have few
extra functions in it (for my own purposes) and code is little less
documented. If needed I can also send the code to look at and give
further suggestions as to how to modify it so that I can be added to
the RL library for the community to use it.

Regards,
Kshitij Judah

[W Bradley Knox]

Hi, Kshitij.

I also have a gridworld environment that is compatible with RLGlue and
RL-Viz. If you'd be interested in swapping environments to check to
see that they work and that they're adequately documented, I'd be
interested in doing so. Then I could figure out how to check them both
into RL-Library by svn.

Let me know. And if you're not interested in the swap, I still might
be interested in using your bicycle code, assuming it's still
available.

Cheers,
Brad

> --
> You received this message because you are subscribed to the Google Groups "rl-library" group.
> To post to this group, send email to rl-li...@googlegroups.com.
> To unsubscribe from this group, send email to rl-library+...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/rl-library?hl=en.
>

[Kshitij Judah]

Hi Brad,
   I am little caught up with my experiments right now but I will sure look into this soon and get back to you. Yes, the bicycle code is still available, and I am using it for my experiments, I tried to make it RL glue compatible, its very similar to cart-pole code from RL-library that I also use for my experiments. I agree with you that ultimately both grid world and bicycle simulator should be made available at RL-library and we should work towards that. We can also discuss this coming weekend when we meet at Arlington, if hurricane sandy doesn't spoil everything.

Regards,
Kshitij

--
Kshitij Judah,                  Office: 541-737-4145
PhD Candidate,               Cell:    541-908-3987
School of EECS,
1148 Kelley Engineering Center,
Oregon State University, Corvallis, OR 97331-5501, USA.
URL: http://web.engr.oregonstate.edu/~judahk

[Brad Knox]

Sounds good. See you this weekend.

Brad

Sent from my iPad