agents, but in javascript

[Ari Kalinowski]

Hi Everyone,

I'm using babylonjs to run VR worlds in the browser.

I want to run/train some agents in those worlds (and I want to look at them).

Is there an tfagents.js extension of some kind? And/or, can I do reinforcement learning in the browser somehow?

Best,

AK

--

ai (poetry, music, simulation) + 

systems (robots, animals, people) =

Delta Ark Studios

[Ari Kalinowski]

https://livebook.manning.com/book/deep-learning-with-javascript/chapter-10/v-6/1 <-- am I correct in understanding that I just use tfagents in javascript, I believe that's implemented in this book. 

[Yannick Assogba]

Hi Ari,

There isn't an implementation of TF agents in JS as far as I know. But as that book chapter shows, you can do RL in TFJS by implementing the algorithms directly. The source code for the RL examples described in the book are also available at https://github.com/tensorflow/tfjs-examples

Best

Yannick

--
You received this message because you are subscribed to the Google Groups "TensorFlow.js Discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to tfjs+uns...@tensorflow.org.
To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/tfjs/CA%2B5zBg6udQnhUkCVg8tDyWgf9b%3DEQ6_V0ruFDCS3bH%2Bt%3DbEOuQ%40mail.gmail.com.

[Ari Kalinowski]

Hi There,

Got it-- Do you also know if there happens to be a community of people trying to do deep reinforcement learning in Javascript? I know that's unusual, the regular way (for artist/gamer people like myself, at least) seems to be unity's ml agents, but I'm wondering if it's possible to have agents mine the internet and then display the results of the mining in a virtual environment in babylonjs (already have that part ready/constructed); now, just trying to figure out the agent training...

Best,

AK

[Jason Mayes]

So I have heard this a few times come up, the agents team even cc'ed me on one of their github bugs as some folk were asking about JS version too, so people are starting to explore this as an option.

 I've also seen a few people experimenting with RL in JS - self driving cars in the browser etc. Some cool links to check:

https://github.com/thibo73800/metacar

https://medium.com/@pierrerouhard/reinforcement-learning-in-the-browser-an-introduction-to-tensorflow-js-9a02b143c099

https://github.com/BeTomorrow/ReImproveJS

https://github.com/tensorflow/tfjs-examples/tree/master/snake-dqn

https://towardsdatascience.com/a-beginners-guide-to-reinforcement-learning-using-rock-paper-scissors-and-tensorflow-js-37d42b6197b5

But that being said you would still be one of the first. If you are willing to set up such a group/discord/website let me know and I can forward anyone else who expresses interest in this area to that so you can start finding each other and gathering 👍 Let me know!

To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/tfjs/CA%2B5zBg7yzOX60Zin9Ug7b7_Xyt_z%2Bi8yMpwLiRh0fDbPuB5K%2Bw%40mail.gmail.com.

[Ari Kalinowski]

Here is a discord server: Deep Reinforcement Learning in Javascript: https://discord.gg/3KbgmcW <-- infinite invites indefinitely open

Please send people my way!

So, here's my question, would it be tremendously difficulty to implement something like ReImproveJS in 3D in Babylonjs?

That's what I'm going to try to do soon...

AK

To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/tfjs/CAK49Qdewt0Z0WzVNduJfv2sKMD4RVfYJEeBsj8VYps9Ub4FSvQ%40mail.gmail.com.

[Eddie J]

Posting a second time to the whole group. :)

I also have a project setup to test RL in TFJS. https://github.com/Y8Games/Y8-ai-gym

To view this discussion on the web visit https://groups.google.com/a/tensorflow.org/d/msgid/tfjs/CA%2B5zBg6ypaH-L8u4nO-NZDq4hHnrW9%3DsSGw9wq0NtTvf1astnQ%40mail.gmail.com.

--

Eddie Jones

+1-801-717-9210

onefoldmedia.com

[Ari Kalinowski]

Hey There,

Come join us in the discord: https://discord.gg/3KbgmcW

It's great to see people working on this.

Best,

AK

[Jason Mayes]

Oh awesome Shall join! I should probably start some sort of TFJS channel on there too for all the other stuff 

--

•  Jason Mayes   •  Senior Developer Advocate, TensorFlow.js   •  Google   •   Follow my discoveries or contribute your own

This email may be confidential and privileged. If you received this communication by mistake, please don't forward it to anyone else, please erase all copies and attachments, and please let me know that it has gone to the wrong person.