Google Colab client?

[Levente Kolcsar]

Is it possible to run the client in the Google Colab environment? So it has Keras, Tensorflow and OpenCV support. It gives you a free GPU ~Tesla K80 resource, limited to 12 hours but you can restart the client twice every day, no problem.

[Oliver Leenders]

Have you tried it out? would be pretty great

[Jeremy Zucker]

Hi folks,

I've been trying to install leela-chess zero on google colab, so far without success.

Part of the problem appears to be that the OpenCL drivers aren't finding the GPU even though the GPU can be found by tensorflow. See issue https://github.com/glinscott/leela-chess/issues/284

If you can figure out how to get it to work, let me know.

Sincerely,

Jeremy

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/8343da2f-818b-4418-83d2-aad8db9975f7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jeremy Zucker]

OK,

I've gotten leela-chess to install correctly on google colab.

Here is the workflow:

The full successful workflow is as follows:

apt install cmake nvidia-cuda-toolkit git-all libboost-all-dev libopenblas-dev opencl-headers ocl-icd-libopencl1 ocl-icd-opencl-dev zlib1g-dev
apt install clinfo && clinfo

followed by:

git clone https://github.com/glinscott/leela-chess.git
cd leela-chess
git submodule update --init --recursive
mkdir -p build && cd build
cmake ..
make

followed by

cp leela-chess/build/lczero .
wget -c https://github.com/glinscott/leela-chess/releases/download/v0.6/client_linux
cp leela-chess/build/lczero .
chmod +x client_linux && ./client_linux --user djinnome --password XXX --debug.

https://www.linkedin.com/in/jeremyzucker

[Matej The Tree]

Create new Colab

Edit -> notebook settings : select python3 and enable GPU accelerations.

Click on +CODE

Paste this into the code

!apt install cmake nvidia-cuda-toolkit git-all libboost-all-dev libopenblas-dev opencl-headers ocl-icd-libopencl1 ocl-icd-opencl-dev zlib1g-dev

!apt install clinfo && clinfo

!git clone https://github.com/glinscott/leela-chess.git

!cd leela-chess

!git submodule update --init --recursive

!mkdir -p build && cd build

!cmake ..

!make

!cp leela-chess/build/lczero .

!wget -c https://github.com/glinscott/leela-chess/releases/download/v0.6/client_linux

!cp leela-chess/build/lczero .

!chmod +x client_linux && ./client_linux --user djinnome --password XXX —debug.

Execute by clicking Play.

This should do the trick in case you have no idea how to do terminal code in colab

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/CA%2BHW2JMAmXZKKi8SHhecTKP8YLiLJC0YKCNf0TDQrc%3DwtnjkNg%40mail.gmail.com.

[Matej The Tree]

doesnt work, I get some errors on execution. 

Jeremy, can you post full instructions please?

thx

[Jesse Jordache]

I'm trying it based on the console instructions, but..
1) I can only apt install each package separately. (when I tried it all in once line, it got to the first time I used cmake and I got a no such command(????).  So I installed cmake by itself, and boom - there it went.  So now I'm going back and doing everything one-by-one.).
2) The packages are MASSIVE.  And unnecessary in part - I'm installing the nvidia-cuda-toolkit, and it's installing the adwaita theme as a dependency.

Etc.  There's something basic I think I don't understand.  Does it make a difference that I'm connected from a windows machine?  Best I can do - I don't have a linux box at the moment.

[Jesse Jordache]

I mean ...installing emacs25... wtf?

[Jeremy Zucker]

Try ./client_linux --help

 For the arguments to invoke.

--user

--password

--gpu

By the way, Im not sure exactly what the openCL ID is fir the GPU.  Is it in the output of clinfo? (Perhaps platform number or Vendor ID?)

On Sun, Apr 15, 2018, 2:01 PM Levente Kolcsar <kolcsa...@gmail.com> wrote:

it works but i have to enter the Username, how can i enter into command line? Google Colab has only starting code and output text but i cant enter my name or anything

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/aa56c14e-fa82-494e-bd73-8252cc301fc5%40googlegroups.com.

[Matej The Tree]

If someone manages to run the client, please post full instructions :)))

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/CA%2BHW2JP4eFzgbk6x%2BmWHpepCMGe4ff7qwVcdx%3D3%3DcjO6t3w-KA%40mail.gmail.com.

[Jeremy Zucker]

Ill send out a link to my colab notebook shortly. Wife just came home and kid was painting the walls...

[Jesse Jordache]

Thanks.  I'm not at all a stranger to the command line, but what and where this stuff all is is baffling.

I don't even know how to start from scratch - it keeps telling me there's already a leela-chess directory.  And cd (and pwd) don't seem to do anything.

[Matej The Tree]

yeah, I didnt know how to use cd

If we can just clone his notepad, it will be cool

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/6d817f0b-de2c-47c3-b4a0-ef1fad6d0194%40googlegroups.com.

[Jeremy Zucker]

Hey folks,

Sorry about the delay.  

Here is a link to my Colab notebook

https://colab.research.google.com/drive/1L5gUocAkW3gG6HH68qBR5K1KrFCBzwZJ

Go ahead and copy this notebook to your colab space and don't forget to set the GPU through 

Edit->Notebook Settings...->Hardware accelerator -> GPU

I'm not positive that the linux client is using the GPU, as I don't know what OpenCL GPU ID to give it, but it had to be an int, so  I guessed that it was 0.

Usage of ./client_linux: -debug Enable debug mode to see verbose output and save logs -gpu int ID of the OpenCL device to use (-1 for default, or no GPU) (default -1) -hostname string Address of the server (default "http://162.217.248.187") -password string Password -user string Username

https://www.linkedin.com/in/jeremyzucker

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/6d817f0b-de2c-47c3-b4a0-ef1fad6d0194%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/6E51234B-CDB0-44E8-AFEF-7390F5D7A937%40gmail.com.

[Jeremy Zucker]

I dont know if all of nvidia-cuda-toolkit, is strictly necessary, but it is sufficient to install the OpenCL drivers so that clinfo generates output.

On Sun, Apr 15, 2018, 2:46 PM Jesse Jordache <youtwis...@gmail.com> wrote:

I mean ...installing emacs25... wtf?

--

You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fe42e4b9-9058-4964-afb5-cd4854def177%40googlegroups.com.

[Matej The Tree]

I cannot open your notebook, it just stays on loading

`There was an error loading this notebook. Ensure that the file is accessible and try again`

There was an error loading this notebook. Ensure that the file is accessible and try again.

https://drive.google.com/drive/?action=locate&id=1L5gUocAkW3gG6HH68qBR5K1KrFCBzwZJ&authuser=0

 DETAILS

OK

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/CA%2BHW2JPa%2BYaxzVz_FBqsaS-mDNpo94HF07DktWd%2BCuxxw9s95Q%40mail.gmail.com.

[Jeremy Zucker]

Hi, sorry about that. Try this instead:

https://drive.google.com/file/d/1GrblsA_I4ceIBXWdSKmGwz3IuXRXk3tk/view?usp=sharing

https://www.linkedin.com/in/jeremyzucker

On Sun, Apr 15, 2018 at 3:37 PM, Matej The Tree <matejt...@gmail.com> wrote:

I cannot open your notebook, it just stays on loading

`There was an error loading this notebook. Ensure that the file is accessible and try again`

There was an error loading this notebook. Ensure that the file is accessible and try again.

https://drive.google.com/drive/?action=locate&id=1L5gUocAkW3gG6HH68qBR5K1KrFCBzwZJ&authuser=0

 DETAILS

OK

On 15 Apr 2018, at 17:35, Jeremy Zucker <djin...@gmail.com> wrote:

I dont know if all of nvidia-cuda-toolkit, is strictly necessary, but it is sufficient to install the OpenCL drivers so that clinfo generates output.

On Sun, Apr 15, 2018, 2:46 PM Jesse Jordache <youtwis...@gmail.com> wrote:

I mean ...installing emacs25... wtf?

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fe42e4b9-9058-4964-afb5-cd4854def177%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

[Matej The Tree]

First command runs with some warnings. This is what I get when running second part:

make: *** No targets specified and no makefile found. Stop.

[Matej The Tree]

full output

Submodule path 'gtest': checked out '15392f1a38fa0b8c3f13a9732e94b209069efa1c'

Cloning into 'leela-chess'...
Submodule 'gtest' (https://github.com/google/googletest.git) registered for path 'gtest'
Cloning into '/content/leela-chess/gtest'...
bash: line 6: cmake: command not found
make: *** No targets specified and no makefile found.  Stop.

On 15 Apr 2018, at 17:40, Jeremy Zucker <djin...@gmail.com> wrote:

[Matej The Tree]

errors from first command

WARNING: apt does not have a stable CLI interface. Use with caution in scripts. E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/libv/libvorbis/libvorbis0a_1.3.5-4ubuntu0.1_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/o/openjdk-8/openjdk-8-jre-headless_8u151-b12-0ubuntu0.17.10.2_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/libv/libvorbis/libvorbisenc2_1.3.5-4ubuntu0.1_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/o/openjdk-8/openjdk-8-jre_8u151-b12-0ubuntu0.17.10.2_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/libv/libvorbis/libvorbisfile3_1.3.5-4ubuntu0.1_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/l/linux-meta/linux-headers-generic_4.13.0.36.38_amd64.deb 404 Not Found [IP: 91.189.88.162 80] E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

On 15 Apr 2018, at 17:40, Jeremy Zucker <djin...@gmail.com> wrote:

[Jeremy Zucker]

Hmm, that is weird.

 I went ahead and added apt-get update and

apt install --fix-missing to the notebook, so copy it an try again.

https://www.linkedin.com/in/jeremyzucker

[Levente Kolcsar]

I think it works, but no output text when it runs, just the running button rolling, it is fast as hell compared to my PC. 4 games in a minute or someting like that im not sure exactly :D THAAAANKS

[Levente Kolcsar]

its not 4 games / minute but still holding 1 / minute

[Matej The Tree]

what is average play per minute when running on desktop?

On 15 Apr 2018, at 18:42, Levente Kolcsar <kolcsa...@gmail.com> wrote:

its not 4 games / minute but still holding 1 / minute

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/51b5dfd1-13b9-4c42-8327-d56144708c5c%40googlegroups.com.

[Matej The Tree]

what is leela chess username and password?

On 15 Apr 2018, at 18:42, Levente Kolcsar <kolcsa...@gmail.com> wrote:

its not 4 games / minute but still holding 1 / minute

[Jeremy Zucker]

Whatever you want it to be so that you show up on the lczero.org leaderboards

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/538F97B0-1A34-49D0-BBD4-BB55AF554FDE%40gmail.com.

[Matej The Tree]

works :))))

I will make a pull request on the git tomorrow with detail noob friendly instructions.

Than I will try to contact some of the chess channels, if they can give a shoutout to use this method

What do you guys think?

[Jeremy Zucker]

Sounds great!  Btw, google allows up to 4 gpus per account but these instructions only use 1 gpu.  

[Matej The Tree]

Can you make use of all 4, than I will create an article how to use it?

[Jeremy Zucker]

I have to experiment a bit.  I dont know if they allow 4 instances with 1 GPU each or if you get 4 GPUs per instance. (I suspect the former).  The solutions are very different.  Go ahead and make the pull request. If I get it working, we can always make another pull request

[gravity_well]

anyone try it in google cloud shell?

[Jeremy Zucker]

Is google cloud shell free to use gpus? Google colab is.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fee691cd-694b-4321-9db0-eea8de8bd00e%40googlegroups.com.

[Matej The Tree]

something strange happened.

my computer went to sleep or just screen went off, I dont know.

So now I cannot restart the notebook, but the client is still running in the background. I can tell that the games are still being uploaded to the server.

Why did this happen?

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/CA%2BHW2JNiNwcWxEEwygTyy5pGyxROsikn6fXeNrOq_SSwMKstNg%40mail.gmail.com.

[gravity_well]

got it boys.  I am in... gravity_1  is the user name.  2 games and climbing !!  LOL

[gravity_well]

I was able to get 22 games out before my connection timed out

[gvergh...@gmail.com]

Well, finally got it to work and it's outputting at 1 game per minute...

Thanks to Jeremy for his Colab notebook !!

[Jeremy Zucker]

Hi Matej

Yes sometimes this happens.  If you start a new notebook just re install everything, you will have 2 gpus running simultaneously. Double the fun!

[Matej The Tree]

Is there a limit on how many notebooks can we open? :)))

[Jeremy Zucker]

Yes there is a limit and I'm guessing it is around 4

[Matej The Tree]

What do you think about this line from wiki? link

!echo '0;XgemmBatched;128;16;128;16; -DKWG=16 -DKWI=8 -DMDIMA=8 -DMDIMC=16 -DMWG=32 -DNDIMB=8 -DNDIMC=8 -DNWG=16 -DSA=1 -DSB=1 -DSTRM=0 -DSTRN=0 -DVWM=2 -DVWN=1;OpenCL: NVIDIA Corporation Tesla K80 @ 823MHz' > leela-chess/build/leelaz_opencl_tuning

[Jeremy Zucker]

I like it, but I'm not sure exactly what it is doing or why it works.  When I run client_linux, the leelaz_opencl_tuning file shows up anyway, so I presume that if you don't put it in there, it will take some time to autotune?

Sincerely,

Jeremy

https://www.linkedin.com/in/jeremyzucker

Why did this happen?

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fee691cd-694b-4321-9db0-eea8de8bd00e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

[Matej The Tree]

Also, the way that wiki colab was written with ! and && to chain commands lets you see the output of client, and %%bash gives white output.

could be usefull for running linux_client to see what is happening if you want.

[Jeremy Zucker]

Yes, that is a nice feature of !, so I updated the google colab notebook to do the same.

https://www.linkedin.com/in/jeremyzucker

[Matej The Tree]

Anyone joining in on the thread late, here is the link again

Easiest way is to first open colab.research.google.com.

Then open https://drive.google.com/file/d/1GrblsA_I4ceIBXWdSKmGwz3IuXRXk3tk/edit

and choose connect more apps from the drop down menu

.

Add Google codelabs as an app and open in codelab. Then choose File -> Save a Copy to Drive

Run all commands one by one, and Voila. You have it running. 

[Levente Kolcsar]

Works fine so far, running 4 notebook in parrelel is going strong with 3 games/ minute. I can add more more notebook but i think slows down, probably the limit kicks in. 

[Lucien Grondin]

I tried the procedure in the wiki, I don't think I get access to the K80.

clinfo returns:

Number of platforms                               0

[Jesse Jordache]

Yeah, I'm getting the same error.  Plus the warnings and 404s from the first command.


On Sunday, April 15, 2018 at 6:52:05 PM UTC-4, Matej The Tree wrote:

full output

Submodule path 'gtest': checked out '15392f1a38fa0b8c3f13a9732e94b209069efa1c'

Cloning into 'leela-chess'...
Submodule 'gtest' (https://github.com/google/googletest.git) registered for path 'gtest'
Cloning into '/content/leela-chess/gtest'...
bash: line 6: cmake: command not found
make: *** No targets specified and no makefile found.  Stop.

On 15 Apr 2018, at 17:40, Jeremy Zucker <djin...@gmail.com> wrote:

Hi, sorry about that. Try this instead:

https://drive.google.com/file/d/1GrblsA_I4ceIBXWdSKmGwz3IuXRXk3tk/view?usp=sharing

https://www.linkedin.com/in/jeremyzucker

On Sun, Apr 15, 2018 at 3:37 PM, Matej The Tree <matejt...@gmail.com> wrote:

I cannot open your notebook, it just stays on loading

`There was an error loading this notebook. Ensure that the file is accessible and try again`

There was an error loading this notebook. Ensure that the file is accessible and try again.

https://drive.google.com/drive/?action=locate&id=1L5gUocAkW3gG6HH68qBR5K1KrFCBzwZJ&authuser=0

 DETAILS

OK

On 15 Apr 2018, at 17:35, Jeremy Zucker <djin...@gmail.com> wrote:

I dont know if all of nvidia-cuda-toolkit, is strictly necessary, but it is sufficient to install the OpenCL drivers so that clinfo generates output.

On Sun, Apr 15, 2018, 2:46 PM Jesse Jordache <youtwis...@gmail.com> wrote:

I mean ...installing emacs25... wtf?

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fe42e4b9-9058-4964-afb5-cd4854def177%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/CA%2BHW2JPa%2BYaxzVz_FBqsaS-mDNpo94HF07DktWd%2BCuxxw9s95Q%40mail.gmail.com.

[Jesse Jordache]

Ugh.  I'll get it working eventually - it was spitting out games at about one per minute and a half, but that seemed slow, and I'd gotten an error in the first package command complaining about some directory under /var being locked.

So I reinstalled the packages, and swept up the new ones.  But now I can't compile.

Starting over... again....

[Matej The Tree]

run. 

!kill -9 -1

wait one minute and refresh

start new

this will clear the machine 

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/cbfe9830-7387-417b-93f7-dc376392c4ec%40googlegroups.com.

[gravity_well]

when I was getting the platform ................  0    message,  I refreshed the page.  then it worked.  I guess that is the same as restarting the connection??

[Matej The Tree]

I still have to run everything from the scratch, even though we have this google drive

how come?

can you explain your process, do you just click play after 12 hours and it works?

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/c0977ecd-fe77-4f0b-a078-5346d5d92d45%40googlegroups.com.

[Jeremy Zucker]

Hi Matej,

The reason why is that every 12 hours you get a fresh new instance of the VM.  Therefore you have to reinstall all the libraries.  Not sure if there is an easy workaround for that.  Interestingly, if you want to run more than one instance simulatenously, when you create a copy of your first notebook, all you just have to execute the last line in the second notebook in order to get it to run (with the gpu number incremented by 1)

https://www.linkedin.com/in/jeremyzucker

On Mon, Apr 16, 2018 at 3:21 PM, Matej The Tree <matejt...@gmail.com> wrote:

I still have to run everything from the scratch, even though we have this google drive

how come?

can you explain your process, do you just click play after 12 hours and it works?

On 16 Apr 2018, at 12:14, gravity_well <tolivea...@gmail.com> wrote:

when I was getting the platform ................  0    message,  I refreshed the page.  then it worked.  I guess that is the same as restarting the connection??

On Monday, April 16, 2018 at 1:02:13 PM UTC-4, Matej The Tree wrote:

run. 

!kill -9 -1

wait one minute and refresh

start new

this will clear the machine 

On 16 Apr 2018, at 06:18, Jesse Jordache <youtwis...@gmail.com> wrote:

Ugh.  I'll get it working eventually - it was spitting out games at about one per minute and a half, but that seemed slow, and I'd gotten an error in the first package command complaining about some directory under /var being locked.

So I reinstalled the packages, and swept up the new ones.  But now I can't compile.

Starting over... again....

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/cbfe9830-7387-417b-93f7-dc376392c4ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/c0977ecd-fe77-4f0b-a078-5346d5d92d45%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/B57A9223-7B0D-4769-BA55-773267AA6036%40gmail.com.

[Matej The Tree]

Ok,

what is the reason then behind google drive and cloud integration?

It is cool that we can just run new notebooks like you said. You said before we can use 4 gpus?

So 4 instances?

[Jesse Jordache]

How do you errr, "run client_linux"?  The only thing I can do is do the thing, shut the window, and the only way I know it's stopped  - usually about an hour later, is by my last activity as reported by the lczero page.

I mean, where's the command prompt?  Once you close the window in your browser, can you interact with it in any way?

[gravity_well]

thank you for the efforts, much appreciated.

if someone has asked this, then sorry for the repeat question, but what would be the benchmark for leaving an instance of this running on the gpu in colab?  if its 1 game a minute for 12 hours. that is 720 games, but that seems a tad high, no?  so I am thinking maybe 650?

https://www.linkedin.com/in/jeremyzucker

https://www.linkedin.com/in/jeremyzucker

Why did this happen?

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/fee691cd-694b-4321-9db0-eea8de8bd00e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "LCZero" group.

To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

[Jeremy Zucker]

That was my experience also.  2-3 colabs running in parallel gets 2-3 games/minute.  The harder problem is how to set up a dead mans switch so you are notified when the processes need restarted

On Tue, Apr 17, 2018, 1:14 AM Levente Kolcsar <kolcsa...@gmail.com> wrote:

probably around that, and you can reach ~1500 / day if you run multiple colabs, the problem with parralel notebooks is that they use the same gpu/cpu resource so there is a sweet spot,  in my experience is around 2-3 colab's running in parralel is fine, running more isnt doing anything, just slows down the overall output rate. 

--
You received this message because you are subscribed to the Google Groups "LCZero" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lczero+un...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/lczero/86bda755-a3dc-434d-91c8-8d3a4dee2d82%40googlegroups.com.

[Jesse Jordache]

On a related subject, my experience is that if I don't keep the browser open, it will terminate and recycle within an hour or two.  It's only supposed to do that if it's "idle", which it isn't.

[gravity_well]

I tried something today.  I ran an instance in chrome and and instance in firefox.  

firefox would time out consistantly about every 30-40 mins or so if the page was left idle and it seems like the background instance finally closed after almost exactly 4 hours and 28 mins.

interestingly, the instance in firefox was able to get about a game a minute for 269 games = 4.48 hours.

in chrome, I was able to get the instance to run 56 games in one hour.  it ran for exactly 10 hours for 560 games.

started at 1:30 am EST... the background instance stopped at 11:30 am EST.

[Dietrich Kappe]

I had to do a few things differently to get colab working for me:

!apt-get update

!apt install cmake

!apt install nvidia-cuda-toolkit

!apt install git-all

!apt install libboost-all-dev

!apt --fix-broken install

!apt install libboost-all-dev

!apt install libopenblas-dev

!apt install opencl-headers

!apt install ocl-icd-libopencl1

!apt install ocl-icd-opencl-dev

!apt install zlib1g-dev

!apt install clinfo && clinfo

!git clone https://github.com/glinscott/leela-chess.git

!cd leela-chess && git submodule update --init --recursive

!cd leela-chess && mkdir -p build

!cd leela-chess/build && cmake ..

!cd leela-chess/build && make

!cd leela-chess/build && wget -c https://github.com/glinscott/leela-chess/releases/download/v0.6/client_linux

!cd leela-chess/build && chmod +x client_linux

!cd leela-chess/build && ./client_linux --user XXX --password XXX

[Levente Kolcsar]

So far i've already runned few days of colab and my multiple colab notebook theory is:

If you have one account, the GPU willl be shared of course, so the avg. nps will be 1000 nps, if you are running 2 notebook that will be 500 nps, but, if you start 2 client there is better efficiency!

Why? Because at the end of game generation we have few seconds for uploading, and there we go, the second client will probably using that unused gpu time. 2-3 is client is enough for this, and you maximize the output of your colab GPU. 

[Levente Kolcsar]

Just make sure that you start the notebooks in a different time. 

[Jeremy Zucker]

Hi Matej, 

the point of the google drive is if you want to run the client with -debug option and save your logfiles so you can record not only the self-play games, but also the variations that leela is considering and the evaluations she is assigning to each position.

https://www.linkedin.com/in/jeremyzucker

[FWCC1]

I'm NOT having any issues now with Colab.The script ran fine.Like the fact you can see the pgn. Of the games and copy them if you like.

[Jesse Jordache]

Good to hear.

I shut my training output off, because sometimes if it fills up, Colab will complain.  But as far as I know no one else has that problem.