PSA: Google Colab now gives access to T4 GPUs

[LuckyDay]

So it has been pointed out on Discord that Google Colab now grants access to T4 GPUs.

Same usage restrictions should still be in place (i.e. 1 hour use every 24 hours) but since T4 GPUs can utilise cudnn-fp16, they can generate much more games (for the 10b T51 as much as 1600 games over 1 hour), completely free.

The workbook script for this is exactly the same as previous.

If you haven't used google colab before, go to https://colab.research.google.com/

and load this workbook:

https://cdn.discordapp.com/attachments/427066771627966466/508693534547771441/lc0_v6.ipynb

and just select Runtime -> Run All

As usual, don't try to abuse it by using multiple accounts as google has blocked people for this in the past.

[Klaus Krtschil]

Can confirm. Just tried it and for the 41xx network the speed is now at about 4 games / minute compared to 1 game / minute with K80

[Fahim Saharaiar]

Also here to confirm, I got about 3.17 games/min compared to the previous 1 game/min. Great improvements for free! 

[Fash Z]

can you write how to load workbook?

[Fash Z]

so i opened that workbook in wordpad copied all the text to CODE area and then pressed run all is that it?  i also selected TPU-s  in some options

[Carl Bicknell]

Follow this link below, but then change the details as Luckyday provided

https://github.com/LeelaChessZero/lc0/wiki/Run-Leela-Chess-Zero-client-on-a-Tesla-K80-GPU-for-free-%28Google-Colaboratory%29

[Al Z]

wow nice it worked but it played 206 games in 1 hour...   probably its t40 but i wonder if that number is too low

[Fash Z]

so as it looks like many people are using default google colab account so google wont be baning people based on training account...   baning would be based on IP address and google account right? so main problem would be multiple IP addresses i wonder if they can ban someone if same accounts has been registered from same address or in the past if multiple accounts have been  logged in from same address?

[jur...@gmail.com]

I just tried it for the first time and I got 500 games in 23m16s

[J S]

Got 1,325 in 59m57s So that's it till tomorrow? 

[LuckyDay]

You can run it as long as they let you, but generally they limit people to 1 hour every 24 hours.

The 1000+ game generation will only happen for the smaller 10b T52 network game generation, which is assigned randomly.

For T40 game generation, it will prob only generate a few hundred games in an hour (but that's still good for a free resource)

[Fash Z]

after disconnect you need to wait and you can reconnect back... right now i am at 5400 games per day and probably can increase it up to 8000-9000 by running 2 clients all the time... will try proxies soon i wonder if they ban it

[Sean Koors]

Any idea why I can't get training games? I get the following errors for the last week or so...

Lc0 client version 22
2019/05/18 20:12:41 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:12:41 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:12:41 lc0_main.go:963: Sleeping for 30 seconds...
2019/05/18 20:13:12 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:13:12 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:13:12 lc0_main.go:963: Sleeping for 30 seconds...
2019/05/18 20:13:42 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:13:42 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:13:42 lc0_main.go:963: Sleeping for 30 seconds...
2019/05/18 20:14:12 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:14:12 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:14:12 lc0_main.go:963: Sleeping for 30 seconds...
2019/05/18 20:14:42 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:14:42 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:14:42 lc0_main.go:963: Sleeping for 30 seconds...
2019/05/18 20:15:13 client_http.go:41: Bad JSON from http://api.lczero.org/next_game -- Invalid training run
2019/05/18 20:15:13 lc0_main.go:962: Server gave back empty SHA
2019/05/18 20:15:13 lc0_main.go:963: Sleeping for 30 seconds...

[Brian Richardson]

It has been down for several days.

We are all waiting for a restart and should be back up hopefully soon.

[Al Z]

after running the last line  

"!cd lc0/build && ./client_linux --hostname=http://157.230.189.191:8080/ --user 'Saitama' --password 123 > /dev/null"  

it says: 2019/05/24 21:11:48 fork/exec /content/lc0/build/lc0: no such file or directory

what can be the problem? i am trying to train 40b net

[Sean Koors]

AI Z,

I posted another thread asking for help looking into this... Definitely something happened between yesterday morning and today.

[Al Z]

if anyone cant run google colab here is a solution

you need to run every cell manually and run this cell twice 

!cd lc0 && rm -rf build

!cd lc0 && meson build --buildtype release -Db_lto=true -Dgtest=false

!cd lc0/build && ninja

or duplicate this cell and run them all  it should look like this... there is +cell bottom use it for duplication 

[Klaus Krtschil]

It seems to work again. No error message any more.

Am Dienstag, 16. April 2019 18:46:10 UTC+2 schrieb LuckyDay: