Video RAM usage during Leela games - data

570 views
Skip to first unread message

Alexey Eromenko

unread,
Jan 21, 2019, 11:10:13 AM1/21/19
to LCZero
root@BigFenix:~# nvidia-smi
Mon Jan 21 18:06:32 2019
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 410.48                 Driver Version: 410.48                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce RTX 2070    Off  | 00000000:02:00.0 Off |                  N/A |
| 63%   70C    P2   172W / 175W |    992MiB /  7951MiB |     96%      Default |
+-------------------------------+----------------------+----------------------+


+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      1592      G   /usr/lib/xorg/Xorg                           106MiB |
|    0      2067      G   /usr/bin/krunner                               3MiB |
|    0      2069      G   /usr/bin/plasmashell                          47MiB |
|    0     18364      C   /root/lc0-0.20.1/build/release/lc0           783MiB |
|    0     30165      G   ...4-linux-gnu/libexec/kscreenlocker_greet    39MiB |
+-----------------------------------------------------------------------------+


According to what I see, I'm using 992MiB of 7951MiB, or 1 GB out of 8 GB.

I'm curious if future nets like 40x512 will require more Video RAM (VRAM) ? Seems so.
Leela takes 800 MB of video memory, or only 10%. If there's a lot of room for growth.

Ivan Ivec

unread,
Jan 21, 2019, 1:00:30 PM1/21/19
to LCZero
Please make VRAM usage adjustable. Thanks!

Alexey Eromenko

unread,
Jan 21, 2019, 1:10:54 PM1/21/19
to LCZero


On Monday, January 21, 2019 at 8:00:30 PM UTC+2, Ivan Ivec wrote:
Please make VRAM usage adjustable. Thanks!

I'm not a Leela developer, so I cannot make it "adjustable".

Ivan Ivec

unread,
Jan 21, 2019, 1:30:49 PM1/21/19
to LCZero
Sorry Alexey, I was talking to developers of course.

Stefan Albrecht

unread,
Jan 21, 2019, 4:28:37 PM1/21/19
to LCZero
Hello Alexey,

did you try to increase the NNCacheSize parameter in the Lc0 uci-setup?
In the pic you see the standard settings; with my 1070 GTX 8gb I can easily increase it 10 times to 2000000.

Regards, Stefan


Alexey Eromenko

unread,
Jan 22, 2019, 9:23:12 AM1/22/19
to LCZero
I'm using client-linux to contribute games and GPU power. All parametrs are set automatically by the client.

svoi s

unread,
Jan 22, 2019, 10:33:46 AM1/22/19
to LCZero
You can use Cute Chess

вторник, 22 января 2019 г., 17:23:12 UTC+3 пользователь Alexey Eromenko написал:

Misha Golub

unread,
Jan 22, 2019, 3:28:42 PM1/22/19
to LCZero
Isn't NN cache in main memory and not in vram?
20x256 network is 45MB if fp16, 90MB as float32. Each position is 112 planes of inputs. When expanded we get 14kB with fp16 28 with fp32. We also have around 3000 outputs for 6k/12k per position. With fp32, batch size of 1000 and 2 networks running I get 260MB. I wonder what I forgot to count.

Sushi Nakamoto

unread,
Jan 22, 2019, 4:45:32 PM1/22/19
to LCZero
Yes. NNCache utilizes CPU RAM, not GPU RAM.
Network size is GPU RAM dependent.
Reply all
Reply to author
Forward
0 new messages