[slurm-users] Dell <> GPU compatibility matrix?

[Chip Seraphine]

We have a cluster of 1U dells (R640s and R650s) and we’ve been asked to install GPUs in them, specifically NVIDIA Teslas with at least 24GB RAM, so I’m trying to select the right card. In the past I’ve used Tesla T4s on similar hardware, but those are limited to 16GB. I know most of the really high-end GPUs won’t physically fit in a 1U server.

Does anyone know of a resource that will tell me which models of GPUS (specifically Teslas) do/do-not fit in various Dell boxes? It seems like both Nvidia and Dell would be motivated to provide such a compatability list but so far I’ve been unable to find one for this sort of enterprise equipment (although they abound for desktops and consumer cards).


--

Chip Seraphine

This e-mail and any attachments may contain information that is confidential and proprietary and otherwise protected from disclosure. If you are not the intended recipient of this e-mail, do not read, duplicate or redistribute it by any means. Please immediately delete it and any attachments and notify the sender that you have received it by mistake. Unintended recipients are prohibited from taking action on the basis of information in this e-mail or any attachments. The DRW Companies make no representations that this e-mail or any attachments are free of computer viruses or other defects.

[Sean Caron]

Hi Chip,

Here's the page I've been using for reference:

https://www.dell.com/en-us/dt/servers/server-accelerators.htm

Best,

Sean

[Fulcomer, Samuel]

The NVIDIA A10 would probably work. Check the Dell specs for card lengths that it can accommodate. It's also passively cooled, so you'd need to ensure that there's good airflow through the card. The proof would be installing a card, and watching the temp when you run apps on it. It's 150W, so not that hot.

On Thu, Oct 27, 2022 at 11:03 AM Chip Seraphine <csera...@drwholdings.com> wrote:

[Jens Dreger]

Hi Chip!

Without owning any R640s or R650s, my impression is that you will only
be able to install a single slot GPU due to space limitations. There
is a single slot Tesla with 24GB: Tesla A10 [1]. This will only fit if
you have the R640/R650 version with full profile slots. But the
biggest problem is the 8pin PCIe power connector on the A10. While the
T4 does not have any additional power connectors, the A10 has an 8pin
connector which must be connected for the card to work. And my guess
would be that the R640/R650 have no easy way to supply the card with
such an 8pin PCIe power connector. But there weem to exist adapters
like:

https://www.moddiy.com/products/Dell-Server-R640-12-Pin-to-8-Pin-and-6-Pin-GPU-PCIE-Power-Cable.html

Regards,

Jens.

[1] https://www.nvidia.com/en-us/data-center/products/a10-gpu/

--
Jens Dreger Freie Universitaet Berlin
dre...@physik.fu-berlin.de Fachbereich Physik - ZEDV
Tel: +49 30 83854774 Arnimallee 14
Fax: +49 30 838454774 14195 Berlin