Cluster with GPUs and TensorFlow support, or AWS?

96 views
Skip to first unread message

Jaan Altosaar

unread,
Nov 25, 2015, 11:24:23 AM11/25/15
to cu-neural-net
Hi all,

Quick questions:

1) are you aware of a cluster that supports GPUs and Google's recently open-sourced TensorFlow library? (and ideally bazel.io as well). I have experiments set up locally but need to scale up.

2) would it be worth just going with Amazon AWS instead for experiments?

Thanks a lot!
Jaan


Colin Raffel

unread,
Nov 25, 2015, 11:37:06 AM11/25/15
to Jaan Altosaar, cu-neural-net
On Wed, Nov 25, 2015 at 11:24 AM, Jaan Altosaar <jaan.a...@gmail.com> wrote:
Hi all,

Quick questions:

1) are you aware of a cluster that supports GPUs and Google's recently open-sourced TensorFlow library? (and ideally bazel.io as well). I have experiments set up locally but need to scale up.

Do you mean a cluster local to Columbia?  I would expect that any server would support TensorFlow and/or bazel, but most would probably need both installed as they are not particularly ubiquitous at this point.  So, you could potentially run things on yeti, but would need to convince the sysadmins to install things.  Daniel Soudry, a frequenter to the group, has done some GPU experiments using yeti.
 
2) would it be worth just going with Amazon AWS instead for experiments?

AWS is not a bad option, but is not particularly cost-effective and their high-end GPUs are not particularly beefy.  Nikolai, who is giving a talk on the 2nd, has done most of his neural net experiments on an Amazon GPU instance.


Jim Fan

unread,
Nov 25, 2015, 11:43:53 AM11/25/15
to Colin Raffel, Jaan Altosaar, cu-neural-net
1) are you aware of a cluster that supports GPUs and Google's recently open-sourced TensorFlow library? (and ideally bazel.io as well). I have experiments set up locally but need to scale up.

Do you mean a cluster local to Columbia?  I would expect that any server would support TensorFlow and/or bazel, but most would probably need both installed as they are not particularly ubiquitous at this point.  So, you could potentially run things on yeti, but would need to convince the sysadmins to install things.  Daniel Soudry, a frequenter to the group, has done some GPU experiments using yeti.

​Does Columbia have any GPU cluster ​other than CLIC? I'm not aware of any. 

And what is Yeti?

Best,

Jim
 

--
Schedule and info: http://labrosa.ee.columbia.edu/cuneuralnet/
---
You received this message because you are subscribed to the Google Groups "cu-neural-net" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cu-neural-ne...@googlegroups.com.
To post to this group, send email to cu-neu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cu-neural-net/CAObWYF23JMSUFJGKEHk-M9qZ2H2900C39%3DJq9R79Rjz1ik%3Dk9Q%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

Daniel Soudry

unread,
Nov 25, 2015, 11:44:59 AM11/25/15
to Colin Raffel, Jaan Altosaar, cu-neural-net
Hi,

To confirm what Colin said, Yeti has K-20 and K-40 GPUs, but you will have to talk with the support team to install any additional software.

Cheers,

Jaan Altosaar

unread,
Nov 25, 2015, 11:54:19 AM11/25/15
to Daniel Soudry, Colin Raffel, cu-neural-net
Awesome, thanks a lot Daniel and Colin - I'll take a look.

Best,
Jaan
Reply all
Reply to author
Forward
0 new messages