Jupyterhub and multicore system

Brian Novogradac

unread,

Sep 15, 2016, 9:55:04 AM9/15/16

to Project Jupyter

Hello,

this is most likely a newbie question.

I am running Jupyterhub on a VM with 8vCPU and 20GB of ram. I do notice that i am only utilizing 2 out of 8 CPUs when notebooks are being spawned.

I may be missing something but I am trying to figure out why jupyterhub is not accessing the remaining CPUs.

MinRK

unread,

Sep 15, 2016, 10:01:45 AM9/15/16

to Project Jupyter

The most common cause of something like this is an environment variable such as CPU_AFFINITY being set. Such things can pin processes to particular CPU threads. You might check `os.environ` in your notebooks to see if anything suspicious is set that might do something like that.

-MinRK

--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.
To post to this group, send email to jup...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/0b4ce8a1-2bb4-40c4-99c8-af3178aaea0f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Brian Novogradac

unread,

Oct 6, 2016, 10:04:38 AM10/6/16

to Project Jupyter

would i have to go through all notebooks or is there a global setting. i have approx 60 users on this system.

On Thursday, September 15, 2016 at 10:01:45 AM UTC-4, Min RK wrote:

The most common cause of something like this is an environment variable such as CPU_AFFINITY being set. Such things can pin processes to particular CPU threads. You might check `os.environ` in your notebooks to see if anything suspicious is set that might do something like that.

-MinRK

On Thu, Sep 15, 2016 at 3:55 PM, Brian Novogradac <brian.no...@gmail.com> wrote:

Hello,

this is most likely a newbie question.
I am running Jupyterhub on a VM with 8vCPU and 20GB of ram. I do notice that i am only utilizing 2 out of 8 CPUs when notebooks are being spawned.

I may be missing something but I am trying to figure out why jupyterhub is not accessing the remaining CPUs.

--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.

MinRK

unread,

Oct 6, 2016, 1:57:55 PM10/6/16

to Project Jupyter

On Thu, Oct 6, 2016 at 4:04 PM, Brian Novogradac <brian.no...@gmail.com> wrote:

would i have to go through all notebooks or is there a global setting. i have approx 60 users on this system.

These variables aren't normally set, so you'll have to find out what's setting it and change it there. Presumably this is in just one place. Did you figure out what environment is causing this and where it's being set?

-Min

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.

To post to this group, send email to jup...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/9558e170-6159-46b4-8b9d-c7f62ca38d44%40googlegroups.com.

Reply all

Reply to author

Forward