Load-balancing Jupyter kernels on Windows

52 views
Skip to first unread message

Pav A

unread,
Jun 26, 2017, 1:28:14 PM6/26/17
to Project Jupyter
JupyterHub and tmpnb are unix only, so, unfortunately these are not an option.

What would be the best approach to load-balance Jupyter kernels on Windows? A reverse proxy to a collection of host/ports is trivial, but the objective is to channel http and ws traffic pertaining to a particular kernel to a particular host.

What's the best way to hook it up to kernel_gateway/nb2kg?

Dave Hirschfeld

unread,
Jun 27, 2017, 6:16:59 PM6/27/17
to Project Jupyter
JupyterHub might [1]_ require *nix but that doesn't mean it's can't spawn containers on remote Windows servers - in fact that's exactly what I'm doing now. I haven't gotten around to the load-balancing part but I assume that could be done with Docker Swarm or I'm considering Windows HPC for its ability to burst to Azure.


.. [1] Having discussed with @minrk it's quite possible if your'e not using the default linux only authentication that you can run JupyterHub on Windows. I'm using the LDAP authenticator so I'll be giving that a go to avoid the hassle of spinning up an Ubuntu VM on Hyper-V.


HTH,
Dave

Denis Akhiyarov

unread,
Jun 29, 2017, 12:44:35 PM6/29/17
to Project Jupyter
Dave, can you share basic instructions how you achieved this hybrid Linux/Windows jupyterhub setup?

Another way would be to rely on WSL in Windows 10 completely:

Reply all
Reply to author
Forward
0 new messages