newbie do server clean up if user exits browser instead of shutting notebook down

[Andy Davidson]

I started using IPython notebook about 2 years ago with spark (spark now uses Jupiter). Notebooks ROCK!

I now need to create a interactive dashboard for my customers. It will make it easy for them to select data and do some graphing. I currently use the standard notebook server and am starting to look into the multiuser server.

In general spark can consume huge amounts of resource. I want to make sure users do not accidentally create a “denial of service attack” by forgetting to shutdown notebooks

Does the server do any kind of automatic clean up?

Kind regards

Andy

[Jonathan Frederic]

I don't think the server does itself, there may be a user contributed extension to do that.  Tmpnb closes entire notebook servers after a given timespan of idleness

--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.
To post to this group, send email to jup...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/D30DB082.34324%25Andy%40SantaCruzIntegration.com.
For more options, visit https://groups.google.com/d/optout.

[Andy Davidson]

Thanks Jon

I image this is a common problem for anyone that runs a multiuser notebook server. Spark jobs may run for a long time and use an enormous amount of cluster resources

Andy

I’ll cross post on the spark mail list and see what they have to say  

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAAoBLw1_4pGmpFB4xyHSRT_2wk%2BTNE-_t3Dxd4tf7xU3gXFxFA%40mail.gmail.com.

[Dan Allan]

We have had this problem in the JupyterHub at Brookhaven National Lab as well. Users come and go, and many of them don't figure out that they need to shut down their kernels.

As you may know, there is a JupyterHub configuration setting that allows admins to enter other users' servers and shut down kernels selectively without shutting down their servers entirely. Depending on the ratio of users to admins, this might be a better solution than an automated shut down, which risks interrupting important work.

Dan

[Andy Davidson]

Hi Dan

Thanks. Do you think it would be possible to automate this some how? I would hate to have to hire someone to deal with this issue.

Andy

P.s. I did not receive a reply from the spark mail list

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/071ca88a-5820-4653-98ec-b3476682514a%40googlegroups.com.

[Thomas Kluyver]

Jupyterhub has an API so scripts can do things like this. I know there's an example somewhere of a daemon/cron job that talks to Jupyterhub and kills notebook servers that have been inactive for more than a set time. One of Jess, Kyle or Min should be able to point you to this.

Thomas

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/D31077EC.349A1%25Andy%40SantaCruzIntegration.com.

[MinRK]

The cull-idle-servers script is in the JupyterHub examples. If you want to cull idle kernels of single-user servers, that’s more work since this information is not tracked at a kernel level.

-MinRK

​

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAOvn4qibsvf8P8TUXmc-kanMGtiEvE%2BjD9N5eJTp54K%3DODy6SQ%40mail.gmail.com.

[Andy Davidson]

Thanks

Andy

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAHNn8BWCm%3Du4yMF284ovPH0hWZ0rSh6JZ5wL8cTJ5QpxRA_5_Q%40mail.gmail.com.

[Jafar Sharif]

Hi Min,

     I have created a config file to cull the kernels that are idle for more than one hour. But it is not killing the notebooks that are idle for more than one hour. Attaching the config file.

[Jafar Sharif]

Hi Andy,

        Is your problem got solved??. Please let me know the way i am facing the same issue.