Resume training of neural network in the cloud using jupyter notebooks

32 views
Skip to first unread message

SWAPAN JAIN

unread,
Dec 27, 2017, 11:47:40 PM12/27/17
to Project Jupyter

I was training a neural network using GPU in the cloud.In the middle of my training,my Internet was disconnected.Now I had saved a previous version of the notebook.Even after being connected to the kernel, I cannot see any new output in my saved version of the notebook. Will I have to train again?

Roland Weber

unread,
Dec 28, 2017, 1:44:33 AM12/28/17
to Project Jupyter
Yes, you probably have to train again.

The kernels don't know about notebooks. They send their output on channels, where it is received by the browser, and stored into the notebook you are working with. If the browser doesn't receive the output, it will not be stored.

If your kernel is still running, then the results of your training may still be in the memory of the kernel. Then you could try to add another code cell which prints the results of the previous training. But this will only work if the same kernel instance is still running, not if you're starting a new kernel instance from the same notebook.

hope that helps,
  Roland
Reply all
Reply to author
Forward
0 new messages