Jupyter Weekly Summary (2017, week 29)

[Matthias Bussonnier]

Tuesday, July 25, 2017

Hello everyone, welcome to the 29th edition of the Jupyter Weekly summary. You can find today’s short video here and the archive versions of these summaries here. As usual I attempt to make a meeting summary when possible, but I’m not always capable. I’ll appreciate when I can’t for someone to take over.

The link to the raw notes can be found here.

Weekly news by organization

• IPython
• Jupyter
• JupyterLab
• Jupyter-widgets
• JupyterHub

Note: weekly news is available via the Dropbox Paper files or stored in this news repo.

IPython

Nothing much, Matthias would like to have time to review a few PR that have been sitting for a month and release a minor of 5.x and 6.x as we had a couple of bug fixes.
We closed a lot of old issues down from 1000+ issues to about 900, if we were overzealous please say so

nbconvert (M)

• added a traitlet to specify the browser opened by the serve postprocessor
• updating mistune, works better with raw html.
• Please look at switching all mathjax to use the inline grammar and what mistune consider an HTML block.
  • https://github.com/jupyter/nbconvert/pull/611
• PR on notebook (classic; lab was already merged) to use labels (but not numbers) on equations. It was not possible to rerender equations because of uniquness of labels. it may break some extensions
  • We are looking at equation numbering, some O(n^2) issue with rerendering multiple cells of a notebook still need to be figured out.

Jupyter markdown spec (M)

• Trying to move forward on writing a roadmap and list of issues to work on, hopefully to get someone new work on it.
• Especially if someone knows how to get the DOM structure rendered in the frontend from Python. Brian say we already had a way of doing this via injecting a cell at the end of a notebook it’s not purely in Python but does the Job.

Documentation (Jessica)

• Collected notes from speakers
• Licenses are now under control
• New feature in process: profiles for talks. A “profile“ is a set of notebook and resources that are useful for a given demo woudl be nice to package together.
• Fernando and Brian are wondering if it is possible to have a binder download other assets that are not in the repo
  • Could use this to make these profiles binders
  • Matthias, Min, suggest a Docker File.
  • Carol suggests we look at software carpentry
  • Brian ask if we can get several Dockerfiles per repo. It’s possible but not available right now.

Notebook (Grant)

• Grant is closing out outstanding issues marked with 5.1 milestone
• Planning on releasing a 5.1 release candidate by EOW
• Grant is planning on doing SERIOUS ISSUE TRIAGE on the notebook repo after 5.1 is released

JupyterLab (Steve, Darian)

• Released version 0.26 last week with backend support for user settings and some improvements to file type handling.
• Ongoing refactor of the notebook models and views, closing in on a solution that blends the observable model we had been using with a redux-like pattern.
• Adding a client-side build service to run the build on the server and prompt the user to refresh when it has finished. jupyterlab/jupyterlab#2714
• The fasta extension has been moved to the JupyterLab organization
• Cameron overhauled our Dark Theme: https://github.com/jupyterlab/jupyterlab/pull/2737

Notebook format (Brian)

Brian talked with Kyle last week, about source-hidden and outputs-hidden metadata. It had stalled on bigger questions (where should we put metadata). These 2 fields were blocking from JupyterLab/Nteract so this was merge as is, and we are now refocusing on the wider metadata questions.

• It might lead at some point to major notebook version bump.
• Discussion on how this affects frontends is now here https://github.com/jupyterlab/jupyterlab/issues/2740

Jupyter widgets (Jason)

We released ipywidgets 7.0 beta 2, along with all the supporting packages. The changelog summarizes what’s new. Please try it out and tell us of any problems you notice:

• pip install --pre ipywidgets, then:
• Classic notebook: jupyter nbextension enable --``sys-prefix --``py widgetsnbextension
• JupyterLab 0.26: jupyter labextension install @jupyter-widgets/jupyterlab

Our hope is to issue a 7.0 release candidate within a week, wait a few more days, and then release 7.0 final. We also had a successful 4-hour tutorial at Scipy, and we had several people work on ipywidgets in the Scipy sprint.

Services (Peter)

• docker-stacks images are now building smoothly on Docker Cloud.
• Min submitted https://github.com/jupyter/nbviewer/pull/709 to Python package nbviewer for publication to pypi.
• There’s been a steady trickle of issues against tmpnb, and the docker image used there hasn’t been updated in forever. We should use the notebook 5.1 release as a lever to do an update.
  • Maybe https://github.com/jupyter/docker-demo-images can be automated on docker cloud too?

JupyterHub (Min, Carol)

• Working on scaling tests for JupyterHub. Finding hotspots and fixing them. Working with at least 2k concurrent active users per Hub.
• Carol’s done a lot of great refactoring of the docs.

Conferences and Workshops

• PyBay, August 11-13 http://pybay.com/
  • Matthias will be there
• PyCon Poland, August 17-20 https://pl.pycon.org/2017/index_en.html
• Strata NYC, Late Sept https://conferences.oreilly.com/strata/strata-ny
• ODSC West, https://www.odsc.com/california
  • Matthias has submitted a talk.
• PlotCon NYC, Nov
• Is anyone attending Supercomputing later this year? If so, please submit a Jupyter BOF by the end of this month.
• Science Gateways webinar went well. Repo resource page https://github.com/willingc/2017-science-gateways/blob/master/resources/resources.md

JupyterCon

• A little under 30 days away! Reminder to book flights.
• We will have a Jupyter and NumFOCUS booth at the conference
• Don’t forget about the Sprint on Saturday! 9am-5pm at the conference hotel. Please email Kyle and Jason if you’d like to be a sprint leader for a particular project. register with the eventbrite.

Legal/Governance

• Min’s trademark policy is merged
  • https://github.com/jupyter/governance/blob/master/trademarks.md
  • This may still mention that we are waiting for the Jupyter trademark, which need to be updated now that we actually have it.
• Apache Foundation has banned usage of react.js and other projects with the Facebook license+patent grant.
  • as a result RocksDB changed their license!
  • Discussion about license change of react.js itself.
  • https://github.com/facebook/react/issues/10191
• We continue to hear friction about this issue
• We are using react.js in some lab extensions (not shipped in core) , would like to use in phosphor/jlab itself

[ ] M could use some code reviews on nbconvert: https://github.com/jupyter/nbconvert/pull/611
[ ] Keep plugging away at notebook - we’re still trying to get to a 5.1 release

Releases for this week

• oauthenticator 0.6

To be released ‘soon’

• notebook 5.1
• jupyterhub 0.8
• jupyter widgets 7 , please install the current preview

That’s all

That’s all for this week. Thanks for following, and looking foward for your contribution.

​

-- 

Matthias for the Jupyter Team. 

[Big Stone]

Do we need to have "npm" for "jupyter labextension install @jupyter-widgets/jupyterlab" to work ?

That may be a problem on Windows

[Steven Silvester]

We use the executable `npm.com` on Windows, is that what you meant Big Stone?

Regards,

Steve

[Big Stone]

Would it be possible jupyterlab wheel to provide all is plugins, so user's pc doesn't need to have npmjs.com nor nodejs on the pc ?

[Jason Grout]

JupyterLab will come with a standard set of plugins precompiled, so to run the stock JupyterLab, the user won't need npm or node installed. To install *extra* plugins, the user will need node/npm installed for now. Note that if the user is using conda, npm is packaged for conda, so it *should* be relatively easy to get.

Thanks,

Jason

On Fri, Jul 28, 2017 at 6:12 AM Big Stone <stone...@gmail.com> wrote:

Would it be possible jupyterlab wheel to provide all is plugins, so user's pc doesn't need to have npmjs.com nor nodejs on the pc ?

--
You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.
To post to this group, send email to jup...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/c2a6c3ff-9816-4657-aeb0-1bd1ef5b877a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Jason Grout]

(I should emphasize that JupyterLab *already* comes with a standard list of plugins. pip or conda installing jupyterlab and then running "jupyter lab" does not require npm or node to be installed.)

Jason

[Jason Grout]

To answer your specific question about the widgets extension: right now the widgets extension is not distributed as an included extension, which means you will need node/npm to install it. We have considered making the jupyter widgets extension one of the standard extensions. I take it your email is a vote for including it as a standard extension?

Jason

[Big Stone]

Yes, it is a vote for including it as standard extension.

[sp...@draves.org]

yes please, include the widgets extension by default.

To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+unsubscribe@googlegroups.com.

To post to this group, send email to jup...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/87a9eec2-0bdb-44e7-a8a7-fcc0f6cf256f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

BeakerNotebook.com

ScottDraves.com

@Scott_Draves

[Big Stone]

I really feel having to use npmjs would be an unsustainable pain. First try gives :

C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\scripts>jupyter labextension install @jupyter-widgets/jupyterlab

> npm.cmd pack @jupyter-widgets/jupyterlab

npm ERR! Windows_NT 10.0.15063

npm ERR! argv "C:\\WinPython\\basedir36\\buildQt5\\winpython-32bit-3.6.x.0\\tools\\node86\\node.exe" "C:\\WinPython\\basedir36\\buildQt5\\winpython-32bit-3.6.x.0\\tools\\node86\\node_modules\\npm\\bin\\npm-cli.js" "pack" "@jupyter-widgets/jupyterlab"

npm ERR! node v6.11.1

npm ERR! npm  v3.10.10

npm ERR! code E404

npm ERR! 404 Not found : @jupyter-widgets/jupyterlab

npm ERR! 404

npm ERR! 404  '@jupyter-widgets/jupyterlab' is not in the npm registry.

npm ERR! 404 You should bug the author to publish it (or use the name yourself!)

npm ERR! 404

npm ERR! 404 Note that you can also install from a

npm ERR! 404 tarball, folder, http url, or git url.

npm ERR! Please include the following file with any support request:

npm ERR!     C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\share\jupyter\lab\extensions\temp\npm-debug.log

Traceback (most recent call last):

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\runpy.py", line 193, in _run_module_as_main

    "__main__", mod_spec)

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\runpy.py", line 85, in _run_code

    exec(code, run_globals)

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\Scripts\jupyter-labextension.EXE\__main__.py", line 9, in <module>

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyter_core\application.py", line 267, in launch_instance

    return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs)

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\traitlets\config\application.py", line 658, in launch_instance

    app.start()

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\labextensions.py", line 167, in start

    super(LabExtensionApp, self).start()

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyter_core\application.py", line 256, in start

    self.subapp.start()

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\labextensions.py", line 57, in start

    for arg in self.extra_args]

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\labextensions.py", line 57, in <listcomp>

    for arg in self.extra_args]

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\commands.py", line 107, in install_extension

    run([get_npm_name(), 'pack', extension], cwd=target, logger=logger)

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\commands.py", line 71, in run

    raise error

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\site-packages\jupyterlab\commands.py", line 67, in run

    return check_output(cmd, **kwargs)

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\subprocess.py", line 336, in check_output

    **kwargs).stdout

  File "C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\python-3.6.2rc2\lib\subprocess.py", line 418, in run

    output=stdout, stderr=stderr)

subprocess.CalledProcessError: Command '['npm.cmd', 'pack', '@jupyter-widgets/jupyterlab']' returned non-zero exit status 1.

C:\WinPython\basedir36\buildQt5\winpython-32bit-3.6.x.0\scripts>

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/87a9eec2-0bdb-44e7-a8a7-fcc0f6cf256f%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

BeakerNotebook.com

ScottDraves.com

@Scott_Draves

[Jason Grout]

That error (package not found) is because you gave the wrong package name. It's:

jupyter labextension install @jupyter-widgets/jupyterlab-manager

Jason

[Big Stone]

with   "jupyter labextension install @jupyter-widgets/jupyterlab-manager" , it works. 

 

npm did install its things in "C:\Users\[my profile]\AppData\Roaming\npm-cache".

Do you know how to define a better place, (that can be moved) , that both npm and jupyterlab-manager would follow ?

[Jason Grout]

I think you can safely delete the npm cache: https://docs.npmjs.com/cli/cache. I think that's what `npm cache clean` will do for you.

Jason

[Big Stone]

ah, ok.... but where did land on my disk the usefull result of this "jupyter labextension install @jupyter-widgets/jupyterlab-manager" action ? 

[Jason Grout]

"jupyter lab path" gives you the directory that jupyterlab puts those sorts of things. The package will be in the extensions/ subdirectory, and then it is built in another subdirectory.

Thanks,

Jason

[Big Stone]

super, it lands in an nice place. Thanks a lot for your help, Jason.

[Big Stone]

is the version of nodejs important ? can it be nodejs 32 bit for python 64 bit ?

[Big Stone]

long path in nodejs are a sort of a problem for windows users :

C:\\WinPython\\basedir36\\Tools\\nodejs\\node_modules\\npm\\node_modules\\npm-registry-client\\node_modules\\npmlog\\node_modules\\gauge\\node_modules\\string-width\\node_modules\\is-fullwidth-code-point\\node_modules\\number-is-nan', 'C:\\Winpython\\basedir36\\buildSlim\\winpython-32bit-3.6.x.0\\tools\\nodejs\\node_modules\\npm\\node_modules\\npm-registry-client\\node_modules\\npmlog\\node_modules\\gauge\\node_modules\\string-width\\node_modules\\is-fullwidth-code-point\\node_modules\\number-is-nan', "[WinError 206] Nom de fichier ou extension trop long

[Hai Nguyen]

+100 from me too. 

Although you and others explain why need npm on github issue but I still feel requiring npm is not very persuasive.

Hai

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAPDWZHw-2CHHwqii5S2-kQ6sYtPZXuVHt9FR%2BTyFm_gC8r-JtA%40mail.gmail.com.