Re: [jupyter] Any solutions to work with hundreds of notebooks?

73 views
Skip to first unread message

Matthias Bussonnier

unread,
Jun 9, 2017, 7:59:58 PM6/9/17
to jup...@googlegroups.com
Hi Vadim,

Apologies your mail was flagged as pending approval to be posted (I'm
not sure why) so lingered a bit in limbo until today.

I would have a look at https://github.com/jupyter-incubator/ and in
particular https://github.com/jupyter-incubator/contentmanagement
you should find extension for the classic notebook server that allow
indexing (using woosh IIRC) and some other fancy stuff.

Pgcontent (https://github.com/quantopian/pgcontents) also allow to
store notebook on Postgresql, and I'm going to guess there are way to
query it.

Hope that gives you a starting point.

Cheers,
--
M

On Wed, Jun 7, 2017 at 5:17 AM, Vadim Markovtsev <va...@sourced.tech> wrote:
> Hello,
>
> my team reached the point at which we've got hundreds of Jupyter notebooks
> and we started to suffer. Searching for the right one is hell. 90% are
> unique and diverse and cannot be organized into directories.
>
> Do you know anything which allows to catalog the notebooks; index them;
> provide a nicer way to access them than the linear list?
>
> --
> You received this message because you are subscribed to the Google Groups
> "Project Jupyter" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jupyter+u...@googlegroups.com.
> To post to this group, send email to jup...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/jupyter/f4c5f3e6-d2de-4957-b0c5-fe0cd422252a%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

Björn Johansson

unread,
Jun 10, 2017, 4:34:04 AM6/10/17
to Project Jupyter
Hi, I have no solution for you, but I have experienced a related problem.
I use linux on my computer and I have recently contacted the gnome tracker people
https://wiki.gnome.org/Projects/Tracker on their mailing list about extending to index jupyter nbs.

Perhaps if you also post on the tracker list, things will happen sooner. They suggest writing an extractor for jupyter nbs, but these are written in C which I don't know.

Recoll should also be able index nbs with modification https://www.lesbonscomptes.com/recoll/

/bjorn

Thomas Kluyver

unread,
Jun 12, 2017, 8:32:40 AM6/12/17
to Project Jupyter
On 10 June 2017 at 09:34, Björn Johansson <bjor...@gmail.com> wrote:
I use linux on my computer and I have recently contacted the gnome tracker people
https://wiki.gnome.org/Projects/Tracker on their mailing list about extending to index jupyter nbs.

It may be worth opening an issue to request ipynb as a supported format? They link to this list of issues requesting support for new formats, which doesn't have ipynb in at present:

https://bugzilla.gnome.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Supported%20Formats&product=tracker

I couldn't see any obvious docs on how to create a new extractor (is an extractor different from a miner?), but maybe I'm missing something.

Thomas
Reply all
Reply to author
Forward
0 new messages