Building a scheduler for notebook based reports

[Tim Paine]

For anyone interested, I'm working on an application to help schedule notebooks-as-reports using papermill and apache airflow. Its not ready for general use yet but if you're interested in using it in the future or helping build it out feel free to reach out. https://github.com/timkpaine/paperboy

[Chris Holdgraf]

Super cool! FYI I cross-posted your message in the JupyterHub discourse pilot here: https://discourse.jupyter.org/t/scheduling-jupyter-notebook-reports-with-paperboy/96

[Luciano Resende]

Very interesting, and something I had in mind for some projects I have
in mind... will definitely look into it.

On Mon, Nov 5, 2018 at 2:06 PM Tim Paine <t.pai...@gmail.com> wrote:
>
> For anyone interested, I'm working on an application to help schedule notebooks-as-reports using papermill and apache airflow. Its not ready for general use yet but if you're interested in using it in the future or helping build it out feel free to reach out. https://github.com/timkpaine/paperboy
>

> --
> You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.
> To post to this group, send email to jup...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/c3f074a6-e868-4ff6-b675-05f33fd53d49%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



--
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/

[Samuel Lelièvre]

Mon 2018-11-05 23:06:17 UTC+1, Tim Paine:

For anyone interested, I'm working on an application to help schedule notebooks-as-reports using papermill and apache airflow. Its not ready for general use yet but if you're interested in using it in the future or helping build it out feel free to reach out. https://github.com/timkpaine/paperboy

Note the related discussion at

https://groups.google.com/d/topic/jupyter-research-facilities/JmZe4NseB_I/discussion 

[Christophe Duong]

Hi all,

I am working on a similar tool as well:
    Jupyter + Airflow + Papermill + Docker = http://www.aiscalate.com

It's still at an early stage, but I would love to get feedback too!

Thanks,
Chris

[Matthew Seal]

Really neat to see these projects popping up using these tools. Let me know if there's anything on the papermill side (how-to or functional) that I can help with. We're decently responsive on the github issues / PRs as well.

Best,

Matt

--

You received this message because you are subscribed to the Google Groups "Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jupyter+u...@googlegroups.com.
To post to this group, send email to jup...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/52c43e83-3800-448d-8c50-abb2ba903930%40googlegroups.com.

[Tony Hirst]

PayPal's PPExtensions is supposed to include a scheduler (uses Apache Airflow) "soon"...

https://ppextensions.readthedocs.io/en/latest/ppextensions-scheduler/scheduler/

A cynic would say they made the announcement about the open source goodness of these extensions for the PR, without having to actually deliver. But that would be churlish, right?

--tony

[Tim Paine]

Looks interesting, if a bit simple. Integrates with the old notebook ui for submitting notebook execution (with nbconvert) to a local airflow instance:

https://github.com/paypal/PPExtensions/pull/50/commits/e13355d7d35c754338f3a1c43b24dd726cc9f785#diff-e8cbf5f1c6d66d6348a9d7bcbc03c41d

https://github.com/paypal/PPExtensions/pull/50/commits/e13355d7d35c754338f3a1c43b24dd726cc9f785#diff-0f0f8b8c636f129f831685e3c25cba0d