Re: [okfn-labs] Github webhooks and automating creating Data APIs for data packages in Github

20 views
Skip to first unread message

sheila miguez

unread,
Mar 19, 2014, 12:59:21 PM3/19/14
to Rufus Pollock, openscienc...@googlegroups.com, okfn-labs
This is an intriguing idea, so I answer yes to A!

For B. I believe that some of the people in the Open Science Framework group have created a github webhook, at least in the case for their hosting of the Open Science Collaboration blog, and perhaps that code is available somewhere.


On Wed, Mar 19, 2014 at 7:35 AM, Rufus Pollock <rufus....@okfn.org> wrote:
Hi All,

I have a User Story as follows:

As a Data Wrangler (Rufus!) I want to push my tabular data package to github and have it automatically have a Data API for that data package created/updated so that I have a nice API I can use in my app (or JS visualization or ...)

Context

I'm currently really liking the work flow of pushing Data Packaged Datasets to Github (see growing set of "Core" datasets at https://github.com/datasets plus personal ones like hard drive prices). However, it would be really nice to get a proper Data API. CKAN, and hence the DataHub, now has a nice DataStore with a rich Data API which we could use. There is even a nice standalone webapp for automatically pulling data into the DataStore - https://github.com/ckan/datapusher

(Note: this would also address the Data API issue in the Frictionless Data roadmap)

Plan

Rather than create a new Data API webapp I thought the best thing would be create a small webapp that a github webhook can connect to. The app will take care of then pushing the updated data to the DataStore.

Question

A. Does this sound sensible

B. Do folks have any thoughs and experience on build github webhook apps (especially in nodejs or python)

All the best,

Rufus


_______________________________________________
okfn-labs mailing list
okfn...@lists.okfn.org
https://lists.okfn.org/mailman/listinfo/okfn-labs
Unsubscribe: https://lists.okfn.org/mailman/options/okfn-labs




--
sheila
Reply all
Reply to author
Forward
0 new messages