Prototype bulkloader

8 views
Skip to first unread message

Aaron Steele

unread,
Aug 1, 2011, 6:55:59 PM8/1/11
to vertnet-d...@googlegroups.com
We just pushed the prototype bulkloader to GitHub.

Weeeeeell, it doesn't actually bulkload yet, but it does the first
part which is calculating and reporting CSV file deltas. Huh? If this
sounds interesting, here's some initial documentation:
https://github.com/VertNet/Software/wiki/Prototype-Bulkloader

If anyone (that means John and Laura in particular) wants to start
playing or breaking this thing, it would be great. You can submit
issues here:
https://github.com/VertNet/Software/issues/new

Thoughts?

P.S. We also put up some initial documentation for the prototype search API:
https://github.com/VertNet/Software/wiki/Prototype-Search-API

Message has been deleted

Aaron Steele

unread,
Aug 5, 2011, 5:58:21 PM8/5/11
to vertnet-d...@googlegroups.com
Update:

In addition to calculating CSV deltas and generating delta reports, the vn.py script now supports bulkloading to the App Engine datastore. The code has been pushed and the wiki page has been updated with descriptions and example usage:
https://github.com/VertNet/Software/wiki/Prototype-Bulkloader

Thoughts? Comments? Feel free to break it and submit issues here:

Reply all
Reply to author
Forward
0 new messages