Hi everybody,
The team working on web archive crawl data download automation has concluded sprint 2 of its work cycle, and is pleased to announce the availability of an associated demo video:
https://www.youtube.com/watch?v=Zu_cm2IzzEc. In this sprint, we largely moved out of onboarding to web archiving workflows and codebases into architecture planning, interaction with and exploration of the Archive-It WASAPI data transfer API, and some initial coding.
Features completed this sprint:
* Code is aware of values specified in a properties file
* Ability to retrieve and parse first page of JSON output from Archive-It WASAPI endpoint
Look forward to more exciting features in the next installment of the web archive crawl data download automation work cycle!
~Nicholas