command-line (drush-based) way to regenerate derivitives?

[Brad Spry]

Searching for a command-line, hopefully drush-based way to regenerate child derivatives on a specified list of multiple objects or for an entire collection.

Web-based method: Collection > Manage > Collection > Regenerate child derivatives

The web-based method is susceptible to timeout and error, especially AJAX HTTP errors.   This happens very frequently for large objects; web browsers just aren't designed to hold open a connection for a very long time...  When such an error happens, the process is completely derailed...

Command-line methods on the other hand can be ran in the background "nohup command &" and stay running until completion.

I've found a couple of couple of scripts below, testing the "co-alliance" script, which works on a single object. 

Question: are there are any other known, available, working solutions?

ryersonlibrary / regenSelectDerivatives.php
https://github.com/ryersonlibrary/islandora_scripts/blob/master/regenSelectDerivatives.php

co-alliance / coalliance_derivative_generation
https://github.com/co-alliance/coalliance_derivative_generation


Sincerely,

Brad Spry
Atkins Library
UNC Charlotte

[Jared Whiklo]

Hi Brad,

I'm hoping you saw the previous responses, for whatever reason they did seem to come back to this topic. They are here:

https://groups.google.com/d/topic/islandora/BMJ8i-CDGvQ/discussion

Regarding Nick's post about our (the University of Manitoba's) maintenance scripts[1]. I used this to generate the missing derivatives for a bunch of newspapers (30K-40K). 

The command does the derivative regeneration as a two step process. First is to fill a queue with the PIDs[2] then you execute against that queue[3].

It is *not* currently designed to handle regenerating existing derivatives, but I have been wanting to change this. 

I think it might be easy enough to modify the pre-process stage to load the queue with an object containing the PIDs and then you could add a --force argument (like this one[4]) and use that in the worker function here[5].

I haven't had time but if you want to fork the repo and do any of the above (*wink* *wink*) I love to add this to our tools.

cheers,

jared

[1] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts
[2] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts/blob/7.x/uofm_maintenance.drush.inc#L144-L168

[3] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts/blob/7.x/uofm_maintenance.drush.inc#L169-L189
[4] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts/blob/7.x/uofm_maintenance.drush.inc#L130-L132

[5] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts/blob/7.x/uofm_maintenance.module#L116

[Brad Spry]

>>>I'm hoping you saw the previous responses, for whatever reason they did seem to come back to this topic.

Yes, it was very odd how replies ended up in another thread...

Regardless, I found them and am so thankful for your replies! Thank you Mr. McFate and Mr. Whiklo!


<B