Re: [islandora] Digest for islandora@googlegroups.com - 2 updates in 2 topics

84 views
Skip to first unread message

McFate, Mark

unread,
Aug 4, 2015, 7:47:51 AM8/4/15
to isla...@googlegroups.com
Hello Brad.

I have such a drush command in my script module.  It works nicely but I have yet to share it with the community because of some embedded credentials that first need to be generalized.  It currently won’t allow object selection based solely on “collection” but I’m working on that right now.  At the moment you can only isolate/select objects based on PID namespace. 

Since we’re both here at the Islandora Conference I would be happy to share this work with you as I replace those credentials and build a more robust object selector.

—Mark McFate
    Grinnell College


From: <isla...@googlegroups.com> on behalf of "isla...@googlegroups.com" <isla...@googlegroups.com>
Reply-To: "isla...@googlegroups.com" <isla...@googlegroups.com>
Date: Tuesday, August 4, 2015 at 4:36 AM
To: Digest recipients <isla...@googlegroups.com>
Subject: [islandora] Digest for isla...@googlegroups.com - 2 updates in 2 topics

Brad Spry <brad...@gmail.com>: Aug 03 12:48PM -0700

Searching for a command-line, hopefully drush-based way to regenerate child
derivatives on a specified list of multiple objects or for an entire
collection.
 
Web-based method: Collection > Manage > Collection > Regenerate child
derivatives
 
The web-based method is susceptible to timeout and error, especially AJAX
HTTP errors. This happens very frequently for large objects; web browsers
just aren't designed to hold open a connection for a very long time...
When such an error happens, the process is completely derailed...
 
Command-line methods on the other hand can be ran in the background "nohup
command &" and stay running until completion.
 
I've found a couple of couple of scripts below, testing the "co-alliance"
script, which works on a single object.
 
Question: are there are any other known, available, working solutions?
 
ryersonlibrary / regenSelectDerivatives.php
https://github.com/ryersonlibrary/islandora_scripts/blob/master/regenSelectDerivatives.php
 
co-alliance / coalliance_derivative_generation
https://github.com/co-alliance/coalliance_derivative_generation
 
 
Sincerely,
 
Brad Spry
Atkins Library
UNC Charlotte
Phil Redmon <phil....@gmail.com>: Aug 03 07:44PM

Just retested with head and this issue appears to be fixed. Thanks!
 
You received this digest because you're subscribed to updates for this group. You can change your settings on the group membership page.
To unsubscribe from this group and stop receiving emails from it send an email to islandora+...@googlegroups.com.

Nick Ruest

unread,
Aug 4, 2015, 7:50:16 AM8/4/15
to isla...@googlegroups.com
University of Manitoba (Jared Whiklo) has a drush utility[1] that I have
taken advantage of many times. Might be worth taking a look at as well.

-nruest

[1] https://github.com/uml-digitalinitiatives/uofm_maintenance_scripts

On 2015-08-04 06:55 AM, McFate, Mark wrote:
> Hello Brad.
>
> I have such a drush command in my script module. It works nicely but I
> have yet to share it with the community because of some embedded
> credentials that first need to be generalized. It currently won’t allow
> object selection based solely on “collection” but I’m working on that
> right now. At the moment you can only isolate/select objects based on
> PID namespace.
>
> Since we’re both here at the Islandora Conference I would be happy to
> share this work with you as I replace those credentials and build a more
> robust object selector.
>
> —Mark McFate
> Grinnell College
>
>
> From: <isla...@googlegroups.com <mailto:isla...@googlegroups.com>>
> on behalf of "isla...@googlegroups.com
> <mailto:isla...@googlegroups.com>" <isla...@googlegroups.com
> <mailto:isla...@googlegroups.com>>
> Reply-To: "isla...@googlegroups.com
> <mailto:isla...@googlegroups.com>" <isla...@googlegroups.com
> <mailto:isla...@googlegroups.com>>
> Date: Tuesday, August 4, 2015 at 4:36 AM
> To: Digest recipients <isla...@googlegroups.com
> <mailto:isla...@googlegroups.com>>
> Subject: [islandora] Digest for isla...@googlegroups.com
> <mailto:isla...@googlegroups.com> - 2 updates in 2 topics
>
> isla...@googlegroups.com
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__groups.google.com_forum_-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail-23-21forum_islandora_topics&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=5YPiSO4a9LKq9KVbJVGrXbSTSCG3OjVLPtECNw6qgU8&e=>
> Google Groups
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__groups.google.com_forum_-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail_-23-21overview&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=v31tswW-Pt2nwNgb-geP5P0YKxHozsgHUMjxm2zFRZs&e=>
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__groups.google.com_forum_-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail_-23-21overview&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=v31tswW-Pt2nwNgb-geP5P0YKxHozsgHUMjxm2zFRZs&e=>
>
> Topic digest
> View all topics
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__groups.google.com_forum_-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail-23-21forum_islandora_topics&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=5YPiSO4a9LKq9KVbJVGrXbSTSCG3OjVLPtECNw6qgU8&e=>
>
>
> * command-line (drush-based) way to regenerate derivitives?
> <#group_thread_0> - 1 Update
> * islandora_solr_metadata <#group_thread_1> - 1 Update
>
> command-line (drush-based) way to regenerate derivitives?
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__groups.google.com_group_islandora_t_697e837732567254-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=uAbTJ91Ine1UKVtG1l8sCiS5o0Y_Z5lwCp72NcNDu50&e=>
> Brad Spry <brad...@gmail.com <mailto:brad...@gmail.com>>: Aug 03
> 12:48PM -0700
>
> Searching for a command-line, hopefully drush-based way to regenerate child
> derivatives on a specified list of multiple objects or for an entire
> collection.
>
> Web-based method: Collection > Manage > Collection > Regenerate child
> derivatives
>
> The web-based method is susceptible to timeout and error, especially AJAX
> HTTP errors. This happens very frequently for large objects; web browsers
> just aren't designed to hold open a connection for a very long time...
> When such an error happens, the process is completely derailed...
>
> Command-line methods on the other hand can be ran in the background "nohup
> command &" and stay running until completion.
>
> I've found a couple of couple of scripts below, testing the "co-alliance"
> script, which works on a single object.
>
> Question: are there are any other known, available, working solutions?
>
> ryersonlibrary / regenSelectDerivatives.php
> https://github.com/ryersonlibrary/islandora_scripts/blob/master/regenSelectDerivatives.php
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_ryersonlibrary_islandora-5Fscripts_blob_master_regenSelectDerivatives.php&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=jFVahnCACnZHL7p8OCZXIF-w5S2WZXCGcx5ADpmfu2c&e=>
>
> co-alliance / coalliance_derivative_generation
> https://github.com/co-alliance/coalliance_derivative_generation
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_co-2Dalliance_coalliance-5Fderivative-5Fgeneration&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=ANepO7GY4PTiF763dNwXMJOtFkCnkg9KJ2-y41qxCCk&e=>
>
>
> Sincerely,
>
> Brad Spry
> Atkins Library
> UNC Charlotte
>
> Back to top <#digest_top>
> islandora_solr_metadata
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__groups.google.com_group_islandora_t_777ae58295f6209a-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=DFL0uW03LgN4Zrqwa-PmwHQb7DztnITAc4u5YQY38xM&e=>
> Phil Redmon <phil....@gmail.com <mailto:phil....@gmail.com>>: Aug
> 03 07:44PM
>
> Just retested with head and this issue appears to be fixed. Thanks!
>
> Back to top <#digest_top>
> You received this digest because you're subscribed to updates for this
> group. You can change your settings on the group membership page
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__groups.google.com_forum_-3Futm-5Fsource-3Ddigest-26utm-5Fmedium-3Demail-23-21forum_islandora_join&d=BQMBaQ&c=HUrdOLg_tCr0UMeDjWLBOM9lLDRpsndbROGxEKQRFzk&r=PQglHQe-EzyZqJOuOVcmU0OZ6bg-89msSPuqyNlQr28&m=GtGv2LrF3YwGgOwpACNUO_XC74a99xatmQiaB3k5e8g&s=P35pYe3tNkls4MN6QX3CbYs3qQYjRuUv3cJQTDcW4hY&e=>.
> To unsubscribe from this group and stop receiving emails from it send an
> email to islandora+...@googlegroups.com
> <mailto:islandora+...@googlegroups.com>.
>
> --
> For more information about using this group, please read our Listserv
> Guidelines: http://islandora.ca/content/welcome-islandora-listserv
> ---
> You received this message because you are subscribed to the Google
> Groups "islandora" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to islandora+...@googlegroups.com
> <mailto:islandora+...@googlegroups.com>.
> Visit this group at http://groups.google.com/group/islandora.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/islandora/D1E61F83.5540%25mcfatem%40grinnell.edu
> <https://groups.google.com/d/msgid/islandora/D1E61F83.5540%25mcfatem%40grinnell.edu?utm_medium=email&utm_source=footer>.
> For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages