Synctool suggestions

[David Chandek-Stark]

A couple of suggestions for improvements to the sync tool:

- Fast exit when user cannot write to the space.  Currently the tool seems to only emit a WARN log message, at least during the startup phase, and continue trying.

- The directory walker should not descend into directories that match a pattern in the exclude file.  We have an excluded directory (that happens to be a symlink) that is quite deep and looks like it is going to take hours to walk.

Thanks,

David

[Bill Branan]

Hi David,

Thanks for reporting these issues, I've created the following Jira tickets to track them:
https://jira.duraspace.org/browse/DURACLOUD-1063
https://jira.duraspace.org/browse/DURACLOUD-1064

best,

Bill

--
You received this message because you are subscribed to the Google Groups "DuraCloud Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to duracloud-users+unsubscribe@googlegroups.com.
To post to this group, send email to duracloud-users@googlegroups.com.
Visit this group at https://groups.google.com/group/duracloud-users.
For more options, visit https://groups.google.com/d/optout.

[David Chandek-Stark]

Thanks, Bill.  I have another suggestion. :)

- Print synctool initial "status" screen (where it shows the sync config parameters) earlier -- perhaps before any actual syncing happens?  On large file sets it takes a very long time to appear (if ever?).  In fact, on one recent run of an initial sync (jumpstart) that ended with an OOM error over 150K files were synced and the initial status had never appeared.

Thanks,

David

On Thursday, September 1, 2016 at 9:38:36 AM UTC-4, Bill Branan wrote:

Hi David,

Thanks for reporting these issues, I've created the following Jira tickets to track them:
https://jira.duraspace.org/browse/DURACLOUD-1063
https://jira.duraspace.org/browse/DURACLOUD-1064

best,

Bill

On Wed, Aug 31, 2016 at 6:00 PM, David Chandek-Stark <dchand...@gmail.com> wrote:

A couple of suggestions for improvements to the sync tool:

- Fast exit when user cannot write to the space.  Currently the tool seems to only emit a WARN log message, at least during the startup phase, and continue trying.

- The directory walker should not descend into directories that match a pattern in the exclude file.  We have an excluded directory (that happens to be a symlink) that is quite deep and looks like it is going to take hours to walk.

Thanks,

David

--
You received this message because you are subscribed to the Google Groups "DuraCloud Users" group.

To unsubscribe from this group and stop receiving emails from it, send an email to duracloud-use...@googlegroups.com.
To post to this group, send email to duraclo...@googlegroups.com.

[Bill Branan]

Hi David,

I've added that suggestion to this Jira ticket, as it seems to be consistent with the recommendations there: https://jira.duraspace.org/browse/DURACLOUD-1060

best,

Bill

To unsubscribe from this group and stop receiving emails from it, send an email to duracloud-users+unsubscribe@googlegroups.com.
To post to this group, send email to duracloud-users@googlegroups.com.