AIP backup timing out

[Gary Browne]

HI all,

JSPUI

DSpace 4.1

Tomcat 7

Apache 2.2

RHEL 6.9

I'm trying to do an AIP export of the entire site - but it keeps timing out after about 20GB of exports.

The command goes something like this:

./dspace packager -d -a -t AIP -e em...@email.com -i 2123/0 /tmp/repo-dump/repo.zip

The dump begins ok but after some time, I get:

Timeout, server not responding.

And the program dies. This happens after about 20GB of exports, but I have about 450GB to export. Any suggestions, other than doing each community one by one :(

Thanks a lot,

Gary

[Tim Donohue]

Hi Gary,

Perhaps bump up the memory available to that task?  By default the "dspace" commandline script will use the settings in your JAVA_OPTS (if set).  If it is *not* set, then it defaults to only 256MB of memory.  See this line here:
https://github.com/DSpace/DSpace/blob/master/dspace/bin/dspace#L43

To override this, you should be able to simply set JAVA_OPTS to some higher memory values.  Some examples are here:

https://wiki.duraspace.org/display/DSDOC6x/Performance+Tuning+DSpace#PerformanceTuningDSpace-GivetheCommandLineToolsMoreMemory

FWIW, I've run this AIP backup on sites in the 300GB+ range, so it should work fine at the range you are talking about.  But, I always have to provide more memory -- usually more like 1GB at least.

You also might want to look closer at your DSpace log files to see if any other errors are reported there prior to the server timeout.  My best guess here is you may be hitting memory issues, but it could be something else entirely.

- Tim

--
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To post to this group, send email to dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

--

Tim Donohue
Technical Lead for DSpace & DSpaceDirect
DuraSpace.org | DSpace.org | DSpaceDirect.org

[Gary Browne]

Thanks a lot Tim, I’ll give that a go!

 

Gary Browne | Technical Manager, Developments
Online Services
University of Sydney Library
THE UNIVERSITY OF SYDNEY
Level 1, Fisher Library F03, The University of Sydney NSW 2006
T +61 2 9351 5946 | M +61 405 647 868
E gary....@sydney.edu.au
Sent from my plain old desktop computer

--
You received this message because you are subscribed to a topic in the Google Groups "DSpace Technical Support" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/dspace-tech/64ZBJXJfBDo/unsubscribe.
To unsubscribe from this group and all its topics, send an email to dspace-tech...@googlegroups.com.

To post to this group, send email to

dspac...@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.