Running multiple imports (SAF) at once

11 views
Skip to first unread message

David Kinsley

unread,
Dec 10, 2019, 8:43:00 AM12/10/19
to DSpace Technical Support
Hey all, I've been importing a large amount of records over the past couple weeks and was wondering if it was possible to run multiple import commands concurrently.  For example, I'd start an import on 6000 records and immediately after starting that, I'd start another import with the next 6000 records. Would that be possible or would it end up breaking something along the way?

Thanks for the help,
David K.

Paul Münch

unread,
Dec 12, 2019, 7:00:47 AM12/12/19
to dspac...@googlegroups.com
Hello,

I can only report experiences from our local test cases. We tested the import in our cluster on two DSpace nodes and ran simultaneously two imports with 600 records on each node. This worked fine, but I can't say more.

Kind regards,

Paul Münch

Am 10.12.19 um 14:43 schrieb David Kinsley:
Hey all, I've been importing a large amount of records over the past couple weeks and was wondering if it was possible to run multiple import commands concurrently.  For example, I'd start an import on 6000 records and immediately after starting that, I'd start another import with the next 6000 records. Would that be possible or would it end up breaking something along the way?

Thanks for the help,
David K.
--
All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/fe130e7e-d442-4e7b-81b4-a7d8c576a41c%40googlegroups.com.

signature.asc

David Kinsley

unread,
Dec 13, 2019, 8:21:11 AM12/13/19
to DSpace Technical Support
Thanks for the reply Paul, the simultaneous imports of 6000 work without a hitch also.


On Thursday, December 12, 2019 at 7:00:47 AM UTC-5, Paul Münch wrote:
Hello,

I can only report experiences from our local test cases. We tested the import in our cluster on two DSpace nodes and ran simultaneously two imports with 600 records on each node. This worked fine, but I can't say more.

Kind regards,

Paul Münch

Am 10.12.19 um 14:43 schrieb David Kinsley:
Hey all, I've been importing a large amount of records over the past couple weeks and was wondering if it was possible to run multiple import commands concurrently.  For example, I'd start an import on 6000 records and immediately after starting that, I'd start another import with the next 6000 records. Would that be possible or would it end up breaking something along the way?

Thanks for the help,
David K.
--
All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspac...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages