the orgunit record for the institution does not accept being linked to more than 1,000 Publication items

[محمود محمد‎]

I have bibliographic record files totaling 10,000 records, corresponding to 10,000 items in an Excel file, which I have successfully migrated into DSpace. Additionally, I have created authority records for 20 institutions within the "orgunit" entity group and linked them to the items as publishers. However, when the number of items linked to a single institution exceeds 1,000, a relation issue arises: the orgunit record for the institution does not accept being linked to more than 1,000 Publication items. What is causing this issue, and how can I resolve it?

is that regarding   rest api or what ?    thanks,,,

[DSpace Technical Support]

Hi,

If there's an error that occurs when you attempt to add the 1,001 relationship, then that error would likely be necessary to debug the problem.  See our troubleshooting guide for how to locate error messages: https://wiki.lyrasis.org/display/DSPACE/Troubleshoot+an+error#Troubleshootanerror-DSpace7.x(orabove)

If you do find an error message, then it's possible this is a bug, and you may want to open an issue at https://github.com/DSpace/DSpace/issues  But, I'd highly recommend looking for more information before opening an issue, as developers will need information on the error or the exact steps to reproduce the issue.

Tim

[محمود محمد‎]

---------- Forwarded message ---------
من: محمود محمد <mahmoud...@gmail.com>
‪Date: الخميس، ٣ أبريل ٢٠٢٥، ٧:٣٨ م‬
Subject: Re: [dspace-community] Re: the orgunit record for the institution does not accept being linked to more than 1,000 Publication items
To: pierre...@bibl.ulaval.ca <pierre...@bibl.ulaval.ca>
Cc: DSpace Community <dspace-c...@googlegroups.com>

Thank you, Mr. Pierre Lasou. I found the solution you provided helpful. Thank you for your feedback. The solution helped me quickly retrieve and display relationships linked to large individuals and institutions. However, when it comes to uploading relationships from external records using the patch upload method, the process is still very slow and gets slower with each operation. This means:

I upload 1,000 records for a book and link them to an authority record in an org units file. In the first batch, the system loads all the records and their metadata together, then adds the relationships at an acceptable speed. However, when I upload the second batch of records, 1,000 records for a book, and link them to the same org units, the problem arises. The system begins to slow down when adding relationships. Instead of five seconds, it takes 10 seconds, then 20 seconds, then 30 seconds, and so on with each addition of a relationship. The code is located in the following files:

First batch The relationships were loaded easily and without problems, but when adding the next batches, the problem appears, which is that the number of seconds increases very significantly with the addition of each relationship.

The diagnosis is that the code updates all relationships in all records that contain the same relationship until it adds a new relationship, and so on with each new addition of a new relationship.

I have sent you files and illustrative images of the nature of the problem and the code.

‫في الخميس، 3 أبريل 2025 في 7:37 م تمت كتابة ما يلي بواسطة محمود محمد <‪mahmoud...@gmail.com‬‏>:‬

Thank you, Mr. Pierre Lasso. I found the solution you provided helpful. Thank you for your feedback. The solution helped me quickly retrieve and display relationships linked to large individuals and institutions. However, when it comes to uploading relationships from external records using the patch upload method, the process is still very slow and gets slower with each operation. This means:

I upload 1,000 records for a book and link them to an authority record in an org units file. In the first batch, the system loads all the records and their metadata together, then adds the relationships at an acceptable speed. However, when I upload the second batch of records, 1,000 records for a book, and link them to the same org units, the problem arises. The system begins to slow down when adding relationships. Instead of five seconds, it takes 10 seconds, then 20 seconds, then 30 seconds, and so on with each addition of a relationship. The code is located in the following files:

First batch The relationships were loaded easily and without problems, but when adding the next batches, the problem appears, which is that the number of seconds increases very significantly with the addition of each relationship.

The diagnosis is that the code updates all relationships in all records that contain the same relationship until it adds a new relationship, and so on with each new addition of a new relationship.

I have sent you files and illustrative images of the nature of the problem and the code.

‫في الثلاثاء، 1 أبريل 2025 في 11:59 ص تمت كتابة ما يلي بواسطة محمود محمد <‪mahmoud...@gmail.com‬‏>:‬

Mr. Pierre Lasou, Thank you for your interest, Ok, I will try, Thank you for your support

في الاثنين، ٣١ مارس ٢٠٢٥، ٥:٢٩ م 'pierre...@bibl.ulaval.ca' via DSpace Community <dspace-c...@googlegroups.com> كتب:

Hi, 

There is a festure called the "tilted relationship" https://github.com/DSpace/DSpace/pull/3134 that should solve your problem. It was introduced in early versions of DSpace 7 but it has not been documented yet.

Thanks,

Kind regards, 

Pierre Lasou

Université Laval

On Tuesday, March 25, 2025 at 7:32:02 AM UTC-4 محمود محمد wrote:

I have bibliographic record files totaling 10,000 records, corresponding to 10,000 items in an Excel file, which I have successfully migrated into DSpace. Additionally, I have created authority records for 20 institutions within the "orgunit" entity group and linked them to the items as publishers. However, when the number of items linked to a single institution exceeds 1,000, a relation issue arises: the orgunit record for the institution does not accept being linked to more than 1,000 Publication items. What is causing this issue, and how can I resolve it?

is that regarding   rest api or what ?    thanks,,,

--
All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx
---
You received this message because you are subscribed to the Google Groups "DSpace Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-communi...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/dspace-community/acbbbb63-d5b8-42f9-b354-d0d1b21b1d68n%40googlegroups.com.