Dspace 6.3 Oai import ERRORS

[lon...@gmail.com]

Hi all,

I'm trying to upgrade from Dspace 5.5 to dspace 6.3. Everything went fine, but when I ran the "dspace oai import -c" command. It came up with some errors and missing some of -the BITSTREAM. I found some answers but not sure where to start .

Any help would be very appreciated!

=========== 

2020-10-17 12:50:22,879 WARN  org.dspace.xoai.util.ItemUtils @ Authorization denied for action READ on BITSTREAM:1148cb67-bb28-4c4e-9721-caeaffe9a638 by user null

org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:1148cb67-bb28-4c4e-9721-caeaffe9a638 by user null

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:157)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:95)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:89)

at org.dspace.content.BitstreamServiceImpl.retrieve(BitstreamServiceImpl.java:307)

at org.dspace.xoai.util.ItemUtils.retrieveMetadata(ItemUtils.java:298)

at org.dspace.xoai.app.XOAI.index(XOAI.java:421)

at org.dspace.xoai.app.XOAI.index(XOAI.java:280)

at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:227)

at org.dspace.xoai.app.XOAI.index(XOAI.java:134)

at org.dspace.xoai.app.XOAI.main(XOAI.java:559)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)

at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)

2020-10-17 12:50:22,894 WARN  org.dspace.xoai.util.ItemUtils @ Authorization denied for action READ on BITSTREAM:b30e1914-f6a7-413f-b98e-0a48885a20fc by user null

org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:b30e1914-f6a7-413f-b98e-0a48885a20fc by user null

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:157)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:95)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:89)

at org.dspace.content.BitstreamServiceImpl.retrieve(BitstreamServiceImpl.java:307)

at org.dspace.xoai.util.ItemUtils.retrieveMetadata(ItemUtils.java:298)

at org.dspace.xoai.app.XOAI.index(XOAI.java:421)

at org.dspace.xoai.app.XOAI.index(XOAI.java:280)

at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:227)

at org.dspace.xoai.app.XOAI.index(XOAI.java:134)

at org.dspace.xoai.app.XOAI.main(XOAI.java:559)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)

at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)

WARN  org.dspace.xoai.util.ItemUtils @ Authorization denied for action READ on BITSTREAM:6c570ef6-b2e2-424a-aa50-fddcbab03094 by user null

org.dspace.authorize.AuthorizeException: Authorization denied for action READ on BITSTREAM:6c570ef6-b2e2-424a-aa50-fddcbab03094 by user null

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:157)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:95)

at org.dspace.authorize.AuthorizeServiceImpl.authorizeAction(AuthorizeServiceImpl.java:89)

at org.dspace.content.BitstreamServiceImpl.retrieve(BitstreamServiceImpl.java:307)

at org.dspace.xoai.util.ItemUtils.retrieveMetadata(ItemUtils.java:298)

at org.dspace.xoai.app.XOAI.index(XOAI.java:421)

at org.dspace.xoai.app.XOAI.index(XOAI.java:280)

at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:227)

at org.dspace.xoai.app.XOAI.index(XOAI.java:134)

at org.dspace.xoai.app.XOAI.main(XOAI.java:559)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:229)

at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:81)

=============

[Jose Blanco]

Try running:

dspace oai import -c -v

It will probably tell you the item where it found the error, and then you can go edit it and see if anything looks suspicious.

-Jose

--
All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/6f4017ad-acec-4ffe-8c36-03a8cc21bbc1n%40googlegroups.com.

[lon...@gmail.com]

hi Jose,

Thanks Jose!  I ran : dspace oai import -c -v . but it didn't show any errors . I only found the same errors I posted earlier in "dspace.log" file.

any other suggestion?

thanks

[Jose Blanco]

Didn’t it show all the items it was indexing and then error out at one of them? Or did it just Error out from the start?

Sent from my iPhone

On Oct 17, 2020, at 8:33 PM, lon...@gmail.com <lon...@gmail.com> wrote:

hi Jose,

To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/d9f32d31-f672-4b3d-85ae-57a132e2e75en%40googlegroups.com.

[Jose Blanco]

It seems to be having permissions problems with this bitstream:

1148cb67-bb28-4c4e-9721-caeaffe9a638

To find out the item handle associated with this bitstream you can go into the database and issues this sql:

select handle from handle where resource_id in (select item_id from item2bundle where bundle_id in (select bundle_id from bundle2bitstream where bitstream_id='1148cb67-bb28-4c4e-9721-caeaffe9a638'));

You can then go into the UI, look at the item and the bitstream, and see if anything looks suspicious.

Not sure if this is related, but in dspace.cfg, I have this configuration:

harvest.includerestricted.oai = false

Which will then only send items that have Anonymous permissions.

-Jose

[lon...@gmail.com]

hi Jose,

I followed you instruction and issued the SQL queries.

select handle from handle where resource_id in (select item_id from item2bundle where bundle_id in (select bundle_id from bundle2bitstream where bitstream_id='1148cb67-bb28-4c4e-9721-caeaffe9a638')); 

and found out that - those item handle which associated with the bitstream errors got withdraw or deleted.

How can I clean those left over bitstream ?

thanks

-P 

[Jose Blanco]

I think you may need to re-index the entire repository and then try to build the oai index, so do this:

./dspace index-discovery -b 

and then:

./dspace oai import -c -v

To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/a4830a6e-d67d-4fcd-b731-a18a45b5ecf2n%40googlegroups.com.

[lon...@gmail.com]

thanks so much Jose for all your helps! I've tried to re-imported the database, re-index and I found no more errors.