question about re-harvesting

[Jacek Chudzik]

Hi, 

we have a bunch of Dataverse installations which are harvested to one main instance.

Now, we are in need to enable access to this cumulated data. I thought, that /oai server will work well for that, but in guide there is information that: 

"Only the published datasets in your Dataverse installation can be made harvestable".

Also when creating query you "define a set of local datasets"

And yes, default "no name" OAI setSpec/Description will give me no results.

Does this mean that it is impossible to harvest data from Dataverse harvester by /oai?

Best regards,

Jacek

[Leonid Andreev]

Hello, 

I just looked at the code and no, it won't allow you to create a set containing non-local datasets. (There's a hard-coded "IS_HARVESTED:false" that we insert into the Solr search query that's used to define an OAI set). 

But, thinking about it, I don't see a problem with making this possible. Please go ahead and open a GitHub issue, something like "Allow creating OAI sets with harvested datasets". 

I would keep the current behavior as the default (simply because I'm assuming this is what most Dataverse instances want; as I can't remember anyone else asking about or requesting this). But we should be able to add this as an optional feature.

All the best, 

-Leo

[Jacek Chudzik]

Hi,

thank you very much for acknowledging that this is not possible at the moment and being open to change it.

Issue: https://github.com/IQSS/dataverse/issues/11939

Have a nice day,

Jacek