Records numbers mismatch

[Milica Knezevic]

Hi,

For the collection 9200231_Ag_EU_TEL_a1081_Collections_1914-1918, the API call http://europeana.eu/api/v2/datasets.json?wskey=xxxxx returns 6989 as the number of records in the collection,
while the value of the field "totalResults" is 6784 in http://europeana.eu/api/v2/search.json?wskey=xxxxx&query=europeana_collectionName:9200231_Ag_EU_TEL_a1081_Collections_1914-1918
What is causing this mismatch and could it be fixed?

Thanks,
Milica

[Milica Knezevic]

Just to add,

similar thing happens with other collections e.g. 9200290_Ag_EU_TEL_a0564b_EUcollection14-18

Best,
Milica

[James Morley]

Hi Milica

This is an issue that I'd spotted recently myself and raised internally. The figures used for the datasets.json response have become out of sync when records have changed in certain datasets. The ones you get from the search API method will be accurate.

I'm looking to get this resolved but I think realistically this may take some time. Are you able to use the figures returned by the query results? If this is a big issue to you please send me some further details (off-list if you want) about what you require and I will see if there's another way to help.

Best wishes, James

 

---

From: europe...@googlegroups.com [europe...@googlegroups.com] on behalf of Milica Knezevic [knezevi...@gmail.com]
Sent: 19 August 2014 15:04
To: europe...@googlegroups.com
Subject: {Europeana API forum} Re: Records numbers mismatch

--
You received this message because you are subscribed to the Google Groups "Europeana API forum" group.
To unsubscribe from this group and stop receiving emails from it, send an email to europeanaAPI...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

James Morley

Creative Industries Community Developer

 

T:
M: +44 (0)77 1336 0563
E: James....@europeana.eu

Skype: jamesinealing

 

If you’re interested in Europe’s cultural heritage, sign up for our newsletter at http://eepurl.com/SAaC5 and start receiving our monthly eNews, in English or French!

 

Europeana makes Europe’s culture available for all, across borders and generations and for creative re-use – follow how at #AllezCulture 

 

Disclaimer: This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. If you have received this email in error please notify the system manager. If you are not the named addressee you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system.

[Milica Knezevic]

Hi James,

Thanks, once again, for your help. This is not causing any big issues, but I needed to know which number is the right one, and if I'm getting all relevant records from collections.

Best,

Milica

--
You received this message because you are subscribed to a topic in the Google Groups "Europeana API forum" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/europeanaAPI/dwdQtHGm_F0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to europeanaAPI...@googlegroups.com.

[James Morley]

Hi Milica (and others interested in datasets)

Due to the ongoing issues with the underlying data in the custom datasets method, could I propose an alternative method using the standard search method and some of Lucene's facet functionality?

If you use the call

http://www.europeana.eu/api/v2/search.json?wskey=xxxxxx&query=*%3A*&rows=0&facet=europeana_collectionName&profile=facets&f.europeana_collectionName.facet.limit=2000

You will get a complete list of paired values showing the dataset name and the record count.

Of course you can also combine this with other standard query parameters (http://labs.europeana.eu/api/data-fields/) to limit these results, an obvious example being to look at datasets for one provider

http://www.europeana.eu/api/v2/search.json?wskey=api2demo&query=provider_aggregation_edm_provider:CultureGrid&rows=0&facet=europeana_collectionName&profile=facets&f.europeana_collectionName.facet.limit=2000

Although this misses some of the fields that the datasets method provides, I suspect it will fulfill most needs, and crucially it will always return 'live' data. 

If you need more, let me know!

Best,

James

---

From: europe...@googlegroups.com [europe...@googlegroups.com] on behalf of Milica Knezevic [knezevi...@gmail.com]

Sent: 26 August 2014 13:11
To: europe...@googlegroups.com
Subject: Re: {Europeana API forum} Re: Records numbers mismatch

[Milica Knezevic]

Hi James,

Great! Thank you for this information and instructions.

Best,
Milica

[Vladimir Alexiev]

I was wondering how a query to count by Collection would look in SPARQL (http://europeana.ontotext.com/sparql). 

Easy enough:

PREFIX edm: <http://www.europeana.eu/schemas/edm/>
select ?coll (count(*) as ?c) {
 ?a1 edm:provider "CultureGrid"; edm:aggregatedCHO ?cho.
 ?a2 edm:collectionName ?coll; edm:aggregatedCHO ?cho.
} group by ?coll order by ?coll

To grok it, see the graph http://europeana.ontotext.com/doc/queries/#EDM_Graph. ?a1 and ?a2 are the two Aggregation nodes.