Solr query for submitted items?

132 views
Skip to first unread message

Gary Browne

unread,
Apr 5, 2017, 11:23:29 PM4/5/17
to DSpace Technical Support
Hi all,

Using DSpace 4.1, RHEL 6, Tomcat 7.

Is there a way I can query Solr to give me information about submitted items. eg. how many items submitted in a given period. I'm imagining something using date.accessioned but I've been unable to get any queries to work.

Secondly, other than:

https://wiki.duraspace.org/display/DSPACE/Solr
https://wiki.duraspace.org/display/DSDOC4x/DSpace+Statistics

are there any other documents with more Solr query examples - I'm finding there isn't enough explanation of parameters for me to work out how to use what and when?

Thanks,
Gary

helix84

unread,
Apr 6, 2017, 3:28:31 AM4/6/17
to Gary Browne, DSpace Technical Support
On Thu, Apr 6, 2017 at 5:23 AM, Gary Browne <gary....@sydney.edu.au> wrote:
> Is there a way I can query Solr to give me information about submitted
> items. eg. how many items submitted in a given period. I'm imagining
> something using date.accessioned but I've been unable to get any queries to
> work.

You can start from the example on the statistics index:


Change the core to search (where dc.date.accessioned is stored), change the query to ask for items and the facet field to query dc.date.accessioned_dt (*_dt fields are the date types which can be faceted like dates; if in doubt, check the Schema Browser for a particular core in the Solr Admin UI or its schema.xml file).

I added the new example here:




> are there any other documents with more Solr query examples - I'm finding
> there isn't enough explanation of parameters for me to work out how to use
> what and when?

Description of Solr parameters are not specific to DSpace, so I'm referring to Solr documentation. Please, check it out:

"Using the knowledge of particular fields from Solr Admin and Solr syntax (SolrQuerySyntaxCommonQueryParameters) you can make your own search requests. You can also read a brief tutorial to learn the query syntax quickly."


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Gary Browne

unread,
Apr 6, 2017, 8:07:19 PM4/6/17
to DSpace Technical Support
Thanks very much Ivan

euler

unread,
Dec 12, 2017, 9:02:28 PM12/12/17
to DSpace Technical Support
Hi ~~helix84,

When I tried to run the example in Breakdown of submitted items per month, the values returned are all zeroes. Am I missing something (ie cron or scheduled tasks to run)? Other examples in the https://wiki.duraspace.org/display/DSPACE/Solr page worked for me, except the breakdown of submitted items per month and the example on Date of last deposited item which gave me an incorrect date.

Thanks in advance,
euler

euler

unread,
Aug 14, 2018, 5:41:59 AM8/14/18
to DSpace Technical Support
Dear All,

I would like to ask for help regarding my solr query. As I've stated in my previous post below, running the query http://localhost:8080/solr/search/select?indent=on&rows=0&facet=true&facet.date=dc.date.accessioned_dt&facet.date.start=2018-01-01T00:00:00Z&facet.date.end=2019-01-01T00:00:00Z&facet.date.gap=%2B1MONTH&q=search.resourcetype:2 gave me zero values. I've found out that when I run http://localhost:8080/solr/search/select?indent=on&q=*:* in our production server, I don't have the field dc.date.accessioned_dt thus the zero values. In my local server, after doing a site restore and running the above solr query, it gave me the correct values. Is there a way to fix the solr in my production server such that it will have the appropriate fields? Other examples found in https://wiki.duraspace.org/display/DSPACE/Solr#Solr-Examples also gave me the incorrect values because of my corrupt data or missing fields in my solr core.

Thanks in advance and best regards,
euler

helix84

unread,
Aug 14, 2018, 6:48:57 AM8/14/18
to Nemiz, Elvi S., DSpace Technical Support
Please, send an example of your record (from [1]) and attach your schema [2]

[1] http://localhost:8080/solr/search/select?indent=on&q=*:*
[2] http://localhost:8080/solr/search/admin/file?file=schema.xml&contentType=text/xml;charset=utf-8


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

> --
> All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
> To post to this group, send email to dspac...@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.

euler

unread,
Aug 14, 2018, 7:27:48 AM8/14/18
to DSpace Technical Support
Hi helix,

Below is an example record from [1]. Attached is the schema.xml [2]. Thank you so much for your time and attention to this.

Best regards,
euler

<doc>
<arr name="dc.contributor.editor_stored">
<str>
Juario, Jesus V. ||| 25d39231-ff36-4279-a9d7-77c595acd0d9 ||| null ||| 25d39231-ff36-4279-a9d7-77c595acd0d9 |||
</str>
<str>
Ferraris, R. P. ||| cf922f2a-122b-4d83-b01a-79c6ab702d0a ||| null ||| cf922f2a-122b-4d83-b01a-79c6ab702d0a |||
</str>
<str>
Benitez, L. V. ||| f3e5c684-9c35-443b-8864-be239a5944fe ||| null ||| f3e5c684-9c35-443b-8864-be239a5944fe |||
</str>
</arr>
<arr name="author">
<str>Fortes, Romeo D.</str>
<str>97876fc9-2d1b-453c-9f75-a4e7965f8b34</str>
</arr>
<str name="dc.contributor.author_sort">Fortes, Romeo D.</str>
<arr name="dc.citation.spage">
<str>107</str>
</arr>
<arr name="dc.subject_mlt">
<str>Chanos chanos</str>
<str>Philippines</str>
</arr>
<arr name="dc.publisher.en">
<str>
Published by Island Pub. House in association with the Aquaculture Dept., Southeast Asian Fisheries Development Center and the International Development Research Centre
</str>
</arr>
<date name="dc.date.issued_dt">1984-01-01T00:00:00Z</date>
<arr name="editor_keyword">
<str>Juario, Jesus V.</str>
<str>25d39231-ff36-4279-a9d7-77c595acd0d9</str>
<str>
25d39231-ff36-4279-a9d7-77c595acd0d9###25d39231-ff36-4279-a9d7-77c595acd0d9
</str>
<str>Ferraris, R. P.</str>
<str>cf922f2a-122b-4d83-b01a-79c6ab702d0a</str>
<str>
cf922f2a-122b-4d83-b01a-79c6ab702d0a###cf922f2a-122b-4d83-b01a-79c6ab702d0a
</str>
<str>Benitez, L. V.</str>
<str>f3e5c684-9c35-443b-8864-be239a5944fe</str>
<str>
f3e5c684-9c35-443b-8864-be239a5944fe###f3e5c684-9c35-443b-8864-be239a5944fe
</str>
</arr>
<arr name="dc.language.iso">
<str>en</str>
</arr>
<str name="handle">10862/170</str>
<str name="search.uniqueid">2-154</str>
<arr name="subject">
<str>Chanos chanos</str>
<str>Chanos chanos</str>
<str>Philippines</str>
<str>Philippines</str>
<str>Aquaculture techniques</str>
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Fish culture</str>
<str>Pond culture</str>
<str>Pond culture</str>
</arr>
<arr name="subject_keyword">
<str>Chanos chanos</str>
<str>Chanos chanos</str>
<str>Chanos chanos###39259</str>
<str>Chanos chanos</str>
<str>Philippines</str>
<str>Philippines</str>
<str>Philippines###5783</str>
<str>Philippines</str>
<str>Aquaculture techniques</str>
<str>Aquaculture techniques</str>
<str>Aquaculture techniques###Aquaculture techniques</str>
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Brackishwater aquaculture</str>
<str>
Brackishwater aquaculture###Brackishwater aquaculture
</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Fish culture</str>
<str>Fish culture###Fish culture</str>
<str>Fish culture</str>
<str>Pond culture</str>
<str>Pond culture</str>
<str>Pond culture###Pond culture</str>
<str>Pond culture</str>
</arr>
<int name="search.resourceid">154</int>
<arr name="bi_2_dis_partial">
<str>97876fc9-2d1b-453c-9f75-a4e7965f8b34</str>
<str>Fortes, Romeo D.</str>
</arr>
<arr name="dc.type.en">
<str>Conference paper</str>
</arr>
<int name="search.resourcetype">2</int>
<arr name="editor_ac">
<str>juario, jesus v. ||| Juario, Jesus V.</str>
<str>
25d39231-ff36-4279-a9d7-77c595acd0d9 ||| 25d39231-ff36-4279-a9d7-77c595acd0d9
</str>
<str>ferraris, r. p. ||| Ferraris, R. P.</str>
<str>
cf922f2a-122b-4d83-b01a-79c6ab702d0a ||| cf922f2a-122b-4d83-b01a-79c6ab702d0a
</str>
<str>benitez, l. v. ||| Benitez, L. V.</str>
<str>
f3e5c684-9c35-443b-8864-be239a5944fe ||| f3e5c684-9c35-443b-8864-be239a5944fe
</str>
</arr>
<arr name="dc.date.available">
<str>2011-06-08T09:47:49Z</str>
</arr>
<arr name="dc.subject">
<str>Chanos chanos</str>
<str>Philippines</str>
</arr>
<arr name="type">
<str>Conference paper</str>
</arr>
<arr name="dc.date.issued_stored">
<str>1984-01-01 ||| null ||| null ||| null ||| </str>
</arr>
<arr name="location.coll">
<str>14</str>
</arr>
<str name="dateIssued.year_sort">1984</str>
<arr name="title_keyword">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="subject_acid">
<str>chanos chanos ||| Chanos chanos###39259</str>
<str>philippines ||| Philippines###5783</str>
<str>
aquaculture techniques ||| Aquaculture techniques###Aquaculture techniques
</str>
<str>
brackishwater aquaculture ||| Brackishwater aquaculture###Brackishwater aquaculture
</str>
<str>fish culture ||| Fish culture###Fish culture</str>
<str>pond culture ||| Pond culture###Pond culture</str>
</arr>
<arr name="bi_4_dis_filter">
<str>
brackishwater aquaculture ||| Brackishwater aquaculture###Brackishwater aquaculture
</str>
<str>philippines ||| Philippines###5783</str>
<str>chanos chanos ||| Chanos chanos###39259</str>
<str>
aquaculture techniques ||| Aquaculture techniques###Aquaculture techniques
</str>
<str>fish culture ||| Fish culture###Fish culture</str>
<str>pond culture ||| Pond culture###Pond culture</str>
</arr>
<arr name="bi_2_dis_authority_filter">
<str>97876fc9-2d1b-453c-9f75-a4e7965f8b34</str>
</arr>
<arr name="dateIssued">
<str>1984-01-01</str>
</arr>
<arr name="dc.title_hl">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<date name="SolrIndexer.lastIndexed">2018-08-14T08:52:40Z</date>
<arr name="dc.citation.epage">
<str>119</str>
</arr>
<arr name="editor_filter">
<str>
25d39231-ff36-4279-a9d7-77c595acd0d9 ||| 25d39231-ff36-4279-a9d7-77c595acd0d9###25d39231-ff36-4279-a9d7-77c595acd0d9
</str>
<str>
cf922f2a-122b-4d83-b01a-79c6ab702d0a ||| cf922f2a-122b-4d83-b01a-79c6ab702d0a###cf922f2a-122b-4d83-b01a-79c6ab702d0a
</str>
<str>
f3e5c684-9c35-443b-8864-be239a5944fe ||| f3e5c684-9c35-443b-8864-be239a5944fe###f3e5c684-9c35-443b-8864-be239a5944fe
</str>
</arr>
<arr name="location.comm">
<str>8</str>
<str>4</str>
<str>1</str>
</arr>
<str name="bi_sort_2_sort">1984</str>
<arr name="dc.contributor.editor">
<str>Juario, Jesus V.</str>
<str>Ferraris, R. P.</str>
<str>Benitez, L. V.</str>
</arr>
<arr name="dateIssued.year">
<int>1984</int>
</arr>
<arr name="dc.title">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="dc.contributor.author_stored">
<str>
Fortes, Romeo D. ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34 ||| null ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34 |||
</str>
</arr>
<arr name="title">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="dc.title_mlt">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="editor_authority">
<str>25d39231-ff36-4279-a9d7-77c595acd0d9</str>
<str>cf922f2a-122b-4d83-b01a-79c6ab702d0a</str>
<str>f3e5c684-9c35-443b-8864-be239a5944fe</str>
</arr>
<arr name="author_keyword">
<str>Fortes, Romeo D.</str>
<str>97876fc9-2d1b-453c-9f75-a4e7965f8b34</str>
<str>
97876fc9-2d1b-453c-9f75-a4e7965f8b34###97876fc9-2d1b-453c-9f75-a4e7965f8b34
</str>
</arr>
<arr name="dc.publisher">
<str>
Published by Island Pub. House in association with the Aquaculture Dept., Southeast Asian Fisheries Development Center and the International Development Research Centre
</str>
</arr>
<arr name="dc.description.abstract.en">
<str>
This paper reviews the work on milkfish (Chanos chanos ) culture techniques conducted from 1973 to 1983 by the Brackishwater Aquaculture Center, the aquaculture research arm of the College of Fisheries, University of the Philippines in the Visayas at Leganes, Iloilo, Philippines. Significant findings and innovative techniques dealing with milkfish fry collection and fingerling production such as those obtained from survival studies of fry during collection, sorting, handling acclimation storage, transport, and rearing in nursery ponds or land-based nurseries are reviewed. Fingerling production utilizing improved methods and techniques is discussed. Results of work on pond culture techniques are presented and discussed.
</str>
</arr>
<arr name="dc.citation.conferenceTitle">
<str>
Advances in milkfish biology and culture: Proceedings of the Second International Milkfish Aquaculture Conference, 4-8 October 1983, Iloilo City, Philippines
</str>
</arr>
<arr name="dc.subject.en">
<str>Philippines</str>
</arr>
<arr name="dc.contributor.author">
<str>Fortes, Romeo D.</str>
</arr>
<arr name="dc.subject.asfa.en">
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Pond culture</str>
</arr>
<arr name="type_filter">
<str>conference paper ||| Conference paper</str>
</arr>
<arr name="subject_authority">
<str>39259</str>
<str>5783</str>
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Pond culture</str>
</arr>
<arr name="bi_4_dis_partial">
<str>Philippines</str>
<str>Chanos chanos</str>
<str>Pond culture</str>
<str>Fish culture</str>
<str>Brackishwater aquaculture</str>
<str>Aquaculture techniques</str>
</arr>
<arr name="type_keyword">
<str>Conference paper</str>
</arr>
<arr name="bi_2_dis_filter">
<str>
97876fc9-2d1b-453c-9f75-a4e7965f8b34 ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34###97876fc9-2d1b-453c-9f75-a4e7965f8b34
</str>
</arr>
<str name="withdrawn">false</str>
<arr name="subject_ac">
<str>chanos chanos ||| Chanos chanos</str>
<str>chanos chanos ||| Chanos chanos</str>
<str>philippines ||| Philippines</str>
<str>philippines ||| Philippines</str>
<str>aquaculture techniques ||| Aquaculture techniques</str>
<str>aquaculture techniques ||| Aquaculture techniques</str>
<str>
brackishwater aquaculture ||| Brackishwater aquaculture
</str>
<str>
brackishwater aquaculture ||| Brackishwater aquaculture
</str>
<str>fish culture ||| Fish culture</str>
<str>fish culture ||| Fish culture</str>
<str>pond culture ||| Pond culture</str>
<str>pond culture ||| Pond culture</str>
</arr>
<str name="bi_sort_3_sort">2011-06-08T09:47:49Z</str>
<arr name="dc.description.abstract">
<str>
This paper reviews the work on milkfish (Chanos chanos ) culture techniques conducted from 1973 to 1983 by the Brackishwater Aquaculture Center, the aquaculture research arm of the College of Fisheries, University of the Philippines in the Visayas at Leganes, Iloilo, Philippines. Significant findings and innovative techniques dealing with milkfish fry collection and fingerling production such as those obtained from survival studies of fry during collection, sorting, handling acclimation storage, transport, and rearing in nursery ponds or land-based nurseries are reviewed. Fingerling production utilizing improved methods and techniques is discussed. Results of work on pond culture techniques are presented and discussed.
</str>
</arr>
<arr name="dateIssued_ac">
<str>1984-01-01 ||| 1984-01-01</str>
<str>1984</str>
</arr>
<arr name="dc.type">
<str>Conference paper</str>
</arr>
<arr name="dc.date.accessioned">
<str>2011-06-08T09:47:49Z</str>
</arr>
<arr name="dc.identifier.citation">
<str>
Fortes, R. D. (1984). Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center. In J. V. Juario, R. P. Ferraris, & L. V. Benitez (Eds.), Advances in milkfish biology and culture: Proceedings of the Second International Milkfish Aquaculture Conference, 4-8 October 1983, Iloilo City, Philippines. (pp. 107-119). Metro Manila, Philippines: Published by Island Pub. House in association with the Aquaculture Department, Southeast Asian Fisheries Development Center and the International Development Research Centre.
</str>
</arr>
<arr name="author_filter">
<str>
97876fc9-2d1b-453c-9f75-a4e7965f8b34 ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34###97876fc9-2d1b-453c-9f75-a4e7965f8b34
</str>
</arr>
<str name="bi_sort_1_sort">
milkfish culture techniques generated and developed by the brackishwater aquaculture center
</str>
<arr name="read">
<str>g0</str>
</arr>
<arr name="dc.contributor.author_mlt">
<str>Fortes, Romeo D.</str>
</arr>
<arr name="dc.contributor.author_hl">
<str>Fortes, Romeo D.</str>
</arr>
<arr name="dc.date.issued">
<str>1984-01-01</str>
</arr>
<arr name="bi_4_dis_authority_filter">
<str>5783</str>
<str>Pond culture</str>
<str>39259</str>
<str>Fish culture</str>
<str>Brackishwater aquaculture</str>
<str>Aquaculture techniques</str>
</arr>
<arr name="dc.title_stored">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center ||| null ||| null ||| null ||| en
</str>
</arr>
<arr name="author_authority">
<str>97876fc9-2d1b-453c-9f75-a4e7965f8b34</str>
</arr>
<arr name="title_ac">
<str>
milkfish culture techniques generated and developed by the brackishwater aquaculture center ||| Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="dateIssued_keyword">
<str>1984-01-01</str>
<str>1984</str>
</arr>
<arr name="subject_tax_0_filter">
<str>chanos chanos ||| Chanos chanos</str>
<str>philippines ||| Philippines</str>
<str>aquaculture techniques ||| Aquaculture techniques</str>
<str>
brackishwater aquaculture ||| Brackishwater aquaculture
</str>
<str>fish culture ||| Fish culture</str>
<str>pond culture ||| Pond culture</str>
</arr>
<arr name="author_ac">
<str>fortes, romeo d. ||| Fortes, Romeo D.</str>
<str>
97876fc9-2d1b-453c-9f75-a4e7965f8b34 ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34
</str>
</arr>
<arr name="dc.title.en">
<str>
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
</arr>
<arr name="dc.language.iso.en">
<str>en</str>
</arr>
<arr name="dc.identifier.uri">
</arr>
<arr name="dc.identifier.isbn">
<str>9711007045</str>
</arr>
<arr name="subject_filter">
<str>chanos chanos ||| Chanos chanos</str>
<str>philippines ||| Philippines</str>
<str>aquaculture techniques ||| Aquaculture techniques</str>
<str>
brackishwater aquaculture ||| Brackishwater aquaculture
</str>
<str>fish culture ||| Fish culture</str>
<str>pond culture ||| Pond culture</str>
</arr>
<arr name="editor_acid">
<str>
25d39231-ff36-4279-a9d7-77c595acd0d9 ||| 25d39231-ff36-4279-a9d7-77c595acd0d9###25d39231-ff36-4279-a9d7-77c595acd0d9
</str>
<str>
cf922f2a-122b-4d83-b01a-79c6ab702d0a ||| cf922f2a-122b-4d83-b01a-79c6ab702d0a###cf922f2a-122b-4d83-b01a-79c6ab702d0a
</str>
<str>
f3e5c684-9c35-443b-8864-be239a5944fe ||| f3e5c684-9c35-443b-8864-be239a5944fe###f3e5c684-9c35-443b-8864-be239a5944fe
</str>
</arr>
<arr name="publication_grp">
<str>10862/170</str>
</arr>
<arr name="type_ac">
<str>conference paper ||| Conference paper</str>
</arr>
<arr name="dc.citation.conferenceTitle.en">
<str>
Advances in milkfish biology and culture: Proceedings of the Second International Milkfish Aquaculture Conference, 4-8 October 1983, Iloilo City, Philippines
</str>
</arr>
<str name="dc.title_sort">
Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center
</str>
<arr name="author_acid">
<str>
97876fc9-2d1b-453c-9f75-a4e7965f8b34 ||| 97876fc9-2d1b-453c-9f75-a4e7965f8b34###97876fc9-2d1b-453c-9f75-a4e7965f8b34
</str>
</arr>
<str name="discoverable">true</str>
<arr name="dc.identifier.citation.en">
<str>
Fortes, R. D. (1984). Milkfish culture techniques generated and developed by the Brackishwater Aquaculture Center. In J. V. Juario, R. P. Ferraris, & L. V. Benitez (Eds.), Advances in milkfish biology and culture: Proceedings of the Second International Milkfish Aquaculture Conference, 4-8 October 1983, Iloilo City, Philippines. (pp. 107-119). Metro Manila, Philippines: Published by Island Pub. House in association with the Aquaculture Department, Southeast Asian Fisheries Development Center and the International Development Research Centre.
</str>
</arr>
<arr name="editor">
<str>Juario, Jesus V.</str>
<str>25d39231-ff36-4279-a9d7-77c595acd0d9</str>
<str>Ferraris, R. P.</str>
<str>cf922f2a-122b-4d83-b01a-79c6ab702d0a</str>
<str>Benitez, L. V.</str>
<str>f3e5c684-9c35-443b-8864-be239a5944fe</str>
</arr>
<arr name="dc.subject.asfa_mlt">
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Pond culture</str>
</arr>
<arr name="dc.description.abstract_hl">
<str>
This paper reviews the work on milkfish (Chanos chanos ) culture techniques conducted from 1973 to 1983 by the Brackishwater Aquaculture Center, the aquaculture research arm of the College of Fisheries, University of the Philippines in the Visayas at Leganes, Iloilo, Philippines. Significant findings and innovative techniques dealing with milkfish fry collection and fingerling production such as those obtained from survival studies of fry during collection, sorting, handling acclimation storage, transport, and rearing in nursery ponds or land-based nurseries are reviewed. Fingerling production utilizing improved methods and techniques is discussed. Results of work on pond culture techniques are presented and discussed.
</str>
</arr>
<arr name="dc.subject.asfa">
<str>Aquaculture techniques</str>
<str>Brackishwater aquaculture</str>
<str>Fish culture</str>
<str>Pond culture</str>
</arr>
<arr name="location">
<str>m8</str>
<str>m4</str>
<str>m1</str>
<str>l14</str>
</arr>
<arr name="stream_source_info">
<str>ambcp107-119.pdf.txt</str>
</arr>
<arr name="stream_content_type">
<str>text/plain</str>
</arr>
<arr name="stream_size">
<str>38328</str>
</arr>
<arr name="Content-Encoding">
<str>windows-1252</str>
</arr>
<arr name="stream_name">
<str>ambcp107-119.pdf.txt</str>
</arr>
<arr name="Content-Type">
<str>text/plain; charset=windows-1252</str>
</arr>
<arr name="fulltext">...</arr>
<arr name="fulltext_hl">...</arr>
<long name="_version_">1608763847970127872</long>
</doc>


schema.xml

helix84

unread,
Aug 14, 2018, 7:43:05 AM8/14/18
to Nemiz, Elvi S., DSpace Technical Support
It seems that you're using the schema from DSpace unmodified, the only
change being the default query operator from OR to AND. This schema
creates the *_dt indexes for you from date fields. If, for some
reason, they are not created, try a full reindex. Otherwise the reason
will be that you simply don't have the dc.date.accessioned metadata
field filled in in any of your items. Those should be filled in
automatically by DSpace if you're creating items via input forms, CSV
import or other standard DSpace methods. They may be missing if you're
using some custom import methods.

Your solution is either to start filling out this field for new
records or to facet by another date field that you're using
(dc.date.issued).


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette



euler

unread,
Aug 15, 2018, 9:44:05 AM8/15/18
to DSpace Technical Support
Hi helix,

I've tried several times to reindex (index-discovery -b) but I still have zero values when doing solr query for breakdown of submitted items per month. I am very sure that I have the dc.date.accessioned metadata field in all of my items. I'm wondering why I have the correct values when doing it in my local instance. In my local instance, I restored the pgdump of our production server and then reindex. Then I tested the solr query and it's working. I also tried restoring (in my local instance) by using the command dspace packager -r -a -f -t AIP and after it finished reindexing, the solr query also worked. So my question now is, what should I do in our production server to make the solr query work? I'm worried that restoring the entire site using packager -r -a -f -t is a little bit extreme just to make this work? Or is it safe to drop the dspace database and then restore it using the backup pgdump? Will it mess up other data in my solr core?

Thanks,
euler

helix84

unread,
Aug 15, 2018, 9:55:43 AM8/15/18
to Nemiz, Elvi S., DSpace Technical Support
Sorry, I can't think of a reason why dc.date.accessioned_dt would be
missing from your Solr search core if you have dc.date.accessioned
values in the metadata.

Dropping and restoring the DB will not help with this issue - it does
not change DB contents.

If the values are in the metadata, the problem must be either with the
schema of the Solr search core (which you sent me and seems to be
correct) or the way the records are loaded into the Solr search core.

One last thing you can try is to
1) stop tomcat
2) manually delete the Solr seach core data [1]
3) start tomcat
4) run index-discovery -b

[1] https://wiki.duraspace.org/display/DSPACE/Solr#Solr-ManuallydeleteSolrindexfiles


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

euler

unread,
Aug 15, 2018, 11:32:07 AM8/15/18
to DSpace Technical Support
Hi helix,

I followed your instruction to delete the Solr search core data which is located in [dspace]/solr/search/data after I stopped tomcat. After starting tomcat and issuing the index-discovery -b command, I waited a couple of minutes just to make sure that there were items already written in the index, I accessed http://localhost:8080/solr/search/select?indent=on&q=*:* to see if there are dc.date.accessioned_dt field in the result but sadly there were none. I'm getting really frustrated about this. Our server is running version 5.5 by the way. Right now the server is still reindexing but sadly no dc.date.accessioned_dt field.

Below is a record showing the available fields when I accessed http://localhost:8080/solr/search/select?indent=on&q=*.*. Note that there is a dc.date.accessioned field but no dc.date.accessioned_dt field.

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<response>
<lst name="responseHeader">
<int name="status">0</int>
<int name="QTime">0</int>
<lst name="params">
<str name="indent">true</str>
<str name="q">*:*</str>
<str name="rows">1</str>
</lst>
</lst>
<result name="response" numFound="919" start="0">
<doc>
<arr name="dc.title_mlt">...</arr>
<arr name="author">...</arr>
<arr name="author_keyword">...</arr>
<arr name="dc.publisher">...</arr>
<str name="dc.contributor.author_sort">Primavera, Jurgenne H.</str>
<arr name="dc.citation.conferenceTitle">...</arr>
<arr name="dc.publisher.en">...</arr>
<date name="dc.date.issued_dt">2006-01-01T00:00:00Z</date>
<arr name="dc.format.extent">...</arr>
<str name="handle">10862/2944</str>
<arr name="dc.language.iso">...</arr>
<str name="search.uniqueid">2-3398</str>
<arr name="dc.contributor.author">...</arr>
<arr name="subject">...</arr>
<arr name="subject_keyword">...</arr>
<arr name="dc.subject.asfa.en">...</arr>
<arr name="type_filter">...</arr>
<int name="search.resourceid">3398</int>
<arr name="subject_authority">...</arr>
<arr name="bi_4_dis_partial">...</arr>
<arr name="type_keyword">...</arr>
<arr name="bi_2_dis_partial">...</arr>
<arr name="bi_2_dis_filter">...</arr>
<arr name="dc.subject.lcsh">...</arr>
<str name="bi_sort_3_sort">2016-03-08T09:28:38Z</str>
<str name="withdrawn">false</str>
<arr name="subject_ac">...</arr>
<arr name="dc.type.en">...</arr>
<arr name="dateIssued_ac">...</arr>
<arr name="dc.type">...</arr>
<int name="search.resourcetype">2</int>
<arr name="bi_4_dis_value_filter">...</arr>
<arr name="dc.date.accessioned">
<str>2016-03-08T09:28:38Z</str>
</arr>
<arr name="dc.date.available">
<str>2016-03-08T09:28:38Z</str>
</arr>
<arr name="author_filter">...</arr>
<arr name="dc.identifier.citation">...</arr>
<str name="bi_sort_1_sort">...</str>
<arr name="read">...</arr>
<arr name="dc.contributor.author_mlt">...</arr>
<arr name="type">...</arr>
<arr name="dc.description.en">...</arr>
<arr name="dc.format.extent.en">...</arr>
<arr name="dc.contributor.author_hl">...</arr>
<arr name="dc.date.issued">...</arr>
<arr name="dc.date.issued_stored">...</arr>
<arr name="bi_4_dis_authority_filter">...</arr>
<arr name="dc.title_stored">...</arr>
<arr name="title_ac">...</arr>
<arr name="author_authority">...</arr>
<arr name="location.coll">...</arr>
<arr name="dateIssued_keyword">...</arr>
<arr name="subject_tax_0_filter">...</arr>
<arr name="dc.title.en">...</arr>
<arr name="author_ac">...</arr>
<str name="dateIssued.year_sort">2006</str>
<arr name="title_keyword">...</arr>
<arr name="dc.language.iso.en">...</arr>
<arr name="dc.identifier.uri">...</arr>
<arr name="subject_acid">...</arr>
<arr name="dc.identifier.isbn">...</arr>
<arr name="subject_filter">...</arr>
<arr name="publication_grp">...</arr>
<arr name="bi_4_dis_filter">...</arr>
<arr name="bi_2_dis_authority_filter">...</arr>
<arr name="dc.title_hl">...</arr>
<arr name="dateIssued">...</arr>
<arr name="dc.citation.conferenceTitle.en">...</arr>
<arr name="type_ac">...</arr>
<date name="SolrIndexer.lastIndexed">2018-08-15T14:43:38Z</date>
<arr name="location.comm">...</arr>
<arr name="dc.description">...</arr>
<str name="dc.title_sort">...</str>
<arr name="author_acid">...</arr>
<str name="discoverable">true</str>
<str name="bi_sort_2_sort">2006</str>
<arr name="dc.identifier.citation.en">...</arr>
<arr name="dc.subject.asfa_mlt">...</arr>
<arr name="dc.subject.lcsh.en">...</arr>
<arr name="dc.title">...</arr>
<arr name="dateIssued.year">...</arr>
<arr name="dc.contributor.author_stored">...</arr>
<arr name="dc.subject.asfa">...</arr>
<arr name="location">...</arr>
<arr name="title">...</arr>
<arr name="stream_source_info">...</arr>
<arr name="stream_content_type">...</arr>
<arr name="stream_size">...</arr>
<arr name="Content-Encoding">...</arr>
<arr name="stream_name">...</arr>
<arr name="Content-Type">...</arr>
<arr name="fulltext">...</arr>
<arr name="fulltext_hl">...</arr>
<long name="_version_">1608876523958304768</long>
</doc>
</result>
</response>

Thanks and best regards,
euler

euler

unread,
Aug 16, 2018, 9:26:42 AM8/16/18
to DSpace Technical Support
Hi helix,

Ok, so aside from your instruction to delete just the Solr search core data and reindexing but still no luck, I tried deleting the whole search directory and created a new search directory, and then inside it I copied a new conf folder from my dspace-src/dspace/solr/search/ directory. Reindexed, but still no dc.date.accessioned_dt field. I also tried unloading the search core from the Solr core admin and created a new search core, but still same results after reindexing. I even created a new search filter in discovery in the hopes that it will trigger to index the dc.date.accessioned_dt in my solr search core, but still no luck. Maybe it's time that I concede that there is no fix to this issue that I have. For now, when I want to query the number of submitted items per month for a given year, I am doing an sql query [1].


Thank you so much and best regards,
euler
Reply all
Reply to author
Forward
0 new messages