Empty Solr statistics

673 views
Skip to first unread message

Maya Zbitneva

unread,
Oct 16, 2020, 6:51:41 AM10/16/20
to DSpace Technical Support
Good day!

Help me please to solve the following problem.

I installed DSpace 6.3 on Ubuntu 18. But I can't attach the function
"Statistics". I see the empty fields of statistics instead of  data of Solr statistics.
And I see the admin data of Solr on the path:
localhost:8080/solr/statistics, localhost:8080/solr.



With respect,
System administrator
Zbitneva Maya
Снимок экрана от 2020-10-16 13-40-36.png

Jose Blanco

unread,
Oct 16, 2020, 4:02:39 PM10/16/20
to Maya Zbitneva, DSpace Technical Support
Maya,

I was having the same issue this week.  This is what I found out. In order for stats to work, you need two things:

1.  The stats have to be properly configured.  I think you may have that.  This would be the configurations to:
/config/modules/solr-statistics.cfg
AND
/config/modules/usage-statistics.cfg

2.  Now... the part that was messing me up was that in /config/modules/usage-statistics.cfg, there is one config parameter:
usage-statistics.dbfile

That should be set to a file like  "GeoLite2-City.mmdb" for 6.3

This file did not come down when I did a fresh install.  I suspect you may have the same issue.  So you will have to get it.  I found something on the tech list that said you can register at https://www.maxmind.com/en/home  and download it from there, and then place it in the config directory.  That is what I did.  Here is the discussion about that:

https://groups.google.com/g/dspace-tech/c/50ecyxxAoUs/m/XMX4X3ioBQAJ

This is the line that is important in that thread:
I signed up to Maxmind and downloaded GeoLite2-City_xxxxxx.tar.gz which has the file GeoLite2-City.mmdb

So that is what I did, and now my config is:
usage-statistics.dbfile = []/config/GeoLite2-City.mmdb

If you look at the code, it says that this configuration has to be set for solr stats to work, and unfortunately if it is not, you will not get any errors in the log file.

Once you have this, go view some items and download some files, you should see the counts, but not immediately, there is a delay. I think it may take 15 minutes or so for the stats to show up.

Hope this helps!
-Jose



--
All messages to this mailing list should adhere to the DuraSpace Code of Conduct: https://duraspace.org/about/policies/code-of-conduct/
---
You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/eece2175-98e5-4d8c-9f48-6e9c522e45a7n%40googlegroups.com.

Mark H. Wood

unread,
Oct 19, 2020, 9:56:55 AM10/19/20
to DSpace Technical Support
On Fri, Oct 16, 2020 at 04:02:14PM -0400, Jose Blanco wrote:
> 2. Now... the part that was messing me up was that in
> */config/modules/usage-statistics.cfg*, there is one config parameter:
> *usage-statistics.dbfile*
>
> That should be set to a file like "GeoLite2-City.mmdb" for 6.3
>
> This file did not come down when I did a fresh install. I suspect you may
> have the same issue. So you will have to get it. I found something on the
> tech list that said you can register at https://www.maxmind.com/en/home
> and download it from there, and then place it in the config directory.
> That is what I did. Here is the discussion about that:
>
> https://groups.google.com/g/dspace-tech/c/50ecyxxAoUs/m/XMX4X3ioBQAJ
>
> This is the line that is important in that thread:
> *I signed up to Maxmind and downloaded GeoLite2-City_xxxxxx.tar.gz which
> has the file GeoLite2-City.mmdb*

Yes. Maxmind now *requires* that you create a (free) account, because
they are bound by a data-privacy law and must require your agreement
to keep your copy of the database updated.

DSpace's built-in download of the GeoLite database no longer works,
and is removed from future versions. MaxMind provides a downloader
which *does* work (once your configure it with your account
credentials), and many Linux distributions have it in their package
managers.

> So that is what I did, and now my config is:
> *usage-statistics.dbfile = []/config/GeoLite2-City.mmdb*
>
> If you look at the code, it says that this configuration has to be set for
> solr stats to work, and unfortunately if it is not, you will not get any
> errors in the log file.
>
> Once you have this, go view some items and download some files, you should
> see the counts, but not immediately, there is a delay. I think it may take
> 15 minutes or so for the stats to show up.

It may. The 'statistics' core is configured to wait 15 minutes before
automatically committing new documents. (I think that the autocommit
interval should be 30-60 seconds, but this is still being debated.)

--
Mark H. Wood
Lead Technology Analyst

University Library
Indiana University - Purdue University Indianapolis
755 W. Michigan Street
Indianapolis, IN 46202
317-274-0749
www.ulib.iupui.edu
signature.asc

Maya Zbitneva

unread,
Oct 21, 2020, 4:10:29 AM10/21/20
to DSpace Technical Support
Good day!

Thank you very much for the answer. Your answer helped me to solve my problem on test server on local host.
Now I need to realize your advice on our real web server. That is why I have some questions.
Could you please help me in the following moments:
1. File "local.cfg". String "solr.server = http://repository.khpa.edu.ua:8080/solr". Is it right?
2. File "dspace.cfg". Section "Browse configuration". Should String "BrowseDAO.class" be uncomment?
3. What access rights should I set in my operating system Ubuntu 18? Namely:
   - owner and its access to the folder [dspace]? Access = "creation, deletion, modification" or Access="access to files"?
   - group and its access to the folder [dspace]? Access = "creation, deletion, modification" or Access="access to files"?
  
With respect,
System administrator,
 Zbitneva Maya


суббота, 17 октября 2020 г. в 00:02:39 UTC+4, bla...@umich.edu:

Maya Zbitneva

unread,
Oct 21, 2020, 4:18:20 AM10/21/20
to DSpace Technical Support
And one more question:
1. File DSpace.cfg file. Section "ItemCounter Configuration". Should string "ItemCountDAO.class" be uncomment?

With respect,
System Administrator,
Zbitneva Maya

суббота, 17 октября 2020 г. в 00:02:39 UTC+4, bla...@umich.edu:
Maya,

Maya Zbitneva

unread,
Oct 21, 2020, 4:23:14 AM10/21/20
to DSpace Technical Support
I mean under "owner" = root or user(maya) or tomcat or what should be?

суббота, 17 октября 2020 г. в 00:02:39 UTC+4, bla...@umich.edu:
Maya,

Maya Zbitneva

unread,
Oct 21, 2020, 4:42:05 AM10/21/20
to DSpace Technical Support
And one more question:
Should [dspace]/webapps/solr and [dspace]/webapps/jspui be copied to opt/tomcat/webapps?

суббота, 17 октября 2020 г. в 00:02:39 UTC+4, bla...@umich.edu:
Maya,

Maya Zbitneva

unread,
Oct 21, 2020, 2:10:00 PM10/21/20
to DSpace Technical Support
  I attached Solr statistics on test server on local host using your instruction. But I can't attach Solr Statistics on real web server using your instruction. That is why I have the above questions.  

пятница, 16 октября 2020 г. в 23:02:39 UTC+3, bla...@umich.edu:
Reply all
Reply to author
Forward
0 new messages