Problem with Data Count

37 views
Skip to first unread message

Taki NakaMura

unread,
Sep 13, 2021, 4:09:49 AM9/13/21
to Dataverse Users Community
Hi everyone,

After installing the Dataverse, I would like to have the Data Count function in the Dataverse, and I installed the Counter Processor and downloaded the GeoLite2 Country from https://www.maxmind.com/en/accounts/605766/geoip/downloads

Since I am running the Counter Processor in the middle of a month, I created the log files from 2021-09-01 to 2021-09-12 (Today is 2021-09-13), and I run 
CONFIG_FILE=counter-processor-config.yaml python3 main.py
and a json file is created. However, in Dataverse, it is showing 0 for downloads, views and citation after I reloaded the page and downloaded the file for serveral times. Is there anything I am missing? Thanks.

download0.PNG

Patrick

Taki NakaMura

unread,
Sep 14, 2021, 5:23:33 AM9/14/21
to Dataverse Users Community
Hi everyone,

When I checked the json file make-data-count-report.json generated, I can see the count in the json file. However, when I tried to checked the count via API, it is showing the following:
{"status":"OK","data":{"message":"No metrics available for dataset 775 for null for country code null."}}
When I added the country code and it showed the following:
{"status":"OK","data":{"message":"No metrics available for dataset 775 for null for country code us."}}. 
Also, in the Dataverse page, the views, downloads and citations are 0.
Is there anything missing in my configuration? Thanks.

Patrick

Taki NakaMura 在 2021年9月13日 星期一下午4:09:49 [UTC+8] 的信中寫道:

James Myers

unread,
Sep 14, 2021, 9:03:37 AM9/14/21
to dataverse...@googlegroups.com

Patrick,

Counter only processes data up to yesterday’s date so any changes from the current day won’t appear until tomorrow. Beyond that, the only issue I can think of would be if you have turned on MDC logging but haven’t turned on display of the MDC metrics (in that case you should see the internal metrics not 0 so I’m guessing this isn’t involved.)

 

There is a counter config setting that you can use to tell it to process the logs as of a given date (such as tomorrow’s date) for testing, but it may just be easier to wait. If you don’t get counts showing up tomorrow, you can walk through the chain of checking that there are entries in the Dataverse mdc log, that counter produces it’s parsed output, that those entries are being submitted to Dataverse and show up in the datasetmetrics table, etc.

 

Also, FWIW: If you use the cron scripts for running counter_processor, they will create any missing files for you (happens at startup but if you have a day with no activity, there won’t be a log file then either.).

 

-- Jim

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/9c2b3648-03da-4019-a3bc-1d4d8a9aeb58n%40googlegroups.com.

James Myers

unread,
Sep 14, 2021, 3:24:08 PM9/14/21
to dataverse...@googlegroups.com

Patrick,

Have you run

after running counter-processor as described in the guides? That step uploads counter’s output to Dataverse for display.

Also – there is a separate API call to request that Dataverse contact DataCite to update citations.

 

The easiest way to do both of those is with the scripts linked into the guide.

 

Hopefully with that you’ll be able to make the API calls you’ve indicated below. Note that the ‘for null’ in the second message is because you haven’t indicated the yyyymm – that’s optional so shouldn’t be a reson for you to see no counts.

 

-- Jim

 

 

From: dataverse...@googlegroups.com [mailto:dataverse...@googlegroups.com] On Behalf Of Taki NakaMura


Sent: Tuesday, September 14, 2021 5:24 AM
To: Dataverse Users Community

--

You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

Taki NakaMura

unread,
Sep 15, 2021, 4:46:08 AM9/15/21
to Dataverse Users Community
Thanks, Jim.
After running curl -X POST "http://localhost:8080/api/admin/makeDataCount/addUsageMetricsFromSushiReport?reportOnDisk=/tmp/make-data-count-report.json", the Dataset Metrics looks fine now, and the API calls also work fine now.

Patrick
Jim Myers 在 2021年9月15日 星期三上午3:24:08 [UTC+8] 的信中寫道:
Reply all
Reply to author
Forward
0 new messages