Dataverse metrics Page

40 views
Skip to first unread message

Michel Bamouni

unread,
Sep 25, 2018, 9:12:03 AM9/25/18
to Dataverse Users Community
Hi,

I see a beautiful page which displays the metrics : https://dataverse.org/metrics

I want to get an equivalent for my dataverse. I know that dataverse provides rest api to get metrics. I want to know which api or development language are you using to get the charts ?

best regards,

Michel

Donald Sizemore II

unread,
Sep 25, 2018, 9:28:37 AM9/25/18
to dataverse...@googlegroups.com
Hello,

That looks like the output from Miniverse, which will generate a number of charts from standard queries. The last time I installed it, they recommend creating a read-only user for direct database access.

painstakingly pecked on my iphone.
--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.
To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/6bd48997-95af-4682-af7a-9c8f61f45531%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Philip Durbin

unread,
Sep 25, 2018, 9:36:35 AM9/25/18
to dataverse...@googlegroups.com
That's right. As Don and https://github.com/IQSS/dataverse/issues/4766 say, Miniverse[1] is powering that metrics page. Unfortunately, there some several problems:

- Only metrics for Harvard Dataverse are shown rather than all Dataverse installations that have been upgraded to Dataverse 4.9 or higher (which exposes metrics via new APIs).
- The Y-axis is truncated: https://github.com/IQSS/miniverse/issues/59

We recently wrote some code at https://github.com/IQSS/metrics.dataverse.org to aggregate metrics across installations and it should work fine for a single installation. However, we haven't written a front end yet. That code generates six TSV files from the new metrics APIs. Please see issue #4766 above for details.

So, at the Dataverse project level (as opposed to the installation level for Harvard Dataverse), we plan to switch to a not-yet-written front end that processes the six TSV files. You are welcome to try using Miniverse with a read-only user as Don mentioned for now.

I hope this helps,

Phil


To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/33CC54CF-232D-4798-9532-0F4AE7E681A8%40gmail.com.

For more options, visit https://groups.google.com/d/optout.


--

Michel Bamouni

unread,
Sep 25, 2018, 10:05:19 AM9/25/18
to Dataverse Users Community
Hi Donald,

Thanks for answer.
If I understands, dataverse procides api colled "miniverse" that I can use to create my metrics page?
If true, how can I see the documentation about miniverse please?

regards,

Michel


Le mardi 25 septembre 2018 15:28:37 UTC+2, Donald Sizemore II a écrit :
Hello,

That looks like the output from Miniverse, which will generate a number of charts from standard queries. The last time I installed it, they recommend creating a read-only user for direct database access.

painstakingly pecked on my iphone.

On Sep 25, 2018, at 09:12, Michel Bamouni <olimi...@gmail.com> wrote:

Hi,

I see a beautiful page which displays the metrics : https://dataverse.org/metrics

I want to get an equivalent for my dataverse. I know that dataverse provides rest api to get metrics. I want to know which api or development language are you using to get the charts ?

best regards,

Michel

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

Michel Bamouni

unread,
Sep 25, 2018, 10:43:32 AM9/25/18
to Dataverse Users Community

Hi DOnald And Phil,

Phil, I write my previous post before seeing your answer.
So if install miniverse following the guilines : https://github.com/IQSS/miniverse
At the installlation, will I able to generates 6 tsv metrics files or will I able to get metrics page like https://services.dataverse.harvard.edu/miniverse/metrics/metrics-links?

As reminder, my need is to get metrics page for my own dataverse.

regards,

Michel

Donald Sizemore II

unread,
Sep 25, 2018, 10:59:11 AM9/25/18
to dataverse...@googlegroups.com
It’s been a while since I’ve stepped through the process, but I installed Miniverse on an Ubuntu VM and pointed it at a copy of our production database.

Some of the charts it generated were very useful for our annual report, but the numbers could be misleading if your query got say a few days for the current month.

Raman presented on his continued work on Miniverse at the last Dataverse Community Meeting (an abysmal OS X upgrade has me limping along with an iPhone and an old Windows laptop, so forgive me for not digging up a link) but I’m a big fan of Miniverse and am excited to see its features rolled into Dataverse proper.


painstakingly pecked on my iphone.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

To post to this group, send email to dataverse...@googlegroups.com.

Philip Durbin

unread,
Sep 25, 2018, 11:50:28 AM9/25/18
to dataverse...@googlegroups.com
Miniverse does not create six TSV files. That's what https://github.com/IQSS/metrics.dataverse.org does. But again, there a front end has not yet been written to turn these six TSV files into charts. Anyone reading this is welcome to contributes a front end! :)

Miniverse creates JSON output that is used by its own front end (written in D3plus) to create the charts you see at https://dataverse.org/metrics

It sounds like Don has experience installing Miniverse. I've never installed it.

I hope this helps,

Phil
Hello,

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/35c97609-6d20-4b35-915b-e0d2c1179963%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Vyacheslav Tikhonov

unread,
Sep 25, 2018, 12:35:04 PM9/25/18
to Dataverse Users Community
Hi Michel,

Screen Shot 2018-09-25 at 6.32.37 PM.png

Screen Shot 2018-09-25 at 6.33.42 PM.png

We (DANS) have developed miniverse further for DataverseNL community and extended functionality with filters on affiliation and added new visualizations. We're interested in the collaboration with other partners on it.

Best,
Slava

Michel Bamouni

unread,
Sep 26, 2018, 3:21:18 AM9/26/18
to Dataverse Users Community
Hi Phil,

Thanks for answer

I understands now. I want to use miniverse , I must create my own front end to display the miniverse json output.

Regards,

Michel
Hello,

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

Michel Bamouni

unread,
Sep 26, 2018, 3:29:15 AM9/26/18
to Dataverse Users Community
Hi Slava,

Thanks for your return.

From the miniverse version in github which output is json, if it's not secret informations, how do you do to have the plotting front end please?

Regards,

Michel

Vyacheslav Tikhonov

unread,
Sep 26, 2018, 5:00:25 AM9/26/18
to Dataverse Users Community
Hi Michel,

miniverse is just simple Django application that connects frontend to Dataverse database (postgres) and aggregates all data.
You can get installation instruction here: https://github.com/IQSS/miniverse

I also want to integrate it in Docker module as separate container to get it next to the standard Dataverse instance.

Best,
Slava

Philip Durbin

unread,
Sep 26, 2018, 7:20:39 AM9/26/18
to dataverse...@googlegroups.com
No, sorry. This is confusing. You don't have to create your own front end for the Miniverse JSON output. A front end is included in Miniverse and it sounds like Slava has made improvements to Miniverse.

Hello,

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-commu...@googlegroups.com.

To post to this group, send email to dataverse...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/dataverse-community/2eabae60-53c4-4b38-aa30-1f5c51deb742%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Michel Bamouni

unread,
Sep 28, 2018, 8:44:32 AM9/28/18
to Dataverse Users Community
Hi Phil,

Thanks for all your answers. I understand now. I will install miniverse to see if I have all plotting I want.

regards,

Michel
Hello,

To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Dataverse Users Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to dataverse-community+unsub...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages