grafana dashboards

[David P. Anderson]

https://grafana.kiska.pw/d/boinc/boinc?orgId=1

This site uses Grafana to show graphs of project info
like the number of unsent and in-progress jobs.
It may be handy for administering your project.

-- David

[Jérôme Cadet]

Hello David

This is great!

- is this updated on a regular basis ? we don't have something like "last update date/hour", for each project ? 

- is it reading the boinc projects data the same way as other existing boinc statistical websites ? 

- some projects do not publish the data "the right way" ? for instance PrimeGrid doesn't have the per app statistic here when we do have it on StatSeb (same for NumberField, I didn't check all) 

Thanks.

--

Jérôme Cadet

--
You received this message because you are subscribed to the Google Groups "boinc_projects" group.
To unsubscribe from this group and stop receiving emails from it, send an email to boinc_project...@ssl.berkeley.edu.
To view this discussion visit https://groups.google.com/a/ssl.berkeley.edu/d/msgid/boinc_projects/CAFtuuLRsS-D9ShzuCCMGw5Rw4aW6CbPWQ_oXizbLB8ARORDL%2Bw%40mail.gmail.com.

[Vitalii Koshura]

Hello Jérôme,

- is this updated on a regular basis ? we don't have something like "last update date/hour", for each project ?

There is some timeout between data fetch. I don't know the details exactly, but you can think about it as a realtime data (almost)

- is it reading the boinc projects data the same way as other existing boinc statistical websites ? 

Yes

 - some projects do not publish the data "the right way" ? for instance PrimeGrid doesn't have the per app statistic here when we do have it on StatSeb (same for NumberField, I didn't check all) 

If some data is missing - it won't be just shown of the board (the corresponding metric will be just empty) 

Best regards,

Vitalii Koshura

ср, 19 февр. 2025 г. в 14:20, Jérôme Cadet <jerome...@pobox.com>:

To view this discussion visit https://groups.google.com/a/ssl.berkeley.edu/d/msgid/boinc_projects/CAMCrg0DN7q1H8iVcOLNUaNmsojaEimQyQ9WM1SLfcDNnta%2BgJQ%40mail.gmail.com.

[Jérôme Cadet]

Thanks for your super quick answer Vitalii :)

Who is maintaining this great tool ? is there some forum / discord / github / other communication canal to interact / report issues / say bravo ? 

--

Jérôme Cadet

[Oliver Behnke]

On 19.02.25 14:24, Vitalii Koshura wrote:
> - is it reading the boinc projects data the same way as other existing
>> boinc statistical websites ?
>
> Yes

Are you sure? To me this looks like scraping (our) server status page.
To my knowledge we don't publish our transitioner delay elsewhere. If
so, we don't like such moves and it might get them banned...

Best,
Oliver

[Vitalii Koshura]

Oliver:

Have you ever had issues with that?

The project is working for years, and since you have never mentioned this - why do it now?

Also, you can join the BOINC DIscord server and ask the author directly: https://discord.gg/wPRafUq

Best regards,

Vitalii Koshura

ср, 19 февр. 2025 г. в 14:50, Oliver Behnke <oliver...@aei.mpg.de>:

--
You received this message because you are subscribed to the Google Groups "boinc_projects" group.
To unsubscribe from this group and stop receiving emails from it, send an email to boinc_project...@ssl.berkeley.edu.

To view this discussion visit https://groups.google.com/a/ssl.berkeley.edu/d/msgid/boinc_projects/31ee1082-56d6-4ad2-8920-6f4add5e2892%40aei.mpg.de.

[Oliver Behnke]

On 19.02.25 14:52, Vitalii Koshura wrote:
> Oliver:
> Have you ever had issues with that?
> The project is working for years, and since you have never mentioned this -
> why do it now?

Well, we're constantly fighting scrapers, DDoS attacks and other
malicious behavior. But even well intentioned actions like calling RPCs
for legitimate reasons can get you banned if you do it excessively since
it stresses our infrastructure without good reason. As you pointed out
earlier:

> There is some timeout between data fetch. I don't know the details exactly,
> but you can think about it as a realtime data (almost)

On the plots there are 1-minute intervals...

That's what I consider excessive. We do provide stats data for
interested parties but it's up to us how we do that such that it doesn't
impact our operations. All major stats sites have access to our data, in
a well-behaved manner. Simply permanently scraping one's site isn't
well-behaved, it's misuse. Think about it, for standard BOINC projects
each request will run multiple potentially expensive live DB requests.

For us, providing a stable and reliable user experience is more or less
the most important (outside) goal. We do what's needed to ensure that.

> Also, you can join the BOINC DIscord server and ask the author directly:
> https://discord.gg/wPRafUq

Thanks. Anyone interested in using our data is welcome to reach out to
us and we'll figure out what's possible.

Oliver

[Oliver Behnke]

On 19.02.25 14:50, Oliver Behnke wrote:
> On 19.02.25 14:24, Vitalii Koshura wrote:
>> - is it reading the boinc projects data the same way as other existing
>>> boinc statistical websites ?
>>
>> Yes
>
> Are you sure? To me this looks like scraping (our) server status page.

Ok, ignore the term "scraping". There is of course the XML version of
the SSP. But still, it's very likely that *live* data, not the usual
statically exported stats data.

Oliver

[Greg Childers]

Overall I think this is a great resource. As Oliver mentioned, the SSP has an XML version for something just like this. And the expensive DB queries that feed the SSP are cached for an adjustable period of time so the project has some control of how live the data and the load on the server.

Greg

--
You received this message because you are subscribed to the Google Groups "boinc_projects" group.
To unsubscribe from this group and stop receiving emails from it, send an email to boinc_project...@ssl.berkeley.edu.

To view this discussion visit https://groups.google.com/a/ssl.berkeley.edu/d/msgid/boinc_projects/f63d8cf0-1c86-4b85-a36f-dd4e837235c2%40aei.mpg.de.

[Oliver Behnke]

On 19.02.25 16:28, Greg Childers wrote:
> And the expensive DB queries
> that feed the SSP are cached for an adjustable period of time so the
> project has some control of how live the data and the load on the server.

Ah, right. I was worried about stock projects but this has been in BOINC
for quite a while, so it should deployed on most of them.

Thanks Greg for the reminder,
Oliver