Announcement: M-Lab is now publishing Cloudflare's network quality data

[Lai Yi Ohlsen]

Hi everyone, 

I'm happy to share that M-Lab is now publishing Cloudflare’s Aggregated Internet Measurement (AIM) dataset, which includes and builds upon the data produced by speed.cloudflare.com. You can read more about our partnership with Cloudflare and our mutual goal of measuring network quality to better understand the end-user experience on both Cloudflare and M-Lab's blog. 

And good news, if you're reading this message, you already have access to the data. Subscription to the dis...@measurementlab.net list is all you need to start querying our public BigQuery dataset. You can test your access and view a sample query here. In the coming weeks we'll be working on more documentation and example use cases. 

I'm also personally excited to note that in addition to publishing open data, Cloudflare has open-sourced their speed test client, thereby providing another open source methodology that can be used to measure Internet performance and enabling the collection of even more open data, all of which will be accessible via M-Lab's public BigQuery. 

If you use the new data and find it useful or have feedback, we'd love to know about it! Feel free to reach out to me directly or in reply to the list. 

Have a great week! 

--

Lai Yi Ohlsen

Lead Data Scientist

Measurement Lab

Code for Science & Society

[Livingood, Jason]

How do we access the schema? I followed the link from https://colab.research.google.com/drive/1xgc-7L1Okr04MSjsYJfiFeUN0Gu05bpQ?usp=sharing#scrollTo=rBQ9aW7wmwj9to over to https://console.cloud.google.com/bigquery?project=measurement-lab&ws=!1m5!1m4!4m3!1smeasurement-lab!2scloudflare!3sspeedtest_speed1 and it just never fully loads the schema.

 

Thx!

--
You received this message because you are subscribed to the Google Groups "discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to discuss+u...@measurementlab.net.
To view this discussion on the web visit https://groups.google.com/a/measurementlab.net/d/msgid/discuss/CAD3WrcO%2BheDC49dAg6M2gMakSWM0C5uQe6pe49tZOJFFsV0p_A%40mail.gmail.com.

[Lai Yi Ohlsen]

Hey Jason, 

Thanks for the quick try :) 

Can you send a screenshot of what you're seeing? And quick check that you're accessing BigQuery with the same e-mail address that you're subscribed to the discuss@ list with? 

[Carlos Rodrigues]

Hi,

This query aggregates data from a country and/or a list of ASNs and can also serve as an example of how to use this schema to get numbers for download, upload, latency (idle/loaded), jitter (idle/loaded), and a (crude) bufferbloat score:

https://console.cloud.google.com/bigquery?sq=754187384106:90a7eff821f840468e3fb249a71c6f7d

[Dave Taht]

On Thu, Apr 27, 2023 at 5:22 AM Carlos Rodrigues <cefrod...@gmail.com> wrote:
>
> Hi,
>
> This query aggregates data from a country and/or a list of ASNs and can also serve as an example of how to use this schema to get numbers for download, upload, latency (idle/loaded), jitter (idle/loaded), and a (crude) bufferbloat score:
>
> https://console.cloud.google.com/bigquery?sq=754187384106:90a7eff821f840468e3fb249a71c6f7d

This is great. Unfortunately I am not familiar enough with this
interface to actually run a query!

I appreciate the shoutout to various sqm techniques in the query also.
I have never had a picture of how fully this deployed, despite
essentially being on by default on most ubnt, mikrotik, google wifi
devices, riverbed, and openwrt/gamer routers worldwide.

Grouping sub 60Mbit connections together might help cut wifi out of the loop.

At a per AS-scale, I am under the impression that the Preseem fq_codel
middlebox has somewhere between 15%-40% penetration in the USA/Canada
wisp market. Two known ASes for universal CAKE (libreqos-based)
deployment are AS45230 in NZ, and AS397709 in the USA. (I have a few
dozen more but not permission to publish). Shaping the downward
direction properly at the ISP ingress from the internet at a shaping
middlebox, rather than via inbound shaping in SQM, usually leads to
pretty nice results on various other tests.

I have a second theory that I would like to confirm, in that folk that
do speedtests are disinclined to run them when the network is running
well, so trying to compare similar size ISPs w or w/o SQM-like
solutions in place might be interesting.

I will try to get more before/afters from this tool on future libreqos
installs! We are down to where a small ISP can get it running
partially in minutes, and fully, over a weekend, and doing a couple a
week now. ( https://github.com/LibreQoE/LibreQoS/releases/tag/v1.4-rc6
)

> To view this discussion on the web visit https://groups.google.com/a/measurementlab.net/d/msgid/discuss/96262574-7b41-46db-a2ad-d01b0102b74dn%40measurementlab.net.



--
AMA March 31: https://www.broadband.io/c/broadband-grant-events/dave-taht
Dave Täht CEO, TekLibre, LLC

[Lai Yi Ohlsen]

Hey Dave, 

Great to get your thoughts here. On running the query: 

If you are logged into Google Cloud with the email address you receive this mailing lists emails on, you should see a blue button that says "Run" at the top which will run the query for you. Then there is a button in the Action column that says 'View Results'. Carlos has provided comments to help structure the query to your interests. 

Let me know if you have issues! 

To view this discussion on the web visit https://groups.google.com/a/measurementlab.net/d/msgid/discuss/CAA93jw5y1jf5iHh06do-82%2BJDEXGMpVu-HH3cte6wUQUepe4Cw%40mail.gmail.com.

[Dave Taht]

On Thu, Apr 27, 2023 at 7:02 AM Lai Yi Ohlsen <la...@measurementlab.net> wrote:
>
> Hey Dave,
>
> Great to get your thoughts here. On running the query:
>
> If you are logged into Google Cloud with the email address you receive this mailing lists emails on, you should see a blue button that says "Run" at the top which will run the query for you. Then there is a button in the Action column that says 'View Results'. Carlos has provided comments to help structure the query to your interests.

that is great! there is a paucity of tests against the ASes I know
about, which I will try to address in the coming months.

[Carlos Rodrigues]

Hi all,

Cloudflare Radar now has an "Internet Quality" section where most of the visualizations are based on the same speed test data that's being published raw through M-Lab since April.

    https://radar.cloudflare.com/quality

Comments are welcome. 👋

[Aditya Bej]

Is there a way to check data for individual states rather than entire countries in the cloudfare link you have provided?

Thanks,

Aditya

[Carlos Rodrigues]

Currently, no. Cloudflare Radar does not expose Internet quality data at the region/state level, even though you can find the region/state in the raw data that's being published through M-Lab.

Best regards,

Carlos