NEW faster prototype unified views in BigQuery

18 views
Skip to first unread message

Matt Mathis

unread,
Dec 23, 2025, 12:35:12 PM (4 days ago) Dec 23
to MLab discuss

I am prototyping candidates for the next generation of unified views in BigQuery.  They are designed to support cost effective investigation of M-Lab’s huge global data set.  They include subsampling the data by 16:1 plus a number of other features to improve BQ performance.  I expect to produce additional versions with other subsampling ratios in the near future.


These new unified views also fully incorporate changes to MLab’s measurement fleet and data sets as described in the 2025-07-15 Blog Post, and should eventually replace the temporary instructions in that Blog Post.


This prototype is nearly 100% code compatible with the current unified and intermediate views. To use them you just need to change 1 or 2 lines of code.   I plan to maintain this level of compatibility going forward.


See the release notes: Rapid prototyping of new Unified Views for MLab


I will be engaging the research community to gather suggestions for further improvements.  You can also reply to this email to make early suggestions.


Happy Holidays everybody!

Thanks,
--MM--
Evil is defined by mortals who think they know "The Truth" and use force to apply it to others.
-------------------------------------------
Matt Mathis  (Email is best)
Home & mobile: 412-654-7529 please leave a message if you must call.
Reply all
Reply to author
Forward
0 new messages