Changing Glean datetime metric columns to be timestamps in BigQuery stable views

[Sean Rose]

Later today I plan to merge bigquery-etl PR 3343 which will cast all Glean datetime metrics to be timestamps instead of strings in their associated BigQuery stable views.

As far as I can tell no datetime metrics are actively being used in Looker dashboards or Redash queries, but it's possible I've missed something that might break, particularly in Looker where you'll now have to pick a particular precision (time, date, month, etc.) when using such datetime metrics.

Also, the string versions of the datetime metrics will still be available as separate columns with a `raw_` prefix (e.g. the string version of `metrics.datetime.foo` would be available as `metrics.datetime.raw_foo`).

Sean Rose

(he/him && Senior Data Engineer && Mozilla Corporation)

(sr...@mozilla.com || Slack @srose || Matrix @srose)

[Sean Rose]

Unfortunately merging bigquery-etl PR 3343 had the side effect of causing the search_derived.mobile_search_clients_daily_v1 ETL query to exceed the query complexity limit in the moz-fx-data-shared-prod project (bug 1803534), so it has been reverted until we can get the query complexity limit increased.

Sean Rose

(he/him && Senior Data Engineer && Mozilla Corporation)

(sr...@mozilla.com || Slack @srose || Matrix @srose)

[Sean Rose]

This change was successfully reapplied last week after the query complexity limit was increased.

Sean Rose

(he/him && Senior Data Engineer && Mozilla Corporation)

(sr...@mozilla.com || Slack @srose || Matrix @srose)

[Alessio Placitelli]

Thank you for your efforts on this one Sean! This will definitely help the ergonomics of querying the data!

--
You received this message because you are subscribed to the Google Groups "data-org" group.
To unsubscribe from this group and stop receiving emails from it, send an email to data-org+u...@mozilla.com.
To post to this group, send email to data...@mozilla.com.
To view this discussion on the web visit https://groups.google.com/a/mozilla.com/d/msgid/data-org/CAGt_AA3840Ro9_s0GPBXO77sosFHgHXj1ewj_Ln-ZcgUYskSqQ%40mail.gmail.com.