[ANNOUNCE] Taskcluster minor-version upgrade Wednesday, March 24

[Aki Sasaki]

The Taskcluster, CloudOps, and Releng teams are planning on rolling out a Taskcluster minor-version upgrade to the FirefoxCI cluster on Wednesday, March 9. Proposed timeline:

- Verify with Relman before proceeding
- Upgrade the cluster at 3pm UTC / 8am PDT
- Finish by 3:30pm UTC / 8:30am PDT; respond to this email.

This should be a low-risk minor-taskcluster-version cluster upgrade.

We have bounced the cluster before, and we've done upgrades-in-place (no tree closure) on the Community cluster. One objective here is to find whether we're able to successfully roll out minor cluster upgrades with no, or acceptably low, disruption. If there is more disruption than expected, ideally we can identify what we need to fix to make non-tree-closure minor upgrades possible.

Other notable changes we're planning on rolling out:
- FCP-64: fix our artifact expiration task, so our 4+ petabytes of artifact storage starts shrinking rather than continuing to grow unbounded.

- FCP-70, FCP-69: improvements to worker-manager, which has been slow to spin up workers in recent months.

Please let us know if you have any questions or concerns.

Backchannels:
- Slack: #firefox-ci-proj (primary) and #taskcluster-cloudops
- Matrix: #releaseduty and #firefox-ci

[Aki Sasaki]

> The Taskcluster, CloudOps, and Releng teams are planning on rolling out a Taskcluster minor-version upgrade to the FirefoxCI cluster on Wednesday, March 9

This should read "Wednesday, March 23".

[Aki Sasaki]

The upgrade is complete.

We upgraded from Taskcluster 44.8.1 to 44.8.4: https://github.com/taskcluster/taskcluster/blob/main/CHANGELOG.md

Please let us know if you noticed any fallout, with the caveat that Github is experiencing issues https://www.githubstatus.com/

Thank you Taskcluster, CloudOps, Sheriffs, and Releng teams!