NB (both versions) down 10/5/21 AM

[David Karger]

Our lab has suffered an outage of its network infrastructure which has taken down NB.  Our sysadmins are working to fix it as quickly as possible.  I will reply here when things are back up.

[David Karger]

Just to update, this is a lab-wide outage that has hit all thousand people working in our lab, so all hands are on deck trying to fix it.  But as yet, they don't have an ETA. They write:

"The root cause of this problem was a minor version upgrade of our "Ceph" storage clusters (which we've done 2-3x a year for the past 5+ years with no issue) that resulted in data unavailability for our OpenStack virtualization systems and many core services that depend on it. We are reasonably confident no data has been lost but we do not have a restoration ETA or a good understanding of why the relevant sub-servce is failing. We very much apologize for this outage and are doing our best to get OpenStack back up and running as quickly as possible. "