On Monday 13th of March 2023 we experienced an outage due to a hardware failure on one of our hypervisors. Affected were all virtual machines on that particular host. Virtual machines running with a CEPH based volume were immediately migrated to other hosts and online again after about 15 minutes after we started investigating the issue. Virtual Machines with volumes located on the hypervisors NVMes were recovered at 1.45 PM CET. The host is fully operational again.
