Completed -
Maintenance on the FE Leaf switches in us-east1-a is now complete and all VMs in the region are up and running.
All services are now Operational.
If you experience any issues, please contact Crusoe Support.
Jul 16, 18:54 UTC
Update -
Work to restore access to the remaining VM's continues. Remaining VM's are expected to recover by 18:45 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 18:33 UTC
Update -
We continue to make progress recovering VM's. The remaining VM's, which account for around 20% of the total in us-east1a, are expected to recover by 18:45 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 18:16 UTC
Update -
Work to restore access to the remaining VM's continues. Remaining VM's are expected to recover by 18:15 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 18:00 UTC
Update -
We continue to make progress recovering VM's. The remaining VM's, which account for around 30% of the total in us-east1a, are expected to recover by 18:15 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 17:41 UTC
Update -
Work to restore access to the remaining VM's continues. Remaining VM's are expected to recover by 17:45 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 17:21 UTC
Update -
Work to restore access to the remaining VM's continues. Remaining VM's are expected to recover by 17:45 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 17:06 UTC
Update -
Significant progress has been made over the past hour. Remaining VM's are expected to recover by 17:45 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 16:46 UTC
Update -
Work to restore access to the remaining VM's continues, which we expect to be fully recovered by 17:00 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 16:30 UTC
Update -
Work to restore access to the remaining VM's continues, which we expect to be fully recovered by 17:00 UTC.
We will continue to post updates every 15 minutes until this is fully resolved.
Jul 16, 16:17 UTC
Verifying -
Maintenance on the FE Leaf switches in us-east1-a is now complete, and VM's in this region are beginning to come back online. We are actively working to restore access to the remaining VM's, which we expect to be fully recovered by 17:00 UTC.
We will continue to post updates every 15 minutes until this is fully resolved. If you have any questions, please reach out to support@crusoe.ai.
Jul 16, 15:52 UTC
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 16, 12:00 UTC
Update -
Update: To ensure a safe and successful maintenance window, we require all customers with active VMs in us-east1-a to shut down their instances prior to the maintenance start time. Any VMs still running at the start of the maintenance window will be shut down by Crusoe on your behalf.
Please note that shutting down a VM will result in loss of any data stored on ephemeral (local) disks. If you have data on ephemeral storage that you need to retain, please back it up before the maintenance window begins.
Persistent/Shared storage volumes will not be affected by this shutdown process.
If you have questions or concerns, please reach out to support@crusoe.ai.
Jul 14, 16:56 UTC
Scheduled -
Crusoe Cloud will be performing planned network maintenance to upgrade Front End (FE) Leaf switches across our global infrastructure. This critical update addresses known software bugs and standardizes our network command-set, significantly improving long-term stability and incident response.
During the maintenance window, all hypervisors in the us-east1-a region will experience intermittent unavailability. We strongly recommend pausing or gracefully shutting down critical workloads during the window to prevent unexpected disruptions or data loss.
All other services outside the us-east1-a region will remain operational. If you have questions regarding your specific workloads or notice persistent issues following a maintenance window, please reach out to support@crusoe.ai.
Jun 27, 04:14 UTC