Degraded network performance in us-southcentral1

Incident Report for Crusoe Cloud

Resolved

Full bandwidth has been restored to this region and this incident is now resolved.
Posted Sep 27, 2024 - 15:46 UTC

Update

We will be performing WAN maintenance this evening at 5:30 PM PT to restore full bandwidth in this region.
Posted Sep 24, 2024 - 21:12 UTC

Update

We have isolated the issue and are running at reduced capacity as we continue to monitor the region.
Posted Sep 22, 2024 - 23:10 UTC

Update

WAN maintenance is complete and we are continuing to monitor for any further issues.
Posted Sep 22, 2024 - 03:14 UTC

Update

We will be preforming WAN maintenance in this region as we continue to monitor and root cause this incident
Posted Sep 21, 2024 - 21:34 UTC

Update

We are still investigating the root cause of the issue. Some mitigations have been applied to the systems that will reduce the frequency of DNS timeouts.
Posted Sep 20, 2024 - 17:30 UTC

Update

We are still investigating the issue. Some mitigations have been applied to the systems that will reduce the frequency of DNS timeouts.
Posted Sep 20, 2024 - 03:37 UTC

Update

We are continuing to monitor for any further issues.
Posted Sep 20, 2024 - 03:37 UTC

Monitoring

We have identified a possible cause for this issue and are working on rolling out a fix for it.
Posted Sep 19, 2024 - 22:14 UTC

Update

We are still investigating our identified root cause as we are still seeing intermittent network degradation. Next update is in 60 minutes.
Posted Sep 19, 2024 - 21:04 UTC

Update

We are still investigating the possible culprit.
Posted Sep 19, 2024 - 19:43 UTC

Identified

We have identified a possible culprit and we are investigating the change. Next update is in 45 minutes.
Posted Sep 19, 2024 - 18:14 UTC

Investigating

We are currently investigating an issue with our networking in the us-southcentral1 region where customers are experiencing intermittent network degraded performance. Next update will be in 45 minutes or earlier.
Posted Sep 19, 2024 - 17:22 UTC
This incident affected: Networking (VPC Networking).