Outage start | Saturday, September 27, 2025 6 a.m. |
Expected end | Thursday, October 02, 2025 4 p.m. |
Update 10/02/2025:
KVM@TACC and CHI@Edge are now back to normal.
CHI@TACC is back to normal, exept for the following:
- A subset of baremetal nodes that lost network configuration.
- Composable hardware (Liqid and GigaIO) cannot reach their attached GPUs, pending a restart of these nodes and their shared PCIe backplane.
Thank you for your patience as we restore these!
Update 09/30/2025:
CHI@TACC and KVM@TACC are now passing tests for new instances.
Some older instances are still experiencing issues, we are working through the list to resolve them manually.
CHI@Edge is still experiencing failures starting new containers, and we're working to resolve those issues.
Due to a power outage the morning of Septermber 27th, the following services are encountering issues:
- CHI@TACC: Some baremetal nodes are encountering network issues
- KVM@TACC: Some instances are failing to power on, stuck either in state "powering on", or the console showing "booting from hard disk"
- CHI@Edge: launching new containers is currently failing
We are working to restore this functionality.