CHI@UC Datacenter outage July 28th-31st
| Outage start | Friday, July 28, 2023 12 p.m. |
| Expected end | Monday, July 31, 2023 4:54 p.m. |
CHI@UC is back online, and we're observing normal usage patterns so far.
Please reach out if you're encountering issues.
| Outage start | Friday, July 28, 2023 12 p.m. |
| Expected end | Monday, July 31, 2023 4:54 p.m. |
CHI@UC is back online, and we're observing normal usage patterns so far.
Please reach out if you're encountering issues.
| Outage start | Wednesday, July 05, 2023 11:13 a.m. |
| Expected end | Wednesday, October 18, 2023 11:01 a.m. |
RESOLVED: The faulty hardware has been identified and replaced. The Liqid subsystem is once again available to use.
The Liqid composeable hardware subsystem for CHI@TACC is experiencing intermittent issues with connecting the PCI devices with the connected hosts.
| Outage start | Wednesday, July 05, 2023 9 a.m. |
| Expected end | Wednesday, July 05, 2023 11:30 a.m. |
The maintenance is proceeding well, but will likely take an extra 30 minutes or so, finishing at 11:30 rather than 11AM.
Afterwards, all instances will be acceissable as normal.
| Outage start | Monday, June 12, 2023 6 a.m. |
| Expected end | Tuesday, June 13, 2023 12 a.m. |
We're currently observing an issue where some projects fail to mount the filesystem at CHI@UC, receiving an error message about an "RBAC Quota". We are currently investigating.
This is purely an access issue with new "storage leases", existing storage leases/mounts should be unaffected.
| Outage start | Saturday, June 03, 2023 6 p.m. |
| Expected end | Tuesday, June 13, 2023 6 p.m. |
CHI@IIT is currently down, we've had a persistent hardware issue with the controller node at this side.
Site staff are currently investigating.
| Outage start | Tuesday, May 30, 2023 2 a.m. |
| Expected end | Wednesday, June 07, 2023 11:36 a.m. |
CHI@NU was down due to a hardware failure in the controller node. This has now been replaced, and the site is back online.
| Outage start | Sunday, May 07, 2023 5 p.m. |
| Expected end | Friday, May 12, 2023 5:55 p.m. |
05/12/23: CHI@UC is back online. All systems look stable, but we'll be keeping an eye on it over the weekend to be sure.
Pleas let us know if you encounter issues!
| Outage start | Monday, April 03, 2023 10:06 a.m. |
| Expected end | Monday, April 03, 2023 11:01 a.m. |
Update 11:01am: The upstream issue seems to have resolved, and sites are again accessible. We'll be monitoring the situation to see if it remains stable.
Authentication to all sites is currently down due to a failure in our central authentication system.
Existing instances should be unaffected, but users won’t be able to create or modify existing instances.
This seems to be caused by a failure in our upstream DNS provider, we are working with them to get an ETA for resolution.
| Outage start | Sunday, March 26, 2023 8 a.m. |
| Expected end | Sunday, March 26, 2023 1:12 p.m. |
Update: Maintenance was completed a 1:12 PM (CDT) yesterday Sunday, 26 March 2023.
Network maintenance will be carried out between 8:00 AM and 2:00 PM (CDT) on Sunday, 26 March 2023. Access to all TACC systems will be unavailable during this time, including CHI@TACC, KVM@TACC, and the Chameleon Portal. Instances will continue to run, but users will have no access to TACC services and systems until the upgrade is complete.
Please submit any questions you may have via the TACC User Portal.
| Outage start | Monday, April 03, 2023 11 a.m. |
| Expected end | Wednesday, April 05, 2023 4 p.m. |
On April 3rd, CHI@EVL will be down while we replace the controller node. Conservatively, this should take about 4 hours before services are restored. Running instances and leases won't be modified, but will not be accessible during the outage window.