Reported Outages

KVM Meltdown/Spectre Outage

Resolved Posted by Michael Keller on January 12, 2018
Outage start Wednesday, January 17, 2018 8 a.m.
Expected end Wednesday, January 17, 2018 6 p.m.

Maintenance outage on Monday January 17, 2018 to the KVM installation to patch for Meltdown/Spectre exploits.

Maintenance period on CHI@TACC

Resolved Posted by Cody Hammock on January 02, 2018
Outage start Tuesday, January 02, 2018 6 a.m.
Expected end Friday, January 05, 2018 5 p.m.

Resolved:

The maintenance for CHI@TACC is complete. 

HP Moonshot nodes will remain reserved for maintenance while we configure network isolation for them.

We have updated the firmware on a number nodes, so if you believe that your experiments are sensitive to this, check the Chameleon Resource Browser (https://www.chameleoncloud.org/hardware/) for details

Maintenance period on CHI@UC

Resolved Posted by Pierre Riteau on December 04, 2017
Outage start Tuesday, December 12, 2017 5 a.m.
Expected end Wednesday, December 13, 2017 5 p.m.

A maintenance period is scheduled on CHI@UC tomorrow to enable new features, from 5 AM to 5 PM Central Time. All nodes have been reserved during this time.

CHI@TACC System Instability

Resolved Posted by Cody Hammock on December 03, 2017
Outage start Sunday, December 03, 2017 10:26 p.m.
Expected end Tuesday, December 05, 2017 12 a.m.

UPDATE:  System stability has been restored.

Due to instability resulting from last week's upgrade CHI@TACC will not be available for use. We are working to correct the issue and will provide an update as soon as possible.

CHI@TACC software upgrade underway

Resolved Posted by Cody Hammock on November 29, 2017
Outage start Monday, November 27, 2017 6 a.m.
Expected end Friday, December 01, 2017 6 p.m.

UPDATE:

The outage for CHI@TACC is complete. Please note that we have made some changes to the networking configuration, instances must be launched using the network named "ironic-provisioning" rather than "sharednet1" as before.

 

The CHI@TACC bare-metal cloud is unavailable due to a planned software upgrade, from November 27 at 7 AM CST to December 1 at 6 PM CST. All nodes have been reserved. You can continue using CHI@UC in the meantime.

CHI@UC software upgrade under way

Resolved Posted by Pierre Riteau on November 20, 2017
Outage start Monday, November 20, 2017 3 a.m.
Expected end Wednesday, November 22, 2017 6 p.m.

The CHI@UC bare-metal cloud is unavailable due to a planned software upgrade, from November 20 at 3 AM CST to November 22 at 6 PM CST. All nodes have been reserved. You can continue using CHI@TACC in the meantime.

Unresponsive network connections to CHI@UC instances

Resolved Posted by Pierre Riteau on November 17, 2017
Outage start Thursday, November 16, 2017 4 p.m.
Expected end Friday, November 17, 2017 2 p.m.

All attempted network connections to CHI@UC instances are unresponsive, expect for ICMP (ping) traffic. We are investigating the issue and will provide an update as soon as possible.

Network isolation temporary unavailable on CHI@UC

Resolved Posted by Pierre Riteau on October 28, 2017
Outage start Friday, October 27, 2017 3 p.m.
Expected end Tuesday, October 31, 2017 12 p.m.

The network isolation feature for bare metal is temporarily unavailable on CHI@UC while we investigate a technical issue.

Power outage at TACC

Resolved Posted by Pierre Riteau on June 23, 2017
Outage start Friday, June 23, 2017 1:15 a.m.
Expected end Friday, June 23, 2017 4:42 p.m.

Update: All Chameleon services have been restored. Several KVM instances are not recoverable, and the owners will be contacted directly.

From 06:15 AM UTC today, a power outage made the Chameleon portal and Chameleon resources hosted at TACC (KVM@TACC and CHI@TACC) unavailable.

Power has now been restored. However we are still running tests to ensure the platform is fully back up. Availability of the resources may be still be impacted while this is in progress.

Upcoming Network Outage at TACC

Resolved Posted by Cody Hammock on June 22, 2017
Outage start Tuesday, July 18, 2017 7 a.m.
Expected end Tuesday, July 18, 2017 5 p.m.

Access to the Chameleon Portal, CHI@TACC and KVM@TACC (https://www.chameleoncloud.org, https://chi.tacc.chameleoncloud.org, and https://openstack.tacc.chameleoncloud.org) will be unavailable on July 18, 2017 from 7:00 AM CDT until 5:00 PM CDT. During this time, TACC will be upgrading the core network switch, and access may be intermittent until the upgrade is complete. Updates will be sent once network services have been restored.