Reported Outages

CHI@TACC System Instability

Resolved Posted by Cody Hammock on December 03, 2017
Outage start Sunday, December 03, 2017 10:26 p.m.
Expected end Tuesday, December 05, 2017 12 a.m.

UPDATE:  System stability has been restored.

Due to instability resulting from last week's upgrade CHI@TACC will not be available for use. We are working to correct the issue and will provide an update as soon as possible.

CHI@TACC software upgrade underway

Resolved Posted by Cody Hammock on November 29, 2017
Outage start Monday, November 27, 2017 6 a.m.
Expected end Friday, December 01, 2017 6 p.m.

UPDATE:

The outage for CHI@TACC is complete. Please note that we have made some changes to the networking configuration, instances must be launched using the network named "ironic-provisioning" rather than "sharednet1" as before.

 

The CHI@TACC bare-metal cloud is unavailable due to a planned software upgrade, from November 27 at 7 AM CST to December 1 at 6 PM CST. All nodes have been reserved. You can continue using CHI@UC in the meantime.

CHI@UC software upgrade under way

Resolved Posted by Pierre Riteau on November 20, 2017
Outage start Monday, November 20, 2017 3 a.m.
Expected end Wednesday, November 22, 2017 6 p.m.

The CHI@UC bare-metal cloud is unavailable due to a planned software upgrade, from November 20 at 3 AM CST to November 22 at 6 PM CST. All nodes have been reserved. You can continue using CHI@TACC in the meantime.

Unresponsive network connections to CHI@UC instances

Resolved Posted by Pierre Riteau on November 17, 2017
Outage start Thursday, November 16, 2017 4 p.m.
Expected end Friday, November 17, 2017 2 p.m.

All attempted network connections to CHI@UC instances are unresponsive, expect for ICMP (ping) traffic. We are investigating the issue and will provide an update as soon as possible.

Network isolation temporary unavailable on CHI@UC

Resolved Posted by Pierre Riteau on October 28, 2017
Outage start Friday, October 27, 2017 3 p.m.
Expected end Tuesday, October 31, 2017 12 p.m.

The network isolation feature for bare metal is temporarily unavailable on CHI@UC while we investigate a technical issue.

Power outage at TACC

Resolved Posted by Pierre Riteau on June 23, 2017
Outage start Friday, June 23, 2017 1:15 a.m.
Expected end Friday, June 23, 2017 4:42 p.m.

Update: All Chameleon services have been restored. Several KVM instances are not recoverable, and the owners will be contacted directly.

From 06:15 AM UTC today, a power outage made the Chameleon portal and Chameleon resources hosted at TACC (KVM@TACC and CHI@TACC) unavailable.

Power has now been restored. However we are still running tests to ensure the platform is fully back up. Availability of the resources may be still be impacted while this is in progress.

Upcoming Network Outage at TACC

Resolved Posted by Cody Hammock on June 22, 2017
Outage start Tuesday, July 18, 2017 7 a.m.
Expected end Tuesday, July 18, 2017 5 p.m.

Access to the Chameleon Portal, CHI@TACC and KVM@TACC (https://www.chameleoncloud.org, https://chi.tacc.chameleoncloud.org, and https://openstack.tacc.chameleoncloud.org) will be unavailable on July 18, 2017 from 7:00 AM CDT until 5:00 PM CDT. During this time, TACC will be upgrading the core network switch, and access may be intermittent until the upgrade is complete. Updates will be sent once network services have been restored.

Maintenance Session on KVM@TACC

Resolved Posted by Cody Hammock on April 20, 2017
Outage start Tuesday, April 25, 2017 8 a.m.
Expected end Wednesday, April 26, 2017 4 p.m.

UPDATE: The maintenance session is now complete. Some instances could not be migrated during this period, and affected users will be contacted regarding migration of their VMs.

A maintenance session on KVM@TACC is scheduled for Tuesday, April 25 2017 from 8 AM to 4 PM Central Time. During this session, a number of virtual machines will be migrated from one host to another. Migrated virtual machines will experience a brief interruption, but are expected to be otherwise unaffected.

Instances unreachable on CHI@UC

Resolved Posted by Pierre Riteau on April 07, 2017
Outage start Friday, April 07, 2017 11 a.m.
Expected end Friday, April 07, 2017 1:20 p.m.

All instances on CHI@UC are currently unreachable via SSH. We are working to fix the issue as soon as possible. We will update when connectivity is restored.

Upcoming Power Outage at CHI@UC

Resolved Posted by John Roberts on February 16, 2017
Outage start Monday, March 06, 2017 7 a.m.
Expected end Monday, March 06, 2017 5 p.m.

UPDATE: This work is complete and CHI@UC is once again available.

Dear Chameleon users,

We have received notice from the building housing the CHI resources at the University of Chicago that they will be performing planned power work on Monday, March 6th 2017.

CHI@UC will be unavailable starting at 07:00 AM CST Monday the 6th and coming back by the end of day. An all clear message will be sent out once the work has been completed.