Keeping customers updated on network, operational, and enterprise elements

EVENT START DATE: 07-25-2010

EVENT START TIME: 00:00 CST

EVENT END DATE: 07-25-2010

EVENT END TIME: 06:00 CST

EVENT IMPACT: ALO01 (Cedar Falls)

EVENT DETAILS:

On Sunday 7/25/2010 at 00:00 CST, LT Network Engineering will be performing scheduled maintenance in the Cedar Falls data center to migrate aggregate customer connectivity to a new network device.  Customers in the Cedar Falls data center will experience brief periods of outage as connectivity is moved to the new device in a phased and controlled migration.  Recovery for customers affected during this migration should be rapid and complete with no residual affect following resumption of normal connectivity.

EVENT START DATE: 07-09-2010

EVENT START TIME: 15:00 CST

EVENT END DATE:  07-9-2010

EVENT END TIME: 15:45 CST

EVENT IMPACT: Toll free and auto routing of inbound Defcon Managed Support line

EVENT DETAILS:

At approximately 3pm on Friday, July 9th, incoming calls to our Defcon Managed Support line began experiencing routing problems or fast-busy responses.  This is impacting customers needing to contact our Managed Support team for updates on open issues or to report new issues via phone.  We apologies for this inconvenience and are working with our providers to correct the call routing and restore full phone services.

Access to all technical support, including Managed Support, remains available via https://pentagon.layeredtech.com.

Thank you for your patience while we work through this issue.

UPDATE 15:45 07/9/2010: The inbound call routing issues have been resolved.  Thank you again for your patience while we worked to resolve this issue.

START DATE: 29 JULY 2010
START TIME: 20:00 (08:00PM) Central Time

END DATE: 30 JULY 2010
END TIME: 04:00 (04:00AM) Central Time

WORK PURPOSE: UPS Quarterly Maintenance
IMPACT: Prairie Lakes Data Center

EVENT DETAILS:

TEAM Technologies will be performing its regular UPS quarterly preventative maintenance from 20:00 (8pm) July 29th to 04:00(4am) July 30th.  The data center will be transferred to generator power for the duration of the maintenance window. No disruption to customer power is expected during the maintenance window.  LayeredTech personnel will also be on-site to monitor the maintenance.  If there are any questions regarding this maintenance, please open a support request via Pentagon (https://pentagon.layeredtech.com).

EVENT START DATE: 08-11-2010
EVENT START TIME: 18:00 CST

EVENT END DATE: 08-12-2010
EVENT END TIME: 00:00 CST

EVENT IMPACT: ORD01 (Chicago)

EVENT DETAILS:

CoreSite will be performing quarterly checks on the facility generators.  This includes performing a 30 minute loaded run.  Best practices and procedures will be employed throughout this event and we would like to ensure that all relevant IDC tenants are aware of the activity.  LayeredTech personnel will also be on-site to monitor the maintenance.  If there are any questions regarding this maintenance, please open a support request via Pentagon (https://pentagon.layeredtech.com).

EVENT START DATE: 27-06-2010

EVENT START TIME: 22:00 CDT

EVENT END DATE:

EVENT END TIME: :

EVENT IMPACT: Connectivity stability in the ALO-Cedar Falls data center impacting multiple customers.

EVENT DETAILS: At 22:00CDT 27-06-2010 Layered Tech NOC observed connectivity issues impacting the Cedar Falls data center.  Network Services is working to identify the source of the issue and a resolution.  Updates will be provided regularly throughout this event and all efforts are being made to minimize the impact of this issue.  Our apologies for the inconvenience.

UPDATE: As of 22:40 LT Network Services is continuing to work to isolate the cause of the connectivity stability issues in Cedar Falls.  Steps are being taken to isolate and mitigate the impact to the various segments of the network and to return stability as soon as possible.  At this time there continues to be some instability that is manifesting itself for customers as latency/packet loss and loss of connectivity to various hosts.  We will continue to update this posting as progress is made, and appreciate your patience while we work to resolve this issue.

UPDATE: 23:40, LT Network Services has worked to identify a likely DDOS event responsible for the packet loss and network stability issues we have experienced in Cedar Falls.  We are actively working to remove the target(s) of the attack and with upstream providers to minimize the ongoing impact.  Evidence points to a DDOS, but final root cause is pending further analysis.  Again we thank you for your patience while we work to fully resolve this issue.