***Resolved*** Connectivity issue – Park Royal Data Centre

April 25th, 2012

Dear Customers,

Update 00:52

The connectivity has been restored and full RFO for the outage requested. Should any of the our customers is still experiencing connectivity issues, please let us know by logging the ticket to https://support.c4l.co.uk.

Update 00:29

Our link provider has confirmed that they are still investigating the root of the problem and aim to resolve it as soon as possible.

Update: 00:12

Our provider has confirmed that they currently are having the issues with their link providers. We are still waiting for the reply and further details will be provided shortly.

 

We are aware of the issues in the Park Royal and are currently working over it in order to resolve it with our link providers.

Regards,

Telehouse North connectivity

April 25th, 2012

Update 26/04/12

Good afternoon, we have continued with our investigations and have now finished the process of documenting each of the below services disruptions from a technical perspective.  This has been handed to our account managers and sales teams for sanitising and agreeing the best way of handling this information to give to our customers.  We expect that tomorrow we will start rolling out specific, detailed information, to our affected customers to email addresses we have on file.

 

Update 18:18

Work has continued to identify the issue and a fix, and we have made progress, we will have further information to follow about this in the morning. Rest assured work is being planned to address the recent issues experienced by various parts of our network, including GS2, Maidenhead and of course Telehouse East and North with the recent reloads.

Update 10:06 : An examination of the log output generated by the device immediately before the reload indicates that the reload was forced by a check that runs inside the router software in order to detect that traffic has stopped forwarding.

The check runs every 15 seconds and forces the reload in the event of 10 failed results, which is consistent with the timeline we observed in terms of loss of connectivity and the beginning of recovery.The information immediately available cannot conclusively determine whether this is a hardware or software fault at this time.

We are proceeding to seek additional advice about the crash data from our supplier.

 

Dear Customers,

We have seen an unexpected reload on our device “Kusanagi” in Telehouse North.  The device has now come back online, so normal service has resumed.  The reported cause was a bus error, and we are presently looking into the potential reasons and possible remedial actions in response to this.

Contact:

Please submit support enquires to our support site at https://support.c4l.co.uk.

Kind Regards
C4L Technical Team

 

TelecityGroup Memaco House – Deep Clean Works 8th – 18th May 2012

April 25th, 2012

Dear Customers,

We have been advised of the following planned maintenance work being carried out at the TelecityGroup Memaco House:

Description:

TelecityGroup will be carrying out a deep clean of customer suites and data floor areas at Memaco House from the 8th – 18th May 2012.

Please be advised that our specialist cleaning contractors will need to enter your dedicated area to carry out the deep clean. Any spare equipment or items on the floor will need to be cleared or moved to enable the cleaning works to be completed. Please make arrangements to clear any items on the floor within your area prior to commencement of the deep clean. If any items are found on the floor when our cleaning contractors enter your area, TelecityGroup’s engineers will move the items to an alternate location and place the items back once the cleaning is complete.

The cleaning contractors will ensure that suites doors are closed and as an additional security measure, TelecityGroup has arranging for dedicated security personnel to be in attendance whilst the cleaning contractors are working in your area to maintain our high security levels.

We do not anticipate any impact to your service whilst these works are ongoing. There may be short periods when some floor tiles in your area are raised during the cleaning works, however this will have minimal impact to the cooling in your area and the tiles can be promptly reinstated back into position if you need to access your dedicated area.

Contact:

If you have any major works planned during the deep clean window, please raise a support ticket on the support site, https://support.c4l.co.uk or give the technical team a call on 01202 299799 ext. 3. and we will reschedule the planned deep clean date of your area if it coincides with your scheduled works.

Update 17/05/2012

Further to the subject notification, please be advised that the work for the deep clean at Memaco House has been extended and will now be completed on the 25th May 2012.

 

 

Tier 1 provider router maintenance – 2nd May 2012

April 25th, 2012

Dear Customers,

We have been advised of the following planned maintenance work being carried out by one of our Internet Tier 1 provider.

Start Date: 2012-05-02 01:00 UTC

End Date: 2012-05-02 04:00 UTC

Reason: Hardware maintenance on the core router.

Services Affected: During the maintenance, Internet Tier 1 traffic will re-route via alternative links, therefore a brief packet loss may be observed while our BGP routers update their routing tables. As the traffic will be flowing via the alternative paths, the routes will be going to the destinations via different AS numbers. As soon as the maintenance is finished, the routes will come back to the previous paths.

Contact: Should customers have any queries, please raise a support ticket on the support site, https://support.c4l.co.uk or give the technical team a call on 01202 299799 ext. 3.

Remedial Generator Work – Maidenhead Data Centre – 1st and 2nd May 2012

April 25th, 2012

Dear Customers,

We have been advised of the following planned maintenance work being carried out at the Pulsant Maidnehead data centre:

What:

As part of our on-going remedial works Pulsant will be changing and improving the bund alarms on the installed generators, and taking the opportunity to replace fan and alternator belts with new at the same time.

Why:

As part of our on-going planned and preventative maintenance regime, and our commitment to environmental best practice, we carry out this work to ensure that the service offered to our clients is the best possible. This work forms part of this regime.  

When:

The work will take place over 2 evenings, to ensure that only one generator is being worked on, and returned to service at any one time.
The first engine will be worked on Tuesday 1st May at 21:00 and is scheduled to last for 4 hours.
The second engine will be worked on Wednesday 2nd May at 21:00 and is scheduled to last for 4 hours.

Contact:

Should customers have any queries, please raise a support ticket on the support site, https://support.c4l.co.uk or give the technical team a call on 01202 299799 ext. 3.