Woke up this morning to find the server back down again and this update from our hosting company:
23:16 - ... still offline, but Cisco technician is currently looking into the issue onsite.
We are extremely sorry for the downtime that occurred today and we know that it was totally unacceptable for this to happen.
Best Regards,
Nitrous Networks LTD
Whatever the routing issue is seemingly the Cisco technician is still working on it now and around one third of the servers they host are currently down due to the connectivity issue, unfortunately we are in that one third.
I'll keep checking for new information and time-scales and update here, thanks for your patience.
UPDATE: 09:40 - Still waiting to hear from the hosting company.
UPDATE: 10:40 - Still waiting to hear from the hosting company.
UPDATE: 11:40 - Still waiting to hear from the hosting company.
UPDATE: 12:40 - Cisco are still working on the problem and our hosting company have offered a partial refund of the hosting fees as compensation, unfortunately no update on when the servers might be back up though.
UPDATE: 13:40 - Waiting to hear from the hosting company.
UPDATE: 15:00 - Still waiting to hear from the hosting company.
UPDATE: 16:05 - Hosting company hope to have servers back up today but can't specify a time.
UPDATE: 17:00 - Waiting to hear from the hosting company.
UPDATE: 17:30 - Our hosting companies managing director is saying that the servers should be back upin about an hour, fingers crossed!
UPDATE: 18:35 - No sign of the server coming up yet, waiting for an update.
UPDATE: 19:15 - Apparently the issues with the new hardware are now completely resolved and servers have been coming back online one by one over the last 20-25 minutes, we shouldn't have long to wait now. I'll be whitelisting for about 5 minutes just to check a few things.
UPDATE: 20:25 - Looks like our server is going to be one of the last to come back up, they are seemingly being manually connected one by one to check for any issues which is why it's taking so long.
UPDATE: 21:25 - Still waiting, but hopefully not for much longer! The servers that have come back up already seem stable now so looking good.
UPDATE: 21:40 - Server is back up! Whitelist is in place for a few minutes whilst I check things over.
UPDATE: 21:45 - Whitelist removed! The server is coming up now and seems stable.
