Outages Suck – An Update of our Outage in July
Outages suck.
They impact on your homes, they impact on your business. Nobody wants an outage.
Especially if you are providing that connection to people and businesses that trust you to keep them connected.
It really, really sucks. (And yes thats really me – sitting in front of the servers – having a minute to work out what’s next and get everyone back on)
Yesterday (15th July) was not our best day for us here at Dreamtilt.
What should have been a routine power outage turned into something much bigger than we had expected.
We were prepared with back up power and we had tested the generators. What we were not prepared for was the cascading effect that came from that little glitch.
First a power trip on a supply, then a faulty power supply, then a motherboard failure, then a storage issue for VM’s, and suddenly what should have been routine becomes anything but routine.
This issue highlighted a number of problems for us, all of which we will learn and put fixes in place. Some are short term fixes, other are more longer term that we need to implement solutions for so that we can become more resilient to these types of occurrences.
And they do happen. I wish they didn’t – I wish I could say to everyone – ‘Outages don’t happen to us’ . But the reality is – it does and can. And it can happen to all telco’s – large and small.
What we need to do is learn from this and work on making sure we do better.
Dreamtilt has been a part of Gladstone since 1999.
We invest back into the local network and the community at large.
We know that many businesses and people put their trust in the connections we provide, and we will work on improving this – as we do with all the previous issues – and potential future ones.
We apologise again for the issues, and as always we will work hard on restoring outages and fixing the issues to minimise them.
