Following up the previous post, which can be found here, all upgrades have completed successfully with less downtime than initially expected.
We are now using the latest and most secure versions of all our software, keeping our customers security a top priority!
Server Canyon will be installing critical software updates, some of which are security updates, early Saturday (2/25/2017) morning, starting around 7:00AM Chicago Time.
The duration of the downtime is expected to be between 10 and 15 minutes.
What we are doing to prevent loss of data:
The upgrade will be comprised of three steps.
Once all that is done service will continue like normal.
Look forward to many new features in the coming months that will make not only hosting, but billing and upgrades even smoother!
–EDIT–
Upgrades have been completed. See the blog post here.
At approximately 5:00AM PST ServerCanyon was alerted to severe performance degradation. The cause as to why is still unknown, but for transparency here is a timeline of events:
If any customer discovers any issues with their website, please contact support immediately!
An incident was reported where sites using SSL would break and become unresponsive.
This problem has been encountered before. We currently do not know what causes it, but we will keep a close eye on it.
The origin of the problem resides in OCSP stapling, a process designed to greatly increase the speed of the initial SSL handshake.
The issue has since been resolved.
There was some downtime last night. This was caused by a problem with an upstream provider. Although there was nothing we could do but wait, here is a quick timeline of events:
Over the course of the next several hours, performance and response times returned to normal and the mail server began to get caught up. Everything went back to normal by 10:00 AM PST.
Here is a quote directly from the service provider (and a rough translation below), with more information of the incident:
Bonjour,
A 10h40pm (4h40 heure française) nous avons constaté un défaut d’alimentation
de 2 salles d’hébergement, C et D, à BHS4, sur 54 baies. Il s’agit de
baies C1-18 et D1-36. Dans ces baies nous avons le PCI/VPS et les SD.
L’origine du problème est un gros cours-circuit dans le bus qui alimente les
baies D1-18. Le court-circuit a mis en défaut l’onduleur T04D. L’équipe
d’électriciens s’est dépêchée sur place pour vérifier l’etat de l’onduleur,
de lignes. L’onduleur a été remis en route. Les baies C1-18 ont été réalimenté
0h30am (6h30). Le remplacement du bus a pris 2H30. A 3h30am (9h30) les baies
D1-36 ont été réalimentée à nouveau.
Nous travaillons sur la mise en route de tous les services qui ne sont pas
encore UP.
D’autres informations vont suivre.Octave
Hello,
At 10h40pm (4:40 French time) we found a power failure in
2 facilities hosting, C and D, BHS4, of 54 bays. It is
C1-18 and D1-36. In these bays we have the PCI / VPS and SD.The origin of the problem is a large current circuit in the bus that feeds bays
D1-18. The short circuit has faulted the T04D inverter. The team
electricians was dispatched to check the state of the inverter,
lines. The UPS has been restarted. C1-18 were brought online
0h30am (6:30 am). The replacement bus took 2:30. At 3h30am (9.30) bays
D1-36 were brought online again.We are working on the initiation of all services that are not
online.Further information will follow.
Octave
An important note:
This is a one in a million event. The chances of a catastrophic and cascading failure of this sort are incredibly small. Once the dust and fog of this event have been cleared, I will work closely with Server Canyons provider to harden our infrastructure against future events of this kind. If no progress can be made with this provider, I will not hesitate to leave them for another company.
It is good to know that more often than not, you will learn much more through failure than success. This does not excuse the fact that this event has happened. However, I believe all affected parties have learned a lot from this event!
TL;DR:
Were sorry
I finally got around to spending the money to get a valid SSL Certificate.
This is exciting because now customers wont have to see annoying “self-signed” certificate warnings when accessing FTP, Email, or cPanel.
Its another great step on the long road to being the best, but we wont stop until we are!
Earlier today we received another block of IP addresses from our main service provider.
It is just a small step, but any great adventure must be taken one step at a time!
I thought it would be pretty cool to have a status page to show the network status, so I set one up.
You can find it at http://servercanyon.com/status.
I will embed the system into a widget on this site eventually, but for now this will do.
If you would like more information on the software used for that status page, you can see it on its authors GitHub page HERE.
The scheduled updates fired without any problems.
You will notice a new layout for cPanel, but other than that everything remained the same.
On the first of February we will apply some software updates to our core infrastructure.
We do not anticipate any downtime, however the increased network load may result in file-transfers and downloads to be slower than normal. The entire process from beginning to end should take no more than 20 minutes.
If any details change, we will put out another post when we have more information.
