Currently we're experiencing an interruption in several shared webhostingservers.
We're currently investigating.
Unfortunately, we are again experiencing issues on some of our shared hosting webservers. The cause of this is the power outage last week. Because of this, a kernel that contains a bug has been loaded, causing the issues. The bug causes issues in combination with RAID10, and fstrim. We are currently restoring the webservers that are affected.
Unfortunately, it's difficult to give an estimated time for this, as the restores are running from an offsite backup.
After some thorough checking we decided to play it safe and reinstall several webservers. We are in the processing backups and will restore the webservers with this current data.
Depending on the website, during the restore process, we expect a downtime of 30min to approximately 2 hours.
All restore operations have currently been completed.
We're still monitoring the situation.
If you're still experiencing issues with one or more websites, please contact our support department.
We've been able to restore the majority of the websites affected. Restores to several webservers are ongoing. As a result, home directories on affected servers are still empty. They will likely be restored during the night.
Please note that as a side effect from the restore, SSH connections to the webservers will give a warning because the host ssh keys have been changed.
The issues are caused by corruptions in the filesystem of the webservers. Restore jobs are already running for multiple hours. Unfortunately, we can not yet give a good indication of how long this process will need to finish.
Once more information becomes available, we will update this message.
13th December 2020
No incidents reported
12th December 2020
No incidents reported
11th December 2020
E-mailInterruption Shared Email
This morning we experienced an error in one of our mail backend servers. This server had to be taken offline to investigate.
The problem has been found and has been fixed.
10th December 2020
No incidents reported
9th December 2020
No incidents reported
8th December 2020
Compute AmsterdamUnknown interruption ams02 zone
We're experiencing an unknown outage. Engineers are investigating.
We have lost power to a part of our cloud in ams02 zone. Our datacenter engineers are troubleshooting.
Since 07:00 hours service to the Servers in zone03.ams02 has been fully restored
Power has been partially restored.
Service has been partially restored.
We're currently replacing hardware to be able to restore full functionality.
7th December 2020
No incidents reported
6th December 2020
No incidents reported
5th December 2020
No incidents reported
4th December 2020
No incidents reported
3rd December 2020
Hypervisor unreachable HAA01
We're currently experiencing issues on one of the hypervisors in HAA01. Our technicians are investigating the problem and we're working very hard to resolve the issues as quickly as possible.
Our sincere apologies for the inconvenience.
The issue has been found and we are starting all local vm's as well. The HA vm's are all online.
2nd December 2020
E-mailShared mail authentication issues
Our shared mail servers are currently experiencing authentication issues, logins may result in "Invalid credentials" errors. We're currently investigating the issue.
