RESOLVED: Service Disruption 14:34 BST (GMT +1) 04 Apr 2009

DETAIL: On April 4 a section of our system went read-only. This currently affects 20% of our customers and has an impact on file uploads, new site building, form submissions and forum posts. The other 80% of our customers are completely unaffected.

RESPONSE: Our technical team are working to resolve this issue as quickly as possible.

UPDATE: We are working on repairing the file system for the affected customers. Current estimate for completion is 2 - 4 hours.

UPDATE: 13:40 BST - We will be taking the service off-line for 10 minutes at approximately 13:55 to reconfigure the file system as part of our recovery actions.

UPDATE: 14:04 BST - The file system reconfiguration was successful and enabled us to restore full service to half of the affected customers. We expect to restore the service fully to the remaining 10 % of customers (the remaining half affected by this issue) within the next couple of hours.

RESOLVED: 15:02 BST

DETAIL: Full service has now been restored to all customers.

RECOVERY: We failed over to our backup file server and performed consistency checks to ensure that the data was not corrupted.

FOLLOW UP: We will run background consistency checks on all our data over the next few days to ensure that no further problems occur. Visitors may possibly experience slower page loads while these checks take place. We will also conduct an investigation into the cause of this event and take steps to mitigate a repeat of this incident.

RESOLVED: Service Disruption 16:40 BST (GMT +1) 07 Apr 2009

DETAIL: On April 7 a section of our system went read-only. This currently affects only 10% of our customers and has an impact on file uploads, new site building, form submissions and forum posts. The other 90% of our customers are completely unaffected by this event.

RESPONSE: Our technical team are working to resolve this issue as quickly as possible and should have it resolved shortly.

We apologise for any inconvenience that this causes any of our customers. Updates will follow.

UPDATE: 01:45 BST - All affected systems have now been fully restored. We will continue to monitor the situation and post more details later in the morning.

Essential Maintenance: 11:20 BST (GMT +1) 09 Apr 2009

REASON: Our investigations into the recent service disruptions indicated that by running consistency checks on the affected data, the file system was stabilised. To be certain that the data is secure we will be running consistency checks on the remaining data in a controlled manor.

PLANNED DURATION: 40 minutes per site

NOTES: Those communities not already affected by the recent disruptions will go Read-Only for about 40 minutes. This will only affect file uploads, new site building, forum posts and saving of data. All sites will remain on view to visitors and owners. There will be six periods of 40 minutes during which 10% of sites will be affected.

UPDATE: This has now been completed. The consistency checks have been successful.