SH97 (72.29.87.194) : Shared

**Kayla** · April 10th, 2006, 9:58 PM

This thread is a timeline for all events occuring to the server SH97.

If you would like official support, please open a ticket here:

https://desk.surpasshosting.com

**Kayla** · December 6th, 2006, 1:44 PM

SH97 suffered a crash this afternoon, seems to be related to Exim (mail). The server is stable now and we are monitoring it. Thank you everyone for your patience.

**Kayla** · June 11th, 2007, 4:18 PM

A few hours ago SH97 was brought to a grinding halt due to a client that performed a backup of their forum...

Top Process %CPU 95.8 /usr/bin/php backup.php
Top Process %CPU 92.6 /usr/bin/php backup.php
Top Process %CPU 54.2 /usr/bin/php backup.php

I am emailing them to let them know what was caused. Either their forum contains a large amount of data (and backups need to be done during off peak times and very seldomly) or the backup script is flawed.

**Kayla** · June 12th, 2007, 5:32 PM

Server has been fine since then.

top - 17:32:03 up 1 day, 3:36, 1 user, load average: 0.43, 0.45, 0.48

**Kayla** · July 18th, 2007, 12:51 AM

On Sunday, July 22, 2007 between 3:00 AM EST and 7:00 AM EST we will be performing a mail system conversion on the server which your website is hosted from. Incoming email messages will be received by the server during this conversion, however they will be stored in the mail queue and not delivered to your mailbox until the conversion is completed.

Incoming email will be received by the server, however will be delayed from reaching your mailbox until after the conversion is completed. You will still have the ability to send email (via SMTP) while the conversion is taking place. All other services on the server (web server, FTP server, etc) will also continue to function as they should.

If you have any questions regarding this scheduled maintenance, please submit your questions to the Surpass help desk, care of the Technical Support Division - https://desk.surpasshosting.com

**Daniel** · April 11th, 2008, 5:44 PM

Hello,

Today, at approximately 3:00PM EST, SH97 started displaying unexpected signs of disk sector damage. After troubleshooting the server, and making sure none of the symptoms were related to other components (ie. bad sata controllers, boards), it was found that the issue really had to do with the disk itself. Despite multiple attempts at getting the machine to work, we are now left with other choice than to perform an emergency restore.

There are good news out of this though (however good it might be during downtime), is that the new server that SH97 is going to is a heavily beefed up machine, that is going to be a whole lot more fault tolerant, so that this sort of a 'mid-day' failure is far less likely to occur ever again.

As of right now, the new server is already setup, and our admins are copying data and re-setting everything back up. I cannot give any specific ETA's yet until we find out how fast the copy is going, and how much data is there that needs to be restored in the first place.

We thoroughly apologize for the issues, but as you probably can guess, this is something we couldn't have predicted.

We'll update you once further progress is made.

Thanks,

**Daniel** · April 11th, 2008, 8:24 PM

A quick update as to the current status:

The restore is well under way, and so far we're at ~20% completion. The copy process is going relatively quick, despite the old disk being damaged, but of course, this may change as we get further into the restore.

At this point, a relatively rough ETA for completion is 8-10 hours. We have to take this with a grain of salt though, as this might change (for better or for worse), as we get deeper into the restore.

On the brighter side of things - the new machine that we are restoring the data onto is setup on a raid5 array, with 1.4TB of space. That's quite nice

We'll update you once further progress is made with the restore. Again, we apologize for the inconvenience this has caused - we're doing our best to speed things up though and keep you in the loop as to the status of the restore.

Thanks,

**Jorge** · April 12th, 2008, 3:48 AM

Hello,

The restore is going great so far we're at 80% completion. At this point, a relatively rough ETA for completion is 2-5 hours. We'll update you once further progress is made with the restore.

**Miguel** · April 13th, 2008, 9:39 AM

Hello,

At around 12 Apr 2008 08:35 AM, the restore of SH97l has been completed.

As usual, please submit a ticket to our helpdesk if you experience any issues or problems.

We thank you for your patience and understanding while this maintenance was taking place.

Best regards,

April 10th, 2006, 9:58 PM	#1 (permalink)
Kayla Surpass Staff Joined in May 2003 Lives in Orlando 23,929 posts Gave thanks: 904 Thanked 769 times	SH97 (72.29.87.194) : Shared This thread is a timeline for all events occuring to the server SH97. If you would like official support, please open a ticket here: https://desk.surpasshosting.com __________________ Have you ever want to draw a windmill, and after that animate it? No problem!

December 6th, 2006, 1:44 PM	#2 (permalink)
Kayla Surpass Staff Joined in May 2003 Lives in Orlando 23,929 posts Gave thanks: 904 Thanked 769 times	SH97 suffered a crash this afternoon, seems to be related to Exim (mail). The server is stable now and we are monitoring it. Thank you everyone for your patience. __________________ Have you ever want to draw a windmill, and after that animate it? No problem!

June 11th, 2007, 4:18 PM	#3 (permalink)
Kayla Surpass Staff Joined in May 2003 Lives in Orlando 23,929 posts Gave thanks: 904 Thanked 769 times	A few hours ago SH97 was brought to a grinding halt due to a client that performed a backup of their forum... Top Process %CPU 95.8 /usr/bin/php backup.php Top Process %CPU 92.6 /usr/bin/php backup.php Top Process %CPU 54.2 /usr/bin/php backup.php I am emailing them to let them know what was caused. Either their forum contains a large amount of data (and backups need to be done during off peak times and very seldomly) or the backup script is flawed. __________________ Have you ever want to draw a windmill, and after that animate it? No problem!

June 12th, 2007, 5:32 PM	#4 (permalink)
Kayla Surpass Staff Joined in May 2003 Lives in Orlando 23,929 posts Gave thanks: 904 Thanked 769 times	Server has been fine since then. top - 17:32:03 up 1 day, 3:36, 1 user, load average: 0.43, 0.45, 0.48 __________________ Have you ever want to draw a windmill, and after that animate it? No problem!

July 18th, 2007, 12:51 AM	#5 (permalink)
Kayla Surpass Staff Joined in May 2003 Lives in Orlando 23,929 posts Gave thanks: 904 Thanked 769 times	On Sunday, July 22, 2007 between 3:00 AM EST and 7:00 AM EST we will be performing a mail system conversion on the server which your website is hosted from. Incoming email messages will be received by the server during this conversion, however they will be stored in the mail queue and not delivered to your mailbox until the conversion is completed. Incoming email will be received by the server, however will be delayed from reaching your mailbox until after the conversion is completed. You will still have the ability to send email (via SMTP) while the conversion is taking place. All other services on the server (web server, FTP server, etc) will also continue to function as they should. If you have any questions regarding this scheduled maintenance, please submit your questions to the Surpass help desk, care of the Technical Support Division - https://desk.surpasshosting.com __________________ Have you ever want to draw a windmill, and after that animate it? No problem!

April 11th, 2008, 5:44 PM	#6 (permalink)
Daniel Sysadmin Seasoned Poster Joined in Feb 2005 71 posts Gave thanks: 0 Thanked 42 times	Hello, Today, at approximately 3:00PM EST, SH97 started displaying unexpected signs of disk sector damage. After troubleshooting the server, and making sure none of the symptoms were related to other components (ie. bad sata controllers, boards), it was found that the issue really had to do with the disk itself. Despite multiple attempts at getting the machine to work, we are now left with other choice than to perform an emergency restore. There are good news out of this though (however good it might be during downtime), is that the new server that SH97 is going to is a heavily beefed up machine, that is going to be a whole lot more fault tolerant, so that this sort of a 'mid-day' failure is far less likely to occur ever again. As of right now, the new server is already setup, and our admins are copying data and re-setting everything back up. I cannot give any specific ETA's yet until we find out how fast the copy is going, and how much data is there that needs to be restored in the first place. We thoroughly apologize for the issues, but as you probably can guess, this is something we couldn't have predicted. We'll update you once further progress is made. Thanks,

April 11th, 2008, 8:24 PM	#7 (permalink)
Daniel Sysadmin Seasoned Poster Joined in Feb 2005 71 posts Gave thanks: 0 Thanked 42 times	A quick update as to the current status: The restore is well under way, and so far we're at ~20% completion. The copy process is going relatively quick, despite the old disk being damaged, but of course, this may change as we get further into the restore. At this point, a relatively rough ETA for completion is 8-10 hours. We have to take this with a grain of salt though, as this might change (for better or for worse), as we get deeper into the restore. On the brighter side of things - the new machine that we are restoring the data onto is setup on a raid5 array, with 1.4TB of space. That's quite nice We'll update you once further progress is made with the restore. Again, we apologize for the inconvenience this has caused - we're doing our best to speed things up though and keep you in the loop as to the status of the restore. Thanks,

April 12th, 2008, 3:48 AM	#8 (permalink)
Jorge Surpass Staff Fresh Surpasser Joined in Nov 2007 4 posts Gave thanks: 0 Thanked 0 times	Hello, The restore is going great so far we're at 80% completion. At this point, a relatively rough ETA for completion is 2-5 hours. We'll update you once further progress is made with the restore.

April 13th, 2008, 9:39 AM	#9 (permalink)
Miguel Surpass Staff Fresh Surpasser Joined in Feb 2005 2 posts Gave thanks: 0 Thanked 0 times	Hello, At around 12 Apr 2008 08:35 AM, the restore of SH97l has been completed. As usual, please submit a ticket to our helpdesk if you experience any issues or problems. We thank you for your patience and understanding while this maintenance was taking place. Best regards,

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Rate This Thread
Rate This Thread: