{"id":113,"date":"2006-11-11T17:30:35","date_gmt":"2006-11-11T15:30:35","guid":{"rendered":"http:\/\/jerome.harckmans.be\/?p=113"},"modified":"2006-11-11T17:30:35","modified_gmt":"2006-11-11T15:30:35","slug":"catastrophic-disk-failure","status":"publish","type":"post","link":"https:\/\/jerome.harckmans.be\/?p=113","title":{"rendered":"Catastrophic disk failure&#8230;"},"content":{"rendered":"<p>Last thursday, our server suffered from a catastrophic hard drives failure. We were using software RAID on two SATA disks, but because of our stupid datacenter&#8217;s team (DigitalRoot not to name it&#8230;) shutting down the server by removing the power plug to move it to another location, the RAID setup became unstable. However, we continued to use it&#8230;<\/p>\n<p>BAD IDEA!!!! After some weeks, it totally broke up. We lost everything&#8230; :grr: Good occasion to test our backup system. After a rapid re-install (from scratch), we recovered all backed-up data from the backup server, and we were up and running some hours later&#8230; :stress:<\/p>\n<p><strong>Lessons Learned<\/strong>:<\/p>\n<ul>\n<li>Perform an image of the base system &#8211; to do<\/li>\n<li>Perform backup of: \/etc, \/home, \/databases  &#8211; OK<\/li>\n<li>DO NOT USE software raid &#8211; OK (sata raid controller installed)<\/li>\n<li>Backup: perform periodic &#8220;copy <strong>and<\/strong> delete&#8221; sync. By that, I mean not only copy all modified files to the backup server, but also remove them from it when they are removed on the production server. Indeed, after the data recovery, I had a lot of unread e-mails&#8230; When I read and deleted them, some of them were in fact already backed up. :dead:<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Last thursday, our server suffered from a catastrophic hard drives failure. We were using software RAID on two SATA disks, but because of our stupid datacenter&#8217;s team (DigitalRoot not to<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[3,6],"tags":[],"_links":{"self":[{"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=\/wp\/v2\/posts\/113"}],"collection":[{"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=113"}],"version-history":[{"count":0,"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=\/wp\/v2\/posts\/113\/revisions"}],"wp:attachment":[{"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=113"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=113"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jerome.harckmans.be\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=113"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}