WHS

Migration to WHS 2011, Part II– Data Duplication & Backup Plan

Posted on April 17, 2011. Filed under: Backups, WHS, WHS 2011 |

Data Storage Implementation

In this post I’ll explain my chosen data storage architecture in light of Drive Extender’s (DE) removal. I will also outline my backup strategy which has nothing really to do with duplication. In fact many WHS v1 users mistakenly thought of DE as backing up the shared folders on the server. Folder duplication does not protect your data from user errors like accidental deletion, etc. Any user error will be reflected in the duplicated folder thus the need for additional backups.

My WHS is the music, photo, and recorded TV hub for the household. Life would not stop if the server crashed but we would certainly have degraded performance and my IT credibility would suffer. I want the WHS to be back in business rapidly in the event of HDD failure. Therefore I have the OS partition on a pair of 250Gb drives in RAID 1 configuration. This allows for a 60Gb OS partition(C:) with a 172Gb mirrored partition left over. I use the extra partition(F:) to mount the Photos and Music folders via the WHS dashboard. If one of these drives fail I will be back in business with a reboot.

After playing around with the Disk Manager in Server 2008 R2 I decided to test out drive mirroring in the OS. Read times did not suffer which was my primary concern so I selected mirroring via Dynamic Disks. By mirroring two 2Tb drives I can have 4Tb of storage in my server with 4 hot swap drive bays. This is 2x more than I currently need and provides fault tolerance to all my storage. The mirrored pair (G:) is used for the balance of the shared folders on the server. This implementation effectively replaces DE but requires much more technical know-how to get it done. The “Home” is Windows Home Server is gone as far as I’m concerned. I hope OEMs fix this with some software additions to the dashboard.

Currently, Client Computer backups are being done on one 500Gb drive(D:) which is not mirrored. This is fine since presumably the data resides on the original computers if the backup drive fails. I would lose the backup history but I am fine with that level of risk. I don’t feel the need to backup my client backups. The 500Gb drive using one of the hot swap bays in the machine and will one day be swapped for a 2Tb drive.

The Server Backups are rotated to external HDD drives of 2Tb each (H:). One is kept offsite.

The storage picture is shown below in the Disk Management Console.

image

 

Backup Plan

When considering Server Backups you are limited to a Maximum of 2TB in total size. For those that rip CD’s and DVD’s as a convenient way to stream media this can be a problem. Media folders can quickly grow the backup size beyond 2Tb. You have to limit what you backup or use a 3rd party backup solution to work around this limit.  For server backups this is acceptable given the variety of solutions the WHS crowd is going to desire.  

To help understand your backup needs it helps to think of your content in terms of content & risk classifications.

Content breakdown

  • Content Class 1 – priceless personal photos, videos, documents that are irreplaceable; add code repository if you’re a developer
  • Content Class 2 – purchased music, videos, software and other data replaceable but at a cost of time or money (including content indexes & organization (i.e. what Zune Pass stuff do you have downloaded in your music collection today?)

Next think what levels of risk mitigation are required for your backups. This will be a primary driver for you backup solution be it cloud based, offsite storage, or simply on another HDD on the LAN.

Risk Mitigation breakdown

  • Risk Class 1 – Theft of content results in personal loss (identity theft, continued charges for services, etc.)
  • Risk Class 2 – Destruction of content via fire or other natural disasters at single physical location
  • Risk Class 3 – Loss of single hard drive or system
  • Risk Class 4 – User error/data corruption

One or more of these Risk Mitigation Classes may apply to your data. Each has different implementation solutions.

Risk Class 2 & 3 are easy to get your head around. The content is destroyed at one physical site or drive as result of natural disaster or system failure. Site destruction requires an offsite solution. WHS can help with this via CloudBerry & KeepVault Addins, or you can take control with manual rotation of backup drives. Don’t forget to store your cloud credentials somewhere safe like your head, parents house, and/or a fire-proof/water-proof vault.

Class 1 is data theft versus data destruction. Think of someone walking off with your laptop, desktop, server, etc. Your data is not just gone, it is in the hands of those that can misuse it.  Your data must be first encrypted locally since the laptop is in the hands of thieves. Again, Cloudberry, KeepVault, or manual rotation of backup drives can recover your backed-up content but not your laptop so protect your data at the source with Bitlocker or other encryption.

Class 4 is the most frequent threat and all content types need this class of risk mitigation. This implies that a series of backup snapshots must be maintained versus a single daily snapshot for example. WHS provides this by default.

Backup Storage Choices

My personal documents (Content Class 1) are the only things requiring Class 1 Risk Mitigation from theft. They are encrypted locally and pushed to the cloud with KeepVault. They are also on a the external backup disk.

My photos & Videos need protection from a natural disaster but no real personal/financial harm can come to me if they are stolen. Physical offsite backups have me covered but even backup systems fail. Therefore, I also push these precious items to the cloud.

I have the original media as a backup for any DVDs or CDs that I have ripped. I stream music & video on demand these days and rarely listen to physical media. I can’t remember the last time I bought a CD, DVD, or Blu-ray. This will be even more common in the future. If a fire tragically strikes it will destroy my CDs, DVDs, vinyl and even more precious non-digital things.  These items are Content Class 2 and are just backed up on the LAN as they are too large for WHS backups and too expensive to backup to the cloud. LAN backups protect me from myself in case of accidental deletion. Natural disaster is a risk I can live with for this content.

With the large media files backed up on the LAN, I can easily live with the 2Tb limit of WHS 2011.

Backup Storage Summary

image

 

LAN Backup Solution

There are many potential LAN backup solutions. If you go with CloudBerry Backup you get the option to backup to the LAN as well as the cloud. No such luck with KeepVault which allows backing up to attached drives or the cloud. This may work if you have enough external HDD capacity attached to your WHS. I needed another cheap solution. Since I was dealing with static media files a simple copy upon addition seemed like a good solution.

I found a well established shareware solution in Directory Compare. This software has a GUI when needed and is easily scripted. You can point it at multiple source and target directories to compare and take actions on the result set. You can Mirror the target to match the source including deletions. However this is not what I need. You can Update the target with new files found in the source. You need to also employ the Ignore Everything but filename & extension option in the comparison. Doing this protects you from corruption of the source files since the file will only be copied forward the first time it appears. Any changes in size or timestamp will be ignored.

Updating is the normal case for media files. Simply add the new content to the LAN backup(target) as it arrives and forget about it.  You can schedule a task to do this frequently. Sometimes you do delete media files from the source intentionally. In this case, I suggest you periodically run Directory Compare with the GUI and manually select the Mirror action. This mirrors the source and target deleting files as appropriate.  You have complete control and visibility with the GUI to override individual files.

This solution does not fully provide Class 4 Risk Mitigation since there is only one backup set. However, the content being protected is static and media files are only copied to the target when the first appear. They are not changed or deleted unless you manually intervene.

Summary

This implementation works for me providing robust backup and fault tolerance. You may have better solutions. Please drop me a line if you have alternate ideas. I’d love to hear them.

Dave

Read Full Post | Make a Comment ( 3 so far )

Migration to WHS 2011, part 1 – the Build

Posted on April 9, 2011. Filed under: WHS |

Let me start by saying my build was not the cheapest possible for a number of reasons. First, I wanted to build it slowly and reuse parts from my recently retired desktop and an “old-school” PC case. This just ended up costing me more money in the end. Second, I did not want to pull drives from the HP MediaSmart v1 WHS.  I intended to have two fully functional WHS systems for the migration. That meant more hard drives had to be purchased than I would ultimately need.

Below is a picture of the new(larger) system next to the HP MediaSmart it is replacing. Stacked on top of the MediaSmart are two Antec MX-1 HDD enclosures and the Asus slim external DVD drive.

This system, although far out of the technical ability of the average consumer, does just about achieve everything the v1 WHS does even without Drive Extender.

The OS is on a Raid 1 cluster to ensure the server is back in business with just a reboot if one of the OS drives fail. The data drives are mirrored as well using the capabilities of the Disk Manager in the OS. Each 2Tb drive is mirrored for a total of 4TB of mirrored storage with a 4 bay hot swap rack from Icy Dock.

The Shared folders on the server take up about 1.3Tb currently. I back these up every two hours to one of the external eSata drives. The external drives get rotated off-site to ensure protection from fire or theft without the expense of cloud storage which I just can’t tolerate at ~$1USD/Gb/Year. I backup every 2 hours during the waking hours to minimize data lose due to human error like accidental deletion, etc.

This system should serve my needs for the next few years and can be easily upgraded if needed.

DSC_0089

My case modifications consisted of cutting a fan hole in the front of the case and mounting the 120mm case fan behind. I cut a 120mm blow hole in the top of the case for ventilation. The CPU is a 95W unit and needs adequate ventilation. I wired the HDD LED pins on the Syba card to a new case LED and molded a mount in the faceplate of the case. I painted the beige case flat black, install acoustic foam inside, and added some bling with the brushed aluminum fan grills and some case badges.

The server is reasonably quiet and the performance exceeds the weaker HP MediaSmart. I have not gathered benchmarks but informal testing shows good results for video streaming. No noticeable speed issues with the HDD reads and writes. Lastly, no stuttering during video playback.

I’m still in test mode until I can purchase the final version so there may be some changes. In the next piece I’ll provide some details on how I managed the data migration and mirroring of the v1 Server to the v2 server.

The Server Hardware:

CPU – AMD Athlon 64 x2 6000+ 3.0 GHz
Mainboard – Biostar A780L, DDR2, 4xSata II (Advice: get a mainboard with 6 Sata ports or use a Rocket Raid card)
RAM – 4Gb 2x2Gb Corsair DDR2
PSU – OCZ OCZ400MXSP 400 Watt ModXStream Pro Power Supply
CPU Cooler – Low profile due to poor “old-school” case design
NIC – Trendnet Gigabit (Get this on your mainboard to save a slot and $10USD)
Sata II Controller Card – Syba SD-STAT2-2E2I, 2 internal, 2 external eSata ports
Hot Swap HDD Cage – Icy Dock MB974SP-B Tray-less 4 in 3 SATA I & II Hot-Swap Backplane Raid Cage Module with eSATA & USB
Drive Cage Fan – Noctua NF-R8 Replacement for noisy Icy Dock fan
Internal Raid Cage – Icy Dock Dual Bay 2.5" Sata SSD or HDD
Case – Reused & heavily modified Mid Tower, 3-External 3.5”, 2-External 2.5”
Case Fan – ThermalTake 120mm
Misc Parts – Paint, Case Fan Grills, Acoustic Foam, LED cables
External DVD – Asus slim USB2.0
HDDs – 2x WD Blue 2.5” 250Gb, 2x WD Green 3.5” 2Tb, 2x empty 3.5” slots

Server Backup:
External HDD Enclosures – 2x Antec MX-1
HDDs – 2x WD Green 3.5” 2Tb, one per enclosure

Read Full Post | Make a Comment ( None so far )

WHS Storage Upgrade leads to Unexpected Recovery

Posted on September 29, 2010. Filed under: WHS | Tags: , |

I had some trivial fan modifications to make to my aging Dell C521 that I have pushed beyond it’s native cooling limits. I took the opportunity to head off to Fry’s Electronics to spend some quality time looking over the goodies.

I found a screaming deal on a 2TB Seagate Barracuda LP internal drive for $99 and could not pass it up. Seemed like a good time to replace one of the 500GB drives in the Windows Home Server while I still had enough overhead to remove it.

Having done this before I was expecting a smooth ride. Drive removal per the WHS console went easily enough. I had plenty to do while data was copied off the drive. A few hours later I pulled the drive and replaced it with the 2TB drive. Presto, I had 5 TB of storage, all shares were in good shape, backups were working. Looking good!

Then a crack appeared, none of the client PCs could reach the WHS with the connector software. A little debugging revealed that IIS was no longer running on the server which was preventing connections. The cause, a corrupted XML configuration file found with the help of the Event Viewer.

Panic! This was not supposed to happen! What else was corrupted? I noted for my sanity that I always had my backups in the cloud at KeepVault.

Some more testing left me convinced the problem was just in the system files and none of my shares. It was time to try a System Recovery using the WHS Recovery Disc.

This technique preserves all of your data but lays down a new system image.  I had just done this when upgrading from v1 to v3 of the HP MediaSmart software so it seemed easy enough.  The Recovery went quickly and without a hitch. Once complete, I simply recreated user accounts & reinstalled my WHS Addins and was back in business. Finally, I uninstalled/reinstalled the Connector software on the client PCs.

I suffered a little lost time and some excitement for my impulse purchase. On the plus side, I’m left a little wiser for the experience.

Read Full Post | Make a Comment ( None so far )

Liked it here?
Why not try sites on the blogroll...