[SGVLUG] scary RAID 5 going going .. soon 2 be gone?

[Rae Yip]

One of the motivations for ZFS is to deal with partial disk failures
(such as URE) more gracefully. But it certainly is a problem as drives
get larger.

As for the virtual appliance below, it seems to be based on BackupPC.
That means it'll work great for Unix as long as you have rsync; SMB is
only required for backing up Windows (even then, only if you don't
care to install cygwin/rsync). It's Perl-based, but assuming the main
bottleneck is disk I/O, it performs alright.

A quick glance at the docs show that it's pre-compression file-level
dedupe, and standard zlib compression (ie. varies between 5-90%
compression depending on your data).

Shang-Lin uses BackupPC at work, so maybe she can tell you more.

-Rae.

On Wed, Jan 14, 2009 at 2:17 PM, Zack, James <JZack at unex.ucla.edu> wrote:
> I hope that's not 10Tb on IDE/ATA drives! (tick, tick, tick)
>
> Your cheapest solution might be another 10Tb of disks and unless there
> is an open source dedupe solution out there.  Commercial dedupe is too
> expensive for home/hobby use.  My Google-Fu turned up this open source
> solution:
>
> http://gotitsolutions.org/2007/01/15/open-source-backup-and-data-de-dupl
> ication-virtual-appliance-2.html
>
> I have not tried it, and it's not clear if this is a file level dedupe
> or a block level one, and if it's pre or post process, nor what the
> compression ratio is, and it looks like it only works with SMB :/
>