[SGVLUG] Moving files in a safe way

[Rae Yip]

Try it with cpio -oH ustar instead. odc is an older serialisation
standard; it might not be implemented properly on Linux.

If that doesn't work, fall back to pax or rdist.

-Rae.

On Fri, May 1, 2009 at 1:00 AM, Matt Campbell <dvdmatt at gmail.com> wrote:
> Thanks Rae,
>
> The speed difference was what I was fishing for.
>
> The incantation you provided below apparently didn't contain some
> information I needed.  The following didn't work, where did I go wrong?
>
> matt at scar:25% find /media/Media -depth | cpio -oH odc | ssh -e none
> matt at mufasa cpio -idmv /media/Media matt at mufasa's password:
> cpio: Media/NinjaNonsense/English/Ninin English 10.mov: file width not
> sufficient for storing file size
> cpio: premature end of file
>
> Could it be that the file was over a Gig in size?
>
> Here is a report from the Debian bugs list on Aug '08:
>
> "This is dreadful. cpio is passing over backup files and omitting large and
> important files. Please raise to critical."
> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=495962
>
> But I'm running Fedora 10... that makes it all ok right?
>
> Matt
>
>> -----Original Message-----
>> From: sgvlug-bounces at sgvlug.net [mailto:sgvlug-bounces at sgvlug.net] On
>> Behalf Of Rae Yip
>> Sent: Thursday, April 30, 2009 7:30 PM
>> To: SGVLUG Discussion List.
>> Subject: Re: [SGVLUG] Moving files in a safe way
>>
>> If it's a one-time operation, I'd be inclined to use cpio over ssh.
>>
>> cd /src; find . -depth | cpio -oH odc | ssh -e none user at host cpio -
>> idmv /tgt
>>
>> Feel free to compare the times for this to rdist. :)
>>
>> -Rae.
>>
>> P.S. Not sure if Linux cpio or rdist will preserve ACLs or security
>> contexts. Assuming this isn't a big deal.
>>
>> On Thu, Apr 30, 2009 at 5:33 PM, Matt Campbell <dvdmatt at gmail.com>
>> wrote:
>> > I have a quick question.
>> >
>> >
>> >
>> > I have 6 TB of data I want to move between 2 arrays across a 1000T
>> network.
>> > What is the best transport mechanism to use to ensure a good copy?
>> Is rdist
>> > over ssh a reasonable solution?
>> >
>> > Matt
>> >
>> >
>> >
>> >
>> >
>> >
>
>