[hllug] Copy files faster with "rsync"

  • From: Lee Parmeter <geek@xxxxxxxxxxxxxx>
  • To: hllug@xxxxxxxxxxxxx
  • Date: Thu, 06 Dec 2007 10:52:53 -0600

Tip: Copy files from one drive to another quickly using "rsync".

Background:
==========
The goal is to replace the 5 IDE drives (20GB, 2-40GB, 60GB and 160GB) in
my home file server with 2 500GB SATAII drives running in a RAID1
configuration (mirrored). In the interim, I have a SATA Raid controller
(sil3124 based) and the drives installed in a 2nd machine so the O/S
(Fedora 8) can be installed, configured and the data transfered without
taking the original file server down. So far, the O/S is up along with
software RAID1 and some of the data has been transfered. Still a lot of
configuration to get done. The drive partitions and Software RAID1 looks
like this:

Partion ~Size  Software Raid1
======= =====  ==============
/boot   100MB  /dev/md0
/       10GB   /dev/md1
swap    1G     /dev/md2
/share  150GB  /dev/md3
/mythtv 300GB  /dev/md4

The 300GB "/mythtv" partition is setup as LVM so that the volume can be
expanded using a 2nd RAID1 drive pair in the future.

Using 'rsync"
============
There is a lot of data to be transfered to the '/share' and '/mythtv'
partitions and could take awhile over Ethernet. One way to speed up the
transfer is to use 'rsync' which can compress the data automatically during
transfer as well as preserve the file & directory user/group and permission
settings. 'rsync' can also be used to re-sync the contents right before
the new drives are installed in the destination server.

Here's an example of how to use 'rsync' to copy complete partitions (as
root) easily from one machine to another:

# rsync -avz root@samba:/mnt/MythTV/ /mythtv

where:
=====
-a = transfer in archive mode, which preserves symbolic links, attributes,
permissions, ownerships & etc.

-v = vebose

-z = use compression during transfer

root@samba: = login as root to the host named "samba" (192.168.10.5); uses ssh.

/mnt/MythTV/ = location of files/directories on remote machine (samba) to
be transfered.

/mythtv = destination directory on this computer.


-- 
Lee Parmeter
http://www.bubbasgeek.com

"When it comes to Vista: just say NO! If you're not ready for Linux, buy a
MAC!" - Lee Parmeter



______________________________________________________________________________
Highland Lakes Linux User Group (HLLUG): http://www.hllug.org
HLLUG mailing list: //www.freelists.org/list/hllug

Other related posts:

  • » [hllug] Copy files faster with "rsync"