Is there a good way to mirror terrabytes of data with daily delta's in 100's of Gb across a oc3 line?

Question

ddup does not seem a good fit due to nature of the data, but other WAN opt?

one problem is that ftp and other data transfer protocols don't come close to oc3 speed.

It is shared but minimal traffic. wonder if latency is an issue and how to measure. If I was really getting 155Mb/s would be happy

Answer 1

Don't say what os you are using but if it is Linux based just use rsync. It is very fast and very effective.
http://samba.anu.edu.au/rsync/

or
http://everythinglinux.org/rsync/
from them I quote:
"Rsync is a wonderful little utility that's amazingly easy to set up on your machines. Rather than have a scripted FTP session, or some other form of file transfer script -- rsync copies only the diffs of files that have actually changed, compressed and through ssh if you want to for security."

Now if you have Windows, you can still use rsync but you have too add it to the machines first
http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=6&MMN_position=23:23
http://www.gaztronics.net/rsync.php
Is a couple of ways to do this.

Its very fast, I have used it to clone servers and is usually does so in very short time. I don't even come close to and OC3 I did it with DSL lines.

Answer 2

if you're already using an oc3 line.. then really the only thing you can look at are wan optimization technologies, but im guessing you're already using that ?