Re: Move large number of files from AIX to Windows

Without getting the calculator out and figuring how many seconds it should
take; Are you sure the network adapters are working properly? I've copied
larger filespaces than 60GB before, and it never took anywhere close to 36
hours. I routinely use cygwin and ssh to copy large filesystems over the
network to a Windows machine, and it works just fine.

Kurt Gilpin
Senior Information Specialist
MoDOT Information Systems
Kurtis.Gilpin@xxxxxxxxxxxx
Phone: 573.522.6022
Mobile: 573.291.9573



"Christopher D. Clausen" <cclausen@xxxxxxx>
Sent by: IBM AIX Discussion List <aix-l@xxxxxxxxxxxxx>
12/03/2007 01:19 PM
Please respond to
IBM AIX Discussion List <aix-l@xxxxxxxxxxxxx>


To
aix-l@xxxxxxxxxxxxx
cc

Subject
Re: Move large number of files from AIX to Windows






Alan R Vidmar <Alan.Vidmar@xxxxxxxxxxxx> wrote:
I've got an F80 with a large number of files (1.6 Million files, 800K
folders, ~60GB) on a JFS2 SSA Raid 5 array that I need to get down to
a Windows server. I've been able to copy the files using NFS and SSH,
but it just takes too long (~1.5 days) Both servers have Gb
interfaces and are working as expected, but NFS and SSH are just too
slow for this process.

I think the fastest way may be to move the files/folders to a
portable/removable drive that can be attached to each server. But I
just don't think there exists and interface/partition format that
both AIX and Windows2003 both support.

I also thought about TARing up the whole folder structure then NFS or
SSH it down, but the TAR process seems to take half as long as the
transfer. Thus it's no time saver.

Any thoughts?

tar -c | nc on the AIX side and then nc | tar -x on the Windows side.
You'll of course need to find a version of netcat and tar for Windows.

This should be significantly faster than SSH although there is no
encryption or authentication.

You may also want to mount -noatime on the filesystem, if AIX supports
such a thing, as writing an updated entry when the file is copied isn't
exactly useful for you.

<<CDC

Relevant Pages

  • Re: Copying files from windows to aix
    ... Copying files from windows to aix ... The best way is to use ssh - install sshd on the aix and ssh on windows. ...
    (AIX-L)
  • Re: Copying files from windows to aix
    ... The best way is to use ssh - install sshd on the aix and ssh on windows. ...
    (AIX-L)
  • Re: OpenSSH, Telnet, Windows Authentication and double-hops
    ... >> ssh -L) ... JM> in seperate DOS console windows in this order: ... I'm using the 3.8 version of OpenSSH. ... >> Kerberos ticket, or your password in order to acquire one. ...
    (comp.security.ssh)
  • Re: OpenSSH, Telnet, Windows Authentication and double-hops
    ... >> ssh -L) ... JM> in seperate DOS console windows in this order: ... >> Kerberos ticket, or your password in order to acquire one. ... JM> We're focusing on the OpenSSH for Windows distribution. ...
    (comp.security.ssh)
  • Re: FC6 VPN
    ... Then you can run any application you would like off the server by simply running it, or if you want to run a whole session, use gnomesession. ... ssh client that supports X forwarding, which is want you want to be looking at. ... SSH allows you to forward any local port to any remote port. ... If you need to connect to, say a windows share, you would forward your local port to the linux server through the ssh tunnel. ...
    (Fedora)