cp taking 24 hours for 200Gigs of data

From: Liam Carey (liam_94609_at_yahoo.com)
Date: 03/31/04 

Date: 30 Mar 2004 23:23:25 -0800

We are having to wait over 24 hours for cp to complete the job of
copying 200Gig of data from one filesystem to another. Any help is
greatly appreciated. Both machines are Solaris 8, with Gigabit
ethernet cards. We have mounted the filesytem via NFS over the network
and are currently copying 3 directories we need using cp -r. The
subdirectories contain (i believe) hundreds of thousands of files
(compile data, consisting of relatively small files). The throughput
we are seeing (using sar -d) is on the order opf 1 to 3 Megabytes/Sec
- incredibly slow considering both machines are powerful servers.

 I have checked the NIC cards using ifconfig, netstat and ndd. There
are no collisions, the connections are Full-Duplex Gigabit rates.
What's going on?

 Liam
 lcarey@kivera.com

Relevant Pages

  • Re: how to use dd command
    ... If you're copying from FAT32 to ext3, dd is not the best utility to ... Use dd to copy the entire FAT32 filesystem (including filesystem ...
    (comp.os.linux.hardware)
  • Re: cp taking 24 hours for 200Gigs of data
    ... > copying 200Gig of data from one filesystem to another. ... We have mounted the filesytem via NFS over the network ... Second recommendation is to not use NFS for bulk copying. ... turnaround time is going to be increased by not only the latency ...
    (comp.unix.solaris)
  • Re: how to use dd command
    ... If you're copying from FAT32 to ext3, dd is not the best utility to choose, IMHO. ... Use dd to copy the entire FAT32 filesystem from one raw device to another. ...
    (comp.os.linux.hardware)
  • Re: Copy Linux Filesystem/Check/Compare Filesystems
    ... > without the intermediate tar file? ... Copying a filesystem is a fairly time consuming task, ...
    (Debian-User)