SATA 3ware RAID review...sort of.

From: Gerald (gcoon_at_inch.com)
Date: 02/04/05

  • Next message: Simon: "Re: SATA 3ware RAID review...sort of."
    Date: Fri, 4 Feb 2005 17:23:22 -0500 (EST)
    To: freebsd-isp@freebsd.org
    
    

    Details of a web server upgrade using SATA RAID5 drives.

    Old Machine:
    FreeBSD 4.8 (CUSTOM), Dual Pentium III 850s, 1 GB RAM
    ADAPTEC 3200S FW Rev. 370F
    External disk case for SCSI SCA 10k RPM drives.

    Problem: Not enough memory. No way to upgrade RAM on existing MB.
    Solution: Kill soon to be hard drive issue and memory problem at same
    time with new machine. (Long story about "hard drive issue"s on old
    machine.)

    After shopping around we decided to try the SATA RAID setup for this
    web server. Upon advice from this list, I went for the 3ware 9000 series
    controller.

    New Machine:
    Freebsd 5.3 (GENERIC), Dual Xeon 3.06GHz, 4GB RAM
    3ware 9500S8CH
    Disks: (5x) 7200RPM 8MB cache SATA150 RAID5'ed

    Some information about this server: It's totally dedicated to serving
    web pages for one site. Site traffic during down months has a 95th
    percentile of about 15 Mb. During Feb and Sep it jumps to 25 Mb and
    this month we expect 30 Mb 95th percentile. For those that do transfer
    numbers, the last week of September 04 saw 895.96 gigabytes total
    transferred and 127.99 gigabytes average per day. (7 days)

    On the old server I watched systat -v 1 for about 30 minutes recently
    to see how busy the individual disks were during normal load. Most
    partitions bounced around from 20% busy to 75% busy. This was a SCSI
    setup though so I was concerned about moving over to SATA for something
    that uses disk I/O so much.

    The new setup is 1 TB of usable space. The new setup allows all of the
    data to be on one partition that is RAID5'ed. I switched to the new
    server Wed night at midnight and peak traffic hit today. They went from
    15 mb to 30 Mb between 6AM and 8AM. (INCH has redundant 100 Mb upstream
    connections.)

    Systat and top now show the machine taking the load in stride.
    LA: 0.94 0.52 0.58
    Disk usage: hovers around 50% (40-55% predominantly)
    CPU: stays about 80% Idle

    I obviously don't have the apache defaults to serve up this many pages,
    but I wanted to share the SATA success on a high usage web server. At
    least from my perspective you can easily do 30 Mb of web traffic on a
    properly configured RAID5 SATA system. If I had to guess, you could make
    it to somewhere in the neighborhood of 75-100 Mb of traffic before you
    would run in to I/O problems configured the way I have it. I wouldn't do
    that much on it though since a drive failure would put your processes
    waiting on the Disk I/O.

    Problems related to drives:

    The twa driver would not let me create more than I think 7 partitions.
    I'm pretty sure it was 7. I've slept since then. It tried to create the
    like "/dev/...i" as /dev/X literally. I just reworked my FS layout to
    work around this. This might just be the 5.3 installer though. I don't
    know. I didn't spend too much time on this.

    Concessions:
    - There are many many changes between FreeBSD 4.8 and 5.3. I'm
    benefiting from quite a few improvements in that upgrade.

    - UFS -> UFS2 probably plays quite a bit in to the above information.

    - If I could have upgraded the RAM on the old machine, I could have made
    do with a memory upgrade for an indeterminate amount of time. The memory
    is what I needed the most.

    - I've not tested (even for the fun of it) a drive failure and the
    ensuing load should such a situation happen. I feel comfortable that I
    have enough breathe room with the current load on the disks.

    - I did stress test the disks with bonnie++ from the ports and it seemed
    to do well.

    - You can squeeze even more out of this setup with 10k RPM drives, but I
    had to do 7200s to keep within customer's budget and it's handling the
    load quite well.

    - YMMV, This information comes with no warranty either expressed or
    implied...etc etc. Contact me if you want a server setup the same way.

    Gerald Coon
    System Administrator
    Internet Channel
    _______________________________________________
    freebsd-isp@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-isp
    To unsubscribe, send any mail to "freebsd-isp-unsubscribe@freebsd.org"


  • Next message: Simon: "Re: SATA 3ware RAID review...sort of."

    Relevant Pages

    • Re: separate hard drive for scratch disks for two different programs?
      ... measures out at a higher speed than the 750GB SATA ... much faster using the middle cylinders than the SCSI ... This is a function of the way the OS deals with the disk, ... of sharing the load between multiple drives, ...
      (rec.photo.digital.slr-systems)
    • Re: SPARC vs Opteron: Which to buy?
      ... Sun has only qualified drives up to 250 GB for the x86 systems. ... The biggest disks available on the market is 500 GB SATA right now. ... You don't *have* to mirror, but not advisable to not mirror at all, for ... External disk stuff would have to be from someone other than Sun. ...
      (comp.unix.solaris)
    • Re: ATA problems again ... general problem of ICH7 or ATA?
      ... atacontrol detach ata3; atacontrol attach ata3 did. ... Yes, that is the method for a controlled remove and reattach, a la hotplug SATA. ... I don't saw any report with one disk machine. ... I'm using an AMD Athlon 64 Newcastle on a ULi M1689 chipset with WD RE2 drives so, although I'd be more than happy to be the numpty that is wrong and to have atavindicated by someone else, I suspect it is atathat is the problem. ...
      (freebsd-stable)
    • Problems hot plugging SATA drives
      ... motherboard's onboard SATA controllers as backup devices. ... on being able to hotswap the SATA backup drives (in removable SATA disk ... Device Manager and 'disable' a disk decide if I want to remove it and, ...
      (microsoft.public.windows.server.general)
    • Re: Unable to install XP on Asus A8N-SLI Deluxe board. Im a moron... but hopefully not that much
      ... Contrary to what some people have said on the Internet, when using an Asus A8n-SLI Deluxe motherboard, a SATA drive and Windows XP Pro, one does not need ANY SATA drivers UNLESS one is using a RAID array... ... When I tried to load XP from my SATA CD-ROM, which was connected to one of the four SATA RAID connectors, the installation would fail with the error "Windows could not start because of a computer disk hardware configuration problem. ... Could not read from the selected boot disk. ... First I disconnected all my hard drives leaving only the CD-ROM drive and floppy drive connected. ...
      (alt.comp.periphs.mainboard.asus)