FreeBSD 5.3 Networking performance problem

From: Andrew Seguin (asegu_at_borgtech.ca)
Date: 11/26/04

  • Next message: Iasen Kostov: "Re: netstat patch for bridge stats"
    To: <freebsd-net@freebsd.org>
    Date: Fri, 26 Nov 2004 13:18:41 +0100
    
    

    *Problem: Poor performance for freebsd transparent gateway.

    *Situation:
    I need to install a simple firewall for a school network I am administering.

    We have about 100 computers active, generating a stream of approximately
    80-90K packets per minute for a load I estimate* to be a little under
    10Mbps. Overall the firewall will need to filter for a /24 subnet.

    *Configuration:
      Hardware:
    The firewall is a Celeron 900Mhz with 128MB ram (more on the way) with one
    rl and one sis based network cards.

    The firewall is to be the bridge between the main switch and the router.

      Software:
    I built up the firewall with FreeBSD 5.3, with a recompiled kernel using
    options BRIDGE, IPFIREWALL, IPFIREWALL_VERBOSE, IPFIREWALL_VERBOSE_LIMIT,
    IPFIREWALL_DEFAULT_TO_ACCEPT and IPSTEALTH. No software is running. IPFW is
    left with only it's default rule of allow all.

    *Testing:
    I tested with the firewall bridging for a single computer: ping time to the
    router was a stable 2ms.

    I then tested with the whole school going through the firewall: very bad.
    packets were being droped and ping times were around 600ms. Internet was
    pretty much unuseable.

    I googled around and read a bit, discovered polling. I Rebuilt the kernel
    for it and HZ set to 1000. I set the appropriate sysctl's and saw on
    ifconfig polling was indicated for both network cards.

    I retried using the firewall for the whole school, but again it wasn't
    working. I disconnected the secondary switches (which is for the offices,
    student residence, computer lab, etc) and kept a computer on the main
    switch. Ping times remained stable up to a bandwith I estimated later to be
    of approximately 20MB/min. The last switch I added, having a trafic of
    5MB/min seemed to kill the box.

    During my testing with the poling kernel, interupt time went up to 10% for
    the whole school, with 90% idle. Memory remained unchanged with 86MB free.

    Conclusion:
    I don't know what could be causing what seems to me as simply low
    performance under increased load. I've heard of people with higher loads
    then I have here**.

    If somebody on the list could give me some clues of what could be the
    problem here and pointers as to what to look at next, I would appreciate it
    greatly. The only idea I have here is to try and rebuild to 4.10 and see if
    the performance is there... is 4.10 much more performant then 5.3 ?

    * I have yet to get access to the router (SNMP or otherwise). I estimated
    the school load by using my firewall to test the traffic from each
    individual switch's uplink. I then extrapolated approximate traffic for our
    web and email servers in the very unscientific manor of comparing the lights
    on the main switch.

    **In particular the post on Nov 17 by Yar Tikhiy "polling(4) rocks!" had a
    claim of about 9kpps vs my load of about 1.5kpps

    _______________________________________________
    freebsd-net@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-net
    To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"


  • Next message: Iasen Kostov: "Re: netstat patch for bridge stats"

    Relevant Pages

    • Re: [fw-wiz] httport 3snf
      ... > This is a military School for 8-12 graders.. ... > how does the network work".....types of pre-adolesent questions. ... > wouldn't have gotten SSH out of my firewall. ... Postfix SMTP server with a wildcard MX that handed the mail that wasn't ...
      (Firewall-Wizards)
    • Re: Question about proxies
      ... >my school unfortunately filters it. ... >with the firewall. ... there are bold pilots, and there are old pilots, but there ... home machine and from there to the internet. ...
      (alt.computer.security)
    • Re: Access my Home Computer
      ... routers and using appropriate firewall software/hardware. ... problem if when I turn it on I can get on a wifi network for free to browse ... Does your school know that you intend to connect to an outside resource ... >>> Sometimes folks forget to put a password on the router. ...
      (microsoft.public.windowsxp.work_remotely)
    • RE: [fw-wiz] AIM
      ... original mail points to the Los Angeles Unified School District... ... This brings up an interesting problem, though: As firewall admins, we ... benachrichtigen Sie bitte den Absender und loeschen Sie bitte die ... Sie sollten die Nachricht ohne die ...
      (Firewall-Wizards)
    • Need firewall/filtering advice.
      ... I have been asked to help setup internet access for our church's school. ... I administrate the firewall (RedHat Linux 9 using ... iptables firewall). ...
      (comp.os.linux.security)