Re: freebsd router project. Problems with polling?

From: Gleb Smirnoff (glebius_at_freebsd.org)
Date: 01/29/05

  • Next message: David Cornejo: "bind() & how to receive broadcast packets?"
    Date: Sat, 29 Jan 2005 19:29:48 +0300
    To: Thomas Vogt <freebsdlists@bsdunix.ch>
    
    

      Thomas,

      can you try if_em driver from HEAD and check whether this help.
    There were some work done during 5.3-RELEASE.

    On Fri, Jan 28, 2005 at 06:18:19PM +0100, Thomas Vogt wrote:
    T> netstat -w 1 (polling disabled)
    T> input (Total) output
    T> packets errs bytes packets errs bytes colls
    T> 300531 0 23441438 300585 0 23444792 0
    T> 300939 0 25872898 300895 0 25870184 0
    T> 300738 0 23457584 300768 0 23460626 0
    T> 300304 10 25826466 300304 0 25826876 0
    T> ...
    T>
    T> Interrupt load is about 70% with net.inet.ip.fastforwarding enabled. If
    T> I disable this the system becomes unusable.
    T> The system hasn't reach the limit yet. But the interrupt is much to
    T> high. It's not worthy to add a second udp sender machine, at the moment.
    T>
    T>
    T> netstat -w 1 (polling enabled)
    T> input (Total) output
    T> packets errs bytes packets errs bytes colls
    T> 150151 47647 12910330 150150 0 12911806 0
    T> 150151 0 11711798 150152 0 11711876 0
    T> 150151 47665 12910986 150151 0 12911810 0
    T> 150151 0 11711798 150151 0 11711798 0
    T> ...
    T>
    T> Interrupt load is about 10%. CPU is about 60% and with
    T> kern.polling.idle_poll enabled it goes to 100% (as expected).
    T>
    T> As you see the speed is droping down to 50% with polling enable and and
    T> I got a lot of errors.
    T> kern.polling.lost_polls: 188748 and kern.polling.suspect: 186919 are
    T> also very high. I don't know why polling is so bad on this machine. All
    T> SMP option are disabled in the kernel and bios.
    T> I tried to do as much as in
    T> http://lists.freebsd.org/pipermail/freebsd-questions/2004-November/064427.html described.
    T>
    T> I will prepare others tests with -STABLE and -CURRENT in the next few
    T> days. At the mean time, are they some other magic things config option I
    T> can try? Perhaps increase the HZ to 2000 in the kernel or remove polling
    T> and try smp machine? I doubt that I can run the machine without polling.
    T> If you see 70% interrupt load with 300k pps without polling.
    T>
    T> regards
    T> Thomas Vogt
    T>
    T> _______________________________________________
    T> freebsd-net@freebsd.org mailing list
    T> http://lists.freebsd.org/mailman/listinfo/freebsd-net
    T> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"

    -- 
    Totus tuus, Glebius.
    GLEBIUS-RIPN GLEB-RIPE
    _______________________________________________
    freebsd-net@freebsd.org mailing list
    http://lists.freebsd.org/mailman/listinfo/freebsd-net
    To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
    

  • Next message: David Cornejo: "bind() & how to receive broadcast packets?"

    Relevant Pages

    • Re: Freebsd IP Forwarding performance (question, and some info) [7-stable, current, em, smp]
      ... I still don't like the huge hit ipfw and lagg take:/ ... CPU is 44% idle (idle polling isn't on) but I'm getting errors! ... packets errs bytes packets errs bytes colls ...
      (freebsd-net)
    • Re: freebsd router project. Problems with polling?
      ... T> netstat -w 1 (polling disabled) ... T> packets errs bytes packets errs bytes colls ... T> Interrupt load is about 70% with net.inet.ip.fastforwarding enabled. ...
      (freebsd-performance)
    • Re: Freebsd IP Forwarding performance (question, and some info) [7-stable, current, em, smp]
      ... It uses the cpus in a slightly different way but the pps rate is similar.. ... Polling doesn't do anything any more. ... packets errs bytes packets errs bytes colls ... Now, while this is happening I have two CPU's 100% idle, and the other two CPUs are about 60%/20% .. ...
      (freebsd-net)
    • Re: throughput and interrupts
      ... I have a router, that rules three subnets. ... single device per IRQ, but still i have near 20-30 % of interrupt load, ... HZ=1000, polling and tried it. ... PID USERNAME PRI NICE SIZE RES STATE TIME WCPU CPU COMMAND ...
      (freebsd-current)
    • Re: throughput and interrupts
      ... Bachilo Dmitry wrote: ... I have discovered some IRQ conflicts and removed them, now I have single device per IRQ, but still i have near 20-30 % of interrupt load, when i download something through this router. ... Some people advised me to use polling, so I've built kernel with HZ=1000, polling and tried it. ...
      (freebsd-current)