Re: jboss4 on freebsd



Paul wrote:
kern.ipc.nmbclusters=128000
changed - no effect

Check output from netstat -m, this shows network buffers.
770/8200/8970 mbufs in use (current/cache/total)
768/5426/6194/128000 mbuf clusters in use (current/cache/total/max)
768/5248 mbuf+clusters out of packet secondary zone in use (current/cache)
0/677/677/12800 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
1728K/15610K/17338K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
73 requests for I/O initiated by sendfile
0 calls to protocol drain routines

This output is in the same second as I see no buffer space available .. isn't this weird?


Stefan Lambrev wrote:
Greetings,

I'm experimenting with jboss4 cluster under freebsd 7 (amd64).
In my configuration I have 2 jboss instances which are in cluster and they communicate via separate network (used only for shared data)
When I create some load on the application sometimes I see this error:

2008-06-24 14:46:21,602 ERROR [org.jgroups.protocols.UDP] failed sending message to 10.50.1.1:57680 (59800 bytes)
java.io.IOException: No buffer space available

It looks very much, that jboss can't handle properly such error as on linux there is no such thing as no network buffers ;) - http://wiki.freebsd.org/AvoidingLinuxisms

But what really bothers me is that I see "No buffer space available" on very low network IO -

input (em2) output
packets errs bytes packets errs bytes colls
144 0 2203390 292 0 2072771 0
1568 0 2329764 63 0 9099 0
76 0 231562 34 0 148306 0
563 0 1152531 1009 0 1768748 0
1625 0 2601502 104 0 229728 0
65 0 467296 85 0 441566 0
464 0 680082 973 0 1439442 0
357 0 1940361 55 0 222484 0
1651 0 2827932 145 0 450265 0

E.g. traffic between 1-3MB/s.

I'm using:
em2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
options=19b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4>
ether 00:15:17:60:04:c8
inet 10.3.3.117 netmask 0xffffff00 broadcast 10.3.3.255
media: Ethernet autoselect (1000baseTX <full-duplex>)
status: active

em2: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f mem 0xb8820000-0xb883ffff,0xb8400000-0xb87fffff irq 18 at device 0.0 on pci5
em2: Using MSI interrupt
em2: [FILTER]

and my sysctl.conf is:
kern.maxfiles=65000
kern.ipc.shmmax=67108864
kern.fallback_elf_brand=3
kern.threads.max_threads_per_proc=6000
kern.ipc.somaxconn=512
#jboss extra
net.inet.udp.maxdgram=73728
kern.ipc.maxsockbuf=1048576
net.inet.udp.recvspace=147456
kern.ipc.maxsockets=49312

Any ideas how I can improve things?



--

Best Wishes,
Stefan Lambrev
ICQ# 24134177

_______________________________________________
freebsd-net@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscribe@xxxxxxxxxxx"

Relevant Pages

  • Re: [fw-wiz] Cisco VPN reconnection every 23 minutes
    ... of UDP packets going between the client and the VPN concentrator. ... crypto map outside_map 61 match address outside_61_cryptomap ... Global IPSec over TCP Statistics ... Encapsulate packet requests: 120048 ...
    (Firewall-Wizards)
  • Re: [fw-wiz] Cisco VPN reconnection every 23 minutes
    ... of UDP packets going between the client and the VPN concentrator. ... Can you forward crypto config from the Cisco VPN concentrator? ... Global IPSec over TCP Statistics ... Encapsulate packet requests: 120048 ...
    (Firewall-Wizards)
  • Re: FreeBSD 7.1 tcp problem (syncache)?
    ... Completed 200 requests ... 31728 data packets ... 9740 connections closed ... segment rexmit in SACK recovery episodes ...
    (freebsd-net)
  • Re: Is it true that All communication between front-end and back-end servers goes through TCP port
    ... Mail server administrator, MCSA/MCSE ... > port to cluster and that MS would be using XML as the format over port 80 ... >> from any front-end server in your organization. ... Proxy requests are ...
    (microsoft.public.exchange2000.general)
  • Re: Wireless module bcm43xx in 2.6.17 kernel
    ... There is a line in dmesg that says "Cleared all keys" before the card starts sending out sending out dhcp requests, so I'm guessing that is what the problem is. ... I used a packet sniffer to see what was going on and my browser will send http get requests, the site will return a few packets, my browser will continue to send http requests on an intermittent bases because no response is recieved for a while, and then for every occasional packet that is returned in response to the http requests I will also get duplicate packets. ... The only problem I had with it was that every once in a while it would drop a connection if I let the connection sit idle for a while yet my wireless card was reporting a successful connection. ...
    (Debian-User)