RE: Slow server



Olivier Nicole wrote:

2) as there are many connections comming from search engines siders
(90% of all the established connections), I'd like to limit the
ressources that spiders are using. One way would be through IPFW,
but are there better ways? Is there a way to limit/prioritize in
Apache (not that I know any).



Lookup mod_security rules for Apache and mod_dosevasive. mod_evasive will help prevent the spiders from opening many pages at one time

mod_security has rules to detect some fake spiders and other bots and block them from the get go.

Both though will add a little bit of overhead to Apache.

_______________________________________________
freebsd-questions@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to "freebsd-questions-unsubscribe@xxxxxxxxxxx"

Relevant Pages

  • Re: Slow server
    ... ressources that spiders are using. ... One way would be through IPFW, ... google robots.txt which ought to limit what the spiders look at ... Try tracking memory usage. ...
    (freebsd-questions)
  • Re: Slow server
    ... ressources that spiders are using. ... One way would be through IPFW, ... but it keeps traffic information on a per web site basis. ...
    (freebsd-questions)