MailScanner/Spamassassin slow after version upgrade

[Gottschalk, David]

How many children are you running?

Are you running a caching DNS server for SA lookups?

what does 'MailScanner --debug -debug-sa' look like?

One thing that made a difference for me was uping my children from 5 to 10. Also lowering my "Max Unsafe Messages Per Scan" to 10, and my "Max Unscanned Messages Per Scan" to 10 helped speed things up as well.

Hope that helps.

David Gottschalk

________________________________
From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf Of donald.dawson at bakerbotts.com
Sent: Monday, July 30, 2007 1:44 PM
To: mailscanner at lists.mailscanner.info
Subject: MailScanner/Spamassassin slow after version upgrade


The time it takes to process an email has doubled since Friday (7/26/07) when I upgraded to MS 4.62.6 and SA 3.2.2.  It was around 3.5 seconds, and now it is averaging 7 seconds.

We use DCC and razor2 - no pyzor.

Jul 30 12:36:35 houmx05 MailScanner[21682]: Batch (30 messages) processed in 187.50 seconds
Jul 30 12:37:06 houmx05 MailScanner[21662]: Batch (16 messages) processed in 105.59 seconds
Jul 30 12:37:24 houmx05 MailScanner[21727]: Batch (30 messages) processed in 196.20 seconds
Jul 30 12:37:28 houmx05 MailScanner[21776]: Batch (30 messages) processed in 211.89 seconds
Jul 30 12:37:38 houmx05 MailScanner[21793]: Batch (30 messages) processed in 223.64 seconds

sar -u shows idle CPU time:
12:00:01 AM   CPU    %user    %nice  %system  %iowait    %idle
Average:          all     10.49      0.00      4.99      1.00     83.51

# uptime is normal
 12:38:30 up 5 days, 25 min,  1 user,  load average: 0.81, 0.79, 0.83

I have implemented sa-compile using re2c expecting to get a performance boost.

'MailScanner --lint' doesn't show any errors, except noting that we have clamav processing turned off (output attached).

<<ms.txt>>
I have included output from spamassassin's lint command.

/etc/mail/spamassassin contents:
bakerbotts.cf   - custom local rule file
Botnet.cf
Botnet.pm
init.pre
init.pre.pre-v310
KAM.cf
local.cf
mailscanner.cf
pdfinfo.cf
sare-sa-update-channels.txt
sa-update-keys
v310.pre
v312.pre
v320.pre

contents of sare-sa-update-channels.txt used by update_spamassassin:

updates.spamassassin.org
70_sare_adult.cf.sare.sa-update.dostech.net
70_sare_bayes_poison_nxm.cf.sare.sa-update.dostech.net
70_sare_evilnum0.cf.sare.sa-update.dostech.net
70_sare_genlsubj0.cf.sare.sa-update.dostech.net
70_sare_genlsubj1.cf.sare.sa-update.dostech.net
70_sare_genlsubj2.cf.sare.sa-update.dostech.net
70_sare_header.cf.sare.sa-update.dostech.net
70_sare_highrisk.cf.sare.sa-update.dostech.net
70_sare_html.cf.sare.sa-update.dostech.net
70_sare_obfu.cf.sare.sa-update.dostech.net
70_sare_oem.cf.sare.sa-update.dostech.net
70_sare_random.cf.sare.sa-update.dostech.net
70_sare_specific.cf.sare.sa-update.dostech.net
70_sare_spoof.cf.sare.sa-update.dostech.net
70_sare_stocks.cf.sare.sa-update.dostech.net
70_sare_unsub.cf.sare.sa-update.dostech.net
70_sare_uri0.cf.sare.sa-update.dostech.net
70_sare_uri1.cf.sare.sa-update.dostech.net
70_sare_uri2.cf.sare.sa-update.dostech.net
70_sare_whitelist.cf.sare.sa-update.dostech.net
70_sare_whitelist_rcvd.cf.sare.sa-update.dostech.net
70_sare_whitelist_spf.cf.sare.sa-update.dostech.net
72_sare_bml_post25x.cf.sare.sa-update.dostech.net
72_sare_redirect_post3.0.0.cf.sare.sa-update.dostech.net
88_FVGT_headers.cf.sare.sa-update.dostech.net
99_FVGT_Tripwire.cf.sare.sa-update.dostech.net
99_sare_fraud_post25x.cf.sare.sa-update.dostech.net

Any ideas would be greatly appreciated.

Thanks,
Donald

Donald Dawson
Security Administrator
Baker Botts L.L.P.
713-229-2183
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.mailscanner.info/pipermail/mailscanner/attachments/20070730/0fdd5b30/attachment.html