Massive queue buildup

[Brent Addis]

if you want to only check spamassassin (generally the slowest part with lots of rules) "time spamassassin -D --lint" is a good start. as long as your mailscanner.cf is in a reasonable place it should pick it up. If you keep an eye on where it seems to take a while, it should help you track down the problem.
 
Or, there is an option within mailscanner to turn on batch process time. I forget the name however its in the last quarter of the config somewhere.
 
are you running bayes? If you are, and its standard db files on the server, I would recommend migrating these to an sql server somewhere. This helped scan times a fair bit too. Another upside is this also means you can have multiple servers using the same db.
 
With RBL's, don't forget spamassassin also does RBL checking so make sure your not doing twice the lookups you need to.
 
100k a day should be fine on the hardware you have.
 
 

________________________________

From: mailscanner-bounces at lists.mailscanner.info on behalf of Jay Chandler
Sent: Tue 11/14/2006 12:39 PM
To: MailScanner discussion
Subject: Re: Massive queue buildup



On Nov 13, 2006, at 2:42 PM, Brent Addis wrote:


	Check your not running one of those massive blacklists from SARE.

	I was running one for a while while testing and a similar thing happened. removing it dropped my average scan time from ~2 1/2 minutes to 11 seconds per message. 


Where does one determine how long the average scan time is?


	Other ideas:

	- Check your dns servers are capable of standing up to the amount of dns requests you are making. Running something like nscd locally is a good idea.


I suspect they are, but I'll verify this.


	- Are you running very many RBL's within mailscanner? Try disabling these and see if it helps.


Three or four-- nothing insane.


	- Are you running any type of recipient verification? (as in, checking that the person being sent the mail actually exists). If not, try turning it on. I am unsure what it is called within postfix as I don't use it.


We are.  Messages to undefined users fault to a 5xx error.


	- Check out http://wiki.mailscanner.info/doku.php?id=maq:index#optimization_tips which has a few others as well.


Thanks!


	How much mail are you handling a day? I have a couple of single cpu 3.0 ghz machines comfortably handling many thousands of messages a day.



Right now, about 100K a day.


Thanks for the help!



-- 
Jay Chandler
Network Administrator, Chapman University
714-628-7249 / chandler at chapman.edu
"Bother," said Pooh as he struggled with /etc/sendmail.cf, "it never does quite what I want.  I wish Christopher Robin was here." -- Peter Da Silva in a.s.r.


-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/ms-tnef
Size: 7350 bytes
Desc: not available
Url : http://lists.mailscanner.info/pipermail/mailscanner/attachments/20061114/ddd4ef2c/attachment-0001.bin