Super Slow Queue Processing

[Julian Field]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Run a "MailScanner --debug". If you get any weird errors about a problem 
in some line in a C file, then your SpamAssassin cache is screwed. 
Deleting it does no harm, it very quickly rebuilds itself. I've seen 
this suddenly cause exactly the problem you are seeing.

Jules.

Peter Russell wrote:
> Hi there, we have a MailScanner system that has had a lot (any) 
> attention for 6 months or so and all of a sudden it is unable to 
> process the messages in the queue faster than they are building up.
>
> Doing an sa -D -t < on any of the high scoring spam messages i have is 
> very quick (less than 5sec). there was some error about hash from 
> sa-learn --force-expire, a google revealed naught so i disabled bayes 
> for now. but it maks no difference.
>
> But changing Use Spamassassin to no means the queue is processed 
> lightening quick. which seems weird because SA appears to run quite 
> quick.
>
> The messages do eventually seem to get processed but it takes quite a 
> while (upto 30min) and the queue seems to be growing muh quicker than 
> processing.
>
> MS debug takes AGES.
>
> I cant seem to find anything useful or interesting in the logs, i have 
> attached the output of the MS debug (yes i need to update clamav).
>
> Appreciate ANY tips on how to diagnose (or hopefully fix) this. :)
>
> Many thanks
> Pete
>
>
> MailScanner version 4.55.9
> SpamAssassin version 3.1.8
>   running on Perl version 5.8.5
> Linux Centos 2.6.9-11.ELsmp
> Postfix 2.3 (HOLD method)
>
> tarting MailScanner daemons:
>          incoming postfix :                                [  OK  ]
>          outgoing postfix :                                [  OK  ]
>          MailScanner:       In Debugging mode, not forking...
> LibClamAV Warning: 
> ********************************************************
> LibClamAV Warning: ***  This version of the ClamAV engine is 
> outdated.  ***
> LibClamAV Warning: *** DON'T PANIC! Read 
> http://www.clamav.net/faq.html ***
> LibClamAV Warning: 
> ********************************************************
> LibClamAV Warning: 
> ********************************************************
> LibClamAV Warning: ***  This version of the ClamAV engine is 
> outdated.  ***
> LibClamAV Warning: *** DON'T PANIC! Read 
> http://www.clamav.net/faq.html ***
> LibClamAV Warning: 
> ********************************************************
> Ignore errors about failing to find EOCD signature
> format error: can't find EOCD signature
>  at /usr/sbin/MailScanner line 820
>
> <snip>
>
> format error: can't find EOCD signature
>  at /usr/sbin/MailScanner line 820
> Stopping now as you are debugging me.
> commit ineffective with AutoCommit enabled at 
> /usr/lib/MailScanner/MailScanner/CustomFunctions/MailWatch.pm line 93, 
> <CLIENT> line 1422.
> Commmit ineffective while AutoCommit is on at 
> /usr/lib/MailScanner/MailScanner/CustomFunctions/MailWatch.pm line 93, 
> <CLIENT> line 1422.
>                                                            [  OK  ]

Jules

- -- 
Julian Field MEng CITP
www.MailScanner.info
Buy the MailScanner book at www.MailScanner.info/store

MailScanner customisation, or any advanced system administration help?
Contact me at Jules at Jules.FM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
For all your IT requirements visit www.transtec.co.uk


-----BEGIN PGP SIGNATURE-----
Version: PGP Desktop 9.7.0 (Build 867)
Comment: Use Thunderbird's Enigmail Add-on to verify this message
Charset: ISO-8859-1

wj8DBQFHREYQEfZZRxQVtlQRAkF0AJ9E1ArhEte7pBGYAeC/f5J8wVeRygCfW4v+
bBymPIZgR0x/NM2bcxM4thc=
=5wKe
-----END PGP SIGNATURE-----

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.