Queue problem

Sat Mar 1 18:16:47 GMT 2008

I have found the relevant "awk" command and modified MailScanner so that 
when the "--debug-sa" option is used, all debug output will have the 
current time stuck on the front of every line. This makes looking for 
pauses a *lot* easier.

Don't send me output from --debug-sa as it is useless without knowing 
where the pauses are.
The next release will help you a lot with this problem.

Maxime Gaudreault wrote:
> I don't understand when to stop, start again etc.. (i don't speak english very well)
>
> However, I can redirect the output to a log file. Can I send it to you ?
>
> Maxime Gaudreault
> Technicien
>                                                   
> Référence Systèmes inc.
> Tél. : 418.650.0997
> Téléc. : 418.650.9668
> Courriel : mgaudreault at reference.qc.ca
> Site Internet : http://www.reference.qc.ca/
>
>
> -----Original Message-----
> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf Of Julian Field
> Sent: March 1, 2008 12:03 PM
> To: MailScanner discussion
> Subject: Re: Queue problem
>
> In which case your DNS lookups should be okay. That's a perfectly 
> reasonable figure in my experience.
>
> Run "MailScanner --debug --debug-sa". It will produce loads of output. 
> However, at some point in the SpamAssassin output, it will pause for a 
> second or two. You want to catch it there, then resume it and then 
> immediately stop it again, as the bits you are interested in are the 
> lines of output printed out immediately *after* the pause.
>
> This can take a few goes to catch, though someone did post a nice 
> command the other day to prepend each line of output with the current 
> time, so you could see easily when (and how long) the pauses were. Can 
> someone repost that please? If I can find it, I'll work out how to build 
> it into the MailScanner debug output directly. It will help diagnose 
> this sort of problem a lot.
>
> This output should tell you where the pauses are, and therefore what 
> operations are taking too long.
>
> Maxime Gaudreault wrote:
>   
>> Hi Jule
>>
>> Dig results comes within 41-108 msec
>>
>> Maxime Gaudreault
>> Technicien
>>                                                   
>> Référence Systèmes inc.
>> Tél. : 418.650.0997
>> Téléc. : 418.650.9668
>> Courriel : mgaudreault at reference.qc.ca
>> Site Internet : http://www.reference.qc.ca/
>>
>>
>>
>> -----Original Message-----
>> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf Of Julian Field
>> Sent: February 29, 2008 5:50 PM
>> To: MailScanner discussion
>> Subject: Re: Queue problem
>>
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>>
>>
>> Maxime Gaudreault wrote:
>>   
>>     
>>> Hi
>>>
>>> The hold queue is actually at 415 emails
>>>
>>> Load Average: 0.11 0.25 0.53
>>>
>>> htop show many of these process:
>>>
>>> MailScanner: checking with SpamAssassin
>>>
>>> MailScanner: checking with Spam Lists
>>>
>>> CPU is 3%
>>>
>>> Mem is 25%
>>>
>>>     
>>>       
>> I would start checking your DNS setup. How long does it take for various 
>> random "dig" commands to produce results? MailScanner should spend a 
>> very small %-age of its time saying "checking with Spam Lists". If you 
>> can see several of them in that state, then that's likely a DNS lookup 
>> problem.
>>
>>   
>>     
>>> I don't understand
>>>
>>> *Maxime Gaudreault*
>>>
>>> Technicien
>>>
>>> _ _
>>>
>>> Référence Systèmes inc.
>>>
>>> Tél. : 418.650.0997
>>>
>>> Téléc. : 418.650.9668
>>>
>>> Courriel : _mgaudreault_ at reference.qc.ca 
>>> <mailto:mgaudreault at reference.qc.ca>
>>>
>>> Site Internet : http://www.reference.qc.ca/
>>>
>>> *From:* mailscanner-bounces at lists.mailscanner.info 
>>> [mailto:mailscanner-bounces at lists.mailscanner.info] *On Behalf Of 
>>> *Maxime Gaudreault
>>> *Sent:* February 29, 2008 10:54 AM
>>> *To:* MailScanner discussion
>>> *Subject:* Queue problem
>>>
>>> Hi
>>>
>>> I have a problem with my anti-spam gateway. The queue is fulling up 
>>> very quickly (1600+ mails in queue).
>>>
>>> The server's load average is <1 (0.60 - 0.80) so I suppose this is not 
>>> a ressource problem.
>>>
>>> Then I have to change the port forwarding directly to my Imail server 
>>> to let the anti-spam's queue going down.
>>>
>>> I used many tweak to maximize the efficacity of the anti-spam 
>>> (mailscanner work directory in ram, dns cache server, increasing 
>>> memory). I only got 1 CPU but I suppose this is not the problem 
>>> because when the queue is full, the load average is under 1.
>>>
>>> Any idea ?
>>>
>>> PS: Sorry for my bad english
>>>
>>> PPS: Sorry if you received my message twice
>>>
>>> *Maxime Gaudreault*
>>>
>>> Technicien
>>>
>>> _ _
>>>
>>> Référence Systèmes inc.
>>>
>>> Tél. : 418.650.0997
>>>
>>> Téléc. : 418.650.9668
>>>
>>> Courriel : _mgaudreault_ at reference.qc.ca 
>>> <mailto:mgaudreault at reference.qc.ca>
>>>
>>> Site Internet : http://www.reference.qc.ca/
>>>
>>>     
>>>       
>> Jules
>>
>> - -- 
>> Julian Field MEng CITP CEng
>> www.MailScanner.info
>> Buy the MailScanner book at www.MailScanner.info/store
>>
>> MailScanner customisation, or any advanced system administration help?
>> Contact me at Jules at Jules.FM
>>
>> PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
>> PGP public key: http://www.jules.fm/julesfm.asc
>>
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: PGP Desktop 9.8.0 (Build 2158)
>> Comment: Use Thunderbird Enigmail to verify this message
>> Charset: windows-1252
>>
>> wj8DBQFHyIwcEfZZRxQVtlQRAuPxAKD9kZyTPfF/rfAZwnYgYtTJ7wBQtACgn2PT
>> eFc95lOZub+5/sADM2GStSY=
>> =9oag
>> -----END PGP SIGNATURE-----
>>
>>   
>>     
>
> Jules
>
>   

Jules

-- 
Julian Field MEng CITP CEng
www.MailScanner.info
Buy the MailScanner book at www.MailScanner.info/store

MailScanner customisation, or any advanced system administration help?
Contact me at Jules at Jules.FM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
PGP public key: http://www.jules.fm/julesfm.asc

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.