Queue problem

Julian Field MailScanner at ecs.soton.ac.uk
Sat Mar 1 18:37:18 GMT 2008 

MailScanner --debug --debug-sa 2>&1 | awk '{printf"%s %s\n", 
strftime("%T"), $0}' | tee /tmp/mstest.log
all on 1 long line.

I have just built this functionality into MailScanner itself, so that in 
future "MailScanner --debug --debug-sa" will do this automatically for you.

But don't worry, it starts by doing a test run of the command to see if 
it works, that "awk" is found and the version of awk installed supports 
the "strftime" function (not all do). It then only does the output 
change if the trial command produced the output I was expecting and not 
any errors that would be caused by awk not being found or strftime not 
doing what I expected. If the test fails, it prints out a little message 
telling you that it tried, and what you might do to improve your system 
so that it does work.

This will be in the next release.

Current release schedule is a new beta probably tomorrow (Sunday) some 
time, followed by a stable release a day or two later.

Best regards,
Jules.

Jason Ede wrote:
> Maxine,
>
> If you do that you'll need to make sure the output is time stamped so that it can be seen whats taking the time. I seem to remember there is a method on the list a short time back.
>
> Jason
>
>
>   
>> -----Original Message-----
>> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-
>> bounces at lists.mailscanner.info] On Behalf Of Maxime Gaudreault
>> Sent: 01 March 2008 17:16
>> To: MailScanner discussion
>> Subject: RE: Queue problem
>>
>> I don't understand when to stop, start again etc.. (i don't speak
>> english very well)
>>
>> However, I can redirect the output to a log file. Can I send it to you
>> ?
>>
>> Maxime Gaudreault
>> Technicien
>>
>> Référence Systèmes inc.
>> Tél. : 418.650.0997
>> Téléc. : 418.650.9668
>> Courriel : mgaudreault at reference.qc.ca
>> Site Internet : http://www.reference.qc.ca/
>>
>>
>> -----Original Message-----
>> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-
>> bounces at lists.mailscanner.info] On Behalf Of Julian Field
>> Sent: March 1, 2008 12:03 PM
>> To: MailScanner discussion
>> Subject: Re: Queue problem
>>
>> In which case your DNS lookups should be okay. That's a perfectly
>> reasonable figure in my experience.
>>
>> Run "MailScanner --debug --debug-sa". It will produce loads of output.
>> However, at some point in the SpamAssassin output, it will pause for a
>> second or two. You want to catch it there, then resume it and then
>> immediately stop it again, as the bits you are interested in are the
>> lines of output printed out immediately *after* the pause.
>>
>> This can take a few goes to catch, though someone did post a nice
>> command the other day to prepend each line of output with the current
>> time, so you could see easily when (and how long) the pauses were. Can
>> someone repost that please? If I can find it, I'll work out how to
>> build
>> it into the MailScanner debug output directly. It will help diagnose
>> this sort of problem a lot.
>>
>> This output should tell you where the pauses are, and therefore what
>> operations are taking too long.
>>
>> Maxime Gaudreault wrote:
>>     
>>> Hi Jule
>>>
>>> Dig results comes within 41-108 msec
>>>
>>> Maxime Gaudreault
>>> Technicien
>>>
>>> Référence Systèmes inc.
>>> Tél. : 418.650.0997
>>> Téléc. : 418.650.9668
>>> Courriel : mgaudreault at reference.qc.ca
>>> Site Internet : http://www.reference.qc.ca/
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-
>>>       
>> bounces at lists.mailscanner.info] On Behalf Of Julian Field
>>     
>>> Sent: February 29, 2008 5:50 PM
>>> To: MailScanner discussion
>>> Subject: Re: Queue problem
>>>
>>> -----BEGIN PGP SIGNED MESSAGE-----
>>> Hash: SHA1
>>>
>>>
>>>
>>> Maxime Gaudreault wrote:
>>>
>>>       
>>>> Hi
>>>>
>>>> The hold queue is actually at 415 emails
>>>>
>>>> Load Average: 0.11 0.25 0.53
>>>>
>>>> htop show many of these process:
>>>>
>>>> MailScanner: checking with SpamAssassin
>>>>
>>>> MailScanner: checking with Spam Lists
>>>>
>>>> CPU is 3%
>>>>
>>>> Mem is 25%
>>>>
>>>>
>>>>         
>>> I would start checking your DNS setup. How long does it take for
>>>       
>> various
>>     
>>> random "dig" commands to produce results? MailScanner should spend a
>>> very small %-age of its time saying "checking with Spam Lists". If
>>>       
>> you
>>     
>>> can see several of them in that state, then that's likely a DNS
>>>       
>> lookup
>>     
>>> problem.
>>>
>>>
>>>       
>>>> I don't understand
>>>>
>>>> *Maxime Gaudreault*
>>>>
>>>> Technicien
>>>>
>>>> _ _
>>>>
>>>> Référence Systèmes inc.
>>>>
>>>> Tél. : 418.650.0997
>>>>
>>>> Téléc. : 418.650.9668
>>>>
>>>> Courriel : _mgaudreault_ at reference.qc.ca
>>>> <mailto:mgaudreault at reference.qc.ca>
>>>>
>>>> Site Internet : http://www.reference.qc.ca/
>>>>
>>>> *From:* mailscanner-bounces at lists.mailscanner.info
>>>> [mailto:mailscanner-bounces at lists.mailscanner.info] *On Behalf Of
>>>> *Maxime Gaudreault
>>>> *Sent:* February 29, 2008 10:54 AM
>>>> *To:* MailScanner discussion
>>>> *Subject:* Queue problem
>>>>
>>>> Hi
>>>>
>>>> I have a problem with my anti-spam gateway. The queue is fulling up
>>>> very quickly (1600+ mails in queue).
>>>>
>>>> The server's load average is <1 (0.60 - 0.80) so I suppose this is
>>>>         
>> not
>>     
>>>> a ressource problem.
>>>>
>>>> Then I have to change the port forwarding directly to my Imail
>>>>         
>> server
>>     
>>>> to let the anti-spam's queue going down.
>>>>
>>>> I used many tweak to maximize the efficacity of the anti-spam
>>>> (mailscanner work directory in ram, dns cache server, increasing
>>>> memory). I only got 1 CPU but I suppose this is not the problem
>>>> because when the queue is full, the load average is under 1.
>>>>
>>>> Any idea ?
>>>>
>>>> PS: Sorry for my bad english
>>>>
>>>> PPS: Sorry if you received my message twice
>>>>
>>>> *Maxime Gaudreault*
>>>>
>>>> Technicien
>>>>
>>>> _ _
>>>>
>>>> Référence Systèmes inc.
>>>>
>>>> Tél. : 418.650.0997
>>>>
>>>> Téléc. : 418.650.9668
>>>>
>>>> Courriel : _mgaudreault_ at reference.qc.ca
>>>> <mailto:mgaudreault at reference.qc.ca>
>>>>
>>>> Site Internet : http://www.reference.qc.ca/
>>>>
>>>>
>>>>         
>>> Jules
>>>
>>> - --
>>> Julian Field MEng CITP CEng
>>> www.MailScanner.info
>>> Buy the MailScanner book at www.MailScanner.info/store
>>>
>>> MailScanner customisation, or any advanced system administration
>>>       
>> help?
>>     
>>> Contact me at Jules at Jules.FM
>>>
>>> PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
>>> PGP public key: http://www.jules.fm/julesfm.asc
>>>
>>>
>>> -----BEGIN PGP SIGNATURE-----
>>> Version: PGP Desktop 9.8.0 (Build 2158)
>>> Comment: Use Thunderbird Enigmail to verify this message
>>> Charset: windows-1252
>>>
>>> wj8DBQFHyIwcEfZZRxQVtlQRAuPxAKD9kZyTPfF/rfAZwnYgYtTJ7wBQtACgn2PT
>>> eFc95lOZub+5/sADM2GStSY=
>>> =9oag
>>> -----END PGP SIGNATURE-----
>>>
>>>
>>>       
>> Jules
>>
>> --
>> Julian Field MEng CITP CEng
>> www.MailScanner.info
>> Buy the MailScanner book at www.MailScanner.info/store
>>
>> MailScanner customisation, or any advanced system administration help?
>> Contact me at Jules at Jules.FM
>>
>> PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
>> PGP public key: http://www.jules.fm/julesfm.asc
>>
>>
>> --
>> This message has been scanned for viruses and
>> dangerous content by MailScanner, and is
>> believed to be clean.
>>
>> --
>> MailScanner mailing list
>> mailscanner at lists.mailscanner.info
>> http://lists.mailscanner.info/mailman/listinfo/mailscanner
>>
>> Before posting, read http://wiki.mailscanner.info/posting
>>
>> Support MailScanner development - buy the book off the website!
>> --
>> MailScanner mailing list
>> mailscanner at lists.mailscanner.info
>> http://lists.mailscanner.info/mailman/listinfo/mailscanner
>>
>> Before posting, read http://wiki.mailscanner.info/posting
>>
>> Support MailScanner development - buy the book off the website!
>>     

Jules

-- 
Julian Field MEng CITP CEng
www.MailScanner.info
Buy the MailScanner book at www.MailScanner.info/store

MailScanner customisation, or any advanced system administration help?
Contact me at Jules at Jules.FM

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654
PGP public key: http://www.jules.fm/julesfm.asc


-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

More information about the MailScanner mailing list