Forwarding x unscanned messages / slow scanning

Matthias Kellermann mkellermann at net-com.de
Fri Apr 20 14:38:34 IST 2007


Thank you,

now I've setup a local caching DNS. Seems to really speed up things.

I don't use any RBLs, so this shouldn't be the problem.

I'll wait and see how the next big mailing will be processed by 
mailscanner ;)

Best Regards
Matthias

Martin.Hepworth schrieb:
> Matthias
>
> Doing a local caching nameserver will have dramatic results....someone
> the IRC channel did the other day and the scan times dropped from 55secs
> per batch to around 20-30.
>
> I'd also check what RBL's you're scanning especially in spamassassin. If
> you're doing all of them you may want to consider just running a couple
> in SA by giving the others a zero score in
> /etc/mail/spamassassin/mailscanner.cf
>
> --
> Martin Hepworth
> Snr Systems Administrator
> Solid State Logic
> Tel: +44 (0)1865 842300
>
>   
>> -----Original Message-----
>> From: mailscanner-bounces at lists.mailscanner.info [mailto:mailscanner-
>> bounces at lists.mailscanner.info] On Behalf Of Matthias Kellermann
>> Sent: 20 April 2007 12:47
>> To: MailScanner discussion
>> Subject: Re: Forwarding x unscanned messages / slow scanning
>>
>> Thanks Martin.
>>
>> Some facts about the machine:
>>
>> 1 x Intel(R) Pentium(R) D CPU 3.00GHz
>> 2GByte RAM
>>
>> Timing cached reads:   2168 MB in  1.99 seconds = 1092.10 MB/sec
>> Timing buffered disk reads:   94 MB in  3.00 seconds =  31.32 MB/sec
>>
>> OS: Debian Etch
>>
>> Here are a few things I've already done to speed things up:
>> - using a ramdisk for the MS working directory
>> - setting the clamav & spamassassin timeouts lower
>> - lowered the max. MS processes to 3
>>
>> The DNS server I use is on the same network. Perhaps I'll try to use a
>> local caching DNS though.
>>
>> Just wondering why MS is so slow about the messages that I defined in
>> the scan.messages.rules not to be scanned. Any ideas?
>>
>> Best Regards
>> Matthias
>>
>>
>> Martin.Hepworth schrieb:
>>     
>>> Matthias
>>>
>>>
>>>       
> http://wiki.mailscanner.info/doku.php?id=documentation:test_troubleshoot
>   
>>> :performance
>>>
>>> also
>>>
>>> http://wiki.mailscanner.info/doku.php?id=maq:index#optimization_tips
>>>
>>> I'd also ask how much RAM/ CPU you've got.
>>>
>>> A local caching DNS server on the computer can make a huge
>>>       
> difference
>   
>>> too.
>>>
>>> --
>>> Martin Hepworth
>>> Snr Systems Administrator
>>> Solid State Logic
>>> Tel: +44 (0)1865 842300
>>>
>>>
>>>       
>>>> -----Original Message-----
>>>> From: mailscanner-bounces at lists.mailscanner.info
>>>>         
> [mailto:mailscanner-
>   
>>>> bounces at lists.mailscanner.info] On Behalf Of Matthias Kellermann
>>>> Sent: 20 April 2007 11:49
>>>> To: MailScanner discussion
>>>> Subject: Forwarding x unscanned messages / slow scanning
>>>>
>>>> Hi folks,
>>>>
>>>> i've a running MailScanner system with Postfix.
>>>>
>>>> When the queue runs full (about 250 messages) I get lots of
>>>>         
> messages
>   
>>>> like this from MailScanner:
>>>>
>>>> Apr 20 12:40:39 server check[23677]: Batch completed at 895 bytes
>>>>         
> per
>   
>>>> second (35672 / 39)
>>>> Apr 20 12:40:39 server check[23677]: Batch (3 messages) processed
>>>>         
> in
>   
>>>> 39.83 seconds
>>>> Apr 20 12:40:39 server check[23677]: New Batch: Found 195 messages
>>>>
>>>>         
>>> waiting
>>>
>>>       
>>>> Apr 20 12:40:39 server check[23677]: New Batch: Forwarding 1
>>>>         
> unscanned
>   
>>>> messages, 1916 bytes
>>>> Apr 20 12:40:39 server check[23677]: New Batch: Scanning 3
>>>>         
> messages,
>   
>>>> 108887 bytes
>>>>
>>>> It needs a long time (about 30minutes) to clear the queue because
>>>> MailScanner is too slow.
>>>>
>>>> There are lots of messages in the queue that shouldn't be scanned
>>>> because I've setup a own scanning rule (scan.messages.rules). So I
>>>>
>>>>         
>>> think
>>>
>>>       
>>>> this messages should get processed very fast by MailScanner, but
>>>>         
> they
>   
>>>> aren't.
>>>>
>>>> Here are my settings in the MailScanner.conf file:
>>>>
>>>> Max Unscanned Bytes Per Scan = 10000
>>>> Max Unsafe Bytes Per Scan = 50000
>>>> Max Unscanned Messages Per Scan = 10
>>>> Max Unsafe Messages Per Scan = 10
>>>>
>>>> Maximal MailScanner children:
>>>> Max Children = 4
>>>>
>>>> I've got played with the Unscanned-/Unsafe-settings with no
>>>>         
> success.
>   
>>> Can
>>>
>>>       
>>>> you give me any hints to speed up things?
>>>>
>>>> Thanks in advance.
>>>>
>>>> Best Regards
>>>> Matthias
>>>>
>>>> --
>>>> MailScanner mailing list
>>>> mailscanner at lists.mailscanner.info
>>>> http://lists.mailscanner.info/mailman/listinfo/mailscanner
>>>>
>>>> Before posting, read http://wiki.mailscanner.info/posting
>>>>
>>>> Support MailScanner development - buy the book off the website!
>>>>
>>>>         
>>>
>>>
>>>
>>>       
> **********************************************************************
>   
>>> Confidentiality : This e-mail and any attachments are intended for
>>>       
> the
>   
>>> addressee only and may be confidential. If they come to you in error
>>> you must take no action based on them, nor must you copy or show
>>>       
> them
>   
>>> to anyone. Please advise the sender by replying to this e-mail
>>> immediately and then delete the original from your computer.
>>>
>>> Opinion : Any opinions expressed in this e-mail are entirely those
>>>       
> of
>   
>>> the author and unless specifically stated to the contrary, are not
>>> necessarily those of the author's employer.
>>>
>>> Security Warning : Internet e-mail is not necessarily a secure
>>> communications medium and can be subject to data corruption. We
>>>       
> advise
>   
>>> that you consider this fact when e-mailing us.
>>>
>>> Viruses : We have taken steps to ensure that this e-mail and any
>>> attachments are free from known viruses but in keeping with good
>>> computing practice, you should ensure that they are virus free.
>>>
>>> Red Lion 49 Ltd T/A Solid State Logic
>>> Registered as a limited company in England and Wales
>>> (Company No:5362730)
>>> Registered Office: 25 Spring Hill Road, Begbroke, Oxford OX5 1RU,
>>> United Kingdom
>>>
>>>       
> **********************************************************************
>   
>>>       
>> --
>> MailScanner mailing list
>> mailscanner at lists.mailscanner.info
>> http://lists.mailscanner.info/mailman/listinfo/mailscanner
>>
>> Before posting, read http://wiki.mailscanner.info/posting
>>
>> Support MailScanner development - buy the book off the website!
>>     
>
>
>
>
> **********************************************************************
> Confidentiality : This e-mail and any attachments are intended for the 
> addressee only and may be confidential. If they come to you in error 
> you must take no action based on them, nor must you copy or show them 
> to anyone. Please advise the sender by replying to this e-mail 
> immediately and then delete the original from your computer.
>
> Opinion : Any opinions expressed in this e-mail are entirely those of 
> the author and unless specifically stated to the contrary, are not 
> necessarily those of the author's employer.
>
> Security Warning : Internet e-mail is not necessarily a secure 
> communications medium and can be subject to data corruption. We advise 
> that you consider this fact when e-mailing us. 
>
> Viruses : We have taken steps to ensure that this e-mail and any 
> attachments are free from known viruses but in keeping with good 
> computing practice, you should ensure that they are virus free.
>
> Red Lion 49 Ltd T/A Solid State Logic
> Registered as a limited company in England and Wales 
> (Company No:5362730)
> Registered Office: 25 Spring Hill Road, Begbroke, Oxford OX5 1RU, 
> United Kingdom
> **********************************************************************
>
>   


More information about the MailScanner mailing list