Performance between SpamAssassin 3.2.1 and 3.2.2 and 3.2.3

Wed Aug 15 14:08:11 IST 2007

I found a big performance hit with 3.2.x vs 3.1.x on my old MailScanner
box, so I reverted to SA 3.1.x.

Having built our new boxes with SA 3.2.2, I didn't have any benchmarks
to compare with on the new hardware.

It would be great to be able to pinpoint the exact cause of your
performance issues.

Cheers,

Phil

--
Phil Randal
Network Engineer
Herefordshire Council
Hereford, UK  

> -----Original Message-----
> From: mailscanner-bounces at lists.mailscanner.info 
> [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf 
> Of Rose, Bobby
> Sent: 15 August 2007 12:53
> To: MailScanner discussion
> Subject: RE: Performance between SpamAssassin 3.2.1 and 3.2.2 
> and 3.2.3
> 
> My change was done last night before I knew about this dns async issue
> that was introduced in 3.2.2.  I know I saw mention of the async issue
> with ASN but not DNS in general.  I'll try patching 3.2.3 later today
> after I've confirmed that that is where the delay in SA is 
> coming from.
> It appears to be resolved after I made my change which I only 
> made based
> on the changelogs and after diff'ing all the SA pm to confirm 
> that there
> weren't any changes elsewhere that replacing Dns.pm would effect.
> 
> I'm just surprised that no one else isn't noticing the performance
> differences based on MailScanner processing times between versions. 
> 
> Bobby Rose
> Senior Systems Administrator
> MSIS Network Operations
> Wayne State University School of Medicine
>  
> 
>  
> 
> -----Original Message-----
> From: mailscanner-bounces at lists.mailscanner.info
> [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf 
> Of Randal,
> Phil
> Sent: Wednesday, August 15, 2007 7:29 AM
> To: MailScanner discussion
> Subject: RE: Performance between SpamAssassin 3.2.1 and 3.2.2 
> and 3.2.3
> 
> Oh, I would have tried 3.2.3 with the aforementioned patch to see if
> that made a difference too, because that patch will end up in 3.2.4.
> 
> Is there any chance that you can do that?  The patch affects more than
> DNS.pm, though.
> 
> If there's still an issue on 3.2.3 with the patch from bug 
> 5589 then you
> should add a note to that bug and raise the issue on the Spamassassin
> Users mailing list too.
> 
> Cheers,
> 
> Phil
> 
> --
> Phil Randal
> Network Engineer
> Herefordshire Council
> Hereford, UK  
> 
> > -----Original Message-----
> > From: mailscanner-bounces at lists.mailscanner.info
> > [mailto:mailscanner-bounces at lists.mailscanner.info] On 
> Behalf Of Rose,
> 
> > Bobby
> > Sent: 15 August 2007 12:14
> > To: MailScanner discussion
> > Subject: RE: Performance between SpamAssassin 3.2.1 and 3.2.2 and 
> > 3.2.3
> > 
> > Yeh that might be it.  I checked the changelog and saw that the DNS 
> > changes were the only real big change between 3.2.1. and
> > 3.2.2 so what I
> > did was installed 3.2.3 and replaced the Dns.pm with the 
> version from 
> > 3.2.1.  I'll know if that is the problem lies there later 
> on today as 
> > traffic load increases.
> > 
> > I grepped my logs from between the versions focusing on 
> batches of 30 
> > and I clearly see differences of 100 to 150 secs between 
> 3.2.1 and the
> 
> > later versions.  If anyone wants to check their times use this
> > 	egrep -e"Batch \(30 messages\) processed in" maillog
> > 
> > -=B
> > 
> > -----Original Message-----
> > From: mailscanner-bounces at lists.mailscanner.info
> > [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf Of 
> > Randal, Phil
> > Sent: Wednesday, August 15, 2007 5:38 AM
> > To: MailScanner discussion
> > Subject: RE: Performance between SpamAssassin 3.2.1 and 3.2.2 and 
> > 3.2.3
> > 
> > Running spamassassin -D -t <quarantined file name> reveals a lot.
> > 
> > I'm running SA with the patch from
> > 
> >   http://issues.apache.org/SpamAssassin/show_bug.cgi?id=5589
> > 
> > and the debug output made that one pretty obvious.
> > 
> > Cheers,
> > 
> > Phil
> > 
> > --
> > Phil Randal
> > Network Engineer
> > Herefordshire Council
> > Hereford, UK
> > 
> > > -----Original Message-----
> > > From: mailscanner-bounces at lists.mailscanner.info
> > > [mailto:mailscanner-bounces at lists.mailscanner.info] On Behalf Of 
> > > Leland J. Steinke
> > > Sent: 14 August 2007 21:18
> > > To: MailScanner discussion
> > > Subject: Re: Performance between SpamAssassin 3.2.1 and 3.2.2 and
> > > 3.2.3
> > > 
> > > Randal, Phil wrote:
> > > > I'm getting very slow DNS lookups from
> > > combined-HIB.dnsiplists.completewhois.com.
> > > > 
> > > > That might be a factor.
> > > > 
> > > > Does using
> > > > 
> > > > score __RCVD_IN_WHOIS 0
> > > > score RCVD_IN_WHOIS_INVALID 0
> > > > score URIBL_COMPLETEWHOIS 0
> > > > 
> > > > solve the performance problem?
> > > 
> > > Much to my recent regret, I have avoided subscribing to any 
> > > spamassassin support lists, opting instead to let all of you more 
> > > adventurous types work out the bugs while I just 
> implement what is 
> > > recommended on the MS list.  Would information such as the
> > above be on
> > 
> > > the SA users list?  Is there a FAQ with known "gotchas" 
> > with running
> > > SA (3.2.2 in our case), where this is listed?  How in
> > Perdition do you
> > 
> > > track that "combined-HIB.dnsiplists.completewhois.com." is slow?
> > > 
> > > And it's only Tuesday!
> > > 
> > > 
> > > thanks,
> > > Leland
> > > --
> > > MailScanner mailing list
> > > mailscanner at lists.mailscanner.info
> > > http://lists.mailscanner.info/mailman/listinfo/mailscanner
> > > 
> > > Before posting, read http://wiki.mailscanner.info/posting
> > > 
> > > Support MailScanner development - buy the book off the website! 
> > > 
> > --
> > MailScanner mailing list
> > mailscanner at lists.mailscanner.info
> > http://lists.mailscanner.info/mailman/listinfo/mailscanner
> > 
> > Before posting, read http://wiki.mailscanner.info/posting
> > 
> > Support MailScanner development - buy the book off the website! 
> > 
> > --
> > MailScanner mailing list
> > mailscanner at lists.mailscanner.info
> > http://lists.mailscanner.info/mailman/listinfo/mailscanner
> > 
> > Before posting, read http://wiki.mailscanner.info/posting
> > 
> > Support MailScanner development - buy the book off the website! 
> > 
> --
> MailScanner mailing list
> mailscanner at lists.mailscanner.info
> http://lists.mailscanner.info/mailman/listinfo/mailscanner
> 
> Before posting, read http://wiki.mailscanner.info/posting
> 
> Support MailScanner development - buy the book off the website! 
> 
> -- 
> MailScanner mailing list
> mailscanner at lists.mailscanner.info
> http://lists.mailscanner.info/mailman/listinfo/mailscanner
> 
> Before posting, read http://wiki.mailscanner.info/posting
> 
> Support MailScanner development - buy the book off the website! 
> 