SA cache not expiring entries?

[Ken A]

Steve Freegard wrote:
> Hi Ken,
> 
> On Wed, 2006-01-25 at 13:49 -0800, Ken A wrote:
> 
> 
> Next time, before nuking the database - run analyse_SpamAssassin_cache
> and post the output as it will show up any irregularities straight away.


MailScanner stopped Expiring entries from the SA cache. This time with 
4.50.14. Here's what it looked like. I noticed the incoming queue 
growing on one MailScanner box. Checked the log for oddities and found this:

MailScanner's last successful "Expired records from the SpamAssassin 
cache" happened about an hour ago (12:30 localtime)
Then there's a load of these:
"Feb  1 13:31:18 MailScanner[14286]: database or disk is full(1) at 
dbdimp.c line 398
Feb  1 13:31:18 last message repeated 59 times"

The disk is tmpfs, and it's not full. The box is not out of RAM or SWAP.

So I checked the size of the SA Cache file:
# ls -lh
-rw-------   1 root root 5.3M Feb  1 12:31 SpamAssassin.cache.db
-rw-------   1 root root 6.6K Feb  1 13:40 SpamAssassin.cache.db-journal

5.3Mb - not that big!

So, per your previous email on this, run analyze....

# /usr/sbin/analyze_SpamAssassin_cache
DBD::SQLite::db selectrow_hashref failed: database is locked(5) at 
dbdimp.c line 416 at /usr/sbin/analyze_SpamAssassin_cache line 20.
--------- TOTALS ---------
Total records:       3251
First seen (oldest): 587347 sec
First seen (newest): 3769 sec
Last seen (oldest):  587347 sec
Last seen (newest):  3745 sec
Cache Hit Rate       0%
-------- NON-SPAM --------
Total records:       712
First seen (oldest): 5963 sec
First seen (newest): 3819 sec
Last seen (oldest):  5960 sec
Last seen (newest):  3819 sec
-------- LOW-SPAM --------
Total records:       60
First seen (oldest): 4481 sec
First seen (newest): 3852 sec
Last seen (oldest):  4481 sec
Last seen (newest):  3852 sec
------- HIGH-SPAM --------
Total records:       2252
First seen (oldest): 294837 sec
First seen (newest): 3853 sec
Last seen (oldest):  14990 sec
Last seen (newest):  3853 sec
-------- VIRUSES  --------
DBD::SQLite::db selectrow_hashref failed: database is locked(5) at 
dbdimp.c line 416 at /usr/sbin/analyze_SpamAssassin_cache line 51.
Total records:       0
First seen (oldest): 0 sec
First seen (newest): 0 sec
Last seen (oldest):  0 sec
Last seen (newest):  0 sec
----- TOP 5 HASHES -------
DBD::SQLite::st execute failed: database is locked(5) at dbdimp.c line 
416 at /usr/sbin/analyze_SpamAssassin_cache line 59.
MD5                                     COUNT   FIRST   LAST

#

After running analyze_SpamAssassin_cache I restarted MailScanner and 
it's again Expiring entries from the Cache and caught up with the 
incoming queue. During the ~1 hour that MailScanner was having trouble 
accessing the SA Cache, it did record "SpamAssassin cache hit" for some 
messages, just not as many as usual (about 50 in an hour instead of 
several thousand).

Google turns up an active bug in DBD::SQLite that may be related.
http://rt.cpan.org/Public/Bug/Display.html?id=11680

This has only happened on one of 3 machines, running FC4.

Thanks,

Ken Anderson
Pacific.Net



> Cheers,
> Steve.
>