Happened to me for a while - it was always an issue with a ruleset in SA. Are you sure you arent running a redundant one? If you disable SA do you get the same problem? spamassassin -D --lint would probably give you a few hints.