FW: SpamAssassin Troubleshooting

Fri Oct 27 16:07:43 IST 2006

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

My standard advice at this point is this:

1. Remove any SpamAssassin rpm packages you have got.
2. Delete all trace of SpamAssassin from your setup.
3. Download and install the install-ClamAV-SA.tar.gz (or some name like 
that) from www.mailscanner.info. It's on the downloads page. That will 
install everything for you and tell you what you need to do to get DCC 
and such like all working.

Kaplan, Andrew H. wrote:
> Hi there --
>
> I got the following error message this morning concerning SpamAssassin:
>
> RulesDuJour Run Summary on hadron.mgh.harvard.edu:
>
> ***NOTICE***: /usr/bin/spamassassin -p /etc/MailScanner/spam.assassin.prefs.conf
> --lint failed.  This means that you have an error somwhere in your SpamAssassin
> configuration.  To determine what the problem is, please run
> '/usr/bin/spamassassin -p /etc/MailScanner/spam.assassin.prefs.conf --lint' from
> a shell and notice the error messages it prints.  For more (debug) information,
> add the -D switch to the command.  Usually the problem will be found in
> local.cf, user_prefs, or some custom rulelset found in /etc/mail/spamassassin.
> Here are the errors that '/usr/bin/spamassassin -p
> /etc/MailScanner/spam.assassin.prefs.conf --lint' reported:
>
> [24833] warn: config: failed to parse line, skipping: dcc_path
> /usr/local/bin/dccproc [24833] warn: config: failed to parse line, skipping:
> dcc_path /usr/local/bin/dccproc [24833] warn: lint: 2 issues detected, please
> rerun with debug enabled for more information
>
>
> --
> This message has been scanned for viruses and dangerous content by MailScanner,
> and is believed to be clean.
>
> ----------------------------------------------------------------------------
>
> I ran the spamassassin --lint and -D commands and have included the results as
> attachments to this e-mail. The first thing that I noticed was there being a
> large amount of perl modules not being installed on the system. There also
> appears to be a problem with dcc. 
>
> I'm guessing that installing the missing perl modules will be the first step,
> but I'm not sure what the solution is for the dcc issue. Besides that, are there
> any other steps that I should take to correct this problem? Thanks. 
>
> -----Original Message-----
> From: Andrew Kaplan [mailto:ahk at hadron.mgh.harvard.edu] 
> Sent: Friday, October 27, 2006 10:43 AM
> To: Kaplan, Andrew H.
> Subject: SpamAssassin Troubleshooting
>
> Send this information to the MailScanner group for help.
>   
> ------------------------------------------------------------------------
>
> [25088] dbg: logger: adding facilities: all
> [25088] dbg: logger: logging level is DBG
> [25088] dbg: generic: SpamAssassin version 3.1.0
> [25088] dbg: config: score set 0 chosen.
> [25088] dbg: util: running in taint mode? yes
> [25088] dbg: util: taint mode: deleting unsafe environment variables, resetting PATH
> [25088] dbg: util: PATH included '/usr/kerberos/bin', keeping
> [25088] dbg: util: PATH included '/usr/local/bin', keeping
> [25088] dbg: util: PATH included '/usr/bin', keeping
> [25088] dbg: util: PATH included '/bin', keeping
> [25088] dbg: util: PATH included '/usr/X11R6/bin', keeping
> [25088] dbg: util: PATH included '/home/ahk/bin', which doesn't exist, dropping
> [25088] dbg: util: final PATH set to: /usr/kerberos/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin
> [25088] dbg: dns: is Net::DNS::Resolver available? yes
> [25088] dbg: dns: Net::DNS version: 0.55
> [25088] dbg: dns: name server: 132.183.1.11, family: 2, ipv6: 0
> [25088] dbg: diag: perl platform: 5.008008 linux
> [25088] dbg: diag: module installed: Digest::SHA1, version 2.11
> [25088] dbg: diag: module installed: HTML::Parser, version 3.50
> [25088] dbg: diag: module installed: MIME::Base64, version 3.05
> [25088] dbg: diag: module installed: DB_File, version 1.814
> [25088] dbg: diag: module installed: Net::DNS, version 0.55
> [25088] dbg: diag: module installed: Net::SMTP, version 2.29
> [25088] dbg: diag: module not installed: Mail::SPF::Query ('require' failed)
> [25088] dbg: diag: module not installed: IP::Country::Fast ('require' failed)
> [25088] dbg: diag: module installed: Razor2::Client::Agent, version 2.82
> [25088] dbg: diag: module not installed: Net::Ident ('require' failed)
> [25088] dbg: diag: module not installed: IO::Socket::INET6 ('require' failed)
> [25088] dbg: diag: module not installed: IO::Socket::SSL ('require' failed)
> [25088] dbg: diag: module installed: Time::HiRes, version 1.68
> [25088] dbg: diag: module installed: DBI, version 1.50
> [25088] dbg: diag: module installed: Getopt::Long, version 2.35
> [25088] dbg: diag: module installed: LWP::UserAgent, version 2.033
> [25088] dbg: diag: module installed: HTTP::Date, version 1.47
> [25088] dbg: diag: module not installed: Archive::Tar ('require' failed)
> [25088] dbg: diag: module not installed: IO::Zlib ('require' failed)
> [25088] dbg: ignore: using a test message to lint rules
> [25088] dbg: config: using "/etc/mail/spamassassin" for site rules pre files
> [25088] dbg: config: read file /etc/mail/spamassassin/init.pre
> [25088] dbg: config: read file /etc/mail/spamassassin/v310.pre
> [25088] dbg: config: using "/usr/share/spamassassin" for sys rules pre files
> [25088] dbg: config: using "/usr/share/spamassassin" for default rules dir
> [25088] dbg: config: read file /usr/share/spamassassin/10_misc.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_advance_fee.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_anti_ratware.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_body_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_compensate.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_dnsbl_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_drugs.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_fake_helo_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_head_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_html_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_meta_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_net_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_phrases.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_porn.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_ratware.cf
> [25088] dbg: config: read file /usr/share/spamassassin/20_uri_tests.cf
> [25088] dbg: config: read file /usr/share/spamassassin/23_bayes.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_accessdb.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_antivirus.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_body_tests_es.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_body_tests_pl.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_dcc.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_domainkeys.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_hashcash.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_pyzor.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_razor2.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_replace.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_spf.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_textcat.cf
> [25088] dbg: config: read file /usr/share/spamassassin/25_uribl.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_de.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_fr.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_it.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_nl.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_pl.cf
> [25088] dbg: config: read file /usr/share/spamassassin/30_text_pt_br.cf
> [25088] dbg: config: read file /usr/share/spamassassin/50_scores.cf
> [25088] dbg: config: read file /usr/share/spamassassin/60_awl.cf
> [25088] dbg: config: read file /usr/share/spamassassin/60_whitelist.cf
> [25088] dbg: config: read file /usr/share/spamassassin/60_whitelist_spf.cf
> [25088] dbg: config: read file /usr/share/spamassassin/60_whitelist_subject.cf
> [25088] dbg: config: using "/etc/mail/spamassassin" for site rules dir
> [25088] dbg: config: read file /etc/mail/spamassassin/bogus-virus-warnings.cf
> [25088] dbg: config: read file /etc/mail/spamassassin/local.cf
> [25088] dbg: config: read file /etc/mail/spamassassin/mailscanner.cf
> [25088] dbg: config: using "/home/ahk/.spamassassin" for user state dir
> [25088] dbg: config: using "/etc/MailScanner/spam.assassin.prefs.conf" for user prefs file
> [25088] dbg: config: read file /etc/MailScanner/spam.assassin.prefs.conf
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0xa44e560)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::Hashcash from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::Hashcash=HASH(0xa459bc0)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::SPF from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::Pyzor from @INC
> [25088] dbg: pyzor: network tests on, attempting Pyzor
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::Pyzor=HASH(0xa424c9c)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::SpamCop from @INC
> [25088] dbg: reporter: network tests on, attempting SpamCop
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::SpamCop=HASH(0xa463a10)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::AWL from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::AWL=HASH(0xa466488)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::AutoLearnThreshold from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::AutoLearnThreshold=HASH(0xa4e7e0c)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::WhiteListSubject from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::WhiteListSubject=HASH(0xa4f5934)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::MIMEHeader from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::MIMEHeader=HASH(0xa4f65c4)
> [25088] dbg: plugin: loading Mail::SpamAssassin::Plugin::ReplaceTags from @INC
> [25088] dbg: plugin: registered Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0xa50337c)
> [25088] dbg: config: adding redirector regex: /^http:\/\/chkpt\.zdnet\.com\/chkpt\/\w+\/(.*)$/i
> [25088] dbg: config: adding redirector regex: /^http:\/\/www(?:\d+)?\.nate\.com\/r\/\w+\/(.*)$/i
> [25088] dbg: config: adding redirector regex: /^http:\/\/.+\.gov\/(?:.*\/)?externalLink\.jhtml\?.*url=(.*?)(?:&.*)?$/i
> [25088] dbg: config: adding redirector regex: /^http:\/\/redir\.internet\.com\/.+?\/.+?\/(.*)$/i
> [25088] dbg: config: adding redirector regex: /^http:\/\/(?:.*?\.)?adtech\.de\/.*(?:;|\|)link=(.*?)(?:;|$)/i
> [25088] dbg: config: adding redirector regex: m'^http.*?/redirect\.php\?.*(?<=[?&])goto=(.*?)(?:$|[&\#])'i
> [25088] dbg: config: adding redirector regex: m'^https?:/*(?:[^/]+\.)?emf\d\.com/r\.cfm.*?&r=(.*)'i
> [25088] warn: config: failed to parse line, skipping: dcc_path /usr/local/bin/dccproc
> [25088] warn: config: failed to parse line, skipping: dcc_path /usr/local/bin/dccproc
> [25088] dbg: plugin: Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0xa50337c) implements 'finish_parsing_end'
> [25088] dbg: replacetags: replacing tags
> [25088] dbg: replacetags: done replacing tags
> [25088] dbg: config: using "/home/ahk/.spamassassin" for user state dir
> [25088] dbg: bayes: no dbs present, cannot tie DB R/O: /home/ahk/.spamassassin/bayes_toks
> [25088] dbg: config: score set 1 chosen.
> [25088] dbg: message: ---- MIME PARSER START ----
> [25088] dbg: message: main message type: text/plain
> [25088] dbg: message: parsing normal part
> [25088] dbg: message: added part, type: text/plain
> [25088] dbg: message: ---- MIME PARSER END ----
> [25088] dbg: bayes: no dbs present, cannot tie DB R/O: /home/ahk/.spamassassin/bayes_toks
> [25088] dbg: dns: dns_available set to yes in config file, skipping test
> [25088] dbg: metadata: X-Spam-Relays-Trusted:
> [25088] dbg: metadata: X-Spam-Relays-Untrusted:
> [25088] dbg: message: no encoding detected
> [25088] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0xa44e560) implements 'parsed_metadata'
> [25088] dbg: uridnsbl: domains to query:
> [25088] dbg: dns: checking RBL sbl-xbl.spamhaus.org., set sblxbl-notfirsthop
> [25088] dbg: dns: checking RBL sa-accredit.habeas.com., set habeas-firsttrusted
> [25088] dbg: dns: checking RBL sbl-xbl.spamhaus.org., set sblxbl
> [25088] dbg: dns: checking RBL sa-other.bondedsender.org., set bsp-untrusted
> [25088] dbg: dns: checking RBL combined.njabl.org., set njabl-notfirsthop
> [25088] dbg: dns: checking RBL combined.njabl.org., set njabl
> [25088] dbg: dns: checking RBL combined-HIB.dnsiplists.completewhois.com., set whois
> [25088] dbg: dns: checking RBL list.dsbl.org., set dsbl-notfirsthop
> [25088] dbg: dns: checking RBL bl.spamcop.net., set spamcop
> [25088] dbg: dns: checking RBL sa-trusted.bondedsender.org., set bsp-firsttrusted
> [25088] dbg: dns: checking RBL combined-HIB.dnsiplists.completewhois.com., set whois-notfirsthop
> [25088] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs-notfirsthop
> [25088] dbg: dns: checking RBL dnsbl.sorbs.net., set sorbs
> [25088] dbg: dns: checking RBL iadb.isipp.com., set iadb-firsttrusted
> [25088] dbg: check: running tests for priority: 0
> [25088] dbg: rules: running header regexp tests; score so far=0
> [25088] dbg: rules: ran header rule __HAS_MSGID ======> got hit: "<"
> [25088] dbg: rules: ran header rule __SANE_MSGID ======> got hit: "<1161960021 at lint_rules>
> [25088] dbg: rules: "
> [25088] dbg: rules: ran header rule __MSGID_OK_HOST ======> got hit: "@lint_rules>"
> [25088] dbg: rules: ran header rule NO_REAL_NAME ======> got hit: "ignore at compiling.spamassassin.taint.org
> [25088] dbg: rules: "
> [25088] dbg: rules: ran header rule __MSGID_OK_DIGITS ======> got hit: "1161960021"
> [25088] dbg: plugin: registering glue method for check_hashcash_double_spend (Mail::SpamAssassin::Plugin::Hashcash=HASH(0xa459bc0))
> [25088] dbg: plugin: registering glue method for check_for_spf_helo_pass (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: spf: message was delivered entirely via trusted relays, not required
> [25088] dbg: eval: all '*From' addrs: ignore at compiling.spamassassin.taint.org
> [25088] dbg: plugin: registering glue method for check_subject_in_blacklist (Mail::SpamAssassin::Plugin::WhiteListSubject=HASH(0xa4f5934))
> [25088] dbg: plugin: registering glue method for check_hashcash_value (Mail::SpamAssassin::Plugin::Hashcash=HASH(0xa459bc0))
> [25088] dbg: eval: all '*To' addrs:
> [25088] dbg: plugin: registering glue method for check_for_spf_neutral (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: spf: message was delivered entirely via trusted relays, not required
> [25088] dbg: plugin: registering glue method for check_for_spf_softfail (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: rules: ran eval rule NO_RELAYS ======> got hit
> [25088] dbg: plugin: registering glue method for check_for_spf_pass (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: plugin: registering glue method for check_for_spf_helo_softfail (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: plugin: registering glue method for check_for_def_spf_whitelist_from (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: spf: cannot get Envelope-From, cannot use SPF
> [25088] dbg: spf: def_spf_whitelist_from: could not find useable envelope sender
> [25088] dbg: plugin: registering glue method for check_for_spf_fail (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: rules: ran eval rule __UNUSABLE_MSGID ======> got hit
> [25088] dbg: plugin: registering glue method for check_subject_in_whitelist (Mail::SpamAssassin::Plugin::WhiteListSubject=HASH(0xa4f5934))
> [25088] dbg: plugin: registering glue method for check_for_spf_whitelist_from (Mail::SpamAssassin::Plugin::SPF=HASH(0xa47c8c0))
> [25088] dbg: spf: spf_whitelist_from: could not find useable envelope sender
> [25088] dbg: rules: ran eval rule MISSING_HEADERS ======> got hit
> [25088] dbg: rules: running body-text per-line regexp tests; score so far=0.738
> [25088] dbg: rules: ran body rule __NONEMPTY_BODY ======> got hit: "I"
> [25088] dbg: uri: running uri tests; score so far=0.738
> [25088] dbg: bayes: no dbs present, cannot tie DB R/O: /home/ahk/.spamassassin/bayes_toks
> [25088] dbg: bayes: not scoring message, returning undef
> [25088] dbg: bayes: opportunistic call attempt failed, DB not readable
> [25088] dbg: plugin: registering glue method for check_uridnsbl (Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0xa44e560))
> [25088] dbg: rules: running raw-body-text per-line regexp tests; score so far=0.738
> [25088] dbg: rules: running full-text regexp tests; score so far=0.738
> [25088] dbg: plugin: registering glue method for check_pyzor (Mail::SpamAssassin::Plugin::Pyzor=HASH(0xa424c9c))
> [25088] dbg: pyzor: pyzor is not available: no pyzor executable found
> [25088] dbg: pyzor: no pyzor found, disabling Pyzor
> [25088] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0xa44e560) implements 'check_tick'
> [25088] dbg: check: running tests for priority: 500
> [25088] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0xa44e560) implements 'check_post_dnsbl'
> [25088] dbg: rules: running meta tests; score so far=0.738
> [25088] dbg: rules: running header regexp tests; score so far=2.216
> [25088] dbg: rules: running body-text per-line regexp tests; score so far=2.216
> [25088] dbg: uri: running uri tests; score so far=2.216
> [25088] dbg: rules: running raw-body-text per-line regexp tests; score so far=2.216
> [25088] dbg: rules: running full-text regexp tests; score so far=2.216
> [25088] dbg: check: running tests for priority: 1000
> [25088] dbg: rules: running meta tests; score so far=2.216
> [25088] dbg: rules: running header regexp tests; score so far=2.216
> [25088] dbg: plugin: registering glue method for check_from_in_auto_whitelist (Mail::SpamAssassin::Plugin::AWL=HASH(0xa466488))
> [25088] dbg: rules: running body-text per-line regexp tests; score so far=2.216
> [25088] dbg: uri: running uri tests; score so far=2.216
> [25088] dbg: rules: running raw-body-text per-line regexp tests; score so far=2.216
> [25088] dbg: rules: running full-text regexp tests; score so far=2.216
> [25088] dbg: check: is spam? score=2.216 required=5
> [25088] dbg: check: tests=MISSING_HEADERS,MISSING_SUBJECT,NO_REAL_NAME,NO_RECEIVED,NO_RELAYS,TO_CC_NONE
> [25088] dbg: check: subtests=__HAS_MSGID,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__NONEMPTY_BODY,__SANE_MSGID,__UNUSABLE_MSGID
> [25088] warn: lint: 2 issues detected, please rerun with debug enabled for more information
>   
> ------------------------------------------------------------------------
>
> [25071] warn: config: failed to parse line, skipping: dcc_path /usr/local/bin/dccproc
> [25071] warn: config: failed to parse line, skipping: dcc_path /usr/local/bin/dccproc
> [25071] warn: lint: 2 issues detected, please rerun with debug enabled for more information
>   

Jules

- -- 
Julian Field MEng CITP
www.MailScanner.info
Buy the MailScanner book at www.MailScanner.info/store

Need help customising MailScanner?
Contact me!
Need help fixing or optimising your systems?
Contact me!
Need help getting you started solving new requirements from your boss?
Contact me!

PGP footprint: EE81 D763 3DB0 0BFD E1DC 7222 11F6 5947 1415 B654

-----BEGIN PGP SIGNATURE-----
Version: PGP Desktop 9.5.0 (Build 1112)
Comment: (pgp-secured)
Charset: ISO-8859-1

wj8DBQFFQiDIEfZZRxQVtlQRAofwAKC6b/B2PpXlAqCU5sFBfXFF/0EAIgCePxPw
Ua/aYboYHBgQxrFiyWn4v2g=
=kq7S
-----END PGP SIGNATURE-----

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.
For all your IT requirements visit www.transtec.co.uk