Phishing Server Change

[Thom van der Boon]

Jerry, 

I am currently debugging a update to the script 

I am currently trying to get the wget part working that i only downloads when the remote file is newer... but the server refuses wget... is that correct? 



Met vriendelijke groet, Best regards, 


Thom van der Boon 
E-Mail: thom at vdb.nl 



===== 



Thom.H. van der Boon b.v. 
Transito 4 
6909 DA Babberich 
Tel.: +31 (0)88 4272727 
Fax: +31 (0)88 4272789 
Home Page: http://www.vdb.nl/ 


Van: "Jerry Benton" <jerry.benton at mailborder.com> 
Aan: "MailScanner Discussion" <mailscanner at lists.mailscanner.info> 
Verzonden: Donderdag 3 augustus 2017 07:03:07 
Onderwerp: Phishing Server Change 

Please use the updated version of the phishing updates script from 
http://phishing.mailscanner.info/ 

I am trying to reduce bandwidth and the new script uses curl as the primary 
method, which support gzip by default. The fallback is wget, which uses more 
bandwidth. Most servers are still using the older update script version that 
uses wget as the primary method. (You cannot just tell wget to use gzip 
because the downloaded file ends up staying compressed and thus useless.) 

The phishing server does about 550GB per month in transfers. Using wget the 
bad phishing file transfer size is 280081 and with curl it is 119027. That 
is almost half the transfer size. I would like to try to get that 550GB 
number down. I don't want to have to pull out the big stick and start 
blocking wget user agents, so please help me out here. 

As a side note, there is no point in updating the phishing files every hour. 
They get updated six times per day. If you are running every hour, please 
change your cron settings to something less taxing. Again, I don't want to 
pull out the big stick and start throttling IPs that are updating too often. 


-- 
Jerry Benton 
www.mailborder.com 
+1 (843) 800-8605 
+44 (020) 3883-8605 





-- 
MailScanner mailing list 
mailscanner at lists.mailscanner.info 
http://lists.mailscanner.info/mailman/listinfo/mailscanner 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mailscanner.info/pipermail/mailscanner/attachments/20170803/bac2ce1e/attachment.html>