Changes between Version 6 and Version 12 of Ticket #3774


Ignore:
Timestamp:
03/12/2016 05:23:40 PM (4 years ago)
Author:
sebastian
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #3774

    • Property Cc trev added; palant removed
    • Property Summary changed from Fix malware domain list updates to Support multiple mirrors for the Malware Domains List
  • Ticket #3774 – Description

    v6 v12  
    11=== Background === 
    22 
    3 The [https://hg.adblockplus.org/sitescripts/file/tip/sitescripts/subscriptions/bin/updateMalwareDomainsList.py script] that converts the [https://www.malwaredomainlist.com/ Malware Domains List] into an Adblock Plus filter list, currently hard-codes `mirror3.malwaredomains.com`. 
     3The [https://hg.adblockplus.org/sitescripts/file/tip/sitescripts/subscriptions/bin/updateMalwareDomainsList.py script] that converts the [https://www.malwaredomainlist.com/ Malware Domains List] into an Adblock Plus filter list, currently relies on a single mirror, i.e.`mirror3.malwaredomains.com`. 
    44 
    55As of now, this mirror blocks out requests sent with Python's `urllib` module's default user agent string, while other mirrors don't have that issue. 
     
    88 
    99=== What to change === 
    10 When dowloading the Malware Domains List, pick a random mirror. When the request fails, fallback to another mirror in the list. 
     10Support a list of mirrors, so that when downloading the Malware Domains List fails, the next mirror in the list is tried. Try following mirrors in that order: 
     11 
     121. `mirror3.malwaredomains.com` (this is the one we got initially told to use) 
     132. `mirror1.malwaredomains.com` 
     143. `mirror2.malwaredomains.com`