Opened on 04/21/2017 at 04:04:24 PM

Closed on 05/23/2017 at 11:57:40 AM

#5171 closed defect (fixed)

Fix automation to update subscriptions.xml

Reported by: arthur Assignee: matze
Priority: P2 Milestone:
Module: Infrastructure Keywords:
Cc: trev, greiner, matze, ferris Blocked By:
Blocking: Platform: Unknown / Cross platform
Ready: yes Confidential: no
Tester: Unknown Verified working: no
Review URL(s):


How to reproduce

  1. Open

Observed behaviour

No subscription entry for EasyList Spanish is found.

Expected behaviour

There should be a subscription entry for EasyList Spanish since it's a recommended filter list since 19 January.

Attachments (0)

Change History (16)

comment:1 Changed on 04/21/2017 at 04:44:26 PM by matze

  • Cc greiner added; matze removed
  • Component changed from Infrastructure to User-Interface

comment:2 Changed on 04/22/2017 at 05:50:05 AM by trev

@greiner: Why did you change the component? We have automation updating subscriptions.xml in adblockplusui, this automation clearly isn't working right now. How is this not an Infrastructure bug?

comment:3 Changed on 04/22/2017 at 12:23:59 PM by greiner

@trev I didn't change anything so better ask matze.

comment:4 Changed on 04/24/2017 at 09:55:49 AM by trev

  • Cc matze added

Sorry, I misread the change. @matze: Question in comment 2 is for you.

comment:5 Changed on 04/24/2017 at 11:25:47 AM by matze

  • Cc ferris added
  • Component changed from User-Interface to Infrastructure

I didn't know about that stuff being auto-generated and thought this being an Infrastructure ticket is a mistake. Even now I do not recall to ever have stumbled upon this, and I also haven't found any reference in code yet. So I guess it's happening on server16 or something?

comment:6 Changed on 04/24/2017 at 11:49:21 AM by trev

The script in question is sitescripts/extensions/bin/, and I assume that it is indeed still running on server16. Given that the file path is incorrect there, it's not really surprising that things aren't working. In fact, it seems that this was never updated after subscriptions.xml moved to the adblockplusui repository.

Last edited on 04/24/2017 at 11:51:08 AM by trev

comment:7 Changed on 04/24/2017 at 12:07:09 PM by matze

  • Priority changed from Unknown to P2
  • Ready set

comment:8 Changed on 04/24/2017 at 12:09:09 PM by trev

  • Review URL(s) modified (diff)

Added review for the sitescripts part. Note that this script is reverting some changes that appear to have been added in the adblockplusui repository manually.

comment:9 Changed on 04/24/2017 at 12:57:48 PM by trev

Never mind, the copy in adblockplusui is bogus. The real one is in adblockpluscore.

comment:10 Changed on 04/25/2017 at 11:06:10 AM by abpbot

A commit referencing this issue has landed:
Issue 5171 - Fix automation to update subscriptions.xml

comment:11 Changed on 04/25/2017 at 12:09:11 PM by trev

@matze: I updated the script but it doesn't seem to be running anywhere. It was definitely running on hg1 but it doesn't any more, I don't know whether it was lost in the server migration or removed intentionally. The following command should be run as a cron job, maybe once a day:

python -m sitescripts.extensions.bin.updateRecommendations

If you add it to hg1 again, then it is best run as user hg. The following entries need to be added to sitescripts.ini:


It will work with a remote repository as well however, from any server. You should have the ssh:// URL in subscriptions_repository then and the cron user should have SSH access to adblockpluscore repository (name in commits will be "hgbot").

comment:12 Changed on 05/23/2017 at 08:44:29 AM by arthur

I think this is an urgent issue since there are already two new recommeded filter lists (Spanish and Vietnamese) that new users won't get by default due to this issue. This should improve their user experience for them and the longer it takes this to be fixed, the more new users only get EasyList as the default list which isn't designed for Spanish or Vietnamese sites.

comment:13 Changed on 05/23/2017 at 09:42:15 AM by matze

  • Owner set to matze

comment:14 follow-up: Changed on 05/23/2017 at 10:12:36 AM by matze

Now the core version ( seems fine after manual update (inclusion with cron or as hook will follow later). But I wonder why there is a "core" and an "UI" version (with the latter being the one this ticket is actually about)?

The script requires the following items to be present as well:


The aforementioned subscriptions_* directives are associated with the [extensions] group.

comment:15 in reply to: ↑ 14 ; follow-up: Changed on 05/23/2017 at 11:49:24 AM by greiner

Replying to matze:

But I wonder why there is a "core" and an "UI" version (with the latter being the one this ticket is actually about)?

The file in adblockplusui is merely a mock that's used for the testing environment.

comment:16 in reply to: ↑ 15 Changed on 05/23/2017 at 11:57:40 AM by matze

  • Resolution set to fixed
  • Review URL(s) modified (diff)
  • Status changed from new to closed

Replying to greiner:

The file in adblockplusui is merely a mock that's used for the testing environment.

Thank you, I guess we're done here then. Setting up the hook will be done in a follow-up ticket (hub).

Add Comment

Modify Ticket

Change Properties
as closed .
The resolution will be deleted. Next status will be 'reopened'.
to The owner will be changed from matze.
Note: See TracTickets for help on using tickets.