Opened on 11/14/2016 at 11:18:01 AM

Last modified on 01/12/2017 at 12:57:11 PM

#4639 reopened change

Remove easylist and easylistgermany repositories from our infrastructure

Reported by: trev Assignee: ferris
Priority: Unknown Milestone:
Module: Infrastructure Keywords:
Cc: matze, nicole@adblockplus.org, arthur@adblockplus.org Blocked By:
Blocking: Platform: Unknown / Cross platform
Ready: no Confidential: no
Tester: Unknown Verified working: no
Review URL(s):

https://codereview.adblockplus.org/29370769 (closed)
https://codereview.adblockplus.org/29370772 (closed)
https://codereview.adblockplus.org/29371597 (closed)
https://codereview.adblockplus.org/29371600 (abandoned)

Description

Background

easylist and easylistgermany repositories moved to GitHub but we are still syncing them to our Mercurial server. This is completely unnecessary as the generation process downloads the data directly from GitHub (see https://hg.adblockplus.org/easylistcombinations/file/tip/easylist.txt for example).

What to change

Remove the manually added cronjob importing easylist and easylistgermany from GitHub on hg1 - as well as its data. Remove the repositories themselves from hg1, these are unused and shouldn't be on our infrastructure in the first place. Remove these repositories from hiera/roles/filtermasterserver.yaml and the already checked out copies from the filter master servers.

Attachments (0)

Change History (15)

comment:1 Changed on 01/05/2017 at 09:57:44 PM by ferris

  • Owner set to ferris

comment:2 Changed on 01/05/2017 at 10:25:52 PM by ferris

  • Review URL(s) modified (diff)
  • Status changed from new to reviewing

Removed cronjobs:

MAILTO=monitoring+easylist@adblockplus.org
*/5 * * * * cd ~/import/github/easylistgermany && git pull -q && hg -q -R ~/web/easylistgermany pull -u
*/5 * * * * cd ~/import/github/easylist && git pull -q && hg -q -R ~/web/easylist pull -u

Moved ~hg/import/ to ~hg/.import.old-and-disabled-4639/ for now (easylist and easylistgermany were the only ones in there, also in ~/import/legacy/).

Moved ~hg/web/easylist{,germany} into the above folder as well.

If nobody complains over the next few days, I'll remove them permanently.

I cannot currently access filtermaster1 - requested access to clean up there.

comment:3 Changed on 01/05/2017 at 10:31:01 PM by ferris

Moved the repositories back into place for now as I need access to the filter masters in order to stop the cronjob there from failing (we just got a couple of annoying alert mails from the filtermasters).

comment:4 Changed on 01/05/2017 at 10:32:47 PM by ferris

Remind myself to remove them from hgaccess as well.

comment:5 Changed on 01/06/2017 at 08:54:04 AM by abpbot

A commit referencing this issue has landed:
Issue 4639 - Remove easylist and easylistgermany

comment:6 Changed on 01/06/2017 at 09:50:02 AM by ferris

  • Review URL(s) modified (diff)

comment:7 Changed on 01/06/2017 at 11:41:48 PM by ferris

  • Resolution set to fixed
  • Status changed from reviewing to closed

Got access to the filtermaster1 and filtermaster2 today. Provisioned them with the change.

Did this on both filtermasters:

mv subscription/easylist .disabled-subscription/
mv subscription/easylistgermany/ .disabled-subscription/

Then re-removed the repos on hg1 again.

No more cron error mails the last half hour.

comment:8 Changed on 01/12/2017 at 12:06:30 PM by ferris

  • Resolution fixed deleted
  • Status changed from closed to reopened

comment:9 Changed on 01/12/2017 at 12:07:47 PM by ferris

Reopening and reverting as per matze's request.

comment:10 Changed on 01/12/2017 at 12:12:53 PM by matze

We actually have a set of legal requirements that result in our requirement to have these repositories and the synchronization. Hence easylistcombinations not referring to our own resources is actually an issue. I will clarify the situation accordingly.

comment:11 Changed on 01/12/2017 at 12:15:57 PM by ferris

  • Review URL(s) modified (diff)

comment:12 Changed on 01/12/2017 at 12:18:10 PM by ferris

  • Review URL(s) modified (diff)

comment:13 Changed on 01/12/2017 at 12:33:14 PM by abpbot

A commit referencing this issue has landed:
Issue 4639 - Reverting the removal of list repos

comment:14 Changed on 01/12/2017 at 12:36:40 PM by ferris

  • Review URL(s) modified (diff)

comment:15 Changed on 01/12/2017 at 12:57:11 PM by ferris

  • Cc nicole@adblockplus.org arthur@adblockplus.org added
  • Review URL(s) modified (diff)

All changes have been reverted again. This has to go through a more managed change process, or be clarified with the filterlist maintainers.

Add Comment

Modify Ticket

Change Properties
Action
as reopened .
as The resolution will be set. Next status will be 'closed'.
to The owner will be changed from ferris.
Next status will be 'reviewing'.
 
Note: See TracTickets for help on using tickets.