Opened on 04/01/2014 at 01:04:47 PM
Closed on 04/25/2014 at 12:41:26 PM
#239 closed change (fixed)
Move AWStats processing to the stats server
Reported by: | trev | Assignee: | trev |
---|---|---|---|
Priority: | P1 | Milestone: | |
Module: | Infrastructure | Keywords: | |
Cc: | Blocked By: | ||
Blocking: | Platform: | ||
Ready: | yes | Confidential: | no |
Tester: | Verified working: | no | |
Review URL(s): |
http://codereview.adblockplus.org/6293281981857792/ |
Description
Background
Currently we run AWStats for adblockplus.org & Co. on the web server itself. However, it doesn't have enough memory for that which causes occasional issues.
What to change
AWStats should be moved to our stats server and merely pull in logs from adblockplus.org & Co via SSH. This will also allow processing stats for other web servers like eyeo.com.
Attachments (0)
Change History (11)
comment:1 Changed on 04/22/2014 at 09:00:01 AM by trev
- Priority changed from P2 to P1
comment:2 Changed on 04/23/2014 at 10:14:55 AM by trev
- Owner set to trev
- Status changed from new to assigned
comment:3 Changed on 04/23/2014 at 01:14:57 PM by trev
- Review URL(s) modified (diff)
- Status changed from assigned to reviewing
comment:4 Changed on 04/24/2014 at 09:39:35 AM by trev
comment:5 Changed on 04/24/2014 at 10:00:17 AM by trev
A quick follow-up commit, intraforum configuration wasn't correct: https://hg.adblockplus.org/infrastructure/rev/c064658dd81b
comment:6 Changed on 04/24/2014 at 11:59:10 AM by trev
Original commit was listing youtube.adblockplus.org rather than youtube.adblockplus.me, fixed: https://hg.adblockplus.org/infrastructure/rev/ea9e282d51b1
comment:7 Changed on 04/24/2014 at 12:46:19 PM by trev
Also fixed DNS name for server10: https://hg.adblockplus.org/infrastructure/rev/eee27e75236e
And it wasn't listed in known_hosts: https://hg.adblockplus.org/infrastructure/rev/fc5c554de095
comment:8 Changed on 04/25/2014 at 11:59:36 AM by trev
- Resolution set to fixed
- Status changed from reviewing to closed
Addressed review comments: https://hg.adblockplus.org/infrastructure/rev/7580e4b14917
comment:9 Changed on 04/25/2014 at 12:23:49 PM by trev
- Resolution fixed deleted
- Status changed from closed to reopened
comment:10 Changed on 04/25/2014 at 12:24:55 PM by trev
- Review URL(s) modified (diff)
- Status changed from reopened to reviewing
One more review, AWStats creates a cron job for itself by default and produces massive cron spam because the system-wide configuration isn't actually usable.
comment:11 Changed on 04/25/2014 at 12:41:26 PM by trev
- Resolution set to fixed
- Status changed from reviewing to closed
Fixed that issue as well: https://hg.adblockplus.org/infrastructure/rev/7d5ecf4e6982
Given the urgency I pushed while the review is still ongoing (fhd agreed): https://hg.adblockplus.org/infrastructure/rev/3c576505b61d