Opened 6 years ago

Last modified 12 months ago

#396 new change

Add a filter hit statistics backend server — at Version 9

Reported by: sebastian Assignee:
Priority: P2 Milestone:
Module: Infrastructure Keywords: 2015q3
Cc: arthur, kzar, manvel@… Blocked By: #395
Blocking: #495 Platform: Unknown
Ready: yes Confidential: no
Tester: Unknown Verified working: no
Review URL(s):

Description (last modified by kzar)


See #495 and #395.

What to change

Add a new server to our infrastructure (, running the filter hits statistics backend as implemented by #395. It should also allow running queries on the filter hit statistics, that part needs access restriction (basic auth).

The filter hitstats back end provides two routes via the multiplexer:

  • /submit Which accepts JSON data POSTed to it from users who have opted-in to usage collection.
  • /query Which accepts GET parameters to determine a query of the aggregated data and returns JSON back.


  • /static needs to be set up on the web server to point to the static files in sitescripts/filterhits/static

Both /static and /query should be protected by basic authentication so that only authorised people can view the data. /submit should be open to the public though obviously.

@kirill we need access to the logged data (path specified by the sitescripts.conf filterhitstats.log_dir option.) He will likely need a daily archive of the past day's logs to be sent to him / available for him to download.

There will also be a log file mysql-errors.log created inside the log directory should any aggregation fail to run inside MySQL. This log should be monitored somehow so that we notice if there's a problem.


Change History (9)

comment:1 Changed 6 years ago by arthur

  • Cc arthur added

comment:2 Changed 6 years ago by trev

  • Blocking 495 added

comment:3 Changed 6 years ago by trev

  • Blocking 155 removed
  • Cc trev added
  • Description modified (diff)
  • Ready set
  • Sensitive unset

comment:4 Changed 6 years ago by fhd

  • Description modified (diff)
  • Platform set to Unknown
  • Priority changed from Unknown to P2
  • Summary changed from Add a filter hits stats server to our infrastructure to Add a filter hit statistics backend server

comment:5 Changed 6 years ago by trev

  • Cc kzar added
  • Description modified (diff)

comment:6 Changed 6 years ago by saroyanm

  • Cc manvel@… added

comment:7 Changed 6 years ago by sven

  • Keywords 2014q4 added

comment:8 Changed 6 years ago by sven

  • Keywords 2014q4 removed

comment:9 Changed 6 years ago by kzar

  • Description modified (diff)
Note: See TracTickets for help on using tickets.