Opened on 04/28/2014 at 09:59:18 AM

Last modified on 10/08/2019 at 05:47:37 PM

#396 new change

[abp-backend] Add a filter hit statistics backend server

Reported by: sebastian Assignee:
Priority: P2 Milestone:
Module: Infrastructure Keywords: 2015q3
Cc: arthur, kzar, Blocked By: #395, #3102, #3105
Blocking: #495 Platform: Unknown
Ready: yes Confidential: no
Tester: Unknown Verified working: no
Review URL(s):

Description (last modified by kzar)


See #495 and #395.

What to change

Add a new server to our infrastructure (, running the filter hits statistics backend as implemented by #395. It should also allow running queries on the filter hit statistics, that part needs access restriction (basic auth).

The filter hitstats back end provides two routes via the multiplexer:

  • /submit Which accepts JSON data POSTed to it from users who have opted-in to usage collection.
  • /query Which accepts GET parameters to determine a query of the aggregated data and returns JSON back.


  • /static needs to be set up on the web server to point to the static files in sitescripts/filterhits/static

Both /static and /query should be protected by basic authentication so that only authorised people can view the data. /submit should be open to the public though obviously.

Logged data will be saved in individual files with a name based on the current timestamp and a random string. The files are stored within separate directories for each day. For example 2014-12-19/1418994873-g1sroc.log.

@kirill will need access to the logged data (base path specified by the sitescripts.conf filterhitstats.log_dir option.) He will likely need a daily archive of the past day's logs to be sent to him / available for him to download.

There will also be a log file processing-errors.log created inside the log directory should we fail to process any submitted data. This log should be monitored somehow so that we notice if there's a problem.


Attachments (0)

Change History (23)

comment:1 Changed on 04/28/2014 at 02:55:28 PM by arthur

  • Cc arthur added

comment:2 Changed on 05/15/2014 at 01:27:56 PM by trev

  • Blocking 495 added

comment:3 Changed on 05/15/2014 at 01:31:49 PM by trev

  • Blocking 155 removed
  • Cc trev added
  • Description modified (diff)
  • Ready set
  • Sensitive unset

comment:4 Changed on 10/06/2014 at 08:20:05 AM by fhd

  • Description modified (diff)
  • Platform set to Unknown
  • Priority changed from Unknown to P2
  • Summary changed from Add a filter hits stats server to our infrastructure to Add a filter hit statistics backend server

comment:5 Changed on 10/07/2014 at 03:14:09 PM by trev

  • Cc kzar added
  • Description modified (diff)

comment:6 Changed on 10/14/2014 at 04:55:52 PM by saroyanm

  • Cc added

comment:7 Changed on 11/23/2014 at 11:20:57 AM by sven

  • Keywords 2014q4 added

comment:8 Changed on 11/24/2014 at 12:02:51 PM by sven

  • Keywords 2014q4 removed

comment:9 Changed on 12/19/2014 at 01:45:17 PM by kzar

  • Description modified (diff)

comment:10 Changed on 12/19/2014 at 01:46:11 PM by kzar

  • Description modified (diff)

comment:11 Changed on 12/19/2014 at 01:50:01 PM by kzar

  • Description modified (diff)

comment:12 Changed on 03/01/2015 at 01:53:55 PM by kzar

  • Description modified (diff)

comment:13 Changed on 04/03/2015 at 10:28:57 AM by kzar

  • Description modified (diff)

comment:14 Changed on 07/30/2015 at 05:42:56 PM by fhd

  • Keywords 2015q3 added
  • Tester set to Unknown

comment:15 Changed on 09/21/2015 at 11:53:52 AM by matze

  • Blocked By 3102 added

comment:16 Changed on 09/21/2015 at 01:30:27 PM by matze

  • Blocked By 3105 added

comment:17 Changed on 12/22/2016 at 09:29:11 PM by ferris

  • Summary changed from Add a filter hit statistics backend server to [abp-backend] Add a filter hit statistics backend server

comment:18 Changed on 12/21/2017 at 11:25:42 AM by fhd

  • Cc trev removed

comment:19 Changed on 07/29/2019 at 08:56:08 AM by titaniumtv app


Last edited on 10/08/2019 at 05:47:25 PM by kzar

comment:20 Changed on 09/08/2019 at 12:10:17 PM by nps1337


Last edited on 10/08/2019 at 05:47:28 PM by kzar

comment:21 Changed on 09/12/2019 at 08:41:11 AM by impulsepp


Last edited on 10/08/2019 at 05:47:31 PM by kzar

comment:22 Changed on 09/23/2019 at 06:40:22 AM by nps1337


Last edited on 10/08/2019 at 05:47:34 PM by kzar

comment:23 Changed on 09/25/2019 at 07:53:17 AM by run3unblockedaz


Last edited on 10/08/2019 at 05:47:37 PM by kzar

Add Comment

Modify Ticket

Change Properties
as new .
as The resolution will be set. Next status will be 'closed'.
to The owner will be changed from (none).
Next status will be 'reviewing'.
Note: See TracTickets for help on using tickets.