Opened 4 years ago

Closed 4 years ago

Last modified 4 years ago

#3667 closed change (fixed)

Block AhrefsBot from Issue Tracker

Reported by: matze Assignee: matze
Priority: P2 Milestone:
Module: Infrastructure Keywords:
Cc: trev Blocked By:
Blocking: Platform: Unknown / Cross platform
Ready: yes Confidential: no
Tester: Unknown Verified working: no
Review URL(s):

https://codereview.adblockplus.org/29336585
https://codereview.adblockplus.org/29336809

Description

Setup a robots.txt file for https://issues.adblockplus.org/, requesting AhrefsBot to stop crawling the sites. The high load it causes, especially when accessing the timeline, is not ratified by any actual purpose for our project.

Change History (5)

comment:1 Changed 4 years ago by matze

  • Review URL(s) modified (diff)
  • Status changed from new to reviewing

comment:2 Changed 4 years ago by matze

  • Resolution set to fixed
  • Status changed from reviewing to closed

comment:3 Changed 4 years ago by trev

  • Cc trev added; palant removed

Generally blocking the bots from accessing the timeline sounds like a better course of action.

comment:4 Changed 4 years ago by matze

  • Review URL(s) modified (diff)
Note: See TracTickets for help on using tickets.