Revive filter27.adblockplus.org

[matze]

***** Nagios *****

Notification Type: PROBLEM
Host: filter27.adblockplus.org
State: DOWN
Address: filter27.adblockplus.org
Info: PING CRITICAL - Packet loss = 100%

Date/Time: Thu Aug 13 00:09:49 UTC 2015

See also #2889.

[matze]

Since that host was behaving off the norm ever since we've set it up a few days ago, I've backed up keys and logs and just re-installed the entire box. Provisioning has finished already, but the RAID sync will take around five to six hours. The server will re-join balancing afterwards.

@palant, @Kirill
Retaining the current logs without rotating them for today should allow for processing them tomorrow without manual intervention. Any objections?

[matze]

The host is back in balancing.

[matze]

The host went down again, without further information visible in any logs. Thus I've asked Hetzner to analyze it's hardware, awaiting results in the next hours.

@Kirill Logs from that host haven't been processed by the stats server yet, because the log rotation (which creates the .1 file downloaded) has never taken place so far. I assume the same goes for your analysis?

[matze]

After the RAM has been replaced and the CPU thermal grease has been renewed, I've put the host back into balancing.

@palant, @Kirill
The logs have now been rotated (implicitly because Hetzner rebooted the host before the rotation last night), but it seems like they haven't been processed yet. I'd suppose they now need manual attention, as the current chunk will become rotated again before processing kicks in.