Timeline


and

03/02/16:

17:15 Ticket #907 (TN Drupal database size) updated by chris
Add Hours to Ticket, Total Hours changed
Note that creating these backup dumps also made the site go off-line, …
16:57 Ticket #907 (TN Drupal database size) updated by chris
Add Hours to Ticket, Total Hours changed
The database is transitionnetw_0, I have just used ninjahelper to dum …
16:00 Ticket #907 (TN Drupal database size) updated by paul
Add Hours to Ticket, Total Hours changed
I turned of database logging and cleared the caches but didn't see any …
12:58 Ticket #907 (TN Drupal database size) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to ade: > > When you say the database dump has …
11:43 Ticket #907 (TN Drupal database size) updated by paul
Add Hours to Ticket, Total Hours changed
Maybe we could turn off database logging and clear the caches. Take a …
11:38 Ticket #907 (TN Drupal database size) updated by paul
Add Hours to Ticket, Total Hours changed
It looks as though it's some kind of cache problem. […]
11:30 Ticket #907 (TN Drupal database size) updated by paul
[…]
11:29 Ticket #907 (TN Drupal database size) updated by paul
Add Hours to Ticket, Total Hours changed
Database logging is enabled. How big is the watchdog table? Investigating …
11:25 Ticket #907 (TN Drupal database size) updated by ade
[…]
10:34 Ticket #896 (Chive access to TN Drupal DB) updated by chris
Add Hours to Ticket, Total Hours changed
So this size of the database has caused a diskspace issue on ParrotServer: …
10:21 Ticket #896 (Chive access to TN Drupal DB) updated by chris
Add Hours to Ticket, Total Hours changed
One odd thing, 6 weeks ago the datadase dump was 447M, see …
10:20 Ticket #907 (TN Drupal database size) created by chris
6 weeks ago the datadase dump was 447M, see trac:ticket/896#comment:3 but …
10:12 Ticket #896 (Chive access to TN Drupal DB) updated by chris
Add Hours to Ticket, Total Hours changed
Updating the copy of the database on ParrotServer, on PuffinServer: …
09:35 Ticket #906 (I borked it) updated by chris
Cc changed
Glad it didn't break! For things like this best test it on a dev copy of …
09:23 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

03/01/16:

22:52 Ticket #906 (I borked it) closed by sam
fixed: Seems to have come back, so I've undone the change and will just leave it …
22:27 Ticket #906 (I borked it) created by sam
Hi Chris I recklessly tried to enable a module on the site that enabled …

02/29/16:

14:26 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
There have been official releases for these security updates. Both of …

02/25/16:

14:57 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
Awaiting drupal 6 security updates from the LTS vendors. …
11:38 Ticket #905 (TN site down due to redis not running) updated by paul
[…]
10:59 Ticket #905 (TN site down due to redis not running) updated by chris
Add Hours to Ticket, Total Hours changed
Here is some info on what can cause a MySQL DEADLOCK: * …
10:50 Ticket #905 (TN site down due to redis not running) updated by chris
Add Hours to Ticket, Total Hours changed
The site is back up. Here is what I did (restarting MySQL and Redis): …
10:45 Ticket #905 (TN site down due to redis not running) updated by ade
[…]
10:28 Ticket #905 (TN site down due to redis not running) created by chris
I'm working on this…

02/24/16:

10:44 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

02/19/16:

12:07 Ticket #904 (Issues to consider in the migration from Drupal to WordPress) updated by paul
Add Hours to Ticket, Total Hours changed
Great advice! A couple of related things you'll want to consider as part …
11:15 Ticket #904 (Issues to consider in the migration from Drupal to WordPress) updated by chris
Add Hours to Ticket, Total Hours changed
== Static Archive == I would suggest it would be worth generating a …
10:41 Ticket #904 (Issues to consider in the migration from Drupal to WordPress) created by chris
A few weeks ago Ade said he though it would be worth me opening a ticket …
10:37 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

02/18/16:

11:00 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week.

02/16/16:

21:13 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
All the servers have been rebooted and all the web sites appear to be up. …
21:07 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
This is a …
14:31 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
13:57 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

02/15/16:

10:59 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Updates applied over the weekend, Debian …

02/12/16:

11:31 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

02/11/16:

15:39 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
The following drupal security updates have been applied this week: View …

02/09/16:

11:10 Ticket #903 (Large load spike on PuffinServer) updated by ade
[…]

02/08/16:

09:08 Ticket #903 (Large load spike on PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Between 7:55am and when I blocked the poneytelecom.eu IP address at …
09:06 IpDrop created by chris
09:05 WikiStart edited by chris
Added link to IpDrop (diff)
09:00 puffin-2016-02-08_mysql_innodb_io-day.png attached to Ticket #903 by chris
09:00 puffin-2016-02-08_mysql_innodb_rows-day.png attached to Ticket #903 by chris
09:00 puffin-2016-02-08_mysql_queries-day.png attached to Ticket #903 by chris
08:59 puffin-2016-02-08_mysql_qcache-day.png attached to Ticket #903 by chris
08:59 puffin-2016-02-08_fw_conntrack-day.png attached to Ticket #903 by chris
08:59 puffin-2016-02-08_http_loadtime-day.png attached to Ticket #903 by chris
08:59 puffin-2016-02-08_nginx_request-day.png attached to Ticket #903 by chris
08:59 puffin-2016-02-08_nginx_vhost_traffic-day.png attached to Ticket #903 by chris
08:58 puffin-2016-02-08_multips_memory-day.png attached to Ticket #903 by chris
08:58 puffin-2016-02-08_redis_commands-day.png attached to Ticket #903 by chris
08:58 puffin-2016-02-08_cpu-day.png attached to Ticket #903 by chris
08:58 puffin-2016-02-08_load-day.png attached to Ticket #903 by chris
08:46 Ticket #903 (Large load spike on PuffinServer) created by chris
There was a large load spike this morning on PuffinServer, which appears …

02/07/16:

10:55 Ticket #847 (Upgrade Servers to Debian Jessie) updated by chris
The next Piwik upgrade will require that PenguinServer is updated from …
10:54 Ticket #902 (Piwik 2.16.0) closed by chris
fixed: Following the PiwikServer#Updates notes […] Check the …
10:41 Ticket #902 (Piwik 2.16.0) created by chris
From the changelog: > == …

02/05/16:

13:10 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

02/04/16:

12:16 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week. Reviewing recent …
12:08 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to ade: > > It appears I have broken the 3 errors …
11:35 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by ade
[…]

02/03/16:

20:27 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
15:05 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by ade
[…]
15:00 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Replying to ade: > > Appears if I try to login via ssh using …
14:59 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Add Hours to Ticket, Total Hours changed
It doesn't work for me either, looks like it might be due to the shell: …
14:55 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by ade
[…]
14:40 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by ade
[…]
14:38 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Ade, our email just crossed, see ticket:901#comment:2 -- if you use …
14:35 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by ade
[…]
14:31 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Add Hours to Ticket, Total Hours changed
Ade, I see you got in OK: […] I don't know how much joy you will have …
13:50 Ticket #901 (Enable SSH access to PuffinServer for Ade) updated by chris
Add Hours to Ticket, Total Hours changed
Following the steps taken for Paul: […] …
13:25 Ticket #901 (Enable SSH access to PuffinServer for Ade) created by chris
This is a ticket to track the time spent sorting out SSH access for Ade to …
11:30 Ticket #900 (Unusal High Load on Puffin) updated by chris
Add Hours to Ticket, Total Hours changed
Just got this from Pingdom: […] All 8 incidents were related to the …

02/02/16:

10:00 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
New version of Passenger and Nginx installed last night on PenguinServer, …

02/01/16:

11:36 Ticket #893 (BOA Cron Jobs) updated by chris
A monthly Redis restart has been added to the root crontab, see …
11:34 Ticket #900 (Unusal High Load on Puffin) closed by chris
fixed: Everything still looks fine with the server, I have added this root …
11:21 Ticket #899 (Managing security after Feb 24th, 2016.) updated by chris
Cc changed

01/31/16:

15:32 Ticket #900 (Unusal High Load on Puffin) updated by chris
Add Hours to Ticket, Total Hours changed
The Redis restart seems to have done the job, things are back to normal …
15:28 puffin-2016-01-31_2_load-day.png attached to Ticket #900 by chris
15:28 puffin-2016-01-31_2_cpu-day.png attached to Ticket #900 by chris
15:27 puffin-2016-01-31_2_mysql_queries-day.png attached to Ticket #900 by chris
14:29 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
13:26 Ticket #900 (Unusal High Load on Puffin) updated by chris
Description changed
13:21 Ticket #900 (Unusal High Load on Puffin) updated by chris
Add Hours to Ticket, Total Hours changed
Actually I think I might have found, at least part of, the cause, most the …
13:12 puffin-2016-01-31-piwik-google-crop.png attached to Ticket #900 by chris
13:12 puffin-2016-01-31-piwik-countries-crop.png attached to Ticket #900 by chris
12:56 Ticket #900 (Unusal High Load on Puffin) updated by chris
Add Hours to Ticket, Total Hours changed
This is the first time since [ticket:846#comment:88 all BOA cron jobs were …
12:51 puffin-2016-01-31-redis_memory-month.png attached to Ticket #900 by chris
12:44 puffin-2016-01-31-nginx_vhost_traffic-day.png attached to Ticket #900 by chris
12:44 puffin-2016-01-31-multips-month.png attached to Ticket #900 by chris
12:40 puffin-2016-01-31-redis_clients-month.png attached to Ticket #900 by chris
12:40 puffin-2016-01-31-redis_clients-week.png attached to Ticket #900 by chris
12:40 puffin-2016-01-31-redis_clients-day.png attached to Ticket #900 by chris
12:37 puffin-2016-01-31-mysql_queries-month.png attached to Ticket #900 by chris
12:37 puffin-2016-01-31-mysql_queries-week.png attached to Ticket #900 by chris
12:37 puffin-2016-01-31-mysql_queries-day.png attached to Ticket #900 by chris
12:35 puffin-2016-01-31-if_eth0-day.png attached to Ticket #900 by chris
12:33 puffin-2016-01-31-load-month.png attached to Ticket #900 by chris
12:33 puffin-2016-01-31-load-day.png attached to Ticket #900 by chris
12:24 Ticket #900 (Unusal High Load on Puffin) created by chris
For the first time since the BOA cron jobs were commented out we have had …

01/28/16:

19:23 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
15:22 Ticket #899 (Managing security after Feb 24th, 2016.) updated by paul
Add Hours to Ticket, Total Hours changed
15:22 Ticket #899 (Managing security after Feb 24th, 2016.) created by paul
Hello, Just did some research to check how we will manage security after …
11:19 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

01/26/16:

20:38 Ticket #898 (Fwd: Access to Drupal) updated by chris
Replying to ade: > > I expect them not to have an SSh key, …
18:40 Ticket #898 (Fwd: Access to Drupal) updated by ade
[…]
17:52 Ticket #898 (Fwd: Access to Drupal) updated by chris
Add Hours to Ticket, Total Hours changed
Yes, I can create an account for them and grant them sudo, what username …
17:50 Ticket #898 (Fwd: Access to Drupal) updated by chris
Cc changed
17:50 Ticket #898 (Fwd: Access to Drupal) updated by chris
Status, Cc, Component, Milestone, Owner, Type changed
17:35 Ticket #898 (Fwd: Access to Drupal) created by ade
[…]

01/22/16:

13:43 Ticket #895 (HTTPS wildcard *.transitionnnetwork.org expires on 22nd January 2016) closed by chris
fixed: Switching to using a SHA2 Intermediate Certificate, on PenguinServer, …

01/21/16:

13:56 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Add Hours to Ticket, Total Hours changed
Follow up email to Ade.
12:29 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Add Hours to Ticket, Total Hours changed
Follow up email to Ade.

01/20/16:

14:18 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Add Hours to Ticket, Total Hours changed
Follow up email to Ade.
12:01 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

01/19/16:

14:08 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Add Hours to Ticket, Total Hours changed
Time for last comment.
14:07 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Follow up email to Ade.
12:51 Ticket #897 (Hosting information/requirements for 2016) updated by chris
Add Hours to Ticket, Total Hours changed
Email sent to Ade on 19th Jan 2016.
10:14 Ticket #897 (Hosting information/requirements for 2016) created by chris
This is a ticket to track the time spent on an email thread with Ade.

01/18/16:

19:18 Ticket #896 (Chive access to TN Drupal DB) closed by chris
fixed: Paul ignore the above, I worked out a work-around Another way to …
18:26 Ticket #896 (Chive access to TN Drupal DB) updated by chris
Cc changed
Paul, which of these database on PuffinServer is the …
18:21 Ticket #896 (Chive access to TN Drupal DB) updated by chris
Add Hours to Ticket, Total Hours changed
Paul: do you know which database on PuffinServer is the live TN Drupal …
17:56 Ticket #896 (Chive access to TN Drupal DB) created by chris
Ade would like to give the developers of the new Transition Network …

01/15/16:

11:45 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
11:41 WikiStart edited by chris
Added link to ticket:701 Emails & Telephone calls (diff)

01/14/16:

16:15 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
15:21 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week.

01/13/16:

14:23 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

01/12/16:

11:27 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to chris: > Replying to kate: > > > 2. …
11:17 puffin-2016-01-16-memory-week.png attached to Ticket #846 by chris

01/11/16:

14:01 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian sudo security update (not yet archived, should be …
09:56 Ticket #895 (HTTPS wildcard *.transitionnnetwork.org expires on 22nd January 2016) created by chris
Unless I hear otherwise I'll renew the *.transitionnnetwork.org cert …

01/09/16:

12:58 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

01/08/16:

16:05 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
11:08 Ticket #894 (Brute Force Attacks Against WordPress XMLRPC) updated by chris
Description changed
11:04 Ticket #894 (Brute Force Attacks Against WordPress XMLRPC) updated by chris
Add Hours to Ticket, Total Hours changed
Installing [https://wordpress.org/plugins/stop-xmlrpc-attack/ Stop XML-RPC …

01/07/16:

11:31 Ticket #894 (Brute Force Attacks Against WordPress XMLRPC) updated by chris
Description changed
11:23 Ticket #894 (Brute Force Attacks Against WordPress XMLRPC) updated by chris
Add Hours to Ticket, Total Hours changed
11:23 Ticket #894 (Brute Force Attacks Against WordPress XMLRPC) created by chris
For a few months I have see a lot of requests going to WordPress
11:20 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week.

01/06/16:

11:59 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

01/03/16:

23:49 BoaCronJobs edited by chris
(diff)
20:35 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
I have no idea why BOA installed samba but since it was installed it has …
20:33 WikiStart edited by chris
Removed link: BOA Updates: PuffinServer#Upgradetickets as we have … (diff)
20:14 Ticket #587 (Puffin MySQL Tuning) updated by chris
Cc changed
Cc list updated, jim and ed removed, paul and ade added.
20:13 Ticket #587 (Puffin MySQL Tuning) updated by chris
Add Hours to Ticket, Total Hours changed
Some recent MySQL config changes have been recorded on …
20:10 Ticket #883 (On February 24th 2016, Drupal 6 will reach end of life and no longer be ...) closed by chris
wontfix: Closing as the plan is to switch to WordPress around April 2016, see …
20:08 Ticket #754 (Can we upgrade from PHP 5.3?) closed by chris
wontfix: Closing as wontfix -- we have stopped updating BOA, the last update was …
20:07 PuffinServer edited by chris
Updated upgrade tickets to make it clear that BOA 2.4.2 was the last ever … (diff)
20:04 Ticket #863 (BOA-2.4.4) closed by chris
wontfix: Closing BOA 2.4.7 ticket:889, BOA 2.4.6 ticket:872, BOA 2.4.5 ticket:864, …
20:04 Ticket #864 (BOA 2.4.5) closed by chris
wontfix: Closing BOA 2.4.7 ticket:889, BOA 2.4.6 ticket:872, BOA 2.4.5 ticket:864, …
20:03 Ticket #872 (BOA 2.4.6) closed by chris
wontfix: Closing BOA 2.4.7 ticket:889, BOA 2.4.6 ticket:872, BOA 2.4.5 ticket:864, …
20:03 Ticket #889 (BOA-2.4.7) closed by chris
wontfix: Closing BOA 2.4.7 ticket:889, BOA 2.4.6 ticket:872, BOA 2.4.5 ticket:864, …
20:03 Ticket #854 (BOA 2.4.3) closed by chris
wontfix: Closing BOA 2.4.7 ticket:889, BOA 2.4.6 ticket:872, BOA 2.4.5 ticket:864, …
19:38 Ticket #670 (Roll back performance customisations and use stock BOA settings where ...) closed by chris
fixed: Replying to jim: > > Given so much has changed since the …
19:34 Ticket #846 (Load Spikes on BOA PuffinServer) closed by chris
fixed: Closing this ticket as the load spike problem appears to have been solved …
19:32 Ticket #893 (BOA Cron Jobs) updated by chris
Add Hours to Ticket, Total Hours changed
I have updated the wiki:PuffinServer#LoadSpikes documentation to reflect …
19:30 PuffinServerBoaLoadSpikes edited by chris
(diff)
19:29 PuffinServer edited by chris
(diff)
19:28 PuffinServer edited by chris
Updated BOA load spike issue documentation (diff)
19:12 Ticket #893 (BOA Cron Jobs) updated by chris
Add Hours to Ticket, Total Hours changed
I have spent some time looking at the …
19:02 puffin_2016-01-03_http_loadtime-month.png attached to Ticket #893 by chris
19:02 puffin_2016-01-03_load-month.png attached to Ticket #893 by chris
18:55 puffin-2016-01-03_multips_memory-week.png attached to Ticket #893 by chris

01/01/16:

13:12 Ticket #893 (BOA Cron Jobs) updated by chris
Add Hours to Ticket, Total Hours changed
I have just made some tweaks to some server settings, doubling the Redis …

12/27/15:

12:03 Ticket #893 (BOA Cron Jobs) updated by chris
Add Hours to Ticket, Total Hours changed
I have been keeping an eye on the site and the Munin graphs, although this …
11:56 BoaCronJobs edited by chris
(diff)
11:48 multips-month.png attached to BoaCronJobs by chris
11:47 load-month.png attached to BoaCronJobs by chris
11:47 http_loadtime-month.png attached to BoaCronJobs by chris
11:45 BoaCronJobs edited by chris
(diff)

12/24/15:

14:08 PuffinServer edited by chris
(diff)
14:00 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Thanks Sam, I wrote the following before I read your comments: I think I …
13:55 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
[…]
13:45 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
[…]
13:43 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to paul: > @Chris > > Normally I can but I couldn't …
13:13 Ticket #846 (Load Spikes on BOA PuffinServer) updated by paul
Add Hours to Ticket, Total Hours changed
@Chris Normally I can but I couldn't figure out quickly how to to run the …
12:42 Ticket #893 (BOA Cron Jobs) updated by chris
Add Hours to Ticket, Total Hours changed
I have updated the …
12:30 BoaCronJobs edited by chris
(diff)
11:57 BoaCronJobs edited by chris
(diff)
11:54 BoaCronJobs created by chris
Page created
11:52 PuffinServer edited by chris
Created link to BoaCronJobs (diff)
11:50 PuffinServer edited by chris
Various updates re BOA tickets and server retirement (diff)
11:45 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
Hi Paul Yep it looks like I can. I enabled it for User Registration …
11:42 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to paul: > > Would you have a look to see if you …
11:39 Ticket #893 (BOA Cron Jobs) created by chris
All the BOA cron jobs were stopped on ticket:846#comment:88. This ticket …
00:37 Ticket #846 (Load Spikes on BOA PuffinServer) updated by paul
Add Hours to Ticket, Total Hours changed
Sam, Would you have a look to see if you can configure the honeypot …
00:17 Ticket #846 (Load Spikes on BOA PuffinServer) updated by paul
Add Hours to Ticket, Total Hours changed
I'll install the honeypot module which should prevent spam bots from …

12/23/15:

23:55 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
Email communications.
19:03 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
18:47 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to kate: > > 1. There were many bash "killall" …
18:41 PuffinServer edited by chris
RAM and CPU update recorded (diff)
18:26 Ticket #846 (Load Spikes on BOA PuffinServer) updated by kate
Add Hours to Ticket, Total Hours changed
Hi, My colleague Chris Croome mentioned in our IRC channel that there …
18:19 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Cc, Total Hours changed
Replying to ade: > > Sorry have taken holiday to coincide …
16:55 Ticket #846 (Load Spikes on BOA PuffinServer) updated by ade
[…]
16:53 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
Hi all Thanks for your work on this. I see the site is available again …
13:48 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
It is knackered again already: […] I'm really giving up for the day …
13:44 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
It is up again: […] […] No idea how long it will be up for, not …
13:38 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
I'm going to have one last try for the day to get the server up, rebooting …
13:36 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
So fucked: […]
13:13 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
> Replying to paul: > > > I'll be around later this …
13:00 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to paul: > > Is the server swapping to the hard …
12:36 Ticket #846 (Load Spikes on BOA PuffinServer) updated by paul
Add Hours to Ticket, Total Hours changed
Is the server swapping to the hard drive? I'll be around later this …
12:32 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
[…] I think I'm going to give up on trying to keep the server up today …
12:27 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
It is only getting worse: […]
12:25 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
PuffinServer was down overnight again due to MySQL locking up, see …
12:15 Ticket #890 (Site offline.) updated by chris
Going to follow this up on the load spike ticket, ticket:846
12:13 Ticket #890 (Site offline.) updated by chris
Add Hours to Ticket, Total Hours changed
PuffinServer is not even able to return a value for uptime again, it …
11:59 Ticket #890 (Site offline.) updated by chris
Add Hours to Ticket, Total Hours changed
Things look fine now: […] I'll reboot it back to 9GB of RAM tonight.
11:44 Ticket #890 (Site offline.) updated by chris
Add Hours to Ticket, Total Hours changed
Same thing has happened, very high loads and: […] So: […] …

12/22/15:

11:39 Ticket #892 (MediWiki Security Release: 1.26.1, 1.25.4, 1.24.5 and 1.23.12) updated by chris
And a …
11:37 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

12/18/15:

10:46 Ticket #892 (MediWiki Security Release: 1.26.1, 1.25.4, 1.24.5 and 1.23.12) created by chris
Email to the …

12/17/15:

18:06 Ticket #891 (Issue with TTT and REconomy websites after upgrade to WP 4.4) updated by laura
Just a quick note to say thanks Chris for fixing, happy for other plugins …
12:37 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …
12:11 Ticket #891 (Issue with TTT and REconomy websites after upgrade to WP 4.4) updated by chris
Add Hours to Ticket, Total Hours changed
I have also edited, /wp-content/uploads/delightful-downloads/.htaccess
11:51 Ticket #891 (Issue with TTT and REconomy websites after upgrade to WP 4.4) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to sam: > > The site looks OK to me (see screenshot) …
11:28 Ticket #891 (Issue with TTT and REconomy websites after upgrade to WP 4.4) updated by sam
Hi Laura The site looks OK to me (see screenshot) I can also access the …
11:26 reconomy.png attached to Ticket #891 by sam
11:18 Ticket #891 (Issue with TTT and REconomy websites after upgrade to WP 4.4) created by chris
Email from Laura: > Just to let you know there's a bit of an oddity …
10:52 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week.

12/14/15:

16:35 Ticket #890 (Site offline.) updated by paul
Add Hours to Ticket, Total Hours changed
Nothing further to add really. The initial problem was that the mysql …
11:11 Ticket #878 (Reconomy.org add subdomains) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to ade: > > I thought I had added this as a ticket, …
11:10 Ticket #876 (Can we add a sub domain to reconomy.org) closed by chris
fixed: Resolved on ticket:878

12/13/15:

17:06 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
The UAs were extracted like this: […]
16:58 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
I think a lot of the load issues are caused by bots, looking at the latest …
14:18 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Another bad day for load spikes, these are the subject lines from lfd …

12/12/15:

15:46 Ticket #890 (Site offline.) updated by chris
Add Hours to Ticket, Total Hours changed
There is nothing in /var/log/syslog or /var/log/messages, in …
12:22 Ticket #890 (Site offline.) updated by chris
Add Hours to Ticket, Total Hours changed
I don't know exactly what the problem was with MySQL, but I had to force …
11:25 Ticket #890 (Site offline.) updated by paul
Add Hours to Ticket, Total Hours changed
/usr/bin/mysqladmin: connect to server at 'localhost' failed error: 'Too …
11:20 Ticket #890 (Site offline.) updated by paul
[…]
10:54 Ticket #890 (Site offline.) created by sam
It's serving a page, so may be Drupal level problem rather than server …

12/10/15:

17:47 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
[https://mariadb.com/kb/en/mariadb/mariadb-5547-release-notes/ MariaDB …
14:14 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
No drupal security updates need to be applied this week.

12/08/15:

17:51 PuffinServer edited by chris
Added link to ticket:889 and various updates (diff)
17:42 Ticket #889 (BOA-2.4.7) updated by chris
Description changed
17:35 Ticket #889 (BOA-2.4.7) updated by chris
Add Hours to Ticket, Total Hours changed
17:35 Ticket #889 (BOA-2.4.7) created by chris
Following is the …

12/07/15:

22:33 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
PenguinServer updates: …
13:21 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
Confirmed that the news website is up to date. …
11:40 Ticket #884 (RE: http://news.transitionnetwork.org) updated by paul
[…]
11:38 Ticket #884 (RE: http://news.transitionnetwork.org) updated by paul
Add Hours to Ticket changed
Thanks Chris. I'll use Drush ..
11:31 Ticket #884 (RE: http://news.transitionnetwork.org) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to paul: > > I thought these were just going to the …
11:21 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Replying to ade: > > Sounds ideal Chris, > Please invoice as …
11:19 Ticket #846 (Load Spikes on BOA PuffinServer) updated by ade
[…]
11:18 Ticket #884 (RE: http://news.transitionnetwork.org) updated by paul
Add Hours to Ticket, Total Hours changed
Sorry Chris, I thought these were just going to the mailing list for …
11:14 Ticket #886 (Re: http://news.transitionnetwork.org) closed by paul
duplicate
11:13 Ticket #885 (Re: http://news.transitionnetwork.org) closed by paul
duplicate

12/06/15:

15:59 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Looking at the …
15:50 puffin_memory-pinpoint_2015-12-06.png attached to Ticket #846 by chris
13:35 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to sam: > also just unpublished …
13:34 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Replying to sam: > > I guess it would be fairly trivial for …
13:32 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
also just unpublished …
13:30 Ticket #846 (Load Spikes on BOA PuffinServer) updated by sam
Replying to chris: > So wiki:WebServerLogs#logstalgia now …
12:59 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Replying to sam: > > I used it to embed a Flickr slideshow, …
12:58 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Description changed
12:57 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) closed by sam
fixed
12:56 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by sam
Definitely unintentional. My guess is it's to do with this thing: …
12:54 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Description, Summary changed
12:53 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
The source of these adverts are webbugs are the content embedded in the …
12:52 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
And some javascript from bam.nr-data.net that is loaded from the HTML …
12:50 tn3.png attached to Ticket #888 by chris
12:44 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Here is another thing loaded from that server. [[Image(...)]]
12:43 tn2.png attached to Ticket #888 by chris
12:41 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Summary changed
12:40 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) updated by chris
Add Hours to Ticket, Total Hours changed
I was just checking the page load time, given the huge amount of RAM I …
12:32 tn.png attached to Ticket #888 by chris
12:30 14260753359355.jpg attached to Ticket #888 by chris
12:25 Ticket #888 (Adverts on Transition Network Front Page loaded via flickrit.com embedded ...) created by chris
It it intentional or accidental that adverts from …

12/05/15:

18:10 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
So wiki:WebServerLogs#logstalgia now works given the extra RAM and guess …
18:00 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
So now it seems fine... […] I have no idea what was causing the …
17:34 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
It is up, I don't know how long it'll stay up: […] BOA hasn't …
17:09 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Again a massive number of BOA bash jobs are running: […]
17:07 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
BOA is on another killing spree: […] At least 12 killall processes …
16:56 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Perhaps the suggestions posted here, 3 months ago, could be considered …
16:32 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
Another massive load spike: […] Rebooting the server again…
11:09 Ticket #884 (RE: http://news.transitionnetwork.org) updated by chris
Cc, Component, Type, Milestone changed
10:58 Ticket #884 (RE: http://news.transitionnetwork.org) updated by chris
Add Hours to Ticket, Total Hours changed
I have only just found this ticket now, does it still need action from me? …
10:52 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
I rebooted the server, once BOA finds high loads and goes on a killing …
10:40 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
The load is through the roof again, BOA is busy killing things (see the …

12/04/15:

12:08 Ticket #846 (Load Spikes on BOA PuffinServer) updated by chris
Add Hours to Ticket, Total Hours changed
[[Image(...)]] There is a on-going very high …
12:07 puffin_2015-12-04_load-day.png attached to Ticket #846 by chris
11:54 Ticket #887 (Lot's of failed logins on conference15.transitionnetwork.org) updated by chris
Add Hours to Ticket, Total Hours changed
There are a *lot* of botnets trying to brute-force WordPress admin …
11:39 Ticket #887 (Lot's of failed logins on conference15.transitionnetwork.org) created by sam
Hi all Overnight I had 150 notifications of failed login attempts and …
10:04 Ticket #692 (Debian Updates) updated by chris
Add Hours to Ticket, Total Hours changed
Debian …

12/03/15:

18:20 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
Investigating the news website as per email communications.
12:50 Ticket #886 (Re: http://news.transitionnetwork.org) updated by paul
[…]
12:45 Ticket #886 (Re: http://news.transitionnetwork.org) created by paul
[…]
12:40 Ticket #885 (Re: http://news.transitionnetwork.org) created by paul
[…]
12:40 Ticket #884 (RE: http://news.transitionnetwork.org) created by paul
[…]
12:06 Ticket #701 (Emails & Telephone calls) updated by paul
Add Hours to Ticket, Total Hours changed
The following drupal security updates have been applied this week: View …
Note: See TracTimeline for information about the timeline view.