Timeline


and

07/26/13:

21:10 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
There was a massive load spike today that resulted in BOA shutting down …
20:35 puffin-2013-07-26-load-day.png attached to Ticket #555 by chris
Puffin Load 2013-07-26

07/25/13:

23:34 Ticket #218 (Debian upgrades and updates) updated by chris
Add Hours to Ticket, Total Hours changed
New http://dotdeb.org/ PHP 5.3.27 for Debian Squeeze, …
22:47 Ticket #218 (Debian upgrades and updates) updated by chris
Add Hours to Ticket, Total Hours changed
Puffin openjdk-6 security update, …
18:15 Ticket #550 (Transition Town Totnes migration) updated by chris
Add Hours to Ticket, Total Hours changed
Regarding the comment above about the size, that was in relation to the …
18:10 TransitionTownTotnesWordPress edited by chris
(diff)
18:07 TransitionTownTotnesWordPress edited by chris
(diff)
16:57 PenguinServer edited by chris
(diff)
13:52 Ticket #550 (Transition Town Totnes migration) updated by chris
Add Hours to Ticket, Total Hours changed
The script mentioned in ticket:550#comment:1 was found at …
11:44 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by chris
Replying to chris: > > As I have said before I think we …
09:15 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) reopened by chris
I should have mentioned this earlier but users of Firefox with the EFF …
09:09 Ticket #574 (EFF: How HTTPS Everywhere affects transitionnetwork.org) created by chris
The following email was sent via the whois contact details for the …

07/23/13:

23:19 Ticket #218 (Debian upgrades and updates) updated by chris
Add Hours to Ticket, Total Hours changed
Penguin upgrades: […]

07/22/13:

09:53 Ticket #561 (Move Transition Research patterns Wagn website onto Penguin) updated by ed
Have emailed Tom researcher and asked - awaiting his go ahead

07/19/13:

12:59 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Bandwidth wise we hit a new high yesterday, over 3GB in a day: …
12:50 puffin_daily_usage_201307.png attached to Ticket #555 by chris
Puffin Webalizer 2013-07-19
11:37 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
One further thought on the mySQL Query cache, when we have a big traffic …
11:34 puffin_2013-07-19-2_mysql_queries-day.png attached to Ticket #555 by chris
Puffin 2013-07-19 Mysql Query Cache
11:33 puffin_2013-07-19_fw_packets-day.png attached to Ticket #555 by chris
Puffin 2013-07-19 Firewall Packets
11:27 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
You can see the effect of the changes to php-fpm here: …
11:21 puffin_2013-07-10_multips_memory-day.png attached to Ticket #555 by chris
Puffin 2013-07-19 Memory Usage
11:19 puffin_2013-07-19_2_phpfpm_status-day.png attached to Ticket #555 by chris
Puffin PHP-FPM 2013-07-19
11:14 Ticket #573 (MariaDB 5.5.32 is available for Puffin) closed by chris
fixed: I have done the udate using the wiki:AptitudeUpdateScript and it took less …
10:58 Ticket #561 (Move Transition Research patterns Wagn website onto Penguin) updated by chris
Summary changed
10:57 Ticket #561 (Move Transition Research patterns Wagn website onto Penguin) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to chris: > > we could start by simply using Ngnix …
10:31 penguin-2013-09-19_memory-week.png attached to Ticket #561 by chris
Penguin RAM by Week 2013-09-19
07:57 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Looking at the mumber of php-fpm processes I think we have too many spare, …
07:49 puffin_2013-07-19_phpfpm_status-day.png attached to Ticket #555 by chris
Puffin 2013-07-19 PHP-FPM Status
07:38 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
The Puffin MySQL query cache, which was set at 512MB filled up last night: …
07:19 puffin_2013-07-19_mysql_qcache_mem-day.png attached to Ticket #555 by chris
Puffin MySQL Query Cache by Day 2013-07-19
07:18 puffin_2013-07-19_mysql_connections-month.png attached to Ticket #555 by chris
Puffin MySQL Connections by Month for 2013-07-19

07/18/13:

21:13 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to jim: > OK so after a couple of days it's clear …
20:11 Ticket #573 (MariaDB 5.5.32 is available for Puffin) created by chris
I could either update this via aptitude and it would be quick and have …
14:34 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by jim
Add Hours to Ticket, Total Hours changed
Adding hours that didn't add…
14:33 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by jim
One last point: if it turns out we have low-grade DoS or a bunch of badly …
14:31 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) closed by jim
fixed: The cyan line in the attached image marks the point I changed the setting …
14:30 session_context_change.png attached to Ticket #571 by jim
14:30 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by jim
Add Hours to Ticket changed
OK so after a couple of days it's clear this was a good improvement. See …

07/17/13:

21:47 Ticket #218 (Debian upgrades and updates) updated by chris
Add Hours to Ticket, Total Hours changed
Oops, forgot to record time against the update on ticket:218#comment:105
21:34 Ticket #218 (Debian upgrades and updates) updated by chris
Parrot update: […]
21:26 Ticket #382 (Measurement and tracking requirements for TN and PSE) updated by chris
Add Hours to Ticket, Total Hours changed
On Tuesday 16th I spent the day with Ed going though Piwik stats and also …
19:56 Ticket #568 (TC blog: can't *not* send notifications) closed by ed
fixed: confirmed and closing
19:01 Ticket #568 (TC blog: can't *not* send notifications) updated by jim
Add Hours to Ticket, Total Hours changed
Done -- all CTs have their 'Updated' events notifications re-enabled on …
18:01 Ticket #568 (TC blog: can't *not* send notifications) updated by ed
following a panicked blog post going out with alerts and various view …
16:01 IIRS/firstTechReply edited by jim
(diff)
15:17 Ticket #572 (Design changes for homepage and TC section) updated by ed
Add Hours to Ticket, Total Hours changed
adding comment to add 5 hours of Ben's time all done
15:17 Ticket #572 (Design changes for homepage and TC section) created by ed
Design changes for TN homepage and TC section done by Ben to be part of …
12:43 WikiStart edited by ed
(diff)
12:42 WikiStart edited by ed
(diff)
12:34 IIRS edited by ed
(diff)
12:34 IIRS edited by ed
(diff)
12:31 IIRS/firstTechReply created by ed
12:29 IIRS created by ed
12:17 Ticket #568 (TC blog: can't *not* send notifications) updated by ed
1. it seems that the email alert is triggered on PUBLISH - ie we can work …

07/16/13:

14:19 WebStats edited by chris
(diff)
14:18 2012-2013-social-networks.png attached to WebStats by chris
2012-2013 Social Network Referers
13:15 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by jim
Note this settings change happened at around 12.50 on Tuesday 16 July for …
12:59 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) updated by jim
Add Hours to Ticket, Total Hours changed
12:59 Ticket #571 (Force HTTP for anonymous, HTTPS for logged in users) created by jim
To further reduce load and leverage the caching I've changed the Session …
11:33 WebStats edited by chris
(diff)
11:32 PiwikExport_Pagetitles_1Apr12-31Mar13.csv attached to WebStats by chris
2012 2013 top 25 page titles
11:29 WebStats edited by chris
(diff)
11:28 WebStats edited by chris
(diff)
11:26 WebStats edited by chris
(diff)
11:26 WebStats edited by chris
(diff)
11:26 WebStats edited by chris
(diff)
11:24 PiwikExport_PageURLs_1Apr12-31Mar13.csv attached to WebStats by chris
2012-2013 Top 100 URLs
11:19 WebStats edited by chris
(diff)
11:18 WebStats edited by chris
(diff)
11:11 WebStats edited by chris
(diff)
11:10 2012-2013-tn-visits.png attached to WebStats by chris
Transition Network 2012-1013 Visitors
11:10 WebStats edited by chris
(diff)
11:09 WebStats created by chris
11:04 WikiStart edited by chris
(diff)
11:03 WikiStart edited by chris
(diff)

07/15/13:

20:23 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
I have edited all the Nginx config files listed above and changed …
14:25 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Adding in the other server and we served 0.1TB of data to clients in July …
14:01 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
When looking at the Puffin Nginx access log via …

07/14/13:

22:34 Ticket #567 (Update BOA for new Redis 2.6.14) updated by chris
Add Hours to Ticket, Total Hours changed
Following the notes here wiki:PuffinServer#UpgradingBOA […] The email …
21:42 Ticket #567 (Update BOA for new Redis 2.6.14) updated by chris
I'm going to do this update now, the site might be down for a few mins, I …

07/12/13:

14:43 PuffinServer edited by chris
(diff)
14:34 PuffinServer edited by chris
(diff)
14:32 PuffinServer edited by chris
(diff)
14:29 PuffinServer edited by chris
(diff)
14:25 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
The following might, of might not be related to the issues we have been …
13:57 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Goaccess on Debian Squeeze is version 0.12-1 and this doesn't have …
13:29 WebServerLogs edited by chris
(diff)
13:29 puffin_webalizer_daily_usage_201307.png attached to WebServerLogs by chris
Puffin Webalizer stats 2013-07-12
13:28 WebServerLogs edited by chris
(diff)
13:02 WebServerLogs edited by chris
(diff)
11:50 WebServerLogs edited by chris
(diff)
11:47 AwStatsInstall edited by chris
(diff)
11:39 Ticket #218 (Debian upgrades and updates) updated by chris
Add Hours to Ticket, Total Hours changed
Puffin update, see …

07/11/13:

15:01 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Oops I forgot to add the time to that last comment.
15:01 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
I have created a new wiki page to document what tools we have for …
15:00 WebServerLogs edited by chris
(diff)
14:55 WebServerLogs edited by chris
(diff)
14:52 WebServerLogs edited by chris
(diff)
14:51 goaccess-puffin.png attached to WebServerLogs by chris
Goaccess display of Nginx log file on Puffin
14:46 WebServerLogs edited by chris
(diff)
14:45 WebServerLogs edited by chris
(diff)
14:44 logstalgia-puffin.png attached to WebServerLogs by chris
Logstalgia display of Nginx access logs on Puffin
14:44 WebServerLogs edited by chris
(diff)
14:33 WebServerLogs edited by chris
(diff)
14:32 WebServerLogs edited by chris
(diff)
14:16 PuffinServer edited by chris
(diff)
14:10 WebServerLogs created by chris
14:05 WikiStart edited by chris
(diff)
09:22 Ticket #570 (Notifications: not sending complete URL) closed by ed
invalid: hmm. this seems to be working for me now. arse. closing.

07/10/13:

14:33 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
This comment is to record the time spend in a email to the ttech list …
11:26 Ticket #569 (403s served to editors, admin very slow) updated by chris
Add Hours to Ticket, Total Hours changed
35% of the hits to the server yesterday, 16433 in total, were from one …
10:16 Ticket #563 (503 Errors) updated by chris
Add Hours to Ticket, Total Hours changed
I have done some work on the script which checks for web server errors …
10:05 ErrorCodeCheck edited by chris
(diff)
10:03 ErrorCodeCheck edited by chris
(diff)
10:02 ErrorCodeCheck edited by chris
(diff)
10:00 ErrorCodeCheck created by chris
09:36 WikiStart edited by chris
(diff)

07/09/13:

15:02 TransitionMaintenance edited by ed
(diff)
15:01 Ticket #568 (TC blog: can't *not* send notifications) updated by jim
Add Hours to Ticket, Total Hours changed
OK: 1. No idea, probably worth testing. I'd guess 'create' events go out, …
14:59 Ticket #382 (Measurement and tracking requirements for TN and PSE) updated by ed
Milestone changed
14:59 Ticket #382 (Measurement and tracking requirements for TN and PSE) updated by ed
Priority, Type changed
14:38 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
I really don't understand why I can't get AWStats working, it doesn't …
14:19 Ticket #570 (Notifications: not sending complete URL) created by ed
Notification for blog post does not include full URL. URL in …
12:27 AwStatsInstall edited by chris
(diff)
12:26 Ticket #568 (TC blog: can't *not* send notifications) updated by ed
and question 3 3. if I create a post and do not publish it, how do i send …
12:25 Screen Shot 2013-07-09 at 12.24.12.png attached to Ticket #568 by ed
Screengrab of notifications option when adding normal blog post
12:22 Ticket #569 (403s served to editors, admin very slow) updated by ed
Thanks Chris, I'm in Sheffield with you next week so let's talk then. Lots …
12:15 Ticket #568 (TC blog: can't *not* send notifications) updated by ed
SO. Please confirm: 1. notification sent on creation of node - does this …
12:10 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
To recap on where we are at with the log analysis: * AWStats - haven't …
11:32 Ticket #568 (TC blog: can't *not* send notifications) updated by jim
Obviously notifications for creation of these nodes is still enabled…
11:03 Ticket #568 (TC blog: can't *not* send notifications) updated by jim
Add Hours to Ticket, Total Hours changed
As part of the 'stop sending updates for everything!' issue, I actually …
10:52 Ticket #569 (403s served to editors, admin very slow) updated by chris
Add Hours to Ticket, Total Hours changed
There was a very significant load spike this morning, and there was also a …
09:52 puffin_load-day_2013-07-09.png attached to Ticket #569 by chris
Puffin Load 2013-07-09
09:50 puffin_phpfpm_connections-day_2013-07-09.png attached to Ticket #569 by chris
Puffin php-fpm 2013-07-09
09:49 puffin_nginx_request-day_2013-07-09.png attached to Ticket #569 by chris
Puffin Nginx Requests 2013-07-09
09:48 puffin_fw_conntrack-day_2013-07-09.png attached to Ticket #569 by chris
Puffin Firewall Connections 2013-07-09
09:47 puffin_mysql_queries-day_2013-07-09.png attached to Ticket #569 by chris
Puffin MySQL Queries 2013-07-09
08:52 Ticket #569 (403s served to editors, admin very slow) created by ed
1. Rob is getting 403s when trying to submit his work. Report from 07:12am …

07/08/13:

11:20 Ticket #568 (TC blog: can't *not* send notifications) created by ed
I can't see how to do a node edit and *not* send a notification - here …

07/04/13:

11:51 PuffinServer edited by chris
(diff)

07/02/13:

14:53 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
To import the puffin nginx logs this was tried: […] But this resulted …
14:45 PiwikImportScript edited by chris
(diff)
14:38 PiwikServer edited by chris
(diff)
14:34 PiwikImportScript edited by chris
(diff)
14:33 PiwikImportScript created by chris
14:28 PiwikServer edited by chris
(diff)
13:05 Ticket #567 (Update BOA for new Redis 2.6.14) updated by jim
[…]
12:14 AwStatsInstall edited by chris
(diff)
12:10 Ticket #567 (Update BOA for new Redis 2.6.14) created by chris
A suggestion from Jim: > BOA now includes Redis > 2.6.14 …
12:04 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
I have installed Munin nginx_vhost_traffic plugin on puffin from …

07/01/13:

14:32 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
I have done some work on the awstats config and detailed data is being …
13:59 AwStatsInstall edited by chris
(diff)
13:59 AwStatsInstall edited by chris
(diff)
13:41 AwStatsInstall edited by chris
(diff)

06/28/13:

14:33 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Replying to jim: > Chris, check out the variables in …
14:25 AwStatsInstall edited by chris
(diff)
13:22 PuffinServer edited by chris
(diff)

06/26/13:

19:02 RamUsage edited by chris
(diff)
19:00 puffin-http_loadtime-month-2013-06-26.png attached to RamUsage by chris
Puffin HTTP Monthly Loadtime 26th June 2013
15:32 Ticket #566 (Profile photo does not work) closed by ed
fixed: ignore - worked it out - put 85x85 photo in user account and it worked.
15:17 Ticket #566 (Profile photo does not work) created by ed
Using this user account: …
11:25 Ticket #564 (Subscription issues for Content Type: blog entry) updated by jim
[…]
11:11 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
I can't see the block in TC section - it's not there?

06/25/13:

21:44 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
Reading this, …
21:16 Ticket #564 (Subscription issues for Content Type: blog entry) updated by jim
Add Hours to Ticket, Total Hours changed
Switched the blocks in the tn_culture context so old subs block not …
20:46 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
Confirmed by phone. 1. Please remove the RHS subs block with all the …
20:34 Ticket #564 (Subscription issues for Content Type: blog entry) updated by jim
Add Hours to Ticket, Total Hours changed
OK new block added: …
17:36 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
1. confirmed 2. If adding the extra text to the bottom of the posts as …
17:01 Ticket #564 (Subscription issues for Content Type: blog entry) updated by jim
Add Hours to Ticket, Total Hours changed
1) Fixed... Blog types now subscribe-able. Also enabled 'By content type …
14:51 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
Description changed
14:48 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
I have made these additional changes to the my.cnf file: […] And …
14:34 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
oh god i'm going to have to change this fucking ticket again. ah well here …
14:32 Ticket #559 (Rob Hopkins blog checks to move onto TN.org) closed by ed
fixed: oh for fuck's sake it's there again. me too impatient for the cache. how …
14:28 Ticket #559 (Rob Hopkins blog checks to move onto TN.org) reopened by ed
Sorry - re-opening. Rob Hopkins' latest blog post (generated on TN.org) …
14:26 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
Description, Summary changed
14:21 Ticket #565 (Blogs breadcrumbs incorrect on listings views) created by ed
Blogs breadcrumbs are wrong at main all blogs view and one author's full …
14:20 Ticket #559 (Rob Hopkins blog checks to move onto TN.org) closed by ed
fixed: brilliant. closed. found a breadcrumb problem though which I'm adding to …
14:14 Ticket #264 (Context changes) updated by ed
Milestone changed
and moving onto next phase as we're out of time for this again!
14:13 Ticket #549 (Support with publishing process) closed by ed
fixed: Closing for now as it's done and invoiced :)
14:12 Ticket #333 (Suggestions to buttons with text in them) closed by ed
fixed
13:56 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
Description changed
13:50 RamUsage edited by chris
(diff)
13:50 RamUsage edited by chris
(diff)
13:49 penguin-swap-day-2013-06-25.png attached to RamUsage by chris
Penguin Swap Daily 20th June 2013
13:49 penguin-memory-month-2013-06-25.png attached to RamUsage by chris
Penguin Monthly Memory Usage 25th June 2013
13:48 RamUsage edited by chris
(diff)
12:04 Ticket #326 (Usability changes as per the usability report) updated by ed
Milestone changed
moving to Drupal 7/8 upgrade!
12:04 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris
Add Hours to Ticket, Total Hours changed
We just had another load spike, the high load config was switched on at …
12:04 Ticket #560 (Install drupal-based project management system onto our servers) updated by ed
Priority changed
moving to minor - in maintenance
12:03 Ticket #562 (Users being subscribed to widgets newsletter on registratoin) closed by ed
fixed
11:44 Ticket #564 (Subscription issues for Content Type: blog entry) updated by ed
This needs to be used as part of the remaining time for Jim's work on …
10:45 Ticket #564 (Subscription issues for Content Type: blog entry) created by ed
1. It is not possible to subscribe to CT 'blog' via the user account …
Note: See TracTimeline for information about the timeline view.