Context Navigation

Timeline

09/11/13:

09/10/13:

18:32 Ticket #582 (TN.org platform and sites) updated by jim: Description changed
Include Term Node Count too... Given the downtime today and the meeting …
13:57 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
Replying to jim: > does Redis-server has enough memory? I …
13:21 Ticket #588 (RSS feed caching) updated by chris: Add Hours to Ticket, Total Hours changed
For comparison with the stats for 100 requests, via 10 concurrent …
13:12 Ticket #588 (RSS feed caching) updated by chris: Add Hours to Ticket, Total Hours changed
I'd like it noted that I fundamentally disagree with making resources such …
12:15 Ticket #582 (TN.org platform and sites) updated by jim: Description changed
As part of Proposal N #590, I'll be adding …
12:10 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
OK, found this: …
11:57 Ticket #582 (TN.org platform and sites) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Adding (per Proposal N on #590): need to get latest admin menu 3.x branch. …
11:24 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
Having seen some really good looking graphs for the Redis memory and …
07:42 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by jim: Aha.. 2 things about redis: 1. I had my readings or by a factor of 5 - …

09/09/13:

20:45 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
Also, not to self and other developers: always disable * UI modules when …
20:35 Ticket #586 (New Relic Monitoring for BOA) updated by jim: Replying to chris: > Does that install all these plugins? > > …
20:32 Ticket #560 (Install drupal-based project management system onto our servers) updated by jim: Cc changed
Haven't forgotten about this but since Ed's away this can wait until his …
20:28 Ticket #590 (Drupal performance improvements) updated by jim: Note, apart from the cron tweak, and another pass at the slow query log, …
20:26 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
OK so I'm still playing! Added Elysia cron per last comment, and have set …
17:56 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
OK though I said I was done, further investigation shows that Redis …
16:46 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by jim: Add Hours to Ticket, Total Hours changed
I could be wrong, but having looked around Drupal and done some …
16:18 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by jim: Add Hours to Ticket, Total Hours changed
It looks to me like since I've upped the use of Redis caches (which stores …
16:17 mem-9sept2013-after-extra-drupal-caching.png attached to Ticket #555 by jim: 9 sept 2013 - mem usage after more Drupal caching enabled
15:40 Ticket #588 (RSS feed caching) updated by jim: Note, this code could be moved to the 'local.settings.php file for the …
15:38 Ticket #588 (RSS feed caching) closed by jim: fixed: OK, so this is done... In a …
13:59 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Proposal L added: (underway already) Review slow query log, explain …
13:47 Ticket #591 (Move MySQL temporary directory to tmpfs) created by jim: Chris, please read: …
13:29 Ticket #582 (TN.org platform and sites) updated by jim: Add Hours to Ticket, Total Hours changed
Regarding Location module patch -- our old version with the changes to the …
13:20 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
14.. Proposal K (Views Lite pager) is done on the 'main' views (blogs, …

09/08/13:

18:11 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
I've now gone through and set block caching and timeouts where appropriate …
17:18 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
Patch for this added to our repo: …
17:18 Ticket #582 (TN.org platform and sites) updated by jim: Per ticket:590#comment:28, we need to apply the patch for blockcache_alter …
17:10 Ticket #590 (Drupal performance improvements) updated by jim: Note also that the blocks on the homepage are quick/dirty to build. Some …
17:08 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
13.. More on block caching: It now works! I needed to apply a core block …

09/07/13:

19:27 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
Further to my last, it seems modules using hook_node_grants() cause …
19:20 Ticket #590 (Drupal performance improvements) updated by jim: Estimated Number of Hours, Description changed
Ensuring it's clear F has been done, even if it requires I to complete... …
19:18 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
13.. continued... OK so there's conflicting reports of if Block Cache …
17:16 Ticket #590 (Drupal performance improvements) updated by jim: Description changed
updating summary…
17:15 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
13.. F is not possible at present (without patching/changing system) …
16:33 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
12.. Onto proposal D: Check/improve views caching... The principle around …
15:23 Ticket #590 (Drupal performance improvements) updated by jim: Finally the view is now in Reports -> Tags cleanup, and has two …
15:20 Ticket #590 (Drupal performance improvements) updated by jim: I'll leave Term Node Count in place for now... we might want to do this …
15:19 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Lots of spammy things clean up, like: Bankruptcy Lawyers, Brain Injury …
15:01 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
11.. In terms of the rest of B (taxo cleanup, A done), I think we need to …
13:52 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours changed
11.. continued.. Which begs the question: Where/how are these spam …

09/06/13:

19:00 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
11.. Proposal A is done: the view in the above link can be filtered by …
18:23 Ticket #590 (Drupal performance improvements) updated by jim: Doing A: Created a new admin VBO view that allows filtering of taxo …
18:10 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Correction…
18:09 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Thanks sir. Updating description…
18:05 Ticket #590 (Drupal performance improvements) updated by ed: E: no go for now. needs discussion. A, B, D, F: yes C, G: sound sexy - …
17:55 Ticket #588 (RSS feed caching) updated by ed: Hi both, given what's going on we need to be in a utilitarian mindset. …
16:36 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Actioned: 11.. OK so I've gone ahead and done H, set up …
16:11 Ticket #590 (Drupal performance improvements) updated by jim: True... we can add back if Ed thinks it's an issue, BUT 3 years is a long …
15:27 Ticket #590 (Drupal performance improvements) updated by chris: Replying to jim: > > * created new page …
15:05 Ticket #590 (Drupal performance improvements) updated by jim: I've also added the new page (and the proposed 403/permission-denied page …
15:03 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
I just realised that 404 pages START A FREAKING SESSION! E.g. go to any …
13:59 Ticket #588 (RSS feed caching) updated by jim: Add Hours to Ticket, Total Hours changed
So we need to improve cachin, which in in order of speed looks like: 1. …
13:36 Ticket #588 (RSS feed caching) updated by jim: The handful of HTTPS Everywhere, who then also try to read an RSS feed …
13:22 Ticket #588 (RSS feed caching) updated by chris: Replying to jim: > See https://drupal.org/node/1894804 Hmm, …
13:06 Ticket #588 (RSS feed caching) updated by jim: Add Hours to Ticket, Total Hours changed
See https://drupal.org/node/1894804 So it appears SSL requests are cached …
12:56 Ticket #588 (RSS feed caching) updated by jim: Hmm... odd. This could be deliberate - looking at issue BOA/Drupal issue …
12:46 Ticket #588 (RSS feed caching) updated by chris: Add Hours to Ticket, Total Hours changed
Looking at the HTTP headers for Rob's RSS feed using lynx: […] So, …
12:44 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Well the NginX & Drupal parts are covered by the ESI module and BOA's …
12:33 Ticket #585 (TTech Meeting 5th September 2013) updated by jim: Add Hours to Ticket, Total Hours changed
I've now emailed Ben, Sarah and Amber to inform them of these tickets to …
12:24 Ticket #590 (Drupal performance improvements) updated by chris: Using ESI could make a massive difference but I expect it would be a quite …
12:20 Ticket #589 (Blocking spammers at a firewall level) updated by jim: Add Hours to Ticket, Total Hours changed
The place to enable this is /etc/csf/csf.conf in the section …
12:13 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Total Hours, Description changed
Adding missed time, and proposal F & G.
12:02 Ticket #590 (Drupal performance improvements) updated by jim: Description changed
Added proposal E: Review site features... moved old E to E.2... Ed, do …
11:52 Ticket #590 (Drupal performance improvements) updated by jim: Add Hours to Ticket, Status, Description, Total Hours changed
Work already done and sent in email, plus additional tweaks since then …
11:27 Ticket #585 (TTech Meeting 5th September 2013) updated by jim: Plus #590 Drupal performance improvements
11:27 Ticket #590 (Drupal performance improvements) created by jim: This ticket is to track the work and changes done within the Drupal sphere …
10:50 Ticket #585 (TTech Meeting 5th September 2013) updated by chris: Add Hours to Ticket, Total Hours changed
Follow up tickets regarding matters discussed in this meeting: * …
10:48 Ticket #589 (Blocking spammers at a firewall level) created by chris: At the meeting on 5th September ticket:585 one thing we discussed was that …
10:43 Ticket #588 (RSS feed caching) created by chris: At the meeting on 5th September ticket:585 one thing we discussed was …

09/05/13:

14:02 Ticket #585 (TTech Meeting 5th September 2013) updated by chris: Replying to jim: > Actually, thinking about it please DO NOT …
13:59 Ticket #587 (Puffin MySQL Tuning) updated by chris: Add Hours to Ticket, Total Hours changed
For reference this is the output of {{{perl …
13:54 Ticket #587 (Puffin MySQL Tuning) created by chris: This ticket is to track the tuning we do to MySQL on PuffinServer. See …
13:44 sql.report.log attached to Ticket #585 by jim: Processed slow query log - puffin 5 sep 2013
13:44 Ticket #585 (TTech Meeting 5th September 2013) updated by jim: Actually, thinking about it please DO NOT change the slow query time... …
12:20 Ticket #585 (TTech Meeting 5th September 2013) updated by chris: Add Hours to Ticket, Total Hours changed
TODO for Chris: - Look at CSF for blocking spammers - Look at caching of …
11:15 Ticket #586 (New Relic Monitoring for BOA) updated by chris: Replying to jim: > It's no work... The install process for BOA …
11:08 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
This issue is very much ongoing, for example this is a list of all the …
11:08 Ticket #586 (New Relic Monitoring for BOA) updated by jim: It's no work... The install process for BOA is to add the key to the …
10:59 Ticket #585 (TTech Meeting 5th September 2013) updated by chris: The main ticket the load spikes are documented on is ticket:555
10:40 Ticket #586 (New Relic Monitoring for BOA) updated by chris: Add Hours to Ticket, Total Hours changed
== Installation Implications == These are not insignificant, there are …
09:55 Ticket #585 (TTech Meeting 5th September 2013) updated by chris: Add Hours to Ticket, Total Hours changed
Some notes for the meeting. == Spam and Bots == I have changed the …
09:40 Ticket #586 (New Relic Monitoring for BOA) updated by chris: We currently have Munin stats: * …
09:35 Ticket #586 (New Relic Monitoring for BOA) created by chris: This is a ticket to document the consideration, and possible installation, …
08:47 Ticket #585 (TTech Meeting 5th September 2013) created by chris: This ticket has been created for the TTech Skype meeting due to take place …

09/04/13:

09/03/13:

09/02/13:

08/30/13:

08/29/13:

08/28/13:

08/27/13:

08/26/13:

08/25/13:

08/23/13:

08/22/13:

08/21/13:

08/20/13:

08/12/13:

08/08/13:

08/07/13:

08/06/13:

08/05/13:

08/01/13:

07/31/13:

07/30/13:

07/29/13:

07/27/13:

07/26/13:

07/25/13:

07/23/13:

23:19 Ticket #218 (Debian upgrades and updates) updated by chris: Add Hours to Ticket, Total Hours changed
Penguin upgrades: […]

07/22/13:

07/19/13:

07/18/13:

07/17/13:

07/16/13:

07/15/13:

07/14/13:

22:34 Ticket #567 (Update BOA for new Redis 2.6.14) updated by chris: Add Hours to Ticket, Total Hours changed
Following the notes here wiki:PuffinServer#UpgradingBOA […] The email …
21:42 Ticket #567 (Update BOA for new Redis 2.6.14) updated by chris: I'm going to do this update now, the site might be down for a few mins, I …

07/12/13:

07/11/13:

07/10/13:

07/09/13:

07/08/13:

11:20 Ticket #568 (TC blog: can't *not* send notifications) created by ed: I can't see how to do a node edit and *not* send a notification - here …

07/04/13:

07/02/13:

07/01/13:

06/28/13:

06/26/13:

06/25/13:

06/24/13:

06/23/13:

06/22/13:

06/21/13:

15:03 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
I have scripted copying the nginx access log to penguin just before it …
11:48 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
The top command usually displayes one line for all the CPU activity: …
10:48 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
There were several times over night when the load was such that …

06/20/13:

06/19/13:

23:25 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
These are the times php-fpm was stopped/killed in the last few days: …
22:08 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
Regarding getting a better idea about what Nginx by processing the logs, …
21:27 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
Looking at /opt/local/etc/php53-fpm.conf: […] This seems quite …
20:54 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
Latest running total of 50x errors for today: […] One thought, the …
17:55 Ticket #382 (Measurement and tracking requirements for TN and PSE) updated by ed: […]
14:51 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
I have changed these things in the /opt/local/etc/php53-fpm.conf …
12:25 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
Following our phone call, ideas we are going to try: * Jim - firewall * …
12:16 Ticket #563 (503 Errors) updated by chris: Add Hours to Ticket, Total Hours changed
I have copied the script we have to find 502 errors in the nginx logs and …
11:59 Ticket #563 (503 Errors) created by chris: The BOA /var/xdrago/second.sh script is run every minute via the …
11:30 Ticket #555 (Load spikes causing the TN site to be stopped for 15 min at a time) updated by chris: Add Hours to Ticket, Total Hours changed
The site went down again this morning for 5 mins. == Email Alerts == …

06/18/13:

06/17/13:

Context Navigation

Timeline

09/11/13:

09/10/13:

09/09/13:

09/08/13:

09/07/13:

09/06/13:

09/05/13:

09/04/13:

09/03/13:

09/02/13:

08/30/13:

08/29/13:

08/28/13:

08/27/13:

08/26/13:

08/25/13:

08/23/13:

08/22/13:

08/21/13:

08/20/13:

08/12/13:

08/08/13:

08/07/13:

08/06/13:

08/05/13:

08/01/13:

07/31/13:

07/30/13:

07/29/13:

07/27/13:

07/26/13:

07/25/13:

07/23/13:

07/22/13:

07/19/13:

07/18/13:

07/17/13:

07/16/13:

07/15/13:

07/14/13:

07/12/13:

07/11/13:

07/10/13:

07/09/13:

07/08/13:

07/04/13:

07/02/13:

07/01/13:

06/28/13:

06/26/13:

06/25/13:

06/24/13:

06/23/13:

06/22/13:

06/21/13:

06/20/13:

06/19/13:

06/18/13:

06/17/13:

06/13/13:

Download in other formats: