Transition Technology: Ticket Query

#502: patterns sub-domain for transitionresearchnetwork.org, was: Setting up specific pointer for URL

ed — Wed, 27 Feb 2013 07:10:03 GMT

Can we set this URL:
www.transitionresearchnetwork.org/research-guidelines
to point to this location:
https://cldstr.com/docs/configure-dns
While this URL:
www.transitionresearchnetwork.org/
Still points to the current location.
~~~~
Ed Mitchell: Transition Network Web manager
web: http://transitionnetwork.org
project blog: http://transitionnetwork.org/blogs/ed-mitchell
mobile: +44 (0)7807 141 828
office hours: Mon, Tues, Wed, Thurs
company no. 6135675  charity no. 1128675
Subscribe to Transition news: http://tinyurl.com/transitionregister
~~~~

#528: patterns.transitionresearchnetwork.org DNS update

chris — Tue, 26 Mar 2013 09:58:13 GMT

Request from Ethan:

We've moved the site back to the production server. Would you be willing to set the CNAME for patterns.transitionresearchnetwork.org to patterns.transitionresearchnetwork.org.230.cldstr.com?

See also previous tickets ticket:482 and ticket:502

#557: Set up a re-direct

ed — Tue, 04 Jun 2013 15:21:18 GMT

Please can you set up two re-direct/pointers

from: "power.transitionnetwork.org" to: "http://www.transitionnetwork.org/power-just-doing-stuff"

AND

from: "http://www.thepowerofjustdoingstuff.org" (we own in gandi) to: "http://www.transitionnetwork.org/power-just-doing-stuff"

#878: Reconomy.org add subdomains

ade — Thu, 15 Oct 2015 11:35:03 GMT

Hi Chris,
I thought I had added this as a ticket, but does not seem to have come
through.
I have had a request to add the following to the reconomy.org website.
I notice that i do not have permission to do this myself via gandi.net so
could you please add for me.
many thanks
Ade
We're going to need to point the REfund API to a particular subdomain
of the reconomy.org domain in the next few weeks. This will also apply
to the frontend. Is there anyone I can email about this?
Here are the proposed subdomains:
funds.reconomy.org
api.funds.reconomy.org
Both subdomains should point to this IP: 178.62.93.215
--
Ade Stuart
Web Manager - Transition network
07595 331877
The Transition Network is a registered charity
address: 43 Fore St, Totnes, Devon, TQ9 5HN, UK
website: www.transitionnetwork.org
TN company no: 6135675 TN charity no: 1128675

#613: Parrot mysql console errors

chris — Mon, 04 Nov 2013 09:48:35 GMT

I connected to the wiki:ParrotServer wiki:XenShell to check the bandwidth usage and there was the following output, we should try to track down the cause of this:

parrot login: [41569.058444] hrtimer: interrupt took 59422559 ns
[442920.164115] INFO: task mysqld:3522 blocked for more than 120 seconds.
[442920.164133] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[442920.164142] mysqld        D ffff880003755c40     0  3522    711 0x00000000
[442920.164153]  ffff8800bfa68e20 0000000000000282 ffff8800565fb9e8 ffff8800565fb9e4
[442920.164165]  00000000000157c8 0000000000000000 000000000000f9e0 ffff8800565fbfd8
[442920.164175]  00000000000157c0 00000000000157c0 ffff88000180c6a0 ffff88000180c998
[442920.164185] Call Trace:
[442920.164200]  [<ffffffff8110fb96>] ? sync_buffer+0x0/0x40
[442920.164211]  [<ffffffff8130de82>] ? io_schedule+0x73/0xb7
[442920.164219]  [<ffffffff8110fbd1>] ? sync_buffer+0x3b/0x40
[442920.164228]  [<ffffffff8130f142>] ? _spin_unlock_irqrestore+0xd/0xe
[442920.164237]  [<ffffffff8130e292>] ? __wait_on_bit_lock+0x3f/0x84
[442920.164246]  [<ffffffff8110fb96>] ? sync_buffer+0x0/0x40
[442920.164253]  [<ffffffff8130e342>] ? out_of_line_wait_on_bit_lock+0x6b/0x77
[442920.164262]  [<ffffffff81066360>] ? wake_bit_function+0x0/0x23
[442920.164271]  [<ffffffff8110ffc3>] ? sync_dirty_buffer+0x29/0x93
[442920.164286]  [<ffffffffa001be04>] ? journal_dirty_data+0xd1/0x1b0 [jbd]
[442920.164301]  [<ffffffffa0032f4c>] ? ext3_journal_dirty_data+0xf/0x34 [ext3]
[442920.164312]  [<ffffffffa00313f5>] ? walk_page_buffers+0x65/0x8b [ext3]
[442920.164322]  [<ffffffffa0032f71>] ? journal_dirty_data_fn+0x0/0x13 [ext3]
[442920.164333]  [<ffffffffa0034a93>] ? ext3_ordered_write_end+0x73/0x10f [ext3]
[442920.164343]  [<ffffffff810b648a>] ? generic_file_buffered_write+0x18d/0x278
[442920.164352]  [<ffffffff810b6926>] ? __generic_file_aio_write+0x25f/0x293
[442920.164361]  [<ffffffff810b69b3>] ? generic_file_aio_write+0x59/0x9f
[442920.164369]  [<ffffffff810f0316>] ? do_sync_write+0xce/0x113
[442920.164377]  [<ffffffff81066332>] ? autoremove_wake_function+0x0/0x2e
[442920.164385]  [<ffffffff8130f6fa>] ? error_exit+0x2a/0x60
[442920.164394]  [<ffffffff8101251d>] ? retint_restore_args+0x5/0x6
[442920.164403]  [<ffffffff8102de30>] ? pvclock_clocksource_read+0x3a/0x8b
[442920.164411]  [<ffffffff810f0c68>] ? vfs_write+0xa9/0x102
[442920.164419]  [<ffffffff810f0d7d>] ? sys_write+0x45/0x6e
[442920.164427]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b
[442920.164435] INFO: task mysqld:21061 blocked for more than 120 seconds.
[442920.164441] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[442920.164448] mysqld        D ffff8800018b0e20     0 21061    711 0x00000000
[442920.164457]  ffff8800018b0e20 0000000000000282 ffffffff8100c426 ffffffff8100e233
[442920.164469]  ffff880003755d10 0000000000000002 000000000000f9e0 ffff8800bdde3fd8
[442920.164480]  00000000000157c0 00000000000157c0 ffff8800bd9462e0 ffff8800bd9465d8
[442920.164492] Call Trace:
[442920.164498]  [<ffffffff8100c426>] ? pfn_to_mfn+0xe/0x22
[442920.164506]  [<ffffffff8100e233>] ? arbitrary_virt_to_machine+0x28/0x73
[442920.164515]  [<ffffffff8110fb96>] ? sync_buffer+0x0/0x40
[442920.164523]  [<ffffffff8106ce4a>] ? timekeeping_get_ns+0xe/0x2e
[442920.164531]  [<ffffffff8110fb96>] ? sync_buffer+0x0/0x40
[442920.164538]  [<ffffffff8130de82>] ? io_schedule+0x73/0xb7
[442920.164545]  [<ffffffff8110fbd1>] ? sync_buffer+0x3b/0x40
[442920.164554]  [<ffffffff8130f142>] ? _spin_unlock_irqrestore+0xd/0xe
[442920.164561]  [<ffffffff8130e292>] ? __wait_on_bit_lock+0x3f/0x84
[442920.164569]  [<ffffffff8110fb96>] ? sync_buffer+0x0/0x40
[442920.164576]  [<ffffffff8130e342>] ? out_of_line_wait_on_bit_lock+0x6b/0x77
[442920.164584]  [<ffffffff81066360>] ? wake_bit_function+0x0/0x23
[442920.164592]  [<ffffffff8110ffc3>] ? sync_dirty_buffer+0x29/0x93
[442920.164600]  [<ffffffffa001be04>] ? journal_dirty_data+0xd1/0x1b0 [jbd]
[442920.164611]  [<ffffffffa0032f4c>] ? ext3_journal_dirty_data+0xf/0x34 [ext3]
[442920.164622]  [<ffffffffa00313f5>] ? walk_page_buffers+0x65/0x8b [ext3]
[442920.164632]  [<ffffffffa0032f71>] ? journal_dirty_data_fn+0x0/0x13 [ext3]
[442920.164643]  [<ffffffffa0034a93>] ? ext3_ordered_write_end+0x73/0x10f [ext3]
[442920.164652]  [<ffffffff810b648a>] ? generic_file_buffered_write+0x18d/0x278
[442920.164661]  [<ffffffff810b6926>] ? __generic_file_aio_write+0x25f/0x293
[442920.164670]  [<ffffffff810b69b3>] ? generic_file_aio_write+0x59/0x9f
[442920.164677]  [<ffffffff810f0316>] ? do_sync_write+0xce/0x113
[442920.164685]  [<ffffffff81066332>] ? autoremove_wake_function+0x0/0x2e
[442920.164693]  [<ffffffff810f0c68>] ? vfs_write+0xa9/0x102
[442920.164700]  [<ffffffff810f0d18>] ? sys_pwrite64+0x57/0x77
[442920.164706]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b

#618: Migrate Penguin and Parrot to the ZFS fileserver

chris — Fri, 15 Nov 2013 09:37:36 GMT

Since wiki:PuffinServer has been running from the ZFS fileserver, see ticket:593, it has been performing better -- we should also migrate wiki:PenguinServer and wiki:ParrotServer to the ZFS server prior to upgrading them to Debian Wheezy on ticket:535.

#632: Add accounts for Sam

chris — Mon, 25 Nov 2013 14:41:25 GMT

Following ticket:534

#641: Enable dynamic Munin graphs

chris — Mon, 02 Dec 2013 15:25:45 GMT

If we only generate munin graphs on the fly we will also get the zoom function working, this example config looks good: http://uname.pingveno.net/blog/index.php/post/2013/08/25/Configure-Munin-graphs-with-Nginx-and-Debian-7

#666: Parrot lockups

chris — Wed, 08 Jan 2014 11:31:16 GMT

We have this on the console, I'm going to reboot it:

[28800.164426]  [<ffffffffa001c1ba>] ? do_get_write_access+0x22c/0x452 [jbd2]
[28800.164435]  [<ffffffff81066360>] ? wake_bit_function+0x0/0x23
[28800.164443]  [<ffffffff8104b51c>] ? try_to_wake_up+0x289/0x29b
[28800.164453]  [<ffffffffa001c402>] ? jbd2_journal_get_write_access+0x22/0x33 [jbd2]
[28800.164475]  [<ffffffffa006289e>] ? __ext4_journal_get_write_access+0x4e/0x56 [ext4]
[28800.164492]  [<ffffffffa0042b8e>] ? ext4_reserve_inode_write+0x37/0x73 [ext4]
[28800.164508]  [<ffffffffa0042c05>] ? ext4_mark_inode_dirty+0x3b/0x1c4 [ext4]
[28800.164528]  [<ffffffffa005bdc7>] ? ext4_journal_start_sb+0xd4/0x10e [ext4]
[28800.164543]  [<ffffffffa0042eb0>] ? ext4_dirty_inode+0x30/0x46 [ext4]
[28800.164553]  [<ffffffff81109ead>] ? __mark_inode_dirty+0x25/0x14a
[28800.164560]  [<ffffffff8110138b>] ? file_update_time+0x101/0x130
[28800.164569]  [<ffffffff810b6835>] ? __generic_file_aio_write+0x16e/0x293
[28800.164578]  [<ffffffff810b69b3>] ? generic_file_aio_write+0x59/0x9f
[28800.164588]  [<ffffffff810f0316>] ? do_sync_write+0xce/0x113
[28800.164596]  [<ffffffff810fcd0c>] ? filldir+0x0/0xb7
[28800.164605]  [<ffffffff810549b1>] ? _local_bh_enable_ip+0x22/0x8f
[28800.164613]  [<ffffffff81066332>] ? autoremove_wake_function+0x0/0x2e
[28800.164626]  [<ffffffff8130f1a1>] ? _spin_lock_bh+0x9/0x25
[28800.164626]  [<ffffffff810f0c68>] ? vfs_write+0xa9/0x102
[28800.164632]  [<ffffffff810f0d18>] ? sys_pwrite64+0x57/0x77
[28800.164639]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b
[28800.164657] INFO: task apache2:31559 blocked for more than 120 seconds.
[28800.164665] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[28800.164675] apache2       D 0000000000000000     0 31559  28011 0x00000000
[28800.164691]  ffffffff8149f1f0 0000000000000286 0000000000000000 ffffffff81274f4f
[28800.164711]  ffff880002dc99d8 ffff8800bd1ca000 000000000000f9e0 ffff880002dc9fd8
[28800.164730]  00000000000157c0 00000000000157c0 ffff8800bd9746a0 ffff8800bd974998
[28800.164752] Call Trace:
[28800.164762]  [<ffffffff81274f4f>] ? sch_direct_xmit+0x7f/0x14c
[28800.164773]  [<ffffffff81066253>] ? bit_waitqueue+0x10/0xa0
[28800.164787]  [<ffffffffa001c1ba>] ? do_get_write_access+0x22c/0x452 [jbd2]
[28800.164798]  [<ffffffff81066360>] ? wake_bit_function+0x0/0x23
[28800.164812]  [<ffffffffa001c402>] ? jbd2_journal_get_write_access+0x22/0x33 [jbd2]
[28800.164833]  [<ffffffffa006289e>] ? __ext4_journal_get_write_access+0x4e/0x56 [ext4]
[28800.164852]  [<ffffffffa0042b8e>] ? ext4_reserve_inode_write+0x37/0x73 [ext4]
[28800.164871]  [<ffffffffa0042c05>] ? ext4_mark_inode_dirty+0x3b/0x1c4 [ext4]
[28800.164890]  [<ffffffffa005bdc7>] ? ext4_journal_start_sb+0xd4/0x10e [ext4]
[28800.164908]  [<ffffffffa0042eb0>] ? ext4_dirty_inode+0x30/0x46 [ext4]
[28800.164921]  [<ffffffff81109ead>] ? __mark_inode_dirty+0x25/0x14a
[28800.164932]  [<ffffffff8110138b>] ? file_update_time+0x101/0x130
[28800.164943]  [<ffffffff810b6835>] ? __generic_file_aio_write+0x16e/0x293
[28800.164958]  [<ffffffff8125227b>] ? sock_aio_write+0x0/0xbc
[28800.164969]  [<ffffffff8100cc43>] ? xen_make_pte+0x7b/0x83
[28800.164980]  [<ffffffff810b69b3>] ? generic_file_aio_write+0x59/0x9f
[28800.164992]  [<ffffffff810f0316>] ? do_sync_write+0xce/0x113
[28800.165003]  [<ffffffff81066332>] ? autoremove_wake_function+0x0/0x2e
[28800.165015]  [<ffffffff810ce24c>] ? handle_mm_fault+0x3b8/0x80f
[28800.165027]  [<ffffffff810f0c68>] ? vfs_write+0xa9/0x102
[28800.165038]  [<ffffffff810f0d7d>] ? sys_write+0x45/0x6e
[28800.165049]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b
[125024.867759] hrtimer: interrupt took 38561246 ns
[1412520.196163] INFO: task mysqld:7928 blocked for more than 120 seconds.
[1412520.196183] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[1412520.196191] mysqld        D 0000000000000000     0  7928  18454 0x00000000
[1412520.196203]  ffff8800bfa69530 0000000000000286 0000000000000000 0000000000000000
[1412520.196215]  0007ffffffffffff 0000000000000001 000000000000f9e0 ffff880074cb5fd8
[1412520.196226]  00000000000157c0 00000000000157c0 ffff880002ce1530 ffff880002ce1828
[1412520.196236] Call Trace:
[1412520.196259]  [<ffffffffa00232bf>] ? jbd2_log_wait_commit+0xbf/0x112 [jbd2]
[1412520.196273]  [<ffffffff81066332>] ? autoremove_wake_function+0x0/0x2e
[1412520.196293]  [<ffffffffa003fb41>] ? ext4_sync_file+0x199/0x25c [ext4]
[1412520.196304]  [<ffffffff8110d6e0>] ? vfs_fsync_range+0x73/0x9e
[1412520.196319]  [<ffffffff8110d78a>] ? do_fsync+0x28/0x39
[1412520.196325]  [<ffffffff8110d7b9>] ? sys_fsync+0xb/0x10
[1412520.196333]  [<ffffffff81011b63>] ? sysret_check+0x17/0x5a
[1412520.196341]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b

#739: Set up DEV and other drupal accounts for Annesley

ed — Wed, 11 Jun 2014 14:38:42 GMT

is this you chris? or a sam job? or paul?

#771: cannot access puffin over sftp again

annesley — Tue, 05 Aug 2014 09:24:10 GMT

not sure what happened this time. my connection to other servers is fine. i am using:

sftp://tn.ftp@puffin.transitionnetwork.org/static/transition-network-d6-32-s002-booker/

the password was accepted first time and i successfully navigated to /static

which worked until i tried to get to the transition-network-d6-32-s002-booker directory. now ssh fails also.

when i ssh in i get plenty of warnings and potential lock outs when i try various things. like trying to access /static.

#780: parrot

annesley — Wed, 27 Aug 2014 14:35:51 GMT

can't access parrot again also: it re-requests my password very quickly. what is the session timeout?

also: i cannot include my files. seems that the website is located under the /home/annesley directory. is this some sort of strange setup because the PHP cannot see that area. and i cannot cd to the root through SFTP...

#713: Ticket clearing

chris — Wed, 02 Apr 2014 09:30:31 GMT

There are 33 Open Maintenance Tickets this ticket is to record the time taken to close as many of them as possible.

#786: GitHub Transition: Annesley needs permission to create repositories

annesley — Mon, 15 Sep 2014 07:17:03 GMT

is Paul the owner of Transition GitHub??

#207: Logwatch Issues

chris — Fri, 17 Dec 2010 14:19:50 GMT

This is a ticket to track items that show up in the logwatch emails to root and often just take a few mins of reading time and response.

Any issues that look like they might take longer than a few mins should have their own tickets opened.

#208: Dblog Issues

chris — Fri, 17 Dec 2010 14:53:29 GMT

"The dblog module monitors your website, capturing system events in a log to be reviewed by an authorized individual at a later time. The dblog log is simply a list of recorded events containing usage data, performance data, errors, warnings and operational information. It is vital to check the dblog report on a regular basis as it is often the only way to tell what is going on."

https://www.transitionnetwork.org/admin/reports/dblog

This is a ticket to be used to flag up issues that are not going to take up enough time that they justify their own ticket -- if an issue is raised in a comment on this ticket that does look like it's going to take some significant time then best start a new ticket for it.

#548: All Admin functions broken on TN.org

ed — Tue, 14 May 2013 07:50:15 GMT

Admins, editors, social reporters cannot create content on TN.org. Choosing to create content leads to homepage. Can't do anything on the admin menu.

Emergency.

#568: TC blog: can't not send notifications

ed — Mon, 08 Jul 2013 10:20:16 GMT

I can't see how to do a node edit and *not* send a notification - here seen on the Transition Culture blog:

https://www.transitionnetwork.org/node/32863/edit

please advise - there's been some kerfuffle about the TC blog move so swift resolution much appreciated

#571: Force HTTP for anonymous, HTTPS for logged in users

jim — Tue, 16 Jul 2013 11:59:54 GMT

To further reduce load and leverage the caching I've changed the Session 443 settings to force anon users to HTTP and logged in to HTTPS. The benefit of allowing a handful of users to choose is tiny compared the downsides of outages, 503s and higher load.

The "User state" setting on the config page is now " Redirect authenticated users to HTTPS and redirect anonymous users to HTTP (with the exception of login/registration pages).", was "Redirect authenticated users to HTTPS and redirect anonymous users on login/registration pages to HTTPS. Anonymous users visiting other pages may use HTTP or HTTPS."

I've also set user and site-wide contact forms, plus the mailchimp subs page force secure-only per the "Additional pages to make secure" setting.

We can see if this makes a difference, and this ticket is to track comments and see if it results in any improvement in performance/stability.

#575: User system is blocking everyone - needs fixing urgently

ed — Wed, 31 Jul 2013 14:39:11 GMT

Everyone who registers for the last two weeks is being blocked - check user list and see screengrab. Needs fixing promptly.

#581: Remove 'add to newsletter' option for site editors/admins

ed — Mon, 26 Aug 2013 13:24:17 GMT

Please remove the option for site editors/admins to 'add this to the newsletter' (which would send it to the newsletter nodequeue). Please also for now make the newsletter nodequeue non-active.

It's been confusing for staff members, and was for the simmplemail service really, so we're going to trial using a google doc for staff to add their stories to the newsletter instead.

#584: News CTs and featured images: not handling as expected

ed — Wed, 04 Sep 2013 08:33:12 GMT

The news CT has a featured image, but it doesn't seem to be handling it as expected (succesfully on the blogs). See this news item:

https://www.transitionnetwork.org/news/2013-09-03/new-economy-20-enterprises-report-released

The featured image isn't visible anywhere - either:

in the news item itself
in the /news view

Please investigate and resolve

#602: RSS problems

ed — Thu, 03 Oct 2013 09:14:43 GMT

Blogs feed not working:

https://www.transitionnetwork.org/blogs/feed/

Rob's blog not working:

https://www.transitionnetwork.org/blogs/feed/rob-hopkins

Getting complaints from users who are getting multiple copies of each blog post. Can't check this as the feed is down, but I've got 2 or 3 complaints in my inbox.

#608: User profile pictures are too big

ed — Mon, 14 Oct 2013 08:37:38 GMT

The user profile pictures on the user profile nodes are too big.

e.g. https://transitionnetwork.org/people/tina-clarke

Please investigate and restrain them into a suitable maximum size

NB: Ed is keeping a number of small UI-ish tickets back for Ben to do in a lump when we've built up enough so don't do anything yet.

#614: Subscription option for Social Reporters CT

ed — Wed, 06 Nov 2013 16:49:49 GMT

We want a button on the Social Reporters section that enables users to easily subscribe to the Social Reporters' blog posts CT. Offers the option to all types of user:

Users may not be logged in
Users may not be registered

This is a bit like the sub button on Transition Culture section
I can't find it in TRAC but have this memory of enabling email-only subscriptions to not-registered-users from olden days - can you enlighten me about that? I'm not sure it's the answer - we probably want them to register so they can add comments - but this request has brought up that old function

#615: Move to GMap 6.x-2.x-dev as and get clusterer to work

jim — Sun, 10 Nov 2013 18:14:51 GMT

This is largely done, but the only tasks left are:

Make a patch and add to our makefile so our custom markers appear ok.
Get the clusterer to work per the comments & issues in comment:1 below.

Per an email I got from Google:

As you may be aware, JavaScript? Maps API v2 was scheduled for shutdown on May 19, 2013. After listening to feedback from developers we decided to extend the deprecation timeline by six months, to November 19, 2013 to allow more time for migration to v3 of the API.

On November 19, 2013 we will deploy a JavaScript? wrapper that attempts to automagically turn remaining v2 maps into v3 maps. Though we expect this wrapper to work for most simple maps, we cannot guarantee that your maps will continue to function. We therefore highly recommend that you migrate to v3 before November 19. The good news is that Google Maps JavaScript? API v3 is more robust and feature rich than v2, and we’ve written a guide to assist the migration.

So this ticket is to do the update to the GMap module, testing and tweaking.

Critical as we only have until 19 November for this...

#617: Help adding text to account creation email

ed — Mon, 11 Nov 2013 17:16:37 GMT

I want to add a link to the email a user receives following their creation of an account.

this one: Subject: Account details for [user] at Transition Network

Can I do this myself? I've looked in subs, notifications, logintoboggan etc. and can't find the place

is it do-able?

#621: Check and speed up updates to homepage sections: TC and slideshow

ed — Mon, 18 Nov 2013 09:22:59 GMT

Two bits of the homepage are taking ages to update once Rob has made the changes and it's driving him spare. He's waiting up to 30 mins for them to update.

Please speed up the times that it takes the system to update these two parts of the homepage to *instant* if possible:

Slideshow on homepage (AKA: https://www.transitionnetwork.org/admin/build/views/edit/slideshows?destination=newhome#views-tab-panel_pane_1).

Latest Transition Culture Blog pane on Homepage (AKA https://www.transitionnetwork.org/admin/build/views/edit/tc_latest_blog?destination=newhome#views-tab-block_1)

#622: Maps not working on TN.org

ed — Mon, 18 Nov 2013 17:06:59 GMT

https://www.transitionnetwork.org/initiatives/map https://www.transitionnetwork.org/initiatives/exeter-nh-transition-town

please attend

#624: Comment handling on pages: particularly Austerity one

ed — Tue, 19 Nov 2013 11:16:02 GMT

Rob is doing an austerity special over 8 days, with a different clip from an interview with NEF every day. I've set up a page here: /austerity-basics

Question:

I know we can handle comments on pages, and I know that I don't get notifications of them. Can we arrange comment notifications for a page - asap - so that commenters get updates?

If not, no problem. I heard about this plan *today* so am not expecting any massive tech leaps.

#628: Change space notifications email from IJK.co.uk to TN.org

ed — Thu, 21 Nov 2013 16:50:37 GMT

The space notifications are coming from "space.transitionnetwork.org" <jim@…>

can you make them from "space.transitionnetwork.org" and a suitable TN address?

Do I need to set up a suitable TN address? Perhaps

space@…?

Or is there a standard drupal system one in place already?

#633: RHS blocks changes for homepage

ed — Mon, 25 Nov 2013 15:27:15 GMT

Re-arrange/add/edit the RHS blocks to appear the order below

Why/how etc. : NO change
newsletter promo: NO change
POJDS book button: much smaller - can you set book image to lhs and buy button to rhs within block? might need a special .png to have both in it
Transition nearby button: NO change
New iT2 film promo button: needs a graphic
New TFP button: NEW: Trucie providing a graphic to fit in
Training button: NEW: Ed asking for training graphic to fit in
Social media promo button: NEW: needs some very modest SM logos to link to SM outposts FB and twitter

NB: Rob is only thinking of the homepage; Ed is not sure of the implications elsewhere on site... please advise on how/if this affects things elsewhere...

#637: What is the wordcount for the /news and /blogs/rob-hopkins teasers?

ed — Thu, 28 Nov 2013 09:40:48 GMT

http://www.transitionnetwork.org/news http://www.transitionnetwork.org/blogs/rob-hopkins

what is the teaser length - ie the first paragraph of a news or blog item that is published in the listings views?

rob wants to know how many words he has for his introductions...

#648: Edit the contact form reply in January

ed — Thu, 12 Dec 2013 10:49:39 GMT

Ed has edited the contact form replies for webproject@… on the contact form for TN.org which will now reply to users saying this:

"Thank you for getting in touch. Please note that the website support is part time; and between mid-December 2013 and mid-January 2014 we are handing over the website support work as Ed goes on Paternity leave and Sam comes onboard, so please be patient - your replies are likely to take more time than usual. "

https://www.transitionnetwork.org/admin/build/contact

SAM - when you are ready - probably mid-Jan - you will want to edit this back to something more suitable like:

Thank you for getting in touch. Please note that the website support is part time, so while we will get back to you as soon as we can, that may be a few days

#649: Add commenting to /films/ content type in January

ed — Thu, 12 Dec 2013 10:53:16 GMT

seen here:

https://www.transitionnetwork.org/admin/content/node-type/films

https://www.transitionnetwork.org/films https://www.transitionnetwork.org/films/occupy-love

#650: Helping TN strategy consultation with online publishing

ed — Thu, 12 Dec 2013 11:00:08 GMT

Sarah will be working on the TN strategy and this is about the content and comms tactics therein. The guiding principle is to use TN.org as the most suitable place for this material and conversations, and social media and direct mailshots for marketing and communicating it (because Sarah/TN cannot manage multiple conversations in multiple locations atm).

This is work for Sam to do from January onwards

set up a landing page ".../TN-strategy-consultation" with its own RHS block with manual links to different documents and interviews

SAM this can be a normal page with anchor links etc.

Use of blogs
Rob's for outreach - it's got the momentum - for updates/alerts/subscriptions
Sarah's for continuity (and looking back at it) - using tag "fn-strategy-consultation"

other places for comms/engagement
Forums not good; too open to trolls and spam; better in blog comments
webinar? Possibly if suitable
FB, twitter, other marketing channels - for marketing only
online meeting with national hubs - quite possibly

Direct Mail shot to PPOCs
Sarah Let Sam know if this is happening; Sam you'll need to do an export of PPOCs (https://www.transitionnetwork.org/admin/reports/initiatives/primary-contacts), tidy and dump into mail chimp using the standard template

#651: Report for tools content type

ed — Thu, 12 Dec 2013 11:33:22 GMT

For January: set up a report for tools content type:

downloadable in .xls
tool title
URL (must be a hyperlink generated in .csv)
node reference

No tools report exists yet - but lots of others here: https://www.transitionnetwork.org/admin/reports

#652: Report for resource content type

ed — Thu, 12 Dec 2013 11:34:49 GMT

For January: set up a report for tools content type:

downloadable in .xls
resource title
URL (must be a hyperlink generated in .csv)
node reference

you will be able to work from this report: https://www.transitionnetwork.org/admin/reports/resources

#653: Report for ingredients content type

ed — Thu, 12 Dec 2013 11:36:53 GMT

For January: set up a report for ingredients content type:

downloadable in .xls
ingredient title
URL (must be a hyperlink generated in .csv)
node reference

No ingredients report exists yet - but lots of others here: https://www.transitionnetwork.org/admin/reports

#654: TIs appearing in 'TIs by list' view without a number

ed — Thu, 12 Dec 2013 12:43:12 GMT

Some TIs are appearing in the 'Initiatives by number' view - but don't have numbers:

https://www.transitionnetwork.org/initiatives/by-number

for Sam to invesitage and solve or put to techs in January

#657: Homepage slideshow: can't order the images

ed — Mon, 16 Dec 2013 14:30:49 GMT

Big picture slideshow on TN homepage: Rob can't get it to go in the order he wants - please investigate:

It is this nodequeue: https://www.transitionnetwork.org/admin/content/nodequeue/9/view/8

Made up with these CTs: https://www.transitionnetwork.org/admin/content/node-type/slide

#658: Check caching on Social Reporters views

ed — Mon, 16 Dec 2013 14:59:38 GMT

The SRs are reporting very slow site updates - is this to do with not switching them over to the new views content caching? please check:

https://www.transitionnetwork.org/admin/build/views/edit/blogs?destination=stories#views-tab-panel_pane_2

https://www.transitionnetwork.org/admin/build/block/configure/views/blogs-block_1?destination=newhome

And elsewhere there may be SR latest views?

#659: Featured story on homepage not updating

ed — Mon, 16 Dec 2013 17:03:41 GMT

Rob cleared the nodequeue for the featured story on the homepage about three hours ago, removed all but one story. No change has been observed. Please investigate:

Nodequeue: https://www.transitionnetwork.org/admin/content/nodequeue/6/view/5

This view: https://www.transitionnetwork.org/admin/build/views/edit/featured_content?destination=newhome#views-tab-panel_pane_1

This is using content cache

#663: De-commission the PSE

ed — Wed, 18 Dec 2013 17:44:43 GMT

We are wrapping up the PSE to simplify our web traffic, codebase and support requirements before we move to TNv3.

Ed has informed all the PSE alpha triallists twice and asked them to remove their widgets. About half have. Others say they will. So we can remove the service any time from now on.

Ed has UNpublished the following pages:

/pse/create
/pse/about
/pse/faq

Jim - time to de-commission the service in a suitable way. Wrap this puppy up and turn it off. Please outline what you are going to do on this ticket and then do it.

Ed suggests this is work for January 2014.

Sam, Chris, fyi and any other changes needed?

#667: Development handover process

ed — Wed, 08 Jan 2014 16:40:47 GMT

Work by the Ttech team to share Jim's knowledge and tasks around the team before he leaves in early February 2014. Please use this ticket to log your time spent on this.

#679: Filter Initiative by Country not working

sam — Fri, 17 Jan 2014 17:15:58 GMT

Filtering the initiatives by country is not working

https://www.transitionnetwork.org/initiatives?themes=All&community_type=All&status_value=All&country=at&field_title_search=

I had a play with the view on stg2.transitionnetwork.org but I couldn't get it working.

It should display only initiatives from the country selected in the filter. It is displaying initiatives from all countries & not respecting the filter.

This view is used a lot by international initiatives.

#693: Module security updates: February 2014

sam — Thu, 27 Feb 2014 16:18:04 GMT

Hi Paul

You'll see from this ticket; https://trac.transitionnetwork.org/trac/ticket/582

That the 6.29 > 6.30 core update patches bugs that don't affect us.

However some recent security updates for modules have been released recently; https://www.transitionnetwork.org/admin/reports/updates

Affected modules are;

ctools; https://drupal.org/node/2194547

filefield https://drupal.org/node/2194103

image resizer https://drupal.org/node/2194063

mimemail https://drupal.org/node/2205939

webform https://drupal.org/node/2194181

The ctools & webform ones look like ones we should get on top of soonish, the mimemail one looks like it could be a pain.

Are you up for testing the updates on your local box? We can then figure out how to roll them out to the live site.

Thanks

Sam

#702: Attachments not being deleted from Trustees page

ed — Fri, 21 Mar 2014 17:11:14 GMT

I can't remove the attachments from the Trustees page: https://www.transitionnetwork.org/about/people/trustees

please investigate and sort if you can. We need to remove all the attachments apart from those in 2013.

#703: Image not scaling on project

ed — Wed, 26 Mar 2014 13:06:15 GMT

The REconomy logo is not scaling and being re-presented well on the project page: https://www.transitionnetwork.org/projects/reconomy

Is this a theme/design issue or a problem with image re-sizing?

What can we do about it?

#704: Image not scaling on project

ed — Wed, 26 Mar 2014 13:51:48 GMT

The REconomy logo is not scaling and being re-presented well on the project page: https://www.transitionnetwork.org/projects/reconomy

Is this a theme/design issue or a problem with image re-sizing?

What can we do about it?

#708: Map not showing Indian initiative

sam — Thu, 27 Mar 2014 13:44:29 GMT

https://www.transitionnetwork.org/initiatives/heal-soil-csa-community-supported-agriculture Address is correct, but doesn’t appear. The person who put it there doesn’t appear on the people map either, so wondering what’s afoot.

#724: Subscription emails from Rob's blog not arriving.

sam — Tue, 29 Apr 2014 09:21:12 GMT

A user has got in touch to let us know he is not getting Rob's updates by email. He's still subscribed.

I just checked my mail and the last one I received was on the 11/4. I'll have a look and see if I can work it out.

#751: Email alert changes

ed — Tue, 01 Jul 2014 11:14:42 GMT

Change the email alert template for news items to include the term 'news item' so it is:

"New news item: [title]"

When users click on the subs links at the bottom of their email alerts, and they are not logged in they get the ‘access denied’ screen. This is not good. Please investigate

(a) can this be changed (with small time investment) (b) can we change the access denied blurb to include something human encouraging the user to login to continue the journey:

"We are sorry for the inconvenience, but if you are seeing this screen having followed a link, you will probably need to login to continue with your request" (NB if they are coming from an email link with their id in it, how do we keep that journey so they get to the destinateion they wanted?)

When user clicks on the general subs link at the bottom of an email alert (and is not logged in), they get a 403 forbidden page. Not good - pls investigage

#755: Site administrator's file upload capacity: not responding to changes

ed — Tue, 08 Jul 2014 09:21:16 GMT

Rob Hopkins reached the limit for file uploads and could not upload any more images (not good for him as he writes posts with lots of pictures daily).

Sam raised the limit. This change in the limit does not seem to have affected Rob's situation - he still can't upload any images.

Looking at these settings: https://www.transitionnetwork.org/admin/settings/uploads

Rob should be able to upload more - he is a site editor and admin - but he can't.

Please investigate

#773: download copy of current TN D6 website

annesley — Wed, 06 Aug 2014 09:58:14 GMT

hi, am trying to get a copy of the current TN.org D6 database and filesystem down to my laptop to develop against. i had pulled from GIT, backed up from Backup&Migrate and got everything working but there are things missing.

so i want to do a file copy. i started a tar operation but the tar size went over 1.3GB and i stopped it because it shouldn't be that big. as always BOA has restricted use of the "du" command so i can't really tell why the tar was so big. and i can't "df" to see if it's a problem

should i let it continue? why is it so big?

#774: * Advisory ID: DRUPAL-SA-CORE-2014-004

paul — Wed, 06 Aug 2014 19:52:54 GMT

View online: https://www.drupal.org/SA-CORE-2014-004

Advisory ID: DRUPAL-SA-CORE-2014-004
Project: Drupal core [1]
Version: 6.x, 7.x
Date: 2014-August-06
Security risk: 13/25 ( Moderately Critical)

AC:None/A:None/CI:None/II:None/E:Proof/TD:100 [2]

Exploitable from: Remote
Vulnerability: Denial of service

Drupal 6 and Drupal 7 include an XML-RPC endpoint which is publicly available (xmlrpc.php). The PHP XML parser used by this XML-RPC endpoint is vulnerable to an XML entity expansion attack and other related XML payload attacks which can cause CPU and memory exhaustion and the site's database to reach the maximum number of open connections. Any of these may lead to the site becoming unavailable or unresponsive (denial of service).

All Drupal sites are vulnerable to this attack whether XML-RPC is used or not.

In addition, a similar vulnerability exists in the core OpenID module (for sites that have this module enabled).

This is a joint release as the XML-RPC vulnerability also affects WordPress (see the announcement [3]).

/A CVE identifier [4] will be requested, and added upon issuance, in

accordance with Drupal Security Team processes./

Drupal core 7.x versions prior to 7.31.
Drupal core 6.x versions prior to 6.33.

Install the latest version:

If you use Drupal 7.x, upgrade to Drupal core 7.31 [5].
If you use Drupal 6.x, upgrade to Drupal core 6.33 [6].

If you are unable to install the latest version of Drupal immediately, you can alternatively remove the xmlrpc.php file from the root of Drupal core (or add a rule to .htaccess to prevent access to xmlrpc.php) and disable the OpenID module. These steps are sufficient to mitigate the vulnerability in Drupal core if your site does not require the use of XML-RPC or OpenID functionality. However, this mitigation will not be effective if you are using a contributed module that exposes Drupal's XML-RPC API at a different URL (for example, the Services module); updating Drupal core is therefore strongly recommended.

Also see the Drupal core [7] project page.

Willis Vandevanter [8]
Nir Goldshlager [9]

Andrew Nacin [10] of the WordPress Security Team
Michael Adams [11] of the WordPress Security Team
Frédéric Marand [12]
David Rothstein [13] of the Drupal Security Team
Damien Tournoud [14] of the Drupal Security Team
Greg Knaddison [15] of the Drupal Security Team
Stéphane Corlosquet [16] of the Drupal Security Team
Dave Reid [17] of the Drupal Security Team

The Drupal Security Team [18] and the WordPress [19] Security Team

The Drupal security team can be reached at security at drupal.org or via the contact form at http://drupal.org/contact [20].

Learn more about the Drupal Security team and their policies [21], writing secure code for Drupal [22], and securing your site [23].

[1] http://drupal.org/project/drupal [2] http://drupal.org/security-team/risk-levels [3] https://wordpress.org/news/2014/08/wordpress-3-9-2/ [4] http://cve.mitre.org/ [5] http://drupal.org/drupal-7.31-release-notes [6] http://drupal.org/drupal-6.33-release-notes [7] http://drupal.org/project/drupal [8] https://www.drupal.org/user/1867894 [9] https://www.drupal.org/user/2891345 [10] http://profiles.wordpress.org/nacin [11] http://profiles.wordpress.org/mdawaffe [12] https://www.drupal.org/user/27985 [13] https://www.drupal.org/user/124982 [14] https://www.drupal.org/user/22211 [15] https://www.drupal.org/u/greggles [16] https://www.drupal.org/user/52142 [17] https://www.drupal.org/user/53892 [18] http://drupal.org/security-team [19] http://wordpress.org [20] http://drupal.org/contact [21] http://drupal.org/security-team [22] http://drupal.org/writing-secure-code [23] http://drupal.org/security/secure-configuration

_ Security-news mailing list Security-news@… Unsubscribe at https://lists.drupal.org/mailman/listinfo/security-news

#777: Comments to blog post only showing up when logged in

ed — Mon, 25 Aug 2014 09:18:39 GMT

Most of the comments to this blog post are only showing up when you are logged in: https://www.transitionnetwork.org/blogs/rob-hopkins/2014-07/fiona-ward-learning-celebrate-10000-failure#comment-17492

Logged in: 5 comments Not logged in: 1 comment

Handing this to Sam but happy for it to escalate. Presumably this issue won't be on this one post only - and it is important.

#785: SA-CONTRIB-2014-086 - Custom BreadCrumbs - Cross Site Scripting (XSS)

paul — Thu, 11 Sep 2014 15:54:35 GMT

@Ed Would you check my choice of component; I was looking for maintenance? Should I assign this to me as I create the ticket?

View online: https://www.drupal.org/node/2336263

Advisory ID: DRUPAL-SA-CONTRIB-2014-086
Project: Custom Breadcrumbs [1] (third-party module)
Version: 6.x, 7.x
Date: 2014-September-10
Security risk: 16/25 ( Critical)

AC:None/A:User/CI:Some/II:Some/E:Theoretical/TD:All [2]

Vulnerability: Cross Site Scripting

Custom Breadcrumbs allows administrators to set up parametrized breadcrumb trails for different content types, views, panels, taxonomy vocabularies and terms, paths, and a simple API that allows contributed modules to enable custom breadcrumbs for module pages and theme templates.

User input is not properly sanitized in all use cases, opening a Cross Site Scripting (XSS) vulnerability.

The vulnerability is only present when the custom breadcrumb is configured with the special identifier so that some of the breadcrumb items are not links. Typical example is that the last breadcrumb element is showing the current page title but is not a link. The XSS vulnerability is not triggered if all items of the breadcrumb are links and special identifier is not used.

/A CVE identifier [3] will be requested, and added upon issuance, in

accordance with Drupal Security Team processes./

Custom Breadcrumbs 6.x-1.x versions prior to 6.x-1.6
Custom Breadcrumbs 6.x-2.x versions are NOT affected
Custom Breadcrumbs 7.x-2.x versions prior to 7.x-2.0-beta1

Drupal core is not affected. If you do not use the contributed Custom Breadcrumbs [4] module, there is nothing you need to do.

Install the latest version:

If you use the Custom Breadcrumbs module version 1.x for Drupal 6.x,

upgrade to Custom Breadcrumbs 6.x-1.6 [5].

If you use the Custom Breadcrumbs module version 2.x for Drupal 7.x,

upgrade to Custom Breadcrumbs 7.x-2.0-beta1 [6].

Also see the Custom Breadcrumbs [7] project page.

Markus Sipilä [8]

Markus Sipilä [9]
Colan Schwartz [10] the module maintainer

Greg Knaddison [11] of the Drupal Security Team

The Drupal security team can be reached at security at drupal.org or via the contact form at https://www.drupal.org/contact [12].

Learn more about the Drupal Security team and their policies [13], writing secure code for Drupal [14], and securing your site [15].

_ Security-news mailing list Security-news@… Unsubscribe at https://lists.drupal.org/mailman/listinfo/security-news

#798: BOA-2.3.5

chris — Thu, 16 Oct 2014 12:40:58 GMT

The changelog:

### Stable BOA-2.3.5 Release - Full Edition
### Date: Wed Oct 15 16:28:25 PDT 2014
### Includes Aegir 2.1 with improvements
### Latest hotfix added on: Wed Oct 15 20:09:52 PDT 2014
# Release Notes:
  This new BOA release includes important updates and bug fixes.
  * All new Drupal 7 platforms received Drupal core security upgrade.
    For details please read: https://www.drupal.org/SA-CORE-2014-005
  * All existing Drupal 7 built-in platforms will receive a hot-fix for
    this known vulnerability: https://www.drupal.org/SA-CORE-2014-005
    once you will run 'barracuda up-stable' command on your server.
    This procedure is automated on hosted and managed Aegir at Omega8.cc
  * Your custom D7 platforms created in the ~/static directory tree
    will be checked in the next 12 hours after the upgrade, and if you
    have not applied this patch yet, it will be applied automatically
    for you - but only if there is at least one active site present
    in the given custom D7 platform. Note that while this procedure is
    automated on hosted and managed Aegir at Omega8.cc, on self-hosted
    BOA systems it will work only if you will set _PERMISSIONS_FIX=YES
    in /root/.barracuda.cnf (default is NO)
  We recommend that you upgrade your D7 sites using safe workflow:
    https://omega8.cc/your-drupal-site-upgrade-safe-workflow-298
# Updated Octopus platforms:
  aGov 1.5 --------------------- https://drupal.org/project/agov
  Commerce 1.31 ---------------- https://drupal.org/project/commerce_kickstart
  Commerce 2.19 ---------------- https://drupal.org/project/commerce_kickstart
  Guardr 1.14 ------------------ https://drupal.org/project/guardr
  Open Atrium 2.22 ------------- https://drupal.org/project/openatrium
  Open Outreach 1.12 ----------- https://drupal.org/project/openoutreach
  OpenPublic 1.2 --------------- https://drupal.org/project/openpublic
  Panopoly 1.12 ---------------- https://drupal.org/project/panopoly
# New features and enhancements in this release:
  * Explain that Solr self-provisioning works only if _MODULES_FIX=YES is set.
  * Reverify all sites daily if /root/.force.sites.verify.cnf ctrl file exists
    and _PERMISSIONS_FIX=YES is set in /root/.barracuda.cnf (default is NO)
# Changes in this release:
  * Security: Remove support for SSLv3 due to POODLE vulnerability.
  * Disable Redis in Hostmaster until we will fix the Views based pages/blocks.
  * Disable site_readonly for non-dev sites by default.
  * Drush: Upgrade command line version 6 to mini-6-04-10-2014
  * Enable AllowUserFXP in Pure-FTPd config by default.
  * Remove support for already deprecated non-LTS Ubuntu versions.
  * Run manage_ip_auth_access only once per minute.
  * The INI variable redis_flush_forced_mode is enabled by default (again).
  * Use sysklogd instead of rsyslog on Ubuntu.
# System upgrades in this release:
  * MariaDB 5.5.40
  * Nginx 1.7.6
  * OpenSSH 6.7p1 (if installed from sources)
  * OpenSSL 1.0.1j (if installed from sources) - security upgrade.
  * PHPRedis: master-03-10-2014
# Fixes in this release:
  * Add auto-detection of Legacy Ruby patch level update on old systems.
  * Add cleanup for ghost/broken sites dirs leftovers.
  * Add missing cleanup for backup_migrate leftovers.
  * Always cleanup pid files on exit/abort.
  * Apply patch for SA-CORE-2014-005 in all shared D7 cores/built-in platforms.
  * Compass Tools: Install 1.9.3 ffi expected by older themes.
  * Fix db_port entry in all vhosts hourly.
  * Fix for broken erpal-7.x-2.0-7.31.1
  * Fix for broken site level drushrc.php file.
  * Fix for false alarm caused by ghost sites leftovers.
  * Fix for incorrect hash filtering on systems with OpenSSL built from sources.
  * Fix locales: Numerous fixes and improvements -- thanks ar-jan!
  * Fix typo in REVISIONS.
  * Force site Verify via frontend if drushrc.php has been fixed.
  * Issue #435 - SQL: Remove deprecated table_cache +update table_open_cache
  * Issue #440 - Improve innodb_buffer_pool_size calculation and add 10%
  * Issue #441 - New Relic is not disabled after removing newrelic.info file.
  * Issue #442 - Skip locked/fpmcheck if /root/.high_traffic.cnf exists.
  * Issue #444 - PHP: Remove useless sed replacement in pool.d/www{*}.conf
  * Issue #445 - Remote Import: update 6.x-2.x branch for Aegir 2.x and Drush 6
  * Issue #447 - Export LANG, LANGUAGE and all LC_ environment variables.
  * Issue #447 - Improve locales consistency.
  * Issue #447 - Set default LC_CTYPE and LC_COLLATE environment variables.
  * Issue #447 - Simplify locales configuration on Ubuntu.
  * Issue #448 - Enforce locale settings by configuring defaults.
  * Issue #452 - PHP build is broken with latest MariaDB 5.5.40
  * Make sure that db_port is never empty and defaults to 3306.
  * Make sure that firewall monitoring scripts never run simultaneously.
  * Make sure that standard caching is enabled in hostmaster.
  * Pause hostmaster tasks when RVM install for any user is running.
  * PHP: Do not run rebuilds if not needed.
  * PHP: Fix for broken upgrade logic on libcurl or libssl packages upgrade.
  * Remove acquia_connector from latest Commons to avoid broken installs.
  * Remove all legacy gems and re-install RVM/Ruby for root from scratch.
  * Remove legacy replacement to avoid converting symlinked includes into files.
  * SQL: Use correct defaults if MySQLTuner test failed.
  * Workaround for Drupal flood using 127.0.0.1 for all requests behind proxy.
### Stable BOA-2.3.4 Release - Full Edition
### Date: Wed Oct 15 09:51:08 PDT 2014
### Includes Aegir 2.1 with improvements
  Release Notes and changelog for BOA-2.3.4 has been merged into BOA-2.3.5
  above after security upgrades related to OpenSSL and SSLv3 have been added
  shortly after 2.3.4 release.

I'm going to run this update tonight.

#888: Adverts on Transition Network Front Page loaded via flickrit.com embedded content

chris — Sun, 06 Dec 2015 12:25:49 GMT

It it intentional or accidental that adverts from https://secureads.bitbillions.com/ are being loaded on the front page of https://www.transitionnetwork.org/ via the embedded content from flickrit.com?

#906: I borked it

sam — Tue, 01 Mar 2016 22:27:10 GMT

Hi Chris

I recklessly tried to enable a module on the site that enabled sending articles to friends by email, this seems to have been one of my less-good ideas.

It tried to enable a print-friendly page and this seems to have brought the whole crumbling edifice down

Sorry about that. Can you fix it?

#908: Please enable Google Analytics

sam — Thu, 10 Mar 2016 15:43:56 GMT

Hi all

The web project board has decided to move from Piwik to Google Analytics.

I realise this has significant privacy implications, these were discussed, but it was decided that the move would go ahead.

I have discussed with Ainslie adding an opt out in the form of a link to EFF's Privacy badger: https://www.eff.org/privacybadger This will be added to the cookie pop up bar in the new website.

Could we enable the Google Analytics module on the existing site so I can add in the tracking code.

Thanks

Sam

#688: Password for innertransition@transitionnetwork.org ?

sam — Thu, 13 Feb 2014 16:59:58 GMT

Hi Chris

At the moment innertransition@… is forwarded to innertransition@… Sophie would like to disable the forward & and get the password for innertransition@… so she can set up Outlook.

Can I access these online anywhere or is it something you need to do?

Thanks

Sam

#748: Urgent: Fiona having problems sending email

sam — Wed, 25 Jun 2014 12:42:27 GMT

Hi Chris, Fiona is having problems sending email. I have checked the quota in the web interface and she is not over her quota.

She initially sent this:

The message could not be sent because the server rejected the sender's email address. The sender's email address was 'fionaward@…'.

Subject 'Re: filming' Server Error: 550 Server Response: 550 Access denied - Invalid HELO name (See RFC2821 4.1.1.1) Server: 'mail.transitionnetwork.org' Windows Live Mail Error ID: 0x800CCC78 Protocol: SMTP Port: 26 Secure(SSL): No

Which looked to me like the email had been sent and rejected by the receiving server.

So I sent this to Fiona:

On 24 June 2014 16:11, Sam Rossiter <samintransition@…> wrote: Hi Fiona I'll take a look now. It could have been rejected for a number of reasons. There's no keywords in the email that might trigger a spam rejection? Or have you Cc'd a large number of people?

As a workaround until we get to the bottom of it is it something a collegue could forward? Or does it have to come from you?

Thanks

Sam

Fiona replied:

Hi Sam I don;t think it's that email, as there are 13 that won't send frm my outbox even if I remove this email - same problem with the next one! Thanks Fiona

---

Chris I'm not working until next Tuesday, so I was wondering if you could pick this up and liase with Fiona? fionawardttt [AT] googlemail.com

Thanks

Sam

#218: Debian upgrades and updates

chris — Thu, 06 Jan 2011 13:34:16 GMT

This is a ticket to track debian upgrades to the wiki:PuffinServer, wiki:PenguinServer and wiki:ParrotServer the time they take.

See:

These updates are generally done using the wiki:AptitudeUpdateScript and this records all the changes in the /root/Changelog and then the contents of the Changelog are pasted into the ticket to document the upgrade.

This ticket was was originally used for the ~~wiki:DevelopmentServer~~ and the ~~wiki:NewLiveServer~~.

#470: Penguin install and configuration

chris — Sat, 15 Dec 2012 16:05:16 GMT

penguin.webarch.net is a new 2GB RAM virtual server which will replace NewLiveServer and DevelopmentServer for running all non-Drupal sites and is due to go live in early 2013. Drupal sites from the old servers will be migrated to PuffinServer.

This ticket has been created for tracking time and tasks done during the install.

See https://tech.transitionnetwork.org/trac/wiki/PenguinServer and also the corresponding PuffinServer.

#483: Nginx 502 Bad Gateway Errors with BOA

chris — Mon, 28 Jan 2013 11:23:45 GMT

The Barracuda Octopus Aegir server on puffin.webarch.net is getting generating a lot of Nginx 502 Bad Gateway errors, see ticket:466#comment:31 and ticket:466#comment:38

The Nginx logs contain 58 502 errors:

cd /var/log/nginx
grep " 502 " * | wc -l
58

I expect the cause of these is Nginx asking PHP-FPM for a page and not getting one, an answer might be to either speed up PHP-FPM response time or adjust the Nginx settings so that it waits longs for a response from PHP-FPM.

There are several threads about this on http://groups.drupal.org/ but none of them have any useful suggestions (eg 1 2 3 4).

#487: robots.txt files for development sites

chris — Tue, 29 Jan 2013 13:24:35 GMT

All the sites other than www.transitionnetwork.org on wiki:PuffinServer should have a robots.txt file to exclude them from being crawled and indexed to prevent the development versions of sites being included in search results.

#529: New Barracuda BOA-2.0.7 Edition available

chris — Fri, 05 Apr 2013 08:57:09 GMT

There is new BOA-2.0.7 Edition of Barracuda and Octopus available.

Please review the changelog and upgrade as soon as possible to receive all security updates and new features.

Changelog: http://bit.ly/newboa

#530: New Barracuda BOA-2.0.8 Edition available

chris — Mon, 08 Apr 2013 07:44:51 GMT

If I had known this was about to come out I would have waited before doing the BOA-2.0.7 upgrade last night on ticket:529

There is new BOA-2.0.8 Edition of Barracuda and Octopus available.

Please review the changelog and upgrade as soon as possible to receive all security updates and new features.

Changelog: http://bit.ly/newboa

Is mostly to fix a problem for people using Percona, https://drupal.org/node/1962690 and as we are using MariaDB this isn't an issue for us.

Other updates in this version:

Allow to use [a-z0-9] subdomains and not only [www] for IDN domain names.
Change the interval between platforms builds from 5 to 3 seconds.
Forced 1s Speed Booster TTL for vhosts behind local proxy is deprecated.
Move old firewall logs to backups to avoid crazy load after upgrade.
Nginx: Better exceptions handling in the Abuse Guard for js/shs modules.
PHP: CLI is at 5.3 since BOA-2.0.4, so symlink old 5.2 binary path to 5.3
Update _LENNY_TO_SQUEEZE major upgrade procedure.
Update contrib with login_security-7.x-1.2
Use static downloads for all distros in stable edition.

I'll do this update tonight unless there are any objections, hopefully it should be quite quick.

#531: Disk usage on puffin

chris — Wed, 10 Apr 2013 13:12:24 GMT

The disk usage on puffing is currently at 85% and it's been going up at around 5% a week, see:

https://penguin.transitionnetwork.org/munin/transitionnetwork.org/puffin.transitionnetwork.org/df.html

This will become a critical issue in a couple of weeks, it would be good to find and address the cause before then.

#535: Upgrade Puffin, Penguin and Parrot from Debian Squeeze to Wheezy

chris — Fri, 26 Apr 2013 18:49:16 GMT

Debian 7 is due out on 5th May 2013 and wiki:PuffinServer, wiki:PenguinServer and wiki:ParrotServer will need upgrading.

#543: Puffin Load Spike

chris — Fri, 03 May 2013 20:48:16 GMT

Puffin just had a massive load spike up to 65 and then it calmed down and it's up in the 70's again:

uptime
 21:46:43 up 91 days,  3:01,  4 users,  load average: 73.45, 30.76, 28.09

I'm trying to find the cause, it's making the TN site unresponsive.

#544: CSF / LDF false positive blocks on Puffin

chris — Sat, 04 May 2013 11:02:53 GMT

Ticket to keep track of CSF /LDF issues on Puffin, see wiki:PuffinServer#CSFLDF

#545: Registration page: 502

ed — Wed, 08 May 2013 08:38:13 GMT

http://www.transitionnetwork.org/user/register

found a bunch of these yesterday - this one is still showing a 502...

#547: New Barracuda BOA-2.0.9 Edition available

chris — Fri, 10 May 2013 11:28:17 GMT

Do we want to upgrade to Wheezy, see ticket:535 at the same time as upgrading to BOA-2.0.9? Or should we wait a few weeks, as Jim suggested here ticket:535#comment:3

I think we should schedule this update (to BOA-2.0.9) for an evening when there isn't much traffic on the site, perhaps Saturday or Sunday night. I don't think this update is super urgent as we have already upgraded Nginx, see ticket:218#comment:80

There is new BOA-2.0.9 Edition of Barracuda and Octopus available.

Please review the changelog and upgrade as soon as possible to receive all security updates and new features.

Changelog: http://bit.ly/newboa

The Changelog contains:

# This is the first Barracuda-only Edition, released to address important
  security issue with Nginx server and provide system level upgrades.
  This Edition will not upgrade Aegir Master nor Aegir Satellite Instances,
  because there was no new Drupal core released since BOA-2.0.8 Edition and
  there were not enough updates to built-in platforms or contrib accumulated.
  Releasing Barracuda-only Edition separately from full Edition allows us
  to address system/services security issues without any extra delay,
  while releasing Octopus-only Edition will allow us to provide Drupal core
  or Aegir version upgrades, without affecting system level services.
  There is also another reason while separate releases will be useful.
  BOA-2.0.9 is the last Edition where Aegir 2.x uses still old Drush 4.6
  in the backend. We need to sync BOA specific Aegir 2.x with upstream
  and finally switch to Drush 5, or even Drush 6, if possible.
  This change, however, may cause issues if you still host legacy Drupal 5
  or some old Drupal 6 sites, with either core or contrib not compatible
  with PHP 5.3, which is now used by default.
  That is why we plan to introduce ability to install older/previous
  Barracuda and/or Octopus release, if you need more time to upgrade.
# New features and enhancements in this release:
  * Debian 7.0 Wheezy support.
  * Automated upgrade from Squeeze with _SQUEEZE_TO_WHEEZY=YES option.
  * Added config template with inline how-to in docs/cnf/barracuda.cnf
  * Added config template with inline how-to in docs/cnf/octopus.cnf
  * Added passwords encryption how-to in docs/BLOWFISH.txt
  * Added the list of symbols used on install in docs/PLATFORMS.txt
  * Forced mysql restart if there are too many high CPU mysqld processes.
  * Improved docs/NOTES.txt
  * Improved docs/README.txt
  * Install libpam-unix2 and libxcrypt1 by default.
  * Install s3cmd by default.
  * Issue #1974640 - Allow to use Midnight Commander for limited shell users.
  * Limited Shell Logs Monitor enabled by default.
  * Nginx: Check for Linux/Cdorked.A malware and delete if discovered.
  * Re-generate and sync Aegir passwords before and after instance upgrade.
  * The silent 'system' mode documented in docs/UPGRADE.txt
  * Allow to exclude platform from otherwise forced `drush en entitycache -y`
    if sites/all/modules/entitycache_dont_enable.info control file is present.
# Changes in this release:
  * Nginx 1.5.0 - security upgrade for CVE-2013-2028
  * PHP 5.3.25
  * Redis 2.6.13
  * Do not disable update module in platforms known to include it as required.
  * Firewall: Open port 1129 for outgoing connections (some gateways need it).
  * Force syslog module as disabled by default and save some disk I/O.
  * Tune kernel to always use max RAM and not swap, if possible.
# Fixes in this release:
  * Add outgoing port 25 SMTP to the list of requirements.
  * Firewall: Add truly permanent block for heavy abusers.
  * Fix for mytop support, available again on systems with MariaDB.
  * Fix permissions in the /data/all tree if required.
  * Fix the order of checks - they scan only the last (current) minute.
  * Force _STRONG_PASSWORDS=NO if locales still look broken on second check.
  * Improve detecting no longer running drush.php and/or cron PHP processes.
  * Improve fix_locales logic.
  * Improve global.inc symlinking on initial install and upgrade.
  * Improve messages displayed when fix_locales discovers broken locales.
  * Improve monitoring to avoid duplicate entries on low traffic systems.
  * Improve sanitize_string() filtering to avoid issues with strong passwords.
  * Improve syncpass tool - Update system user passwd and flush privileges.
  * Issue #1961226 - Warning: Could not change permissions of sites/all to 751.
  * Issue #1962458 - 403 for anonymous users on node/add.
  * Issue #1963044 - Force UTF-8 locales if not present/configured properly.
  * Issue #1974542 - Use /root/.home.no.wildcard.chmod.cnf control file.
  * Issue #1987936 - Restore ability to install PHP 5.2 for FPM and CLI.
  * Make sure that /dev/null is writable for everyone.
  * Make sure that all drushrc.php files are owned by Aegir system user.
  * Make sure that all expected sites/all/{modules,themes,libraries} dirs exist.
  * Make sure that DB server is restarted on upgrade after config tuning.
  * Make sure that pdnsd and resolvconf are properly installed.
  * Nginx: Remove duplicate Vary: Accept-Encoding headers.
  * Percona no longer supports older Ubuntu non-LTS releases.
  * PHP: Do not reload FPM every hour - it may cause error 502.
  * PHP: Fix paths depending on CLI version used.
  * PHP: Fix the extensions installation and upgrade logic.
  * PHP: Make sure that the FPM port is set correctly for D6 sites with 5.2
  * PHP: Properly uninstall all related packages when using source build.
  * PHP: Start more FPM workers on systems with enough RAM by default.
  * Purge bin logs before disabling them.
  * Run NewRelic re-install early enough to avoid locking full-upgrade.
  * Sync the load limits for spiders and backend tasks.
  * The Java/Jetty monitor should use higher allowed limits by default.
  * Update apticron message to recommend system mode instead of full upgrade.
  * Update docs for _BUILD_FROM_SRC option.
  * Use aggressive enough Jetty restart procedure on nightly services reload.
  * Use correct status messages on install and upgrade.
  * Use installer and not Aegir version download on stable install/upgrade.

#552: Puffin Downtime 23rd May 2013

chris — Thu, 23 May 2013 20:54:15 GMT

There was a massive load spike on wiki:PuffinServer this afternoon, the load average peaked at over 60 and at exactly the same time there was also one on the virtual server serving http://webarch.net/.

Pingdom reported:

www.transitionnetwork.org down since 23/05/2013 12:11:57
www.transitionnetwork.org is UP again at 23/05/2013 12:19:57, after 8m of downtime
www.transitionnetwork.org is down since 23/05/2013 12:26:57
www.transitionnetwork.org is UP again at 23/05/2013 12:58:57, after 32m of downtime

When I did managed to get back into the server php-fpm and nginx were not running and it took several attempt to get them to start up.

Attached is the munin graps of the load from today, munin didn't record the start of the spike but it did start recording it as it came down.

This ticket has been created to report the issue and also to record anything that might be found in the logs to explain what happened.

#554: Site slow down and MySQL load increase

chris — Tue, 28 May 2013 18:11:51 GMT

Since the upgrade to MariaDB 5.5.31, done on ticket:218#comment:93 (and fixed on ticket:548#comment:32) there appears to have been been a noticeable slowdown in the time for pages to be generated, measuring with http://tools.pingdom.com/fpt/ the front page alone takes around 5 seconds to generate.

There is a clear increase in the amount of MySQL/MariaDB activity measured by Munin, see the attached graphs, the upgrade was done around midday on 24th May 2013. There has also been a increase in traffic according to the firewall graphs. The memory usage of redis has also dropped right down and the database memory usage has significantly increased.

It's not totally clear if the cause of this change in behaviour of the site is related to the MySQL/MariaDB upgrade or if there was a coincidental change in the traffic to the site at the same time. There is no noticeable change in the visitors recorded in the Piwik stats.

According to pingdom the front page of the site is now "slower than 77% of all tested websites" with a total load time of around 6 seconds, almost all of this is down to the wait of around 5 seconds for the index.php file. This can also be tested from parrot with Apache bench, sometimes cached pages are served up and these appear in an instance, if the front page is generated it takes around 5 seconds, see wiki:LoadTimes#a2013-05-28

#555: Load spikes causing the TN site to be stopped for 15 min at a time

chris — Wed, 29 May 2013 09:53:52 GMT

The BOA /var/xdrago/second.sh script is run every minute via the root crontab and if it detects a certain load level it changes the nginx config to a "high load" config which results in bots being served 503 errors when they spider the site, see ticket:563. When the load goes higher and hits another threshold the second.sh script kills the webserver applications, nginx and php-fpm, and waits till the load has dropped before starting them up again. This was happening once or twice a day following the increase in traffic around the launch of The Power of Just Doing Stuff. This has been addressed by multiplying the thresholds by 5 in second.sh.

Original Description

This morning at 10:19:24 I received the following alert from puffin:

Subject: lfd on puffin.webarch.net: High 5 minute load average alert - 6.59
Time:                    Wed May 29 10:17:02 2013 +0100
1 Min Load Avg:          23.39
5 Min Load Avg:          6.59
15 Min Load Avg:         2.57
Running/Total Processes: 44/326

At 10:21:57 I got an alert regarding ssh:

Service: SSH
Host: puffin
Address: puffin.webarch.net
State: CRITICAL
Date/Time: Wed May 29 10:21:57 BST 2013
Additional Info:
CRITICAL - Socket timeout after 10 seconds

Then at 10:26:47 ssh appeared to have recovered:

Service: SSH
Host: puffin
Address: puffin.webarch.net
State: OK
Date/Time: Wed May 29 10:26:47 BST 2013
Additional Info:
SSH OK - OpenSSH_5.5p1 Debian-6+squeeze3 (protocol 2.0)

But then pingdom reported at 10:29:07:

www.transitionnetwork.org is down since 29/05/2013  10:24:57.

There was then a report regarding Nginx at 10:32:07:

Notification Type: PROBLEM
Service: HTTP
Host: puffin
Address: puffin.webarch.net
State: CRITICAL
Date/Time: Wed May 29 10:32:07 BST 2013
Additional Info:
Connection refused

So at 10:33:47 I ssh'd in and found that php53-fpm and nginx were not running and it took several attempts to get them running again.

The up email from pingdom reported:

www.transitionnetwork.org is UP again at 29/05/2013  10:36:57, after 12m of downtime.

I can't find anything in the logs to indicate what caused the load spike and php-fpm and nginx to stopp running.

#563: 503 Errors

chris — Wed, 19 Jun 2013 10:59:54 GMT

Original Description

The site is generating a lot of 503 errors, 83 since 6:30am today and there were around 750 yesterday.

#567: Update BOA for new Redis 2.6.14

chris — Tue, 02 Jul 2013 11:10:27 GMT

A suggestion from Jim:

BOA now includes Redis 2.6.14 <https://raw.github.com/antirez/redis/2.6/00-RELEASENOTES> if you do a 'barracda up-stable system'... What interests me about this is these lines from the changelog:

UPGRADE URGENCY: HIGH because of the following two issues:

Lua scripting + Replication + AOF in slaves problem (see Issue #1164).
AOF + expires possible race condition (see Issue #1079).

It's a long shot, but that could maybe be part of the issue we've seen recently.

I'm not sure if this is best done now or later tonight when the site is less busy?

#569: 403s served to editors, admin very slow

ed — Tue, 09 Jul 2013 07:52:32 GMT

Rob is getting 403s when trying to submit his work. Report from 07:12am this morning (Tuesday)

Ed tried to add a blog post at node add:

https://www.transitionnetwork.org/node/add/blog It took nearly 15 seconds to get this published https://www.transitionnetwork.org/blogs/ed-mitchell/2013-07/eds-test-blog-item-check-403

Running admin functions takes ages.This request took well over 30 seconds:

https://www.transitionnetwork.org/admin/content/node/overview

Please advise?

#573: MariaDB 5.5.32 is available for Puffin

chris — Thu, 18 Jul 2013 19:11:24 GMT

I could either update this via aptitude and it would be quick and have little down time or I could update it via BOA and it'll take 3 or 4 times as long and involved extra downtime.

Jim -- which way would you like it done?

The MariaDB project is pleased to announce the immediate availability of MariaDB 5.5.32.

This is a bug-fix release. See the Release Notes and Changelog for details.

MariaDB 5.5.32 Stable (GA)

Release Notes: https://kb.askmonty.org/en/mariadb-5532-release-notes
Changelog: https://kb.askmonty.org/en/mariadb-5532-changelog
http://lists.askmonty.org/pipermail/announce/2013-July/000048.html

#576: Site down

ed — Thu, 01 Aug 2013 09:42:44 GMT

Been down for 15 minutes by now I reckon

#580: php5-fpm starting when puffin boots

chris — Mon, 12 Aug 2013 16:03:06 GMT

When wiki:PuffinServer is booted /etc/init.d/php5-fpm is started and this causes errors with the site.

#585: TTech Meeting 5th September 2013

chris — Thu, 05 Sep 2013 07:47:16 GMT

This ticket has been created for the TTech Skype meeting due to take place today.

#586: New Relic Monitoring for BOA

chris — Thu, 05 Sep 2013 08:35:17 GMT

This is a ticket to document the consideration, and possible installation, of https://newrelic.com/ on the PuffinServer

#588: RSS feed caching

chris — Fri, 06 Sep 2013 09:43:57 GMT

At the meeting on 5th September ticket:585 one thing we discussed was that:

The biggest single source of bandwidth by URL is Rob's RSS feed, 34.5GB of data, 150k hits. This represents half the total site data transfer, the RSS files is 0.4MB but will hopefully be mostly served gzipped at 0.1MB.

This ticket is to follow up on that -- are the RSS feeds served directly by Nginx?

#589: Blocking spammers at a firewall level

chris — Fri, 06 Sep 2013 09:48:59 GMT

At the meeting on 5th September ticket:585 one thing we discussed was that for August 2013:

More data is transferred for /user/register than the front page, 5.1GB compared to 3.6GB.

Most of this will be spam bots trying to register to post spam. Jim suggested that we could look at blocking some of these spam bots at a firewall level to save on resources. This ticket is to follow up on this suggestion.

#591: Move MySQL temporary directory to tmpfs

jim — Mon, 09 Sep 2013 12:47:41 GMT

Chris, please read: http://2bits.com/articles/reduce-your-servers-resource-usage-moving-mysql-temporary-directory-ram-disk.html

I think we could easily drop a little MySQL memory to give it some in-memory disk space to do the temporary table munching Drupal is causing it. I see there are already some mounted tmpfs partitions.

Related to #590 (proposal L: Review slow query log, explain queries, tweak as necessary/flag poorly behaving modules)

What do you think? Worth doing?

#593: Migrating Puffin to a ZFS file server

chris — Wed, 11 Sep 2013 15:52:47 GMT

This ticket is for the migration of PuffinServer to a ZFS file server, this will involve some downtime but should result in better IO and easier backups.

#599: Server time drift

chris — Sun, 29 Sep 2013 21:57:59 GMT

The servers are not keeping good time at the moment.

#610: Aegir database intensive (migrate, clone, restore) tasks hang for larger sites

jim — Tue, 15 Oct 2013 10:18:59 GMT

Large sites (TN.org and variants) will simply not complete their migrate, clone or restore tasks in Aegir.

However, smaller sites are fine, and all tasks work for them.

The process largely completes -- codebase installs, database is cloned, symlinks for sites aliases and files created... BUT the process never completes in Aegir, so the final steps of switching a site's served location never occurs.

Useful links/comments in this issue:

#612: Upgrade to BOA-2.1.1 Stable Edition

chris — Sun, 03 Nov 2013 11:11:24 GMT

I have been sent this email from wiki:PuffinServer:

There is new BOA-2.1.0 Stable Edition available.

Please review the changelog and upgrade as soon as possible to receive all security updates and new features.

Changelog: http://bit.ly/newboa

I could potentially do this upgrade tonight as it's a quite time for the server -- Jim, any reason not to apply this update tonight?

#670: Roll back performance customisations and use stock BOA settings where possible

jim — Sat, 11 Jan 2014 20:51:30 GMT

Issue Given so much has changed since the initial issues on the server, I now strongly recommend reverting all settings changes that do not add features back to stock BOA settings after the next BOA release.

These would include all MySQL, PHP, FPM, Redis and other settings that have been for performance reasons, or to combat the situation where there was hardware/IO issues with the underlying server. I'm most interested in FPM and MySQL settings.

The next version of BOA will include some improvements we need (see 629: Upgrades to BOA which should handle load on our server with a lot of CPU cores. With this in place we'll be able to revert more easily to stock settings.

Rationale I'm not talking about rolling back changes that provide us with features or mission-critical capabilities, just the changes to the subsystems I list above for performance reasons.

It's my belief that these enhancements no longer match the needs of the server since the changes to filesystem and underlying hardware fixes have been completed. They also represent an ongoing risk around updates, future planning -- plus it's possible they might mean Puffin's web services need more memory than it otherwise would, costing TN more than it should need to spend on hardware.

Proposed solution

Await the next version of BOA, and setup the enhanced load settings per the documentation.
Revert all other changes to conf files for MySQL, PHP, FPM, Redis that do not add a feature or are not mission-critical.
Review /root/.barracuda.cnf and turn off any overrides and customisations we don't now need as a result of 2).
Run the BOA BOND.sh script to do the tuning of the server appropriate to the memory requirements. This will tune for the current levels on first pass.
Review Munin and site performance. If we need to make any tweaks then we can do a minimal set as required -- keeping an eye on memory usage.
Once a few days have gone by I would hope that the overall memory use will be lower, OR with more cached data. At this point we can either re-run the barracuda installer with the _RESERVED_RAM set to 1-4 Gb, or simply reduce the memory available to Puffin.
Repeat from 4, using BOND.sh to optimise for the new memory footprint.

Clearly, it's possible no memory savings can be made, or just 1Gb or so is sensible. Either way, rolling back the changes made for a system that has changed immensely is worth attempting to compare current (tweaked) performance to the stock system. Since current settings are all documented and can be backed up, we should be able to test this with no risk and the ability to roll back as needed.

Next steps

Chris and Ed to give their thoughts.
Ed to green-light before we proceed in too much detail or take any action.
Chris and Jim to establish the changes and outcomes.
Chris, Jim and whoever to do the new optimisation process.

#673: Install mosh - the mobile shell

chris — Mon, 13 Jan 2014 11:27:40 GMT

The mobile shell enables terminal connections to stay up when using really bad connections, for example on a train, see:

http://mosh.mit.edu/

#674: Puffin locked up

chris — Tue, 14 Jan 2014 09:59:40 GMT

This is on the console, no response via web or ssh :

[4478428.894563]  [<ffffffff810f3634>] ? sys_readlinkat+0x25/0x8d
[4478428.894571]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b
[4478428.894581] INFO: task cron:46009 blocked for more than 120 seconds.
[4478428.894587] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[4478428.894595] cron          D ffff8801fb270e20     0 46009   8829 0x00000080
[4478428.894606]  ffff8801fb270e20 0000000000000286 0000000000000001 00000001810423b0
[4478428.894617]  ffff88000bcf87c0 000000000000000b 000000000000f9e0 ffff8800cbb9dfd8
[4478428.894628]  00000000000157c0 00000000000157c0 ffff8801fa458000 ffff8801fa4582f8
[4478428.894640] Call Trace:
[4478428.894648]  [<ffffffff811976a6>] ? vsnprintf+0x40a/0x449
[4478428.894656]  [<ffffffff8130e5c3>] ? __mutex_lock_common+0x122/0x192
[4478428.894666]  [<ffffffff8130e6eb>] ? mutex_lock+0x1a/0x31
[4478428.894673]  [<ffffffff810f7eac>] ? do_lookup+0x80/0x15d
[4478428.894681]  [<ffffffff810f892c>] ? __link_path_walk+0x5a5/0x6f5
[4478428.894689]  [<ffffffff810f826a>] ? do_follow_link+0x1fa/0x317
[4478428.894697]  [<ffffffff810f86e0>] ? __link_path_walk+0x359/0x6f5
[4478428.894705]  [<ffffffff810f8caa>] ? path_walk+0x66/0xc9
[4478428.894713]  [<ffffffff810fa114>] ? do_path_lookup+0x20/0x77
[4478428.894721]  [<ffffffff810fa2a0>] ? do_filp_open+0xe5/0x94b
[4478428.894729]  [<ffffffff81012cdb>] ? xen_hypervisor_callback+0x1b/0x20
[4478428.894738]  [<ffffffff8130dda8>] ? thread_return+0x79/0xe0
[4478428.894746]  [<ffffffff811901fb>] ? _atomic_dec_and_lock+0x33/0x50
[4478428.894755]  [<ffffffff81103705>] ? alloc_fd+0x67/0x10c
[4478428.894763]  [<ffffffff810eeacf>] ? do_sys_open+0x55/0xfc
[4478428.894770]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b
[4478669.197427] INFO: task vnstatd:1920 blocked for more than 120 seconds.
[4478669.197448] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[4478669.197458] vnstatd       D 0000000000000000     0  1920      1 0x00000000
[4478669.197469]  ffff8801ff18bf90 0000000000000282 ffff8801fa651e10 ffff880000009680
[4478669.197482]  0000000000000000 000000000000000a 000000000000f9e0 ffff8801fa651fd8
[4478669.197494]  00000000000157c0 00000000000157c0 ffff8801fe335bd0 ffff8801fe335ec8
[4478669.197505] Call Trace:
[4478669.197520]  [<ffffffff8130f6fa>] ? error_exit+0x2a/0x60
[4478669.197531]  [<ffffffff8101251d>] ? retint_restore_args+0x5/0x6
[4478669.197542]  [<ffffffff8130e5c3>] ? __mutex_lock_common+0x122/0x192
[4478669.197551]  [<ffffffff8130e6eb>] ? mutex_lock+0x1a/0x31
[4478669.197561]  [<ffffffff810f7eac>] ? do_lookup+0x80/0x15d
[4478669.197569]  [<ffffffff810f86aa>] ? __link_path_walk+0x323/0x6f5
[4478669.197577]  [<ffffffff810f8caa>] ? path_walk+0x66/0xc9
[4478669.197585]  [<ffffffff810fa114>] ? do_path_lookup+0x20/0x77
[4478669.197593]  [<ffffffff810fa2a0>] ? do_filp_open+0xe5/0x94b
[4478669.197602]  [<ffffffff8130f054>] ? _spin_lock_irqsave+0x15/0x34
[4478669.197612]  [<ffffffff81068fa6>] ? hrtimer_try_to_cancel+0x3a/0x43
[4478669.197622]  [<ffffffff8102de30>] ? pvclock_clocksource_read+0x3a/0x8b
[4478669.197631]  [<ffffffff81103705>] ? alloc_fd+0x67/0x10c
[4478669.197641]  [<ffffffff810eeacf>] ? do_sys_open+0x55/0xfc
[4478669.197649]  [<ffffffff81011b42>] ? system_call_fastpath+0x16/0x1b

Rebooting...

#677: Spike in MyISAM (search) database activity, Redis unable to cache such requests

chris — Wed, 15 Jan 2014 10:49:33 GMT

Since Sunday there has been a marked increase in MySQL activity and also a drop in Redis memory use, I suspect these things are related.

I'll post some Munin graphs below to illustrate this.

#683: Create Aegir account for Paul

sam — Wed, 22 Jan 2014 12:42:48 GMT

Hi Jim

It looks like i@… will be joining us to pick up some of your work.

Could you create an Aegir account for him please?

I was also wondering about the Transition Network Github repo, do we need to do anything to hand that over?

Thanks

Sam

#685: SSL certificate about to expire?

sam — Thu, 23 Jan 2014 12:31:06 GMT

Hi Chris this dropped into my inbox this morning.

Can you tell from the following if it's a certificate we still use? Does it need to be renewed?

Thanks

Sam

---

Hello,

This mail is to inform you that your certificate SSL Standard (*.transitionnetwork.org) expires today, on 2014-01-24 00:59.

Warning: for Pro and Business certificates, web browsers have increased security. It can now take up to several weeks, and so we strongly recommend that you perform the operation as soon as possible.

If you would like to keep your certificate, we recommend renewing it today. For this you must launch the renewal process from the following page: https://www.gandi.net/admin/ssl/renew/26873

If you do not want to keep your certificate, then no further action is necessary on your part. It will be automatically revoked by our services and rendered useless.

#698: intransitionmovie.com returns 405 on submit

sam — Thu, 06 Mar 2014 11:45:39 GMT

http://www.intransitionmovie.com/screenings/share-your-screening/

vid Atcheson (david@…) sent a message using the contact form at https://www.transitionnetwork.org/contact.

I couldn't find any contact info at http://www.intransitionmovie.com/, but am hoping you can help. When I visit http://www.intransitionmovie.com/screenings/share-your-screening/index.html and put in my email address and hit Enter, I get:

Hi I checked this and it returns a 405 error for me too.

http://www.intransitionmovie.com/screenings/share-your-screening/

405 Not Allowed nginx/1.4.4

Hoping this can be fixed so we can let you know about our screening on April 8 at the Hawaii State Capitol auditorium.

Aloha,

David Atcheson, Transition Oahu

I'll do some initial investigation

Transition Technology: Ticket Query

#502: patterns sub-domain for transitionresearchnetwork.org, was: Setting up specific pointer for URL

#528: patterns.transitionresearchnetwork.org DNS update

#557: Set up a re-direct

#878: Reconomy.org add subdomains

#613: Parrot mysql console errors

#618: Migrate Penguin and Parrot to the ZFS fileserver

#632: Add accounts for Sam

#641: Enable dynamic Munin graphs

#666: Parrot lockups

#739: Set up DEV and other drupal accounts for Annesley

#771: cannot access puffin over sftp again

#780: parrot

#713: Ticket clearing

#786: GitHub Transition: Annesley needs permission to create repositories

#207: Logwatch Issues

#208: Dblog Issues

#548: All Admin functions broken on TN.org

#568: TC blog: can't *not* send notifications

#571: Force HTTP for anonymous, HTTPS for logged in users

#575: User system is blocking *everyone* - needs fixing urgently

#581: Remove 'add to newsletter' option for site editors/admins

#584: News CTs and featured images: not handling as expected

#602: RSS problems

#608: User profile pictures are too big

#614: Subscription option for Social Reporters CT

#615: Move to GMap 6.x-2.x-dev as and get clusterer to work

#617: Help adding text to account creation email

#621: Check and speed up updates to homepage sections: TC and slideshow

#622: Maps not working on TN.org

#624: Comment handling on pages: particularly Austerity one

#628: Change space notifications email from IJK.co.uk to TN.org

#633: RHS blocks changes for homepage

#637: What is the wordcount for the /news and /blogs/rob-hopkins teasers?

#648: Edit the contact form reply in January

#649: Add commenting to /films/ content type in January

#650: Helping TN strategy consultation with online publishing

#651: Report for tools content type

#652: Report for resource content type

#653: Report for ingredients content type

#654: TIs appearing in 'TIs by list' view without a number

#657: Homepage slideshow: can't order the images

#658: Check caching on Social Reporters views

#659: Featured story on homepage not updating

#663: De-commission the PSE

#667: Development handover process

#679: Filter Initiative by Country not working

#693: Module security updates: February 2014

#702: Attachments not being deleted from Trustees page

#703: Image not scaling on project

#704: Image not scaling on project

#708: Map not showing Indian initiative

#724: Subscription emails from Rob's blog not arriving.

#751: Email alert changes

#755: Site administrator's file upload capacity: not responding to changes

#773: download copy of current TN D6 website

#774: * Advisory ID: DRUPAL-SA-CORE-2014-004

#777: Comments to blog post only showing up when logged in

#785: SA-CONTRIB-2014-086 - Custom BreadCrumbs - Cross Site Scripting (XSS)

#798: BOA-2.3.5

#888: Adverts on Transition Network Front Page loaded via flickrit.com embedded content

#906: I borked it

#908: Please enable Google Analytics

#688: Password for innertransition@transitionnetwork.org ?

#748: Urgent: Fiona having problems sending email

#218: Debian upgrades and updates

#470: Penguin install and configuration

#483: Nginx 502 Bad Gateway Errors with BOA

#487: robots.txt files for development sites

#529: New Barracuda BOA-2.0.7 Edition available

#530: New Barracuda BOA-2.0.8 Edition available

#531: Disk usage on puffin

#535: Upgrade Puffin, Penguin and Parrot from Debian Squeeze to Wheezy

#543: Puffin Load Spike

#544: CSF / LDF false positive blocks on Puffin

#545: Registration page: 502

#547: New Barracuda BOA-2.0.9 Edition available

#552: Puffin Downtime 23rd May 2013

#554: Site slow down and MySQL load increase

#555: Load spikes causing the TN site to be stopped for 15 min at a time

#568: TC blog: can't not send notifications

#575: User system is blocking everyone - needs fixing urgently