Ticket #629 (closed maintenance: wontfix)

Opened 3 years ago

Last modified 3 years ago

Upgrade to BOA-2.1.3 Stable Edition

Reported by: chris Owned by: chris
Priority: major Milestone: Maintenance
Component: Live server Keywords:
Cc: ed, jim Estimated Number of Hours: 0.0
Add Hours to Ticket: 0 Billable?: yes
Total Hours: 8.2

Description (last modified by chris) (diff)

This ticket is for BOA-2.1.3, the previous version was BOA-2.1.1 ticket:612, see wiki:PuffinServer#Upgradetickets

The steps to follow when upgrading wiki:PuffinServer are documented at wiki:PuffinServer#UpgradingBOA

Attachments

puffin_2014-03-26_phpfpm_connections-day.png (34.5 KB) - added by chris 3 years ago.
puffin_2014-03-26_phpfpm_memory-day.png (22.9 KB) - added by chris 3 years ago.
puffin_2014-03-26_phpfpm_processes-day.png (16.1 KB) - added by chris 3 years ago.
puffin_2014-03-26_phpfpm_processes-day.2.png (16.1 KB) - added by chris 3 years ago.
puffin_2014-03-26_phpfpm_status-day.png (22.8 KB) - added by chris 3 years ago.
puffin_2014-03-26_multips_memory-day.png (26.6 KB) - added by chris 3 years ago.

Change History

comment:1 follow-up: ↓ 3 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.15
  • Total Hours changed from 0.0 to 0.15
  • Description modified (diff)
  • Summary changed from Upgrade to BOA-2.1.3 Stable Edition to Upgradesto BOA

Making ticket general for BOA updates like Debian ticket etc.

Original description by Chris:

From the release notes:

This release provides Drupal 7.24.1 and Pressflow 6.29.1 core security upgrade for all supported distributions. It also includes two updated platforms and several fixes for issues discovered since BOA-2.1.2 released 3 days ago, plus some clever improvements to help you automatically optimize all tables daily, or even automatically convert tables to-innodb or to-myisam, either per site or per platform, or per entire Octopus instance. There is also Purge Cruft Machine available to run some spring-cleaning daily with configurable TTL.


I'm very keen for this do be done ASAP -- Chris can you do it tonight or shall I?

comment:2 Changed 3 years ago by jim

  • Summary changed from Upgradesto BOA to Upgrades to BOA

typo

comment:3 in reply to: ↑ 1 ; follow-up: ↓ 4 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.25
  • Total Hours changed from 0.15 to 0.4
  • Description modified (diff)

Sorry I have only just seen this:

Replying to jim:

I'm very keen for this do be done ASAP -- Chris can you do it tonight or shall I?

I find that comments are hard to notice when ticket descriptions are edited as they are at the end of a long diff.

I can do this upgrade tonight, following wiki:PuffinServer#UpgradingBOA.

comment:4 in reply to: ↑ 3 Changed 3 years ago by jim

Replying to chris:

I find that comments are hard to notice when ticket descriptions are edited as they are at the end of a long diff.

Yeah, Trac is a bit rubbish in this regard... Comment first, description second would make a lot more sense -- plus it simply sends the whole thing even if you only add a sentence (as you did last comment). Bit lame...

I can do this upgrade tonight, following wiki:PuffinServer#UpgradingBOA.

Lovely, thanks.

comment:5 follow-up: ↓ 6 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 0.4 to 0.5

FYI wiki:PuffinServer#UpgradingBOA tweaked as 'limit_con' has changed: "gulag" now is a more politically correct "limreq".

Also the scripts in /var/xdrago are changing every release with fixes and improvements -- I'd therefore caution against blindly copying over scripts with our tweaked versions (e.g. second.sh).

Perhaps a better approach would be to add a set of patches to a new folder in the TN Github profile repo and then have a little script we can run each time that applies the patches to the appropriate files. This has the advantage that it's only modifying files, rather than replacing them, so it would alert us to any failed chunks so we can review what BOA changes occurred along the way... It should also speed up the future updates and lower the chances of human error.

What do you think, Chris?

comment:6 in reply to: ↑ 5 ; follow-up: ↓ 7 Changed 3 years ago by chris

Sorry, the upgrade didn't happen last night, I'll try to get it done this evening.

Replying to jim:

FYI wiki:PuffinServer#UpgradingBOA tweaked as 'limit_con' has changed: "gulag" now is a more politically correct "limreq".

Also the scripts in /var/xdrago are changing every release with fixes and improvements -- I'd therefore caution against blindly copying over scripts with our tweaked versions (e.g. second.sh).

Perhaps a better approach would be to add a set of patches to a new folder in the TN Github profile repo and then have a little script we can run each time that applies the patches to the appropriate files. This has the advantage that it's only modifying files, rather than replacing them, so it would alert us to any failed chunks so we can review what BOA changes occurred along the way... It should also speed up the future updates and lower the chances of human error.

What do you think, Chris?

I think that if it's simply a matter of changing a few variables there is a danger that doing it using git and diffs will end up making it harder than manually editing the files.

comment:7 in reply to: ↑ 6 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.05
  • Total Hours changed from 0.5 to 0.55

Replying to chris:

I think that if it's simply a matter of changing a few variables there is a danger that doing it using git and diffs will end up making it harder than manually editing the files.

Faity nuff...

However, I'd like to point out that git would just be storage for the patches. We'd have a script that did something like this for each patch:

cd /location/of/file/to/be/patched
curl [github location]/[patch-name].patch | patch -p1 

Any issues would appear on the screen, and we can always make a backup (e.g. .tn-bak) by copying the file before applying the patch.

Even if we don't do this, it'd be better for the files you are copying over with our tweaked versions. I'll leave it with you to do or not...

Version 0, edited 3 years ago by jim (next)

comment:8 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 1.0
  • Total Hours changed from 0.55 to 1.55

OK, let look at what we change for this upgrade.

Following wiki:PuffinServer#UpgradingBOA

sudo -i
screen
cd
wget -q -U iCab http://files.aegir.cc/BOA.sh.txt
bash BOA.sh.txt
  
  BOA Meta Installer setup completed
  Please check INSTALL.txt and UPGRADE.txt at http://bit.ly/boa-docs for how-to
  Bye
  
barracuda up-stable
 
  Barracuda [Sat Nov 30 20:42:51 GMT 2013] ==> BOA Skynet welcomes you aboard!
  
  Barracuda [Sat Nov 30 20:42:55 GMT 2013] ==> INFO: UPGRADE
  Barracuda [Sat Nov 30 20:42:55 GMT 2013] ==> INFO: Reading your /root/.barracuda.cnf config file
  Barracuda [Sat Nov 30 20:42:56 GMT 2013] ==> NOTE! Please review all config options displayed below
  Barracuda [Sat Nov 30 20:42:56 GMT 2013] ==> NOTE! It will *override* all settings in the Barracuda script
  
  ###
  ### Configuration created on 121215-1545
  ### with Barracuda version BOA-2.0.4
  ###
  ### NOTE: the group of settings displayed bellow will *not* be overriden
  ### on upgrade by the Barracuda script nor by this configuration file.
  ### They can be defined only on initial Barracuda install.
  ###
  _HTTP_WILDCARD=YES
  _MY_OWNIP="81.95.52.103"
  #_MY_OWNIP=""
  _MY_HOSTN="puffin.webarch.net"
  #_MY_HOSTN=""
  _MY_FRONT="master.puffin.webarch.net"
  _THIS_DB_HOST=localhost
  #_THIS_DB_HOST=FQDN
  _SMTP_RELAY_TEST=YES
  _SMTP_RELAY_HOST=""
  _LOCAL_NETWORK_IP=""
  _LOCAL_NETWORK_HN=""
  ###
  ### NOTE: the group of settings displayed bellow
  ### will *override* all listed settings in the Barracuda script,
  ### both on initial install and upgrade.
  ###
  _MY_EMAIL="chris@webarchitects.co.uk"
  _XTRAS_LIST="PDS CSF CHV"
  _AUTOPILOT=NO
  _DEBUG_MODE=NO
  _DB_SERVER=MariaDB
  _SSH_PORT=22
  _LOCAL_DEBIAN_MIRROR="ftp.debian.org"
  _LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
  _FORCE_GIT_MIRROR=""
  _DNS_SETUP_TEST=YES
  _NGINX_EXTRA_CONF=""
  _NGINX_WORKERS=AUTO
  _PHP_FPM_WORKERS=AUTO
  _BUILD_FROM_SRC=NO
  _PHP_MODERN_ONLY=YES
  _PHP_FPM_VERSION=5.3
  _PHP_CLI_VERSION=5.3
  #_LOAD_LIMIT_ONE=1444
  #_LOAD_LIMIT_TWO=888
  _LOAD_LIMIT_ONE=8664
  _LOAD_LIMIT_TWO=5328
  _CUSTOM_CONFIG_CSF=YES
  #_CUSTOM_CONFIG_SQL=NO
  _CUSTOM_CONFIG_SQL=YES
  _CUSTOM_CONFIG_REDIS=NO
  _CUSTOM_CONFIG_PHP_5_2=NO
  #_CUSTOM_CONFIG_PHP_5_3=NO
  _CUSTOM_CONFIG_PHP_5_3=YES
  _SPEED_VALID_MAX=3600
  _NGINX_DOS_LIMIT=300
  _SYSTEM_UPGRADE_ONLY=NO
  _USE_MEMCACHED=NO
  _NEWRELIC_KEY=
  _USE_STOCK=NO
  ###
  ### Configuration created on 121215-1545
  ### with Barracuda version BOA-2.0.4
  ###
  _EXTRA_PACKAGES=
  _PHP_EXTRA_CONF=""
  _STRONG_PASSWORDS=NO
  _DB_BINARY_LOG=NO
  _DB_ENGINE=InnoDB
  _NGINX_LDAP=NO
  _PHP_GEOS=NO
  _PHP_MONGODB=NO
  _AEGIR_UPGRADE_ONLY=NO
  ### Squeeze to Wheezy upgrade config
  ### See /trac/ticket/535
  _SQUEEZE_TO_WHEEZY=YES
  _NGINX_FORWARD_SECRECY=YES
  _NGINX_SPDY=YES
  #_BUILD_FROM_SRC=NO
  _NGINX_NAXSI=NO
  _PHP_ZEND_OPCACHE=YES
  _PERMISSIONS_FIX=YES
  _MODULES_FIX=YES
  _MODULES_SKIP=""
  _SSL_FROM_SOURCES=NO
  _SSH_FROM_SOURCES=NO
  _RESERVED_RAM=0
  
  Do you want to proceed with the upgrade? [Y/n] Y
  
  Barracuda [Sat Nov 30 20:43:35 GMT 2013] ==> INFO: Checking your system version...
   
  Barracuda [Sat Nov 30 20:43:36 GMT 2013] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3
   
  Barracuda [Sat Nov 30 20:43:36 GMT 2013] ==> INFO: Updating packages sources list...
  Barracuda [Sat Nov 30 20:43:36 GMT 2013] ==> INFO: We will use Debian mirror ftp.debian.org
    
  Barracuda [Sat Nov 30 20:43:52 GMT 2013] ==> INFO: Downloading little helpers...
  Barracuda [Sat Nov 30 20:43:53 GMT 2013] ==> INFO: Checking BARRACUDA version...
  Barracuda [Sat Nov 30 20:43:53 GMT 2013] ==> INFO: BARRACUDA version test: OK
   
  Barracuda [Sat Nov 30 20:43:55 GMT 2013] ==> UPGRADE START -> checkpoint: 
  
    * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
    * Your server hostname is puffin.webarch.net.
    * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.
  
   
  Do you want to proceed with the upgrade? [Y/n] Y

  Barracuda [Sat Nov 30 20:44:24 GMT 2013] ==> INFO: Cleaning up temp files in /var/opt/
  Barracuda [Sat Nov 30 20:44:26 GMT 2013] ==> INFO: Running aptitude update...
  Barracuda [Sat Nov 30 20:45:35 GMT 2013] ==> INFO: Upgrading required libraries and tools
  Barracuda [Sat Nov 30 20:45:35 GMT 2013] ==> NOTE! This step may take a few minutes, please wait...
  Barracuda [Sat Nov 30 20:46:44 GMT 2013] ==> INFO: Testing Nginx version...
  Barracuda [Sat Nov 30 20:46:46 GMT 2013] ==> INFO: Installed Nginx version nginx/1.5.6, upgrade required
  Barracuda [Sat Nov 30 20:46:52 GMT 2013] ==> INFO: Upgrading Nginx...
  Barracuda [Sat Nov 30 20:48:08 GMT 2013] ==> INFO: Running aptitude full-upgrade, please wait...
  Barracuda [Sat Nov 30 20:48:55 GMT 2013] ==> INFO: Testing Nginx version...
  Barracuda [Sat Nov 30 20:48:57 GMT 2013] ==> INFO: Installed Nginx version nginx/1.5.7, OK
  Barracuda [Sat Nov 30 20:49:02 GMT 2013] ==> INFO: Installing MySecureShell 1.31...
  Barracuda [Sat Nov 30 20:49:29 GMT 2013] ==> INFO: Checking SMTP connections...
  Barracuda [Sat Nov 30 20:49:31 GMT 2013] ==> INFO: Upgrading a few more tools...
  Barracuda [Sat Nov 30 20:49:35 GMT 2013] ==> INFO: Checking if PHP upgrade is available
  Barracuda [Sat Nov 30 20:49:37 GMT 2013] ==> INFO: Installed PHP version 5.3.27, OK
  Barracuda [Sat Nov 30 20:49:37 GMT 2013] ==> INFO: PHP 5.3.27 rebuild required to include MariaDB 5.5.34 libs
  Barracuda [Sat Nov 30 20:49:39 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27
  Barracuda [Sat Nov 30 20:49:39 GMT 2013] ==> NOTE! This step may take longer than 8 minutes, please wait...
  Barracuda [Sat Nov 30 20:49:44 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 1/3
  Barracuda [Sat Nov 30 20:49:47 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 2/3
  Barracuda [Sat Nov 30 20:51:41 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 3/3
  Barracuda [Sat Nov 30 21:02:18 GMT 2013] ==> INFO: Installing Imagick for PHP-FPM 5.3.27...
  Barracuda [Sat Nov 30 21:02:41 GMT 2013] ==> INFO: Installing Zend OPcache for PHP-FPM 5.3.27...
  Barracuda [Sat Nov 30 21:03:01 GMT 2013] ==> INFO: Installing PhpRedis for PHP-FPM 5.3.27...
  Barracuda [Sat Nov 30 21:03:22 GMT 2013] ==> INFO: Installing UploadProgress for PHP-FPM 5.3.27...
  Barracuda [Sat Nov 30 21:03:33 GMT 2013] ==> INFO: Installing JSMin for PHP-FPM 5.3.27...
  Barracuda [Sat Nov 30 21:03:57 GMT 2013] ==> INFO: Installed Redis version 2.6.16, OK
  Barracuda [Sat Nov 30 21:03:59 GMT 2013] ==> INFO: Installing Redis update for Debian/wheezy...
  Barracuda [Sat Nov 30 21:05:10 GMT 2013] ==> INFO: Generating random password for Redis server
  Barracuda [Sat Nov 30 21:05:17 GMT 2013] ==> INFO: Updating MariaDB and PHP configuration
  Barracuda [Sat Nov 30 21:05:19 GMT 2013] ==> INFO: OS and services upgrade completed
   
  Barracuda [Sat Nov 30 21:05:21 GMT 2013] ==> INFO: Restarting MariaDB server, please wait...
  Barracuda [Sat Nov 30 21:05:40 GMT 2013] ==> INFO: Upgrading MariaDB tables if necessary, please wait a minute...
   
  Do you want to upgrade Aegir Master Instance? [Y/n] y
  Barracuda [Sat Nov 30 21:07:49 GMT 2013] ==> INFO: Running Aegir Master Instance upgrade
  Barracuda [Sat Nov 30 21:07:53 GMT 2013] ==> INFO: Syncing provision backend db_passwd...
  Barracuda [Sat Nov 30 21:07:57 GMT 2013] ==> INFO: Running hosting-dispatch (1/3)...
  Barracuda [Sat Nov 30 21:08:10 GMT 2013] ==> INFO: Running hosting-dispatch (2/3)...
  Barracuda [Sat Nov 30 21:08:17 GMT 2013] ==> INFO: Running hosting-dispatch (3/3)...
  Barracuda [Sat Nov 30 21:08:17 GMT 2013] ==> INFO: Syncing hostmaster frontend db_passwd...
  Barracuda [Sat Nov 30 21:08:19 GMT 2013] ==> INFO: Testing previous install...
  Barracuda [Sat Nov 30 21:08:19 GMT 2013] ==> INFO: Test OK, we can proceed with Hostmaster upgrade
  Barracuda [Sat Nov 30 21:08:19 GMT 2013] ==> INFO: Moving old directories
  Barracuda [Sat Nov 30 21:08:19 GMT 2013] ==> INFO: Downloading drush...
  PHP Warning:  PHP Startup: Unable to load dynamic library '/opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so' - /opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so: cannot open shared object file: No such file or directory in Unknown on line 0
  Barracuda [Sat Nov 30 21:08:21 GMT 2013] ==> INFO: Drush seems to be functioning properly
  PHP Warning:  PHP Startup: Unable to load dynamic library '/opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so' - /opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so: cannot open shared object file: No such file or directory in Unknown on line 0
  Barracuda [Sat Nov 30 21:08:21 GMT 2013] ==> INFO: Installing provision backend in /var/aegir/.drush
  Barracuda [Sat Nov 30 21:08:21 GMT 2013] ==> INFO: Downloading Drush and Provision extensions...
  Barracuda [Sat Nov 30 21:08:22 GMT 2013] ==> INFO: Running hostmaster-migrate, please wait...
  Barracuda [Sat Nov 30 21:09:02 GMT 2013] ==> INFO: Syncing hostmaster frontend db_passwd...
  Barracuda [Sat Nov 30 21:09:39 GMT 2013] ==> INFO: Aegir Master Instance upgrade completed
   
  Barracuda [Sat Nov 30 21:09:40 GMT 2013] ==> INFO: Installing extra Drush versions
  Barracuda [Sat Nov 30 21:09:42 GMT 2013] ==> INFO: Drush 4.6-dev installation complete
  Barracuda [Sat Nov 30 21:09:42 GMT 2013] ==> INFO: Drush 5-head-nov-21-2013 installation complete
  Barracuda [Sat Nov 30 21:09:42 GMT 2013] ==> INFO: Drush 6-head-nov-21-2013 installation complete
  Barracuda [Sat Nov 30 21:09:48 GMT 2013] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
  Barracuda [Sat Nov 30 21:09:56 GMT 2013] ==> INFO: Restarting MariaDB server
   
  Barracuda [Sat Nov 30 21:10:07 GMT 2013] ==> INFO: New random password for MariaDB generated and updated
  Barracuda [Sat Nov 30 21:10:09 GMT 2013] ==> INFO: New entry added to /var/log/barracuda_log.txt
  Barracuda [Sat Nov 30 21:10:13 GMT 2013] ==> INFO: DNS cache pdnsd server re-installation forced
  Barracuda [Sat Nov 30 21:10:13 GMT 2013] ==> INFO: Installing DNS cache pdnsd server...
  
  Barracuda [Sat Nov 30 21:11:22 GMT 2013] ==> CARD: Now charging your credit card for this auto-upgrade magic...
  Barracuda [Sat Nov 30 21:11:28 GMT 2013] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)
   
  Barracuda [Sat Nov 30 21:11:32 GMT 2013] ==> Final post-upgrade cleaning, please wait a moment...
  Barracuda [Sat Nov 30 21:16:25 GMT 2013] ==> BYE!
  
  BARRACUDA upgrade completed
  Bye

I then edited:

And restarted the servers:

/etc/init.d/php53-fpm reload
/etc/init.d/nginx restart

Then:

octopus up-stable all
  load is 33 while maxload is 1555
  Octopus upgrade for User /data/disk/tn
  waiting 3 sec
  Octopus [Sat Nov 30 21:26:59 GMT 2013] ==> BOA Skynet welcomes you aboard!
   
  Octopus [Sat Nov 30 21:27:02 GMT 2013] ==> INFO: Reading your /root/.tn.octopus.cnf config file
  Octopus [Sat Nov 30 21:27:03 GMT 2013] ==> NOTE! Please review all config options displayed below
   
  ###
  ### Configuration created on 121215-1617 with
  ### Octopus version BOA-2.0.4
  ###
  ### NOTE: the group of settings displayed bellow
  ### will *override* all listed settings in the Octopus script.
  ###
  _USER="tn"
  _MY_EMAIL="chris@webarchitects.co.uk"
  _PLATFORMS_LIST="D7P OA7"
  _ALLOW_UNSUPPORTED=NO
  _AUTOPILOT=YES
  _HM_ONLY=NO
  _O_CONTRIB_UP=YES
  _DEBUG_MODE=NO
  _MY_OWNIP=
  _FORCE_GIT_MIRROR=""
  _THIS_DB_HOST=localhost
  _DNS_SETUP_TEST=NO
  _HOT_SAUCE=NO
  _USE_CURRENT=YES
  _REMOTE_CACHE_IP=127.0.0.1
  _LOCAL_NETWORK_IP=
  _PHP_FPM_VERSION=5.3
  _PHP_CLI_VERSION=5.3
  _USE_STOCK=NO
  ###
  ### NOTE: the group of settings displayed bellow will be *overriden*
  ### by config files stored in the /data/disk/tn/log/ directory,
  ### but only on upgrade.
  ###
  _DOMAIN="tn.puffin.webarch.net"
  _CLIENT_EMAIL="chris@webarchitects.co.uk"
  _CLIENT_OPTION="SSD"
  _CLIENT_SUBSCR="Y"
  _CLIENT_CORES="14"
  ###
  ### Configuration created on 121215-1617 with
  ### Octopus version BOA-2.0.4
  ###
  _STRONG_PASSWORDS=NO
  _DEL_OLD_EMPTY_PLATFORMS=90
  _SQL_CONVERT=NO
  _DEL_OLD_BACKUPS=0
  _DEL_OLD_TMP=0
   
  Octopus [Sat Nov 30 21:27:07 GMT 2013] ==> UPGRADE in progress...
   
  Octopus [Sat Nov 30 21:27:07 GMT 2013] ==> START -> checkpoint: 
  
    * Your Aegir control panel for this instance is available at https://tn.puffin.webarch.net
    * Your Aegir system user for this instance is tn
    * This Octopus will use PHP-CLI 5.3 for all sites
    * This Octopus will use PHP-FPM 5.3 both for D6 and D7 sites
    * This Octopus includes platforms: D7P OA7 / Unsupported: NO
    * This Octopus options are listed as SSD / Y / 14 C
  
   
  Octopus [Sat Nov 30 21:27:07 GMT 2013] ==> 8s before we will continue...
  Octopus [Sat Nov 30 21:27:23 GMT 2013] ==> UPGRADE A: Aegir automated install script part A
  Octopus [Sat Nov 30 21:27:23 GMT 2013] ==> UPGRADE A: Checking OCTOPUS version...
  Octopus [Sat Nov 30 21:27:23 GMT 2013] ==> UPGRADE A: OCTOPUS version test: OK
  Octopus [Sat Nov 30 21:27:23 GMT 2013] ==> UPGRADE A: Shared platforms code v.004 (hot new) will be created
  Octopus [Sat Nov 30 21:27:23 GMT 2013] ==> UPGRADE A: Creating directories with correct permissions...
  Octopus [Sat Nov 30 21:27:25 GMT 2013] ==> UPGRADE A: Syncing provision backend db_passwd...
  Octopus [Sat Nov 30 21:27:29 GMT 2013] ==> UPGRADE A: Running hosting-dispatch (1/3)...
  Octopus [Sat Nov 30 21:27:45 GMT 2013] ==> UPGRADE A: Running hosting-dispatch (2/3)...
  Octopus [Sat Nov 30 21:28:03 GMT 2013] ==> UPGRADE A: Running hosting-dispatch (3/3)...
   
  Octopus [Sat Nov 30 21:28:06 GMT 2013] ==> UPGRADE A: Syncing hostmaster frontend db_passwd...
  Octopus [Sat Nov 30 21:28:08 GMT 2013] ==> UPGRADE A: Switching user and running AegirSetupB...
  Octopus [Sat Nov 30 21:28:11 GMT 2013] ==> UPGRADE B: Aegir automated install script part B
  Octopus [Sat Nov 30 21:28:11 GMT 2013] ==> UPGRADE B: Creating directories with correct permissions
  Octopus [Sat Nov 30 21:28:14 GMT 2013] ==> UPGRADE B: Running standard installer
  Octopus [Sat Nov 30 21:28:16 GMT 2013] ==> UPGRADE B: Downloading drush...
  PHP Warning:  PHP Startup: Unable to load dynamic library '/opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so' - /opt/local/lib/php/extensions/no-debug-non-zts-20090626/newrelic.so: cannot open shared object file: No such file or directory in Unknown on line 0
  Octopus [Sat Nov 30 21:28:17 GMT 2013] ==> UPGRADE B: Drush seems to be functioning properly
  Octopus [Sat Nov 30 21:28:17 GMT 2013] ==> UPGRADE B: Installing provision backend in /data/disk/tn/.drush
  Octopus [Sat Nov 30 21:28:17 GMT 2013] ==> UPGRADE B: Downloading Drush and Provision extensions...
  Octopus [Sat Nov 30 21:28:20 GMT 2013] ==> UPGRADE B: Testing previous install...
  Octopus [Sat Nov 30 21:28:20 GMT 2013] ==> UPGRADE B: Hostmaster STATUS: upgrade start
  Octopus [Sat Nov 30 21:28:22 GMT 2013] ==> UPGRADE B: Running hostmaster-migrate, please wait...
  Octopus [Sat Nov 30 21:29:16 GMT 2013] ==> UPGRADE B: Hostmaster STATUS: upgrade completed
  Octopus [Sat Nov 30 21:29:16 GMT 2013] ==> UPGRADE B: Simple check if Aegir upgrade is successful
  Octopus [Sat Nov 30 21:29:18 GMT 2013] ==> UPGRADE B: Aegir upgrade test result: OK
  Octopus [Sat Nov 30 21:29:18 GMT 2013] ==> UPGRADE B: Enhancing Aegir UI, please wait...
  Octopus [Sat Nov 30 21:29:49 GMT 2013] ==> UPGRADE A: Syncing hostmaster frontend db_passwd...
  Octopus [Sat Nov 30 21:29:51 GMT 2013] ==> UPGRADE A: Aegir Satellite Instance upgrade completed
  Octopus [Sat Nov 30 21:30:10 GMT 2013] ==> UPGRADE A: Creating shared directories...
  Octopus [Sat Nov 30 21:30:26 GMT 2013] ==> UPGRADE A: Running o_contrib modules check and upgrade...
  Octopus [Sat Nov 30 21:30:26 GMT 2013] ==> UPGRADE A: Switching user and running Platforms build
  Octopus [Sat Nov 30 21:30:28 GMT 2013] ==> UPGRADE C: Aegir automated install script part C
  Octopus [Sat Nov 30 21:30:28 GMT 2013] ==> UPGRADE C: Shared platforms code v.004 (hot new) will be created
   
  Octopus [Sat Nov 30 21:30:30 GMT 2013] ==> DISTRO: Drupal 7.24.1 P.004 installation in progress...
  Octopus [Sat Nov 30 21:30:32 GMT 2013] ==> DISTRO: Drupal 7.24.1 P.004 installation completed
   
  Octopus [Sat Nov 30 21:30:34 GMT 2013] ==> DISTRO: Open Atrium 2.0.9 7.24.1 P.004 installation in progress...
  Octopus [Sat Nov 30 21:30:43 GMT 2013] ==> DISTRO: Open Atrium 2.0.9 7.24.1 P.004 installation completed
   
  Octopus [Sat Nov 30 21:30:45 GMT 2013] ==> UPGRADE C: Removing some unused core files...
  Octopus [Sat Nov 30 21:30:45 GMT 2013] ==> UPGRADE C: Running Platforms Save & Verify tasks, please wait...
  Octopus [Sat Nov 30 21:30:54 GMT 2013] ==> UPGRADE A: Platforms installation completed
  Octopus [Sat Nov 30 21:30:54 GMT 2013] ==> UPGRADE A: Cleaning up various dot files...
  Octopus [Sat Nov 30 21:30:59 GMT 2013] ==> UPGRADE A: Creating ftp symlinks
  Octopus [Sat Nov 30 21:31:01 GMT 2013] ==> UPGRADE A: Preparing setupmail.txt
  Octopus [Sat Nov 30 21:31:03 GMT 2013] ==> UPGRADE A: Resending setup e-mail on upgrade...
  Octopus [Sat Nov 30 21:31:07 GMT 2013] ==> UPGRADE A: New entry added to /data/disk/tn/log/octopus_log.txt
  Octopus [Sat Nov 30 21:31:07 GMT 2013] ==> UPGRADE A: Final cleaning, please wait a moment...
Octopus [Sat Nov 30 21:31:03 GMT 2013] ==> UPGRADE A: Resending setup e-mail on upgrade...
Octopus [Sat Nov 30 21:31:07 GMT 2013] ==> UPGRADE A: New entry added to /data/disk/tn/log/octopus_log.txt
Octopus [Sat Nov 30 21:31:07 GMT 2013] ==> UPGRADE A: Final cleaning, please wait a moment...
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Fixing context version in FServer platforms
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/purge with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/expire with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/httprl with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/boost with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/phpass with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/advagg with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/force_password_change with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/fpa with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:31 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib/cdn with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/purge with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/expire with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/httprl with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/boost with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/phpass with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/advagg with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/force_password_change with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/fpa with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:33 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib/cdn with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/purge with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/expire with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/httprl with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/boost with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/phpass with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/advagg with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/force_password_change with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/fpa with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:35 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib/cdn with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/purge with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/expire with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/httprl with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/filefield_nginx_progress with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/boost with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/speedy with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/entitycache with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/taxonomy_edge with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/advagg with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/force_password_change with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/fpa with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:38 GMT 2013] ==> UPGRADE A: Replaced /data/all/001/o_contrib_seven/cdn with latest release
Octopus [Sat Nov 30 21:31:43 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/purge with latest release
Octopus [Sat Nov 30 21:31:43 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/expire with latest release
Octopus [Sat Nov 30 21:31:43 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/httprl with latest release
Octopus [Sat Nov 30 21:31:43 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/filefield_nginx_progress with latest release
Octopus [Sat Nov 30 21:31:43 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/boost with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/speedy with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/entitycache with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/taxonomy_edge with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/advagg with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/force_password_change with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/fpa with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/cdn with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/speedy with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/entitycache with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/taxonomy_edge with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/advagg with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/force_password_change with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/fpa with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:44 GMT 2013] ==> UPGRADE A: Replaced /data/all/002/o_contrib_seven/cdn with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/purge with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/expire with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/httprl with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/filefield_nginx_progress with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/boost with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/speedy with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/entitycache with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/taxonomy_edge with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/advagg with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/force_password_change with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/fpa with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/views_cache_bully with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/views_content_cache with latest release
Octopus [Sat Nov 30 21:31:49 GMT 2013] ==> UPGRADE A: Replaced /data/all/003/o_contrib_seven/cdn with latest release
Octopus [Sat Nov 30 21:31:55 GMT 2013] ==> UPGRADE A: Starting the cron now
Octopus [Sat Nov 30 21:31:55 GMT 2013] ==> UPGRADE A: All done!
Octopus [Sat Nov 30 21:31:55 GMT 2013] ==> BYE!
waiting 7 sec
Done for /data/disk/tn



OCTOPUS upgrade completed
Bye

I think scripting the changes to the files probably would make sense, but it wouldn't make this task all that much faster as I edited the files mostly while the upgrades were running.

I also updated the steps at wiki:PuffinServer#UpgradingBOA so that now reflects exactly the change made.

And the site seems to be working, so that's it for tonight :-)


Last edited 3 years ago by chris (previous) (diff)

comment:9 follow-up: ↓ 11 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 1.55 to 1.65

Jim -- I'm proposing I upgrade BOA tonight / tomorrow to get new PHP version -- does this make sense?

wiki:PuffinServer is now running PHP from source, that means that we don't get updates with Debian for PHP like we do for the other servers. We still have config files from the dotdeb PHP that was installed but these packages are no longer installed, they have been removed:

dpkg -l | grep php
rc  php-pear                                5.3.27-1~dotdeb.0             all          PEAR - PHP Extension and Application Repository
rc  php5-apc                                5.3.27-1~dotdeb.0             amd64        apc module for php5
rc  php5-cli                                5.3.27-1~dotdeb.0             amd64        command-line interpreter for the php5 scripting language
rc  php5-common                             5.3.27-1~dotdeb.0             amd64        Common files for packages built from the php5 source
rc  php5-curl                               5.3.27-1~dotdeb.0             amd64        CURL module for php5
rc  php5-fpm                                5.3.27-1~dotdeb.0             amd64        server-side, HTML-embedded scripting language (FPM-CGI binary)
rc  php5-gd                                 5.3.27-1~dotdeb.0             amd64        GD module for php5
rc  php5-geoip                              5.3.27-1~dotdeb.0             amd64        geoip module for php5
rc  php5-gmp                                5.3.27-1~dotdeb.0             amd64        GMP module for php5
rc  php5-imagick                            5.3.27-1~dotdeb.0             amd64        imagick module for php5
rc  php5-imap                               5.3.27-1~dotdeb.0             amd64        IMAP module for php5
rc  php5-ldap                               5.3.27-1~dotdeb.0             amd64        LDAP module for php5
rc  php5-mcrypt                             5.3.27-1~dotdeb.0             amd64        MCrypt module for php5
rc  php5-mysql                              5.3.27-1~dotdeb.0             amd64        MySQL module for php5
rc  php5-sqlite                             5.3.27-1~dotdeb.0             amd64        SQLite module for php5
rc  php5-xmlrpc                             5.3.27-1~dotdeb.0             amd64        XML-RPC module for php5
rc  php5-xsl                                5.3.27-1~dotdeb.0             amd64        XSL module for php5

wiki:PuffinServer has:

php -v
PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
Copyright (c) 1997-2013 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
    with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

And yesterday PHP 5.3.28 Released:

The PHP development team announces the immediate availability of PHP 5.3.28. This release fixes two security issues in OpenSSL module in PHP 5.3 - CVE-2013-4073 and CVE-2013-6420. All PHP 5.3 users are encouraged to upgrade to PHP 5.3.28 or latest versions of PHP 5.4 or PHP 5.5.

See ticket:218#comment:128 for the Debian updates.

I assume we need to do a BOA upgrade, wiki:PuffinServer#UpgradingBOA to get the latest PHP, I could do this during the day today but as it generally takes around 30 mins and involves quite a bit of site downtime it is probably best if it waits till an evening or at least the weekend.

Last edited 3 years ago by chris (previous) (diff)

comment:11 in reply to: ↑ 9 ; follow-ups: ↓ 12 ↓ 13 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 1.65 to 1.75

Replying to chris:

Jim -- I'm proposing I upgrade BOA tonight / tomorrow to get new PHP version -- does this make sense?

Yes, go for it...

I assume we need to do a BOA upgrade, wiki:PuffinServer#UpgradingBOA to get the latest PHP, I could do this during the day today but as it generally takes around 30 mins and involves quite a bit of site downtime it is probably best it it waits till an evening or at least the weekend.

Does it really take that long?... I timed a simple barracuda up-stable system on my server - it takes:

  • 8m 50s in total
  • Of which there's 4m 30s of downtime about 20s in whilst it rebuilds PHP and anything else from source.
  • ~2m 30s of uptime
  • Then a final 30s of downtime whilst it restarts everything.

And when done PHP was indeed updated to 5.3.28 as part of this.

Note I did nothing apart from enter the command -- though it looks like it hangs, it just outputs it all to an email I got. It requires no more than 1 minute of my actual time to log in and run the command... Next time I'll make tea whilst it does its thing.

So the question becomes: Why does it take 30min on Puffin? TN should not need to pay so much for a simple update.

comment:12 in reply to: ↑ 11 ; follow-up: ↓ 21 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.43
  • Total Hours changed from 1.75 to 2.18

Replying to jim:

So the question becomes: Why does it take 30min on Puffin?

30 mins was a guess based on how long I remember it taking in the past, I'll run it now and see how long it takes. It does take longer to compile source code than install binary packages, I think it's a shame that BOA no longer uses debs for things like PHP and Nigix. In addition there are all the changes that BOA overwrites than then need to be manually changed back, see wiki:PuffinServer#UpgradingBOA.

date
Sat Dec 14 13:24:06 GMT 2013
sudo -i
screen
cd
wget -q -U iCab http://files.aegir.cc/BOA.sh.txt
bash BOA.sh.txt

BOA Meta Installer setup completed
Please check INSTALL.txt and UPGRADE.txt at http://bit.ly/boa-docs for how-to
Bye

barracuda up-stable system
waiting 8 sec

REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk

BARRACUDA upgrade completed
Bye
date
Sat Dec 14 13:37:44 GMT 2013

The wiki:PuffinServer#nginxconfigchanges were not needed, I have made the wiki:PuffinServer#php-fpmconfigchanges changes and the wiki:PuffinServer#xdragoshellscriptchanges changes.

Check the PHP version:

php -v
PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
Copyright (c) 1997-2013 The PHP Group
Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
    with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

It's not been upgraded :-(

This is the email that was sent:

From: root@puffin.webarch.net (root)
Date: Sat, 14 Dec 2013 13:35:53 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at 131214-1325


Barracuda [Sat Dec 14 13:25:24 GMT 2013] ==> BOA Skynet welcomes you aboard!

Barracuda [Sat Dec 14 13:25:28 GMT 2013] ==> INFO: UPGRADE
Barracuda [Sat Dec 14 13:25:28 GMT 2013] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Sat Dec 14 13:25:29 GMT 2013] ==> NOTE! Please review all config options displayed below
Barracuda [Sat Dec 14 13:25:29 GMT 2013] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Sat Dec 14 13:25:31 GMT 2013] ==> INFO: Checking your system version...

Barracuda [Sat Dec 14 13:25:31 GMT 2013] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Sat Dec 14 13:25:31 GMT 2013] ==> INFO: Updating packages sources list...
Barracuda [Sat Dec 14 13:25:31 GMT 2013] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Sat Dec 14 13:25:49 GMT 2013] ==> INFO: Downloading little helpers...
Barracuda [Sat Dec 14 13:25:50 GMT 2013] ==> INFO: Checking BARRACUDA version...
Barracuda [Sat Dec 14 13:25:50 GMT 2013] ==> INFO: BARRACUDA version test: OK

Barracuda [Sat Dec 14 13:25:52 GMT 2013] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Sat Dec 14 13:25:52 GMT 2013] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Sat Dec 14 13:25:54 GMT 2013] ==> INFO: Running aptitude update...
Barracuda [Sat Dec 14 13:27:15 GMT 2013] ==> INFO: Upgrading required libraries and tools
Barracuda [Sat Dec 14 13:27:15 GMT 2013] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Sat Dec 14 13:28:25 GMT 2013] ==> INFO: Testing Nginx version...
Barracuda [Sat Dec 14 13:28:27 GMT 2013] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Sat Dec 14 13:28:32 GMT 2013] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Sat Dec 14 13:30:20 GMT 2013] ==> INFO: Testing Nginx version...
Barracuda [Sat Dec 14 13:30:22 GMT 2013] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Sat Dec 14 13:30:26 GMT 2013] ==> INFO: Checking SMTP connections...
Barracuda [Sat Dec 14 13:30:28 GMT 2013] ==> INFO: Upgrading a few more tools...
Barracuda [Sat Dec 14 13:30:33 GMT 2013] ==> INFO: Checking if PHP upgrade is available
Barracuda [Sat Dec 14 13:30:36 GMT 2013] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Sat Dec 14 13:30:50 GMT 2013] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Sat Dec 14 13:30:53 GMT 2013] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Sat Dec 14 13:30:54 GMT 2013] ==> INFO: OS and services upgrade completed

Barracuda [Sat Dec 14 13:30:56 GMT 2013] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Sat Dec 14 13:30:57 GMT 2013] ==> INFO: Installing extra Drush versions
Barracuda [Sat Dec 14 13:30:59 GMT 2013] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Sat Dec 14 13:30:59 GMT 2013] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Sat Dec 14 13:31:00 GMT 2013] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Sat Dec 14 13:31:04 GMT 2013] ==> INFO: Generating random password for Redis server
Barracuda [Sat Dec 14 13:31:05 GMT 2013] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Sat Dec 14 13:31:14 GMT 2013] ==> INFO: Restarting MariaDB server

Barracuda [Sat Dec 14 13:31:58 GMT 2013] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Sat Dec 14 13:32:00 GMT 2013] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Sat Dec 14 13:32:08 GMT 2013] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Sat Dec 14 13:32:14 GMT 2013] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Sat Dec 14 13:32:18 GMT 2013] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Sat Dec 14 13:35:53 GMT 2013] ==> BYE!

That did take a bit less than 30 mins, however we are still on the old PHP, Jim -- any suggestions?

Last edited 3 years ago by chris (previous) (diff)

comment:13 in reply to: ↑ 11 Changed 3 years ago by chris

Replying to jim:

So the question becomes: Why does it take 30min on Puffin? TN should not need to pay so much for a simple update.

It took 25 mins, but it didn't compile a new PHP as it should have. You seem to be implying that I'm recording incorrect times or not working fast enough on BOA updates, is that the case or am I misunderstanding something here?

comment:14 follow-ups: ↓ 15 ↓ 16 ↓ 17 ↓ 18 Changed 3 years ago by jim

[JK] So the question becomes: Why does it take 30min on Puffin? TN should not need to pay so much for a simple update.

[CC] It took 25 mins, but it didn't compile a new PHP as it should have. You seem to be implying that I'm recording incorrect times or not working fast enough on BOA updates, is that the case or am I misunderstanding something here?

Sorry Chris, reading that back I realise that was a really poorly constructed sentence -- my daughter was clawing at the keyboard and I saved rather than thinking though my point through.

My point is: I'm just surprised it costs so much to get these updates done... That's not a slight against you as your hands are tied with BOA and the frequency of updates, I'm merely a little surprised at the discrepancy between my BOA server and Puffin's running costs.

Perhaps we should look at the frequency of the updates, or the post-BOA update tasks themselves and try to minimise time taken on these... Clearly when you spot a key update that must go though, then it must be done -- but could perhaps other updates can wait until a high priority update takes them through? Or are you doing that already?

But the above doesn't cover the point about BOA taking 20 mins to update... I think this is too much, and if we've overcomplicated the Puffin config, perhaps we need to either script these extra tweaks or drop some of them... Adding up the 10mins extra here and there is an 1-4 hours a year we could spend on scripting/patch generation instead.

What do you reckon? Also, are there any parts of the wiki:PuffinServer#UpgradingBOA you would like for the platform to support out the box? It might be worth raising some feature or support requests on the BOA issue queue -- I'm happy to do them if you like.

comment:15 in reply to: ↑ 14 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.54
  • Total Hours changed from 2.18 to 2.72

Replying to jim:

My point is: I'm just surprised it costs so much to get these updates done... That's not a slight against you as your hands are tied with BOA and the frequency of updates, I'm merely a little surprised at the discrepancy between my BOA server and Puffin's running costs.

I realise that one of the key reasons to switch from Apache / Varnish to BOA was to reduce the sysadmin time needed, it would be interesting to add up all the time spent on BOA in the last year and to compare that with the time spent on Apache / Varnish, my guess would be that it didn't save any sysadmin time and perhaps has taken up even more than we spent on Apache / Varnish.

Please feel free to audit the time spent on the BOA updates:

For the one today, the script ran from 13:24:06 to 13:35:53, that is 0:11:47, but this didn't include installing a full new PHP, last time a new PHP was installed from source code it took 14 mins just to build and install PHP, see ticket:535#comment:24

Barracuda [Sun Nov 17 23:55:32 GMT 2013] ==> INFO: Checking if PHP upgrade is available
Barracuda [Sun Nov 17 23:55:34 GMT 2013] ==> INFO: PHP 5.3.27 rebuild required to include MariaDB 5.5.33a libs
Barracuda [Sun Nov 17 23:55:36 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27
Barracuda [Sun Nov 17 23:55:36 GMT 2013] ==> NOTE! This step may take longer than 8 minutes, please wait...
Barracuda [Sun Nov 17 23:55:41 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 1/3
Barracuda [Sun Nov 17 23:55:44 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 2/3
Barracuda [Sun Nov 17 23:57:36 GMT 2013] ==> INFO: Installing PHP-FPM 5.3.27 part 3/3
Barracuda [Mon Nov 18 00:08:20 GMT 2013] ==> INFO: Installing Imagick for PHP-FPM 5.3.27...
Barracuda [Mon Nov 18 00:08:42 GMT 2013] ==> INFO: Installing Zend OPcache for PHP-FPM 5.3.27...
Barracuda [Mon Nov 18 00:09:03 GMT 2013] ==> INFO: Installing PhpRedis for PHP-FPM 5.3.27...
Barracuda [Mon Nov 18 00:09:24 GMT 2013] ==> INFO: Installing UploadProgress for PHP-FPM 5.3.27...
Barracuda [Mon Nov 18 00:09:35 GMT 2013] ==> INFO: Installing JSMin for PHP-FPM 5.3.27...

So adding 11:47 and 14:03 is 25:50 -- this is how long it takes, and once some time for updating the ticket and wiki are added in it generally takes over 30 mins to do a BOA upgrade.

I'm dissapointed that BOA now uses PHP from source and not from debs, it does make the upgrades slower, upgrading PHP on the other servers is very quick, see ticket:218#comment:128, the upgrade of PHP on wiki:PuffinServer would have been done in the same 15 mins that was recorded for upgrading PHP on wiki:PenguinServer and wiki:ParrotServer if BOA still used PHP from dotdeb.

Perhaps we should look at the frequency of the updates

This isn't something in our control.

or the post-BOA update tasks themselves and try to minimise time taken on these... Clearly when you spot a key update that must go though, then it must be done -- but could perhaps other updates can wait until a high priority update takes them through? Or are you doing that already?

I'm not sure what things you think should be held back? The debian updates are done as soon as possible as I get sent a email every 5 mins for each server with outstanding updates, we have often waited not to deploy BOA updates as soon as they come out and have even skipped versions when doing this, if needs be I could go through the past years worth of updates and compare the date the update came out with the date it was deployed. But I doubt there is much time to be saved here.

But the above doesn't cover the point about BOA taking 20 mins to update... I think this is too much

Well, what can we do, this isn't something we can control, if a new PHP has been installed today I think the script would have taken 25 mins to run based on how long it has taken in the past.

and if we've overcomplicated the Puffin config, perhaps we need to either script these extra tweaks or drop some of them... Adding up the 10mins extra here and there is an 1-4 hours a year we could spend on scripting/patch generation instead.

The changes we make are essential, the fixes are:

  • To enable Munin graphs to be produced from PHP-FPM data.
  • To ensure that BOA does not commit suicide when there is a small load spike.
  • To reduce the number of PHP-PFM processes to save on RAM for other things.

I could look at writing a bash script to apply the changes if you want but it's not going to save a huge amount of time.

What do you reckon? Also, are there any parts of the wiki:PuffinServer#UpgradingBOA you would like for the platform to support out the box?

Yes, the list above.

It might be worth raising some feature or support requests on the BOA issue queue -- I'm happy to do them if you like.

OK, go for it.

I'm sorry that I have spent 30 mins writing this reply but I feel that it was needed due to the concerns raised regarding the time and money spent on BOA updates.

Last edited 3 years ago by chris (previous) (diff)

comment:16 in reply to: ↑ 14 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 2.72 to 2.82

Replying to jim:

Perhaps we should look at the frequency of the updates, or the post-BOA update tasks themselves and try to minimise time taken on these... Clearly when you spot a key update that must go though, then it must be done -- but could perhaps other updates can wait until a high priority update takes them through? Or are you doing that already?

Wherever possible I try to avoid using the BOA scripts for updates, to save time all debian updates are done via the wiki:AptitudeUpdateScript and are recorded on ticket:218, this is a quick process.

We still need to decide what to do regarding the PHP upgrade that failed, see ticket:629#comment:12, perhaps we should try running barracuda up-stable system again or perhaps we should raise a ticket about this, I can't see any existing ones, https://drupal.org/project/issues/barracuda?categories=All

comment:17 in reply to: ↑ 14 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.28
  • Total Hours changed from 2.82 to 3.1

Replying to jim:

It might be worth raising some feature or support requests on the BOA issue queue -- I'm happy to do them if you like.

I think we need to be very careful with this and do it in a way that doesn't result in responses like:

When you started editing config files manually, you are on your own and don't expect any support from us.

https://drupal.org/comment/8255239#comment-8255239

And

Don't mess with config by hand, ever.

https://drupal.org/comment/8257649#comment-8257649

The changes I'd like to see are the following.

Suicide Thresholds

The values for all these variables in /var/xdrago/second.sh to be taken from /root/.barracuda.cnf, currently only two of them are:

CTL_ONEX_SPIDER_LOAD=
CTL_FIVX_SPIDER_LOAD=
CTL_ONEX_LOAD=
CTL_FIVX_LOAD=
CTL_ONEX_LOAD_CRIT=
CTL_FIVX_LOAD_CRIT=

I would also suggest that the way the initial values for these variables is calculated should be checked as the values for servers with lots of cores make no sense, the default values result in a very suicidal server, see ticket:555 (50 hours was spent on this ticket).

PHP_FPM Status Data for Munin and Number of Servers

We currently have the following set in /root/.barracuda.cnf:

_CUSTOM_CONFIG_PHP_5_3=YES

However each BOA upgrade results in /opt/local/etc/php53-fpm.conf needing to be manually edited to change the values documented here wiki:PuffinServer#php-fpmconfigchanges and reproduced here:

pm.status_path = /status
ping.path = /ping
pm.start_servers = 4
pm.max_spare_servers = 4

Nginx and PHP-FPM Status for Munin

There is this variable in /root/.barracuda.cnf and we should look at what this is for, perhaps it can help with the Nginx config we have to manually make for Munin graphs:

_NGINX_EXTRA_CONF=""

We edit /var/aegir/config/server_master/nginx.conf and add the following to the nginx default server section:

  location /nginx_status {
    stub_status on;
    access_log   off;
    allow 127.0.0.1;
    allow 81.95.52.103;
    deny all;
  }
  location ~ ^/(status|ping)$ {
    fastcgi_pass 127.0.0.1:9090;
    fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
    fastcgi_intercept_errors on;
    include fastcgi_params;
    access_log off;
    allow 127.0.0.1;
    deny all;
  }

I haven't found another place where this Nginx config can be added and doesn't get clobbered, however it doesn't get clobbered on every upgrade.

Last edited 3 years ago by chris (previous) (diff)

comment:18 in reply to: ↑ 14 Changed 3 years ago by chris

Replying to jim:

I'm merely a little surprised at the discrepancy between my BOA server and Puffin's running costs.

I think one of the biggest BOA costs this year has perhaps been the issues related to the load spikes, we spent at least 77 hours on this, see ticket:555#comment:132, this isn't a cost you will have had with your BOA server because, I presume, you are running smaller, less complicated and less busy sites on it?

It's also worth noting that the site is currently running on a server with 14 CPU cores and 8G of RAM, this time last year when we were running with Varnish and Apache we had 4 (slower) CPU cores and 3G of (slower) RAM, see wiki:NewLiveServer. I seem to recall that one of the main arguments for the switch to BOA was that it would result in better performance, on the same hardware compared with Apache and Varnish? It appears to me that we have had to throw a lot of time and hardware at BOA to get it to the stage where it's running as well as the Apache / Varnish stack, but I think we have finally got there...?

comment:19 Changed 3 years ago by chris

One thought on Jim's time / money concerns, it might be worth going through all the migration tickets from wiki:NewLiveServer to wiki:PuffinServer and also all the wiki:PuffinServer tickets to add up the time spent this year, the listings here probably include almost all the relevant tickets:

I think that having some hard facts to go on would perhaps help inform the time / money debate we are currently having.

Last edited 3 years ago by chris (previous) (diff)

comment:20 Changed 3 years ago by chris

One other change I'd like to see in BOA is for this value in the config file to be respected:

_BUILD_FROM_SRC=NO

I would have thought that this should result in PHP being installed using debs, as it was in the past from the dotdeb repo, but now we have a PHP installed from source code and this makes upgrades substiantially slower and thus more expensive.

comment:21 in reply to: ↑ 12 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 3.1 to 3.2

Replying to chris:

This is the email that was sent:

Barracuda [Sat Dec 14 13:30:33 GMT 2013] ==> INFO: Checking if PHP upgrade is available
Barracuda [Sat Dec 14 13:30:36 GMT 2013] ==> INFO: Installed PHP version 5.3.27, OK

we are still on the old PHP

Is this is worth following up? Should we try again to see if a "barracuda up-stable system" will upgrade the server to PHP 5.3.28?

Or perhaps we should leave it till another time? It looks like BOA is being tweaked so that multiple versions of PHP can be installed from source:

comment:22 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.5
  • Total Hours changed from 3.2 to 3.7

FYI I've raised an issue around load thresholds: Proposal: Replace hard-coded load thresholds for PHP-FPM kill; defaults are overly suicidal on servers many CPU cores -- this uses uch of the work Chris and I did in ticket:555.

Regarding a new BOA update, we could wait I suppose... Depends on on the criticality of the .28 fix.

I'll try to cover the other points raised in recent tickets soon.

Last edited 3 years ago by jim (previous) (diff)

comment:23 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.05
  • Total Hours changed from 3.7 to 3.75

Well that was quick, <24h later, they've agreed the proposal and expanded on it and fixed the issue around load limits in this commit: http://drupalcode.org/project/barracuda.git/commit/5c9e954

Lesson: They're very responsive to genuine issues and considered proposals, but somewhat hostile to having their time wasted by people who've altered the way BOA works, then expect free help in fixing it. Which is understandable.

I'll raise similar proposals for the other two issues Chris raised above,

comment:24 follow-up: ↓ 25 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 3.75 to 3.85

I see a new entry for /nginx_status has been added in this issue https://drupal.org/node/2148335 that delivers this nginx entry:

server {
    listen 127.0.0.1:80;
    server_name 127.0.0.1;
    location /nginx_status {
      stub_status on;
      access_log off;
      allow 127.0.0.1;
      deny all;
    }
}

Now this is 50% of what Chris wanted, yes? The key thing is we need to allow a remote IP to monitor, plus handle this bit:

  location ~ ^/(status|ping)$ {
    fastcgi_pass 127.0.0.1:9090;
    fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
    fastcgi_intercept_errors on;
    include fastcgi_params;
    access_log off;
    allow 127.0.0.1;
    deny all;
  }

Is the piece above necessary? And can we somehow get by with just 127.0.0.1 open? If not we'll need something more than just this commit, though it fixes the general case (but not ours).

comment:25 in reply to: ↑ 24 Changed 3 years ago by chris

Replying to jim:

I see a new entry for /nginx_status has been added in this issue https://drupal.org/node/2148335 that delivers this nginx entry:

server {
    listen 127.0.0.1:80;
    server_name 127.0.0.1;
    location /nginx_status {
      stub_status on;
      access_log off;
      allow 127.0.0.1;
      deny all;
    }
}

Now this is 50% of what Chris wanted, yes?

Yes.

The key thing is we need to allow a remote IP to monitor

No, just allowing local connections is fine, munin-node runs locally.

  location ~ ^/(status|ping)$ {
    fastcgi_pass 127.0.0.1:9090;
    fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
    fastcgi_intercept_errors on;
    include fastcgi_params;
    access_log off;
    allow 127.0.0.1;
    deny all;
  }

Is the piece above necessary?

Yes, the above is for php-fpm stats.

And can we somehow get by with just 127.0.0.1 open?

Yes, other IP addresses have just been added for testing.

comment:26 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.25
  • Total Hours changed from 3.85 to 4.1

Thanks Chris, I've added this issue for the FPM stats part: https://drupal.org/node/2167459

comment:27 Changed 3 years ago by chris

Thanks, a corresponding change is also needed in the php.ini config file to enable the /ping and /status stats.

comment:28 Changed 3 years ago by jim

Ta, I've updated the issue...

comment:29 Changed 3 years ago by ed

Good work lads

comment:30 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.05
  • Total Hours changed from 4.1 to 4.15

Chris, please see my comment here: https://drupal.org/comment/8347749#comment-8347749

It appears there's already a 2 FPM status stubs in place -- see the standard BOA Nginx config file here: http://drupalcode.org/project/barracuda.git/blob/HEAD:/aegir/conf/nginx_modern_include.conf#l116

Does this work -- can you updated Munin to try please?

comment:31 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 4.15 to 4.25

Response from Omega8cc and issue closed:

Yeah, we have enabled standard PHP-FPM status and ping, but with custom URLs, since it is designed to work on any URL, because site can be hosted on one of three supported PHP versions running in parallel, so there is no global monitoring via single special vhost possible/useful.

So since it's included in the standard site config I think we can simply call either http://www.transitionnetwork.org/fpm-status or http://www.transitionnetwork.org/fpm-ping for monitoring.

However curl http://www.transitionnetwork.org/fpm-ping returns the HTML for a Drupal 404 page, so I'm not clear if this is working in the present version of BOA... this should work when the new version comes out.

comment:32 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.25
  • Total Hours changed from 4.25 to 4.5

I can confirm that the /fpm-status URL doesn't work:

lynx -dump http://127.0.0.1/fpm-status
                                404 Not Found
     __________________________________________________________________

                                    nginx

The /status URL one is the one we are using:

lynx -dump http://127.0.0.1/status
pool:                 www
process manager:      dynamic
start time:           07/Jan/2014:10:03:02 +0000
start since:          1182
accepted conn:        308
listen queue:         0
max listen queue:     0
listen queue len:     128
idle processes:       3
active processes:     1
total processes:      4
max active processes: 3
max children reached: 0

Following the docs from the php-fpm plugin we are using, https://github.com/tjstein/php5-fpm-munin-plugins we can add this to /etc/munin/plugin-conf.d/munin-node to change the URL:

[phpfpm*]
env.url http://127.0.0.1/status

When the /fpm-status URL works then we can update this setting, I have added the above setting in anticipation.

comment:33 Changed 3 years ago by chris

New PHP 5.5.8 is out today http://php.net/archive/2014.php#id2014-01-10-1

10-Jan-2014
The PHP development team announces the immediate availability of PHP 5.5.8. This release fixes about 20 bugs against PHP 5.5.7 components

comment:34 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 4.5 to 4.6

There is a New version of Nginx, 1.5.10 and it looks like the next version of BOA should pick this up, it includes support for SPDY 3.1.

comment:35 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 1.0
  • Total Hours changed from 4.6 to 5.6

As of 26th March 2014 the latest versions of are PHP:

The versions we have on wiki:PuffinServer:

which php
 /usr/local/bin/php
/usr/local/bin/php --version
 PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
 Copyright (c) 1997-2013 The PHP Group
 Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
    with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

This is the version we are using, see:

The latest version in the 5.3 series is:

And:

This release fixes two security issues in OpenSSL module in PHP 5.3 - CVE-2013-4073 and CVE-2013-6420. All PHP 5.3 users are encouraged to upgrade to PHP 5.3.28 or latest versions of PHP 5.4 or PHP 5.5.

These issues:

The OpenSSL::SSL.verify_certificate_identity function in lib/openssl/ssl.rb in Ruby 1.8 before 1.8.7-p374, 1.9 before 1.9.3-p448, and 2.0 before 2.0.0-p247 does not properly handle a '\0' character in a domain name in the Subject Alternative Name field of an X.509 certificate, which allows man-in-the-middle attackers to spoof arbitrary SSL servers via a crafted certificate issued by a legitimate Certification Authority, a related issue to CVE-2009-2408.

https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2013-4073

And:

The asn1_time_to_time_t function in ext/openssl/openssl.c in PHP before 5.3.28, 5.4.x before 5.4.23, and 5.5.x before 5.5.7 does not properly parse (1) notBefore and (2) notAfter timestamps in X.509 certificates, which allows remote attackers to execute arbitrary code or cause a denial of service (memory corruption) via a crafted certificate that is not properly handled by the openssl_x509_parse function.

https://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2013-6420

The day after ​PHP 5.3.28 was released I proposed we used BOA to update PHP, see ticket:629#comment:9, and said I though it would take around 30 mins.

Jim responded to say that it should take less than 10 mins, on ticket:629#comment:11, "TN should not need to pay so much for a simple update.".

On December 14th 2013 I ran the upgrade, see ticket:629#comment:12 and it took 25 mins, however it failed to upgrade PHP and I asked "any suggestions?".

On a later comment, ticket:629#comment:16, I said

We still need to decide what to do regarding the PHP upgrade that failed, see ticket:629#comment:12, perhaps we should try running barracuda up-stable system again or perhaps we should raise a ticket about this, I can't see any existing ones, ​https://drupal.org/project/issues/barracuda?categories=All

And on a later comment, ticket:629#comment:21 I asked:

Should we try again to see if a "barracuda up-stable system" will upgrade the server to PHP 5.3.28?

I will try running "barracuda up-stable system" later tonight to see if results in PHP being upgraded.

Regarding Nginx:

which nginx
  /usr/bin/nginx
/usr/bin/nginx -v
  nginx version: nginx/1.5.7

Since version 1.5.7 the following versions have come out, http://nginx.org/

  • 2013-12-17 nginx-1.5.8
  • 2014-01-22 nginx-1.5.9
  • 2014-02-04 nginx-1.5.10 mainline version has been released, with SPDY 3.1 support in SPDY module
  • 2014-03-04 nginx-1.5.11 mainline version has been released, with a fix for the SPDY memory corruption vulnerability in nginx 1.5.10 discovered by Lucas Molas, researcher at Programa STIC, Fundación Dr. Manuel Sadosky, Buenos Aires, Argentina (CVE-2014-0088).
  • 2014-03-18 nginx-1.5.12 mainline versions has been released, with a fix for the SPDY heap buffer overflow vulnerability discovered by Lucas Molas, researcher at Programa STIC, Fundación Dr. Manuel Sadosky, Buenos Aires, Argentina (CVE-2014-0133).

If you install the Firefox extension, SPDY Indicator (no restart needed, get it via Mozilla) you can see that the site does use SPDY so these security issues do potentially effect us.

Again a "barracuda up-stable system" should result in a new Nginx being compiles from source.

Due to the problems reviewing past BOA upgrades when only one ticket is used for all upgrades I have created a new ticket for the next upgrade, ticket:707 - Upgrade to BOA-2.2.0.

The time creating that ticket has also been included in the time spent on this ticket reviewing the outstanding PHP and Nginx updates.

comment:36 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.5
  • Total Hours changed from 5.6 to 6.1

This is the current /root/.barracuda.cnf

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
#_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO 
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Running the system upgrade in screen:

barracuda up-stable system
waiting 8 sec
^C

I have realised that this is essential to change this to see what is happening:

_AUTOPILOT=NO 

Restarting the update:

barracuda up-stable system
  Another BOA installer is running probably - /var/run/boa_run.pid exists
rm /var/run/boa_run.pid 
barracuda up-stable system
  Some important system task is running probably - /var/run/boa_wait.pid exists

The logs haven't changed:

ls -lah  /var/log/BOA.sh.txt 
  -rw-r--r-- 1 root root 2.2K Dec 23  2012 /var/log/BOA.sh.txt
ls -lah  /var/log/barracuda_log.txt 
  -rw-r--r-- 1 aegir aegir 3.3K Dec 14 13:32 /var/log/barracuda_log.txt

And there doesn't appear to be any tasks running from top or ps, so:

rm /var/run/boa_wait.pid 
barracuda up-stable system
  waiting 8 sec
  REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk
  
  BARRACUDA upgrade completed
  Bye

The report:

From: root@puffin.webarch.net (root)
Date: Wed, 26 Mar 2014 21:21:20 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at 140326-2111


Barracuda [Wed Mar 26 21:11:23 GMT 2014] ==> BOA Skynet welcomes you aboard!

Barracuda [Wed Mar 26 21:11:27 GMT 2014] ==> INFO: UPGRADE
Barracuda [Wed Mar 26 21:11:27 GMT 2014] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Wed Mar 26 21:11:28 GMT 2014] ==> NOTE! Please review all config options displayed below
Barracuda [Wed Mar 26 21:11:28 GMT 2014] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Wed Mar 26 21:11:30 GMT 2014] ==> INFO: Checking your system version...

Barracuda [Wed Mar 26 21:11:30 GMT 2014] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Wed Mar 26 21:11:30 GMT 2014] ==> INFO: Updating packages sources list...
Barracuda [Wed Mar 26 21:11:30 GMT 2014] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Wed Mar 26 21:11:42 GMT 2014] ==> INFO: Downloading little helpers...
Barracuda [Wed Mar 26 21:11:44 GMT 2014] ==> INFO: Checking BARRACUDA version...
Barracuda [Wed Mar 26 21:11:44 GMT 2014] ==> INFO: BARRACUDA version test: OK

Barracuda [Wed Mar 26 21:11:46 GMT 2014] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Wed Mar 26 21:11:46 GMT 2014] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Wed Mar 26 21:11:48 GMT 2014] ==> INFO: Running aptitude update...
Barracuda [Wed Mar 26 21:12:36 GMT 2014] ==> INFO: Upgrading required libraries and tools
Barracuda [Wed Mar 26 21:12:36 GMT 2014] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Wed Mar 26 21:13:22 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 21:13:24 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 21:13:30 GMT 2014] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Wed Mar 26 21:13:58 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 21:14:01 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 21:14:05 GMT 2014] ==> INFO: Checking SMTP connections...
Barracuda [Wed Mar 26 21:14:07 GMT 2014] ==> INFO: Upgrading a few more tools...
Barracuda [Wed Mar 26 21:14:14 GMT 2014] ==> INFO: Checking if PHP upgrade is available
Barracuda [Wed Mar 26 21:14:16 GMT 2014] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Wed Mar 26 21:14:23 GMT 2014] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Wed Mar 26 21:14:25 GMT 2014] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Wed Mar 26 21:14:27 GMT 2014] ==> INFO: OS and services upgrade completed

Barracuda [Wed Mar 26 21:14:29 GMT 2014] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Wed Mar 26 21:14:30 GMT 2014] ==> INFO: Installing extra Drush versions
Barracuda [Wed Mar 26 21:14:32 GMT 2014] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Wed Mar 26 21:14:33 GMT 2014] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 21:14:33 GMT 2014] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 21:14:38 GMT 2014] ==> INFO: Generating random password for Redis server
Barracuda [Wed Mar 26 21:14:38 GMT 2014] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Wed Mar 26 21:14:51 GMT 2014] ==> INFO: Restarting MariaDB server

Barracuda [Wed Mar 26 21:15:09 GMT 2014] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Wed Mar 26 21:15:11 GMT 2014] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Wed Mar 26 21:15:25 GMT 2014] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Wed Mar 26 21:15:31 GMT 2014] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Wed Mar 26 21:15:35 GMT 2014] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Wed Mar 26 21:21:20 GMT 2014] ==> BYE!

Check the PHP version:

php -v
  PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
  Copyright (c) 1997-2013 The PHP Group
  Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
    with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

And it's the same version at https://www.transitionnetwork.org/admin/reports/status/php

Check the Nginx version:

/usr/bin/nginx -v
  nginx version: nginx/1.5.7

So neither have been upgraded, perhaps "barracuda up-stable system" is the wrong command to update things like PHP and Nginx?

Last edited 3 years ago by chris (previous) (diff)

comment:37 follow-ups: ↓ 40 ↓ 46 Changed 3 years ago by jim

  • Estimated Number of Hours changed from 0.0 to 0.1

The only thing I'd suggest: _SYSTEM_UPGRADE_ONLY is set to 'yes' - try setting to 'no', could be the cause.

comment:38 Changed 3 years ago by jim

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Estimated Number of Hours changed from 0.1 to 0.0
  • Total Hours changed from 6.1 to 6.2

comment:39 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.3
  • Total Hours changed from 6.2 to 6.5

The following was written before I saw ticket:629#comment:37 -- I'll follow that up on the next comment...

Looking at the http://drupalcode.org/project/barracuda.git/blob/HEAD:/docs/UPGRADE.txt file:

69 ### NOTE: You can append "system" as a last argument to the barracuda
70           command, and it will upgrade only the system, without running
71           Aegir Master Instance upgrade, plus it will write the output
72           to the file instead of to the console:
73           /var/backups/reports/up/barracuda/*
74
75           Example:
76
77           $ barracuda up-stable system
78
79 ### NOTE: While both "log" and "system" modes are "silent", because
80           they don't display anything in your console, they will send
81           the log via e-mail to your address specified in the file:
82           /root/.barracuda.cnf
83
84           It is recommended that you start `screen` before running
85           commands using the "silent" mode - to avoid confusion
86           or incomplete tasks when your SSH connection drops.

It is the expected behaviour not to display what is happening in the console with a "barracuda up-stable system".

Perhaps this needs to be run first:

15 $ wget -q -U iCab http://files.aegir.cc/BOA.sh.txt
16 $ bash BOA.sh.txt

So:

wget -q -U iCab http://files.aegir.cc/BOA.sh.txt
root@puffin:~# bash BOA.sh.txt

  BOA Meta Installer setup completed
  Please check INSTALL.txt and UPGRADE.txt at http://bit.ly/boa-docs for how-to
  Bye

barracuda up-stable system
  waiting 8 sec
  REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk
  
  BARRACUDA upgrade completed
  Bye

This is the email that was sent:

From: root@puffin.webarch.net (root)
Date: Wed, 26 Mar 2014 21:47:32 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at
 140326-2138


Barracuda [Wed Mar 26 21:38:49 GMT 2014] ==> BOA Skynet welcomes you aboard!

Barracuda [Wed Mar 26 21:38:53 GMT 2014] ==> INFO: UPGRADE
Barracuda [Wed Mar 26 21:38:53 GMT 2014] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Wed Mar 26 21:38:54 GMT 2014] ==> NOTE! Please review all config options displayed below
Barracuda [Wed Mar 26 21:38:54 GMT 2014] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Wed Mar 26 21:38:55 GMT 2014] ==> INFO: Checking your system version...

Barracuda [Wed Mar 26 21:38:55 GMT 2014] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Wed Mar 26 21:38:55 GMT 2014] ==> INFO: Updating packages sources list...
Barracuda [Wed Mar 26 21:38:55 GMT 2014] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Wed Mar 26 21:39:05 GMT 2014] ==> INFO: Downloading little helpers...
Barracuda [Wed Mar 26 21:39:06 GMT 2014] ==> INFO: Checking BARRACUDA version...
Barracuda [Wed Mar 26 21:39:06 GMT 2014] ==> INFO: BARRACUDA version test: OK

Barracuda [Wed Mar 26 21:39:08 GMT 2014] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Wed Mar 26 21:39:08 GMT 2014] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Wed Mar 26 21:39:10 GMT 2014] ==> INFO: Running aptitude update...
Barracuda [Wed Mar 26 21:39:54 GMT 2014] ==> INFO: Upgrading required libraries and tools
Barracuda [Wed Mar 26 21:39:54 GMT 2014] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Wed Mar 26 21:40:40 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 21:40:42 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 21:40:46 GMT 2014] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Wed Mar 26 21:41:16 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 21:41:18 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 21:41:22 GMT 2014] ==> INFO: Checking SMTP connections...
Barracuda [Wed Mar 26 21:41:24 GMT 2014] ==> INFO: Upgrading a few more tools...
Barracuda [Wed Mar 26 21:41:27 GMT 2014] ==> INFO: Checking if PHP upgrade is available
Barracuda [Wed Mar 26 21:41:29 GMT 2014] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Wed Mar 26 21:41:36 GMT 2014] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Wed Mar 26 21:41:38 GMT 2014] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Wed Mar 26 21:41:39 GMT 2014] ==> INFO: OS and services upgrade completed

Barracuda [Wed Mar 26 21:41:41 GMT 2014] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Wed Mar 26 21:41:42 GMT 2014] ==> INFO: Installing extra Drush versions
Barracuda [Wed Mar 26 21:41:44 GMT 2014] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Wed Mar 26 21:41:45 GMT 2014] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 21:41:45 GMT 2014] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 21:41:50 GMT 2014] ==> INFO: Generating random password for Redis server
Barracuda [Wed Mar 26 21:41:51 GMT 2014] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Wed Mar 26 21:42:03 GMT 2014] ==> INFO: Restarting MariaDB server

Barracuda [Wed Mar 26 21:42:15 GMT 2014] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Wed Mar 26 21:42:17 GMT 2014] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Wed Mar 26 21:42:27 GMT 2014] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Wed Mar 26 21:42:33 GMT 2014] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Wed Mar 26 21:42:37 GMT 2014] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Wed Mar 26 21:47:32 GMT 2014] ==> BYE!

Check the PHP version:

php -v
  PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
  Copyright (c) 1997-2013 The PHP Group
  Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
      with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

Check the Nginx version:

nginx -v
  nginx version: nginx/1.5.7

No upgrades have been done, looking at /var/log/barracuda_log.txt there have been times when PHP and Nginx have been updated without a BOA version change:

Sat Dec 15 16:16:55 GMT 2012 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.4 / Barracuda BOA-2.0.4 / Nginx 1.3.8 / PHP 5.2.17 and 5.3.18 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.28a localhost / Wildcard YES
Tue Jan  8 12:43:48 GMT 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.5 / Barracuda BOA-2.0.5 / Nginx 1.3.9 / PHP 5.2.17 and 5.3.20 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.28a localhost / Wildcard YES
Wed Jan 23 22:12:22 GMT 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.5 / Barracuda BOA-2.0.5 / Nginx 1.3.9 / PHP 5.2.17 and 5.3.20 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.28a localhost / Wildcard YES
Thu Jan 24 09:46:29 GMT 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.5 / Barracuda BOA-2.0.5 / Nginx 1.3.9 / PHP 5.2.17 and 5.3.20 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.28a localhost / Wildcard YES
Mon Jan 28 00:08:36 GMT 2013 / Debian.squeeze x86_64 XEN / Aegir HEAD / Barracuda BOA-2.0.6-dev / Nginx 1.3.11 / PHP 5.2.17 and 5.3.21 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.28a localhost / Wildcard YES
Sun Apr  7 20:48:52 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.7 / Barracuda BOA-2.0.7 / Nginx 1.3.15 / PHP 5.2.17 and 5.3.23 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.30 localhost / Wildcard YES
Mon Apr  8 21:52:56 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.8 / Nginx 1.3.15 / PHP 5.2.17 and 5.3.23 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.30 localhost / Wildcard YES
Sun May 12 22:23:52 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.0 / PHP 5.2.17 and 5.3.25 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.30 localhost / Wildcard YES
Fri May 24 10:43:33 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.0 / PHP 5.2.17 and 5.3.25 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.31 localhost / Wildcard YES
Sun Jul 14 21:56:44 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.2 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.31 localhost / Wildcard YES
Sun Sep 15 09:26:49 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.2 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.32 localhost / Wildcard YES
Mon Sep 30 02:05:54 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.2 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.33a localhost / Wildcard YES
Thu Oct  3 21:16:47 BST 2013 / Debian.squeeze x86_64 XEN / Aegir BOA-2.0.8 / Barracuda BOA-2.0.9 / Nginx 1.5.2 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.33a localhost / Wildcard YES
Mon Nov 18 00:12:08 GMT 2013 / Debian.wheezy x86_64 XEN / Aegir BOA-2.1.2 / Barracuda BOA-2.1.2 / Nginx 1.5.6 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.33a localhost / Wildcard YES
Sat Nov 30 21:10:09 GMT 2013 / Debian.wheezy x86_64 XEN / Aegir BOA-2.1.3 / Barracuda BOA-2.1.3 / Nginx 1.5.7 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.34 localhost / Wildcard YES
Sat Dec 14 13:32:00 GMT 2013 / Debian.wheezy x86_64 XEN / Aegir BOA-2.1.3 / Barracuda BOA-2.1.3 / Nginx 1.5.7 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.34 localhost / Wildcard YES
Wed Mar 26 21:15:11 GMT 2014 / Debian.wheezy x86_64 XEN / Aegir BOA-2.1.3 / Barracuda BOA-2.1.3 / Nginx 1.5.7 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.36 localhost / Wildcard YES
Wed Mar 26 21:42:17 GMT 2014 / Debian.wheezy x86_64 XEN / Aegir BOA-2.1.3 / Barracuda BOA-2.1.3 / Nginx 1.5.7 / PHP 5.2.17 and 5.3.27 / MODERN-YES / FPM 5.3 / CLI 5.3 / MariaDB-5.5.36 localhost / Wildcard YES

With BOA-2.0.8 we had these versions:

  • Mon Apr 8 2013 -- Nginx 1.3.15 / PHP 5.2.17 and 5.3.23
  • Sun May 12 2013 -- Nginx 1.5.0 / PHP 5.2.17 and 5.3.25
  • Sun Jul 14 2013 -- Nginx 1.5.2 / PHP 5.2.17 and 5.3.2

I wonder how we managed to do these upgrades?

Changed 3 years ago by chris

Changed 3 years ago by chris

Changed 3 years ago by chris

Changed 3 years ago by chris

Changed 3 years ago by chris

Changed 3 years ago by chris

comment:40 in reply to: ↑ 37 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.5
  • Total Hours changed from 6.5 to 7.0

Replying to jim:

The only thing I'd suggest: _SYSTEM_UPGRADE_ONLY is set to 'yes' - try setting to 'no', could be the cause.

OK... I have changed that, the updated /root/.barracuda.cnf:

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=NO
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO 
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Running the update:

barracuda up-stable system
  waiting 8 sec
  REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk
  
  BARRACUDA upgrade completed
  Bye

The email:

From: root@puffin.webarch.net (root)
Date: Wed, 26 Mar 2014 22:20:07 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at 140326-2211


Barracuda [Wed Mar 26 22:11:26 GMT 2014] ==> BOA Skynet welcomes you aboard!

Barracuda [Wed Mar 26 22:11:30 GMT 2014] ==> INFO: UPGRADE
Barracuda [Wed Mar 26 22:11:30 GMT 2014] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Wed Mar 26 22:11:31 GMT 2014] ==> NOTE! Please review all config options displayed below
Barracuda [Wed Mar 26 22:11:31 GMT 2014] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=NO
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Wed Mar 26 22:11:33 GMT 2014] ==> INFO: Checking your system version...

Barracuda [Wed Mar 26 22:11:33 GMT 2014] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Wed Mar 26 22:11:33 GMT 2014] ==> INFO: Updating packages sources list...
Barracuda [Wed Mar 26 22:11:33 GMT 2014] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Wed Mar 26 22:11:43 GMT 2014] ==> INFO: Downloading little helpers...
Barracuda [Wed Mar 26 22:11:45 GMT 2014] ==> INFO: Checking BARRACUDA version...
Barracuda [Wed Mar 26 22:11:45 GMT 2014] ==> INFO: BARRACUDA version test: OK

Barracuda [Wed Mar 26 22:11:47 GMT 2014] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Wed Mar 26 22:11:47 GMT 2014] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Wed Mar 26 22:11:49 GMT 2014] ==> INFO: Running aptitude update...
Barracuda [Wed Mar 26 22:12:31 GMT 2014] ==> INFO: Upgrading required libraries and tools
Barracuda [Wed Mar 26 22:12:31 GMT 2014] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Wed Mar 26 22:13:21 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 22:13:23 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 22:13:28 GMT 2014] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Wed Mar 26 22:13:56 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Wed Mar 26 22:13:58 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Wed Mar 26 22:14:02 GMT 2014] ==> INFO: Checking SMTP connections...
Barracuda [Wed Mar 26 22:14:04 GMT 2014] ==> INFO: Upgrading a few more tools...
Barracuda [Wed Mar 26 22:14:06 GMT 2014] ==> INFO: Checking if PHP upgrade is available
Barracuda [Wed Mar 26 22:14:09 GMT 2014] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Wed Mar 26 22:14:15 GMT 2014] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Wed Mar 26 22:14:17 GMT 2014] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Wed Mar 26 22:14:18 GMT 2014] ==> INFO: OS and services upgrade completed

Barracuda [Wed Mar 26 22:14:20 GMT 2014] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Wed Mar 26 22:14:22 GMT 2014] ==> INFO: Installing extra Drush versions
Barracuda [Wed Mar 26 22:14:24 GMT 2014] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Wed Mar 26 22:14:24 GMT 2014] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 22:14:24 GMT 2014] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Wed Mar 26 22:14:29 GMT 2014] ==> INFO: Generating random password for Redis server
Barracuda [Wed Mar 26 22:14:29 GMT 2014] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Wed Mar 26 22:14:40 GMT 2014] ==> INFO: Restarting MariaDB server

Barracuda [Wed Mar 26 22:14:50 GMT 2014] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Wed Mar 26 22:14:53 GMT 2014] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Wed Mar 26 22:15:00 GMT 2014] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Wed Mar 26 22:15:06 GMT 2014] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Wed Mar 26 22:15:10 GMT 2014] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Wed Mar 26 22:20:07 GMT 2014] ==> BYE!

Check the php version:

php -v
  PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
  Copyright (c) 1997-2013 The PHP Group
  Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
      with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

Check the Nginx version:

nginx -v
  nginx version: nginx/1.5.7

Still no upgrades.

Looking at the Munin graphs for the server, the upgrades has broken the php-fpm accepted connections graph:


Dramatically increased the php-fpm memory usage:


The memory usage increase is due to the number of processes jumping from 5 to 19:


The php-fpm status graph has also been broken:


The relative memory usage shows here, note that the massive drop in Mysql memory usage is due to Mysql being restarted and the cache being emptied as a result:


So, following the wiki:PuffinServer#php-fpmconfigchanges notes, /opt/local/etc/php53-fpm.conf was edited and these things were changed:

pm.status_path = /status

ping.path = /ping

pm.start_servers = 4

pm.max_spare_servers = 4

And the services were restarted:

/etc/init.d/php53-fpm reload
/etc/init.d/nginx restart

And the plugins were tested:

cd /etc/munin/plugins
munin-run phpfpm_connections
  accepted.value 19
munin-run phpfpm_status
  idle.value 3
  active.value 1
  total.value 4
munin-run nginx_status
  total.value 13
  reading.value 0
  writing.value 3
  waiting.value 10
munin-run nginx_request
  request.value 63

comment:41 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 7.0 to 7.1
  • Description modified (diff)
  • Summary changed from Upgrades to BOA to Upgrade to BOA-2.1.3 Stable Edition

I have modified the title and description of this ticket to make it specifically for BOA-2.1.3 as there is a new ticket:707 for BOA-2.2.0 and the description with the handy links has been copied to wiki:PuffinServer#UpgradingBOA -- I think with each BOA upgrade potentially resulting in lots of comments it's worth having a ticket per version to make the process of each upgrade easier to review and also to make it easier see how long each one takes, I hope this change, which is reverting to how we were doing it last year, is OK with everybody.

comment:42 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.15
  • Total Hours changed from 7.1 to 7.25

Changing the suicide thresholds, as per wiki:PuffinServer#xdragoshellscriptchanges the following in /var/xdrago/second.sh:

CTL_ONEX_SPIDER_LOAD=699
CTL_FIVX_SPIDER_LOAD=699
CTL_ONEX_LOAD=1555
CTL_FIVX_LOAD=999
CTL_ONEX_LOAD_CRIT=1999
CTL_FIVX_LOAD_CRIT=1555

Was changed to:

CTL_ONEX_SPIDER_LOAD=2716
CTL_FIVX_SPIDER_LOAD=2716
CTL_ONEX_LOAD=10108
CTL_FIVX_LOAD=6216
CTL_ONEX_LOAD_CRIT=13216
CTL_FIVX_LOAD_CRIT=10885

See wiki:PuffinServer#LoadSpikes

And to stop useful logs being clobbered /var/xdrago/clear.sh was opened in vi and the following command was run:

:1,$s/^echo rotate/# echo rotate/g

Which resulted in these lines being commented out:

# echo rotate > /var/log/php/php-fpm-error.log
# echo rotate > /var/log/php/php-fpm-slow.log
# echo rotate > /var/log/php/php53-fpm-error.log
# echo rotate > /var/log/php/php53-fpm-slow.log
# echo rotate > /var/log/php/error_log_52
# echo rotate > /var/log/php/error_log_53
# echo rotate > /var/log/php/error_log_cli_52
# echo rotate > /var/log/php/error_log_cli_53
# echo rotate > /var/log/redis/redis-server.log
# echo rotate > /var/log/mysql/sql-slow-query.log

comment:43 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.1
  • Total Hours changed from 7.25 to 7.35

Checking the /var/log/php/error_log_53 there is this issue:

[26-Mar-2014 23:03:01 UTC] PHP Warning:  PHP Startup: Unable to load dynamic library '/opt/local/lib/php/extensions/no-debug-non-zts-20090626/apc.so' - /opt/local/lib/php/extensions/no-debug-non-zts-20090626/apc.so: cannot open shared object file: No such file or directory in Unknown on line 0

There isn't a apc.so on the server:

updatedb
locate apc.so

So this section of /opt/local/etc/php53.ini was commented out:

; Enable APC
;extension=apc.so
;apc.shm_size = 512M
;apc.stat = 1
;apc.stat_ctime = 1

And php-fpm restarted:

/etc/init.d/php53-fpm restart

comment:44 follow-up: ↓ 45 Changed 3 years ago by jim

Hmm...

I think it's best to check the BOA docs, and also consider setting _BUILD_FROM_SRC to yes... I've certainly seen tickets referring to this on D.o.

I'm in meetings all day tomorrow but can assist tomorrow night if needed.

comment:45 in reply to: ↑ 44 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.4
  • Total Hours changed from 7.35 to 7.75

Replying to jim:

I think it's best to check the BOA docs, and also consider setting _BUILD_FROM_SRC to yes...

Good idea, trying that, /root/.barracuda.cnf has been edited and:

barracuda up-stable system
  Some important system task is running probably - /var/run/boa_wait.pid exists
barracuda up-stable system
  waiting 8 sec
  REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk
  
  BARRACUDA upgrade completed
  Bye

Checking the versions:

php -v
  PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
  Copyright (c) 1997-2013 The PHP Group
  Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
    with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.
nginx -v
  nginx version: nginx/1.5.7

So, no joy...

The email:

From: root@puffin.webarch.net (root)
Date: Thu, 27 Mar 2014 00:12:44 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at
 140327-0003


Barracuda [Thu Mar 27 00:03:19 GMT 2014] ==> BOA Skynet welcomes you aboard!

Barracuda [Thu Mar 27 00:03:23 GMT 2014] ==> INFO: UPGRADE
Barracuda [Thu Mar 27 00:03:23 GMT 2014] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Thu Mar 27 00:03:24 GMT 2014] ==> NOTE! Please review all config options displayed below
Barracuda [Thu Mar 27 00:03:24 GMT 2014] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=YES
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Thu Mar 27 00:03:25 GMT 2014] ==> INFO: Checking your system version...

Barracuda [Thu Mar 27 00:03:25 GMT 2014] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Thu Mar 27 00:03:25 GMT 2014] ==> INFO: Updating packages sources list...
Barracuda [Thu Mar 27 00:03:25 GMT 2014] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Thu Mar 27 00:03:37 GMT 2014] ==> INFO: Downloading little helpers...
Barracuda [Thu Mar 27 00:03:39 GMT 2014] ==> INFO: Checking BARRACUDA version...
Barracuda [Thu Mar 27 00:03:39 GMT 2014] ==> INFO: BARRACUDA version test: OK

Barracuda [Thu Mar 27 00:03:41 GMT 2014] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Thu Mar 27 00:03:41 GMT 2014] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Thu Mar 27 00:03:43 GMT 2014] ==> INFO: Running aptitude update...
Barracuda [Thu Mar 27 00:04:29 GMT 2014] ==> INFO: Upgrading required libraries and tools
Barracuda [Thu Mar 27 00:04:29 GMT 2014] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Thu Mar 27 00:05:17 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Thu Mar 27 00:05:19 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Thu Mar 27 00:05:23 GMT 2014] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Thu Mar 27 00:05:51 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Thu Mar 27 00:05:53 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Thu Mar 27 00:05:58 GMT 2014] ==> INFO: Checking SMTP connections...
Barracuda [Thu Mar 27 00:06:00 GMT 2014] ==> INFO: Upgrading a few more tools...
Barracuda [Thu Mar 27 00:06:02 GMT 2014] ==> INFO: Checking if PHP upgrade is available
Barracuda [Thu Mar 27 00:06:04 GMT 2014] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Thu Mar 27 00:06:11 GMT 2014] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Thu Mar 27 00:06:13 GMT 2014] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Thu Mar 27 00:06:14 GMT 2014] ==> INFO: OS and services upgrade completed

Barracuda [Thu Mar 27 00:06:16 GMT 2014] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Thu Mar 27 00:06:17 GMT 2014] ==> INFO: Installing extra Drush versions
Barracuda [Thu Mar 27 00:06:20 GMT 2014] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Thu Mar 27 00:06:20 GMT 2014] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Thu Mar 27 00:06:20 GMT 2014] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Thu Mar 27 00:06:25 GMT 2014] ==> INFO: Generating random password for Redis server
Barracuda [Thu Mar 27 00:06:25 GMT 2014] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Thu Mar 27 00:06:36 GMT 2014] ==> INFO: Restarting MariaDB server

Barracuda [Thu Mar 27 00:06:47 GMT 2014] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Thu Mar 27 00:06:49 GMT 2014] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Thu Mar 27 00:06:55 GMT 2014] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Thu Mar 27 00:07:01 GMT 2014] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Thu Mar 27 00:07:06 GMT 2014] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Thu Mar 27 00:12:44 GMT 2014] ==> BYE!

Fixing the broken things:

comment:46 in reply to: ↑ 37 Changed 3 years ago by chris

  • Add Hours to Ticket changed from 0.0 to 0.45
  • Total Hours changed from 7.75 to 8.2

Replying to jim:

The only thing I'd suggest: _SYSTEM_UPGRADE_ONLY is set to 'yes' - try setting to 'no'

Replying to jim:

consider setting _BUILD_FROM_SRC to yes...

One thing I don't think we haven't tried is:

_SYSTEM_UPGRADE_ONLY=YES
_BUILD_FROM_SRC=YES

So, running that:

barracuda up-stable system
  waiting 8 sec
  REPORT: Successful Barracuda upgrade on puffin.webarch.net sent to chris@webarchitects.co.uk
  
  BARRACUDA upgrade completed
  Bye

Checking the versions:

php -v
  PHP 5.3.27 (cli) (built: Nov 30 2013 21:01:35) 
  Copyright (c) 1997-2013 The PHP Group
  Zend Engine v2.3.0, Copyright (c) 1998-2013 Zend Technologies
      with the ionCube PHP Loader v4.4.1, Copyright (c) 2002-2013, by ionCube Ltd.

nginx -v
  nginx version: nginx/1.5.7

So, fixing things again:

This is the email that was sent:

From: root@puffin.webarch.net (root)
Date: Thu, 27 Mar 2014 20:45:04 +0000
To: chris@webarchitects.co.uk
Subject: REPORT: Successful Barracuda upgrade on puffin.webarch.net at
 140327-2036


Barracuda [Thu Mar 27 20:36:10 GMT 2014] ==> BOA Skynet welcomes you aboard!

Barracuda [Thu Mar 27 20:36:14 GMT 2014] ==> INFO: UPGRADE
Barracuda [Thu Mar 27 20:36:14 GMT 2014] ==> INFO: Reading your /root/.barracuda.cnf config file
Barracuda [Thu Mar 27 20:36:15 GMT 2014] ==> NOTE! Please review all config options displayed below
Barracuda [Thu Mar 27 20:36:15 GMT 2014] ==> NOTE! It will *override* all settings in the Barracuda script

###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
### NOTE: the group of settings displayed bellow will *not* be overriden
### on upgrade by the Barracuda script nor by this configuration file.
### They can be defined only on initial Barracuda install.
###
_HTTP_WILDCARD=YES
_MY_OWNIP="81.95.52.103"
#_MY_OWNIP=""
_MY_HOSTN="puffin.webarch.net"
#_MY_HOSTN=""
_MY_FRONT="master.puffin.webarch.net"
_THIS_DB_HOST=localhost
#_THIS_DB_HOST=FQDN
_SMTP_RELAY_TEST=YES
_SMTP_RELAY_HOST=""
_LOCAL_NETWORK_IP=""
_LOCAL_NETWORK_HN=""
###
### NOTE: the group of settings displayed bellow
### will *override* all listed settings in the Barracuda script,
### both on initial install and upgrade.
###
_MY_EMAIL="chris@webarchitects.co.uk"
_XTRAS_LIST="PDS CSF CHV"
_AUTOPILOT=YES
_DEBUG_MODE=NO
_DB_SERVER=MariaDB
_SSH_PORT=22
_LOCAL_DEBIAN_MIRROR="ftp.debian.org"
_LOCAL_UBUNTU_MIRROR="archive.ubuntu.com"
_FORCE_GIT_MIRROR=""
_DNS_SETUP_TEST=YES
_NGINX_EXTRA_CONF=""
_NGINX_WORKERS=AUTO
_PHP_FPM_WORKERS=AUTO
_BUILD_FROM_SRC=YES
_PHP_MODERN_ONLY=YES
_PHP_FPM_VERSION=5.3
_PHP_CLI_VERSION=5.3
#_LOAD_LIMIT_ONE=1444
#_LOAD_LIMIT_TWO=888
_LOAD_LIMIT_ONE=8664
_LOAD_LIMIT_TWO=5328
_CUSTOM_CONFIG_CSF=YES
#_CUSTOM_CONFIG_SQL=NO
_CUSTOM_CONFIG_SQL=YES
_CUSTOM_CONFIG_REDIS=NO
_CUSTOM_CONFIG_PHP_5_2=NO
#_CUSTOM_CONFIG_PHP_5_3=NO
_CUSTOM_CONFIG_PHP_5_3=YES
_SPEED_VALID_MAX=3600
_NGINX_DOS_LIMIT=300
_SYSTEM_UPGRADE_ONLY=YES
_USE_MEMCACHED=NO
_NEWRELIC_KEY=
_USE_STOCK=NO
###
### Configuration created on 121215-1545
### with Barracuda version BOA-2.0.4
###
_EXTRA_PACKAGES=
_PHP_EXTRA_CONF=""
_STRONG_PASSWORDS=NO
_DB_BINARY_LOG=NO
_DB_ENGINE=InnoDB
_NGINX_LDAP=NO
_PHP_GEOS=NO
_PHP_MONGODB=NO
_AEGIR_UPGRADE_ONLY=NO
### Squeeze to Wheezy upgrade config
### See /trac/ticket/535
_SQUEEZE_TO_WHEEZY=YES
_NGINX_FORWARD_SECRECY=YES
_NGINX_SPDY=YES
#_BUILD_FROM_SRC=NO
_NGINX_NAXSI=NO
_PHP_ZEND_OPCACHE=YES
_PERMISSIONS_FIX=YES
_MODULES_FIX=YES
_MODULES_SKIP=""
_SSL_FROM_SOURCES=NO
_SSH_FROM_SOURCES=NO
_RESERVED_RAM=0

Barracuda [Thu Mar 27 20:36:17 GMT 2014] ==> INFO: Checking your system version...

Barracuda [Thu Mar 27 20:36:17 GMT 2014] ==> Aegir on Debian/wheezy - Skynet Agent v.BOA-2.1.3

Barracuda [Thu Mar 27 20:36:17 GMT 2014] ==> INFO: Updating packages sources list...
Barracuda [Thu Mar 27 20:36:17 GMT 2014] ==> INFO: We will use Debian mirror ftp.debian.org
Barracuda [Thu Mar 27 20:36:29 GMT 2014] ==> INFO: Downloading little helpers...
Barracuda [Thu Mar 27 20:36:30 GMT 2014] ==> INFO: Checking BARRACUDA version...
Barracuda [Thu Mar 27 20:36:30 GMT 2014] ==> INFO: BARRACUDA version test: OK

Barracuda [Thu Mar 27 20:36:32 GMT 2014] ==> UPGRADE START -> checkpoint:

  * Your e-mail address appears to be chris@webarchitects.co.uk - is that correct?
  * Your server hostname is puffin.webarch.net.
  * Your Aegir control panel is/will be available at https://master.puffin.webarch.net.


Barracuda [Thu Mar 27 20:36:32 GMT 2014] ==> INFO: Cleaning up temp files in /var/opt/
Barracuda [Thu Mar 27 20:36:34 GMT 2014] ==> INFO: Running aptitude update...
Barracuda [Thu Mar 27 20:37:20 GMT 2014] ==> INFO: Upgrading required libraries and tools
Barracuda [Thu Mar 27 20:37:20 GMT 2014] ==> NOTE! This step may take a few minutes, please wait...
Barracuda [Thu Mar 27 20:38:06 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Thu Mar 27 20:38:08 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Thu Mar 27 20:38:12 GMT 2014] ==> INFO: Running aptitude full-upgrade, please wait...
Barracuda [Thu Mar 27 20:38:40 GMT 2014] ==> INFO: Testing Nginx version...
Barracuda [Thu Mar 27 20:38:42 GMT 2014] ==> INFO: Installed Nginx version nginx/1.5.7, OK
Barracuda [Thu Mar 27 20:38:46 GMT 2014] ==> INFO: Checking SMTP connections...
Barracuda [Thu Mar 27 20:38:48 GMT 2014] ==> INFO: Upgrading a few more tools...
Barracuda [Thu Mar 27 20:38:51 GMT 2014] ==> INFO: Checking if PHP upgrade is available
Barracuda [Thu Mar 27 20:38:53 GMT 2014] ==> INFO: Installed PHP version 5.3.27, OK
Barracuda [Thu Mar 27 20:39:00 GMT 2014] ==> INFO: Installed Redis version 2.6.16, OK
Barracuda [Thu Mar 27 20:39:02 GMT 2014] ==> INFO: Updating MariaDB and PHP configuration
Barracuda [Thu Mar 27 20:39:03 GMT 2014] ==> INFO: OS and services upgrade completed

Barracuda [Thu Mar 27 20:39:05 GMT 2014] ==> INFO: Aegir Master Instance upgrade skipped

Barracuda [Thu Mar 27 20:39:06 GMT 2014] ==> INFO: Installing extra Drush versions
Barracuda [Thu Mar 27 20:39:08 GMT 2014] ==> INFO: Drush 4.6-dev installation complete
Barracuda [Thu Mar 27 20:39:09 GMT 2014] ==> INFO: Drush 5-head-nov-21-2013 installation complete
Barracuda [Thu Mar 27 20:39:09 GMT 2014] ==> INFO: Drush 6-head-nov-21-2013 installation complete
Barracuda [Thu Mar 27 20:39:14 GMT 2014] ==> INFO: Generating random password for Redis server
Barracuda [Thu Mar 27 20:39:14 GMT 2014] ==> INFO: Restarting Redis and PHP-FPM, reloading Nginx
Barracuda [Thu Mar 27 20:39:26 GMT 2014] ==> INFO: Restarting MariaDB server

Barracuda [Thu Mar 27 20:39:38 GMT 2014] ==> INFO: New random password for MariaDB generated and updated
Barracuda [Thu Mar 27 20:39:40 GMT 2014] ==> INFO: New entry added to /var/log/barracuda_log.txt

Barracuda [Thu Mar 27 20:39:48 GMT 2014] ==> CARD: Now charging your credit card for this auto-upgrade magic...
Barracuda [Thu Mar 27 20:39:54 GMT 2014] ==> JOKE: Just kidding! Enjoy your Aegir Hosting System :)

Barracuda [Thu Mar 27 20:39:58 GMT 2014] ==> Final post-upgrade cleaning, please wait a moment...
Barracuda [Thu Mar 27 20:45:04 GMT 2014] ==> BYE!

Is it worth investing any more time into this issue or should we simply wait for the next version of BOA?

comment:47 follow-up: ↓ 48 Changed 3 years ago by ed

Unless its massively security urgent, wait for the next version, and try to do it as standard as possible as agreed some months ago. boa has been very expensive this year.

comment:48 in reply to: ↑ 47 Changed 3 years ago by chris

  • Status changed from new to closed
  • Resolution set to wontfix

Replying to ed:

Unless its massively security urgent, wait for the next version, and try to do it as standard as possible as agreed some months ago. boa has been very expensive this year.

OK, closing this ticket. The ticket for the next version of BOA is ticket:707.

Note: See TracTickets for help on using tickets.