Changes between Initial Version and Version 1 of PiwikServerInstall

Timestamp:

02/27/13 11:08:43 (4 years ago)

Author:

chris

Comment:

--

PiwikServerInstall

@@ +1 @@
+[[PageOutline(2-5, Table of Contents, floated)]]
+
+Notes moved from the PiwikServer page.
+
+== Archive ==
+
+The following documentation is outdated.
+
+=== Quince Server ===
+
+The live install at https://stats.transitionnetwork.org/ on the NewLiveServer, the install was done on ticket:160.
+
+==== Install ====
+
+{{{
+cd /web
+cd stats.transitionnetwork.org/
+wget http://piwik.org/latest.zip
+unzip latest.zip
+cd piwik
+chown -R www-data:www-data tmp/
+chown -R www-data:www-data config/
+chown -R www-data:www-data themes/
+}}}
+
+===== Apache =====
+
+Create {{{stats.transitionnetwork.org.conf}}} in {{{cd /etc/apache2/sites-available/}}}:
+
+{{{
+<VirtualHost *:80>
+  ServerName stats.transitionnetwork.org
+  ServerAlias stats.transitionnetwork.org.webarch.net
+  ServerSignature Off
+  UseCanonicalName On
+
+  ErrorLog /var/log/apache2/stats.transitionnetwork.org_error.log
+  ErrorLog /var/log/apache2/error.log
+  SetEnvIf Remote_Addr "127\.0\.0\.1" loopback
+  SetEnvIf Remote_Addr "kiwi\.transitionnetwork\.org" loopback
+  CustomLog /var/log/apache2/stats.transitionnetwork.org_access.log combined env=!loopback
+  CustomLog /var/log/apache2/access.log combined env=!loopback
+
+  Redirect / https://stats.transitionnetwork.org/
+</VirtualHost>
+
+<VirtualHost *:443>
+  ServerName stats.transitionnetwork.org
+  ServerAlias stats.transitionnetwork.org.webarch.net
+  ServerSignature Off
+  UseCanonicalName On
+
+  LogLevel warn
+  ErrorLog /var/log/apache2/stats.transitionnetwork.org_ssl_error.log
+  ErrorLog /var/log/apache2/error.log
+  SetEnvIf Remote_Addr "127\.0\.0\.1" loopback
+  SetEnvIf Remote_Addr "kiwi\.transitionnetwork\.org" loopback
+  CustomLog /var/log/apache2/stats.transitionnetwork.org_ssl_access.log combined env=!loopback
+  CustomLog /var/log/apache2/access.log combined env=!loopback
+
+  SSLEngine on
+  SSLCipherSuite HIGH
+  SSLProtocol all -SSLv2
+  SSLCertificateFile      /etc/ssl/transitionnetwork.org/transitionnetwork.org.pem
+  SSLCertificateChainFile /etc/ssl/transitionnetwork.org/gandi.pem
+
+  DocumentRoot "/web/stats.transitionnetwork.org/piwik"
+  <Directory "/web/stats.transitionnetwork.org/piwik">
+    DirectoryIndex index.php
+    Options -Indexes
+    AddType 'image/x-icon' .ico
+    AddHandler php5-script .php
+    AddType text/html .php
+    SSLOptions +StdEnvVars
+    AllowOverride None
+    order allow,deny
+    allow from all
+  </Directory>
+  <Directory "/web/stats.transitionnetwork.org/piwik/tmp">
+    Options Indexes
+    RemoveHandler .php
+    AllowOverride None
+    order allow,deny
+    allow from all
+  </Directory>
+  <Location /config>
+    Order deny,allow
+    Deny from all
+    Allow from 127.0.0.1
+  </Location>
+
+  <FilesMatch "\.(cgi|shtml|phtml|php)$">
+    SSLOptions +StdEnvVars
+  </FilesMatch>
+  <Directory /usr/lib/cgi-bin>
+    SSLOptions +StdEnvVars
+  </Directory>
+
+</VirtualHost>
+}}}
+
+Enable it and restart:
+
+{{{
+/etc/apache2/sites-enabled
+ln -s ../sites-available/stats.transitionnetwork.org.conf 35-stats.transitionnetwork.org.conf
+apache2ctl configtest
+apache2ctl restart
+}}}
+
+===== MySQL =====
+
+As MySQL root user:
+
+{{{
+CREATE USER 'stats'@'localhost' IDENTIFIED BY '********';
+GRANT USAGE ON * . * TO 'stats'@'localhost' IDENTIFIED BY '********' WITH MAX_QUERIES_PER_HOUR 0 MAX_CONNECTIONS_PER_HOUR 0 MAX_UPDATES_PER_HOUR 0 MAX_USER_CONNECTIONS 0 ;
+CREATE DATABASE IF NOT EXISTS `stats` ;
+GRANT ALL PRIVILEGES ON `stats` . * TO 'stats'@'localhost';
+FLUSH PRIVILEGES;
+}}}
+
+===== Web Install =====
+
+MySQL settings:
+
+ * database server: 127.0.0.1
+ * login: stats
+ * password: ********
+ * database name: stats
+ * table prefix: (blank - we don't need one, the default is piwik_)
+ * adapter: PDO_MYSQL
+
+Super User settings:
+
+ * super user login: webproject
+ * password: ********
+ * email: webproject (at) transitionnetwork.org
+
+Suggested JS code:
+
+{{{
+<!-- Piwik -->
+<script type="text/javascript">
+var pkBaseURL = (("https:" == document.location.protocol) ? "https://stats.transitionnetwork.org/" : "http://stats.transitionnetwork.org/");
+document.write(unescape("%3Cscript src='" + pkBaseURL + "piwik.js' type='text/javascript'%3E%3C/script%3E"));
+</script><script type="text/javascript">
+try {
+var piwikTracker = Piwik.getTracker(pkBaseURL + "piwik.php", 1);
+piwikTracker.trackPageView();
+piwikTracker.enableLinkTracking();
+} catch( err ) {}
+</script><noscript><p><img src="http://stats.transitionnetwork.org/piwik.php?idsite=1" style="border:0" alt="" /></p></noscript>
+<!-- End Piwik Tracking Code -->
+}}}
+
+Suggested image code:
+
+{{{
+<!-- Piwik Image Tracker -->
+<img src="https://stats.transitionnetwork.org/piwik.php?idsite=1&rec=1" style="border:0" alt="" />
+<!-- End Piwik -->
+}}}
+
+===== Configure =====
+
+In the General Settings page:
+
+ * Allow Piwik archiving to trigger when reports are viewed from the browser: no
+ * Reports for today (or any other Date Range including today) will be processed at most every: 1800
+
+Set up cron:
+
+{{{
+crontab -u www-data -e
+
+5 * * * * /web/stats.transitionnetwork.org/piwik/misc/cron/archive.sh > /dev/null
+}}}
+
+Test it:
+
+{{{
+su www-data -c "sh /web/stats.transitionnetwork.org/piwik/misc/cron/archive.sh"
+}}}
+
+This generated this error:
+
+{{{
+ALERT - script tried to increase memory_limit to 134217728 bytes which is above the allowed value (attacker 'REMOTE_ADDR not set', file '/web/stats.transitionnetwork.org/piwik/core/Piwik.php', line 947)
+}}}
+
+Which can be ignored because in {{{/etc/php5/apache2/php.ini}}} it's set to double that already, 256M, so I don't understand why it tried to raise it.
+
+Things added to {{{/web/stats.transitionnetwork.org/piwik/config/config.ini.php}}}, taken from {{{global.ini.php}}}:
+
+{{{
+[General]
+force_ssl_login = 1
+feedback_email_address = "webproject (at) transitionnetwork.org"
+assume_secure_protocol = 1
+}}}
+
+===== GA Import =====
+
+First install Python 2.6 from source:
+
+{{{
+aptitude build-dep python2.5 
+cd /usr/local/src
+wget http://www.python.org/ftp/python/2.6.7/Python-2.6.7.tgz
+tar -zxvf Python-2.6.7.tgz
+cd Python-2.6.7
+./configure --with-threads --enable-shared
+make
+make install 
+ln -s /usr/local/lib/libpython2.6.so* /usr/lib/
+cd /usr/local/src
+wget 'http://pypi.python.org/packages/source/s/setuptools/setuptools-0.6c11.tar.gz#md5=7df2a529a074f613b509fb44feefe74e'
+tar zxvf setuptools-0.6c11.tar.gz
+cd setuptools-0.6c11
+python setup.py install
+cd /usr/local/src
+wget "https://gdata-python-client.googlecode.com/files/gdata-2.0.14.tar.gz" --no-check-certificate
+tar -zxvf gdata-2.0.14.tar.gz
+cd gdata-2.0.14
+python setup.py install
+cd /usr/local/src
+aptitude purge python-mysqldb
+wget "http://downloads.sourceforge.net/project/mysql-python/mysql-python/1.2.3/MySQL-python-1.2.3.tar.gz"
+tar -zxvf MySQL-python-1.2.3.tar.gz 
+cd MySQL-python-1.2.3
+vim site.cfg
+ mysql_config = /usr/bin/mysql_config
+aptitude install libmysqlclient-dev
+python setup.py build
+python setup.py install
+}}}
+
+Then the GA code and import:
+
+{{{
+cd /web/stats.transitionnetwork.org/
+wget http://clearcode.cc/google2piwik-1.2.5.tgz
+tar -zxvf google2piwik-1.2.5.tgz
+cd google2piwik-1.2.5
+cp google2piwik.conf.sample google2piwik.conf
+}}}
+
+Edit {{{google2piwik.conf}}}: 
+
+{{{
+
+## Google Account Credentials
+# If you don't know your site table_id type:
+#                       ./google2piwik.py -p
+[google]
+user_login = transitiontownsnetwork [at] gmail.com
+user_pass  = XXX
+table_id   = ga:XXX
+
+# MySQL Piwik Database configuration
+[mysql]
+db = stats
+host = localhost
+port = 3306
+user = stats
+passwd = XXX
+table_prefix =
+
+# Set export date range
+[export]
+start = 2008-01-01
+end   = 2011-06-29
+
+## Piwik configuration of site.
+# For default Piwik installation with one website, site_id should be set to 1
+[piwik]
+site_id  = 1
+site_url = http://transitionnetwork.org
+}}}
+
+Test and backup db:
+
+{{{
+./google2piwik.py -p
+./google2piwik.py -c
+mysql_backup
+}}}
+
+Then change the timezone to UTC for the site on https://stats.transitionnetwork.org/ run it in screen:
+
+{{{
+screen
+./google2piwik.py --verbose=2
+}}}
+
+=== Kiwi Server ===
+
+The [http://piwik.org/ Piwik] server that is to be installed on the DevelopmentServer, the install was done on ticket:160
+
+==== Config ====
+
+In {{{/web/piwik.transitionnetwork.org/piwik/config}}}
+
+{{{
+assume_secure_protocol = 1
+}}}
+
+==== Install ====
+
+Site:  https://piwik.transitionnetwork.org/
+
+===== Download =====
+
+{{{
+cd /web/
+mkdir piwik.transitionnetwork.org
+cd piwik.transitionnetwork.org/
+wget http://piwik.org/latest.zip
+unzip latest.zip
+}}}
+
+===== Apache =====
+
+Then set up apache, see /etc/apache2/sites-available/piwik.transitionnetwork.org and run the web installer and:
+
+{{{
+cd /web/piwik.transitionnetwork.org/piwik/
+chown -R www-data:www-data tmp/
+chown -R www-data:www-data config/
+}}}
+
+===== MySQL =====
+
+Then a MySQL user and database was added using phpMyAdmin which ran the following SQL:
+
+{{{
+CREATE USER 'piwik'@'localhost' IDENTIFIED BY '********';
+GRANT USAGE ON * . * TO 'piwik'@'localhost' IDENTIFIED BY '********' WITH MAX_QUERIES_PER_HOUR 0 MAX_CONNECTIONS_PER_HOUR 0 MAX_UPDATES_PER_HOUR 0 MAX_USER_CONNECTIONS 0 ;
+CREATE DATABASE IF NOT EXISTS `piwik` ;
+GRANT ALL PRIVILEGES ON `piwik` . * TO 'piwik'@'localhost';
+}}}
+
+===== Tracking code =====
+
+The installer suggested this JS tracking code, see the docs at http://piwik.org/docs/javascript-tracking/ :
+
+{{{
+<!-- Piwik -->
+<script type="text/javascript">
+var pkBaseURL = (("https:" == document.location.protocol) ? "https://piwik.transitionnetwork.org.webarch.net/" : "http://piwik.transitionnetwork.org.webarch.net/");
+document.write(unescape("%3Cscript src='" + pkBaseURL + "piwik.js' type='text/javascript'%3E%3C/script%3E"));
+</script><script type="text/javascript">
+try {
+var piwikTracker = Piwik.getTracker(pkBaseURL + "piwik.php", 1);
+piwikTracker.trackPageView();
+piwikTracker.enableLinkTracking();
+} catch( err ) {}
+</script><noscript><p><img src="http://piwik.transitionnetwork.org.webarch.net/piwik.php?idsite=1" style="border:0" alt="" /></p></noscript>
+<!-- End Piwik Tracking Code -->
+}}}
+
+And this image tracking code:
+
+{{{
+<!-- Piwik Image Tracker -->
+<img src="https://piwik.transitionnetwork.org.webarch.net/piwik.php?idsite=1&rec=1" style="border:0" alt="" />
+<!-- End Piwik -->
+}}}
+
+The following parameters can also be passed to the image URL:
+
+ *   rec - (required) The parameter &rec=1 is required to force the request to be recorded
+ *   idsite - (required) Defines the Website ID being tracked
+ *   action_name - Defines the custom Page Title for this page view
+ *   idgoal - The request will trigger the given Goal
+ *   urlref - The Referrer URL: must be set to the referrer URL used before landing on the page containing the Image tracker. For example, in PHP this value is accessible via
+    {{{$_SERVER['HTTP_REFERER']}}}
+ *   revenue - Used with idgoal, defines the custom revenue for this conversion
+
+===== Logo =====
+
+Customise the logo:
+
+{{{
+cd /web/piwik.transitionnetwork.org/piwik
+chown -R www-data:www-data themes/
+}}}
+
+===== Cron =====
+
+Set up the [http://piwik.org/docs/setup-auto-archiving/#toc-linuxunix-how-to-setup-a-crontab-to-automatically-archive-the-reports crontab to automatically archive the reports]:
+
+{{{
+crontab -u www-data -e
+
+5 * * * * /web/piwik.transitionnetwork.org/piwik/misc/cron/archive.sh > /dev/null
+}}}
+
+===== Python =====
+
+For the Google Analytics data import we need Python 2.6 and we are running with Python 2.5.2, so [http://evan.borgstrom.ca/post/845359613/python-2-6-on-debian-lenny-5-0 following this] a source compile was done on the dev server:
+
+{{{
+aptitude build-dep python2.5 
+cd /usr/local/src
+wget http://www.python.org/ftp/python/2.6.7/Python-2.6.7.tgz
+tar -zxvf Python-2.6.7.tgz
+cd Python-2.6.7
+./configure --with-threads --enable-shared
+make
+make install 
+ln -s /usr/local/lib/libpython2.6.so* /usr/lib/
+cd /usr/local/src
+wget 'http://pypi.python.org/packages/source/s/setuptools/setuptools-0.6c11.tar.gz#md5=7df2a529a074f613b509fb44feefe74e'
+tar zxvf setuptools-0.6c11.tar.gz
+cd setuptools-0.6c11
+python setup.py install
+cd /usr/local/src
+wget "https://gdata-python-client.googlecode.com/files/gdata-2.0.14.tar.gz" --no-check-certificate
+tar -zxvf gdata-2.0.14.tar.gz
+cd gdata-2.0.14
+python setup.py install
+aptitude purge python-mysqldb
+wget "http://downloads.sourceforge.net/project/mysql-python/mysql-python/1.2.3/MySQL-python-1.2.3.tar.gz"
+tar -zxvf MySQL-python-1.2.3.tar.gz 
+cd MySQL-python-1.2.3
+vim site.cfg
+ mysql_config = /usr/bin/mysql_config
+aptitude install libmysqlclient-dev
+python setup.py build
+python setup.py install
+}}}
+
+===== GA Import =====
+
+See python notes above and [http://clearcode.cc/offer/open-source-projects/google2piwik/ Google2Piwik].
+
+{{{
+cd /web/piwik.transitionnetwork.org/
+wget http://clearcode.cc/google2piwik-1.2.5.tgz
+tar -zxvf google2piwik-1.2.5.tgz
+cd google2piwik-1.2.5
+cp google2piwik.conf.sample google2piwik.conf
+}}}
+
+Edit {{{google2piwik.conf}}}:
+
+{{{
+## Google Account Credentials
+# If you don't know your site table_id type:
+#                       ./google2piwik.py -p
+[google]
+user_login = XXX@gmail.com
+user_pass  = XXX
+table_id   = ga:XXX
+
+# MySQL Piwik Database configuration
+[mysql]
+db = piwik
+host = localhost
+port = 3306
+user = piwik
+passwd = XXX
+table_prefix = 
+
+# Set export date range
+[export]
+start = 2011-05-01
+end   = 2011-06-29
+
+## Piwik configuration of site.
+# For default Piwik installation with one website, site_id should be set to 1
+[piwik]
+site_id  = 1
+site_url = http://www.transitionnetwork.org
+}}}
+
+Get the table_id and test and backup db:
+
+{{{
+./google2piwik.py -p
+./google2piwik.py -c
+mysql_backup
+}}}
+
+Piwik, for the website you are importing data to, [https://piwik.transitionnetwork.org/index.php?module=SitesManager&action=index&idSite=1&period=day&date=yesterday change the timezone to UTC] and run the script:
+
+{{{
+./google2piwik.py --verbose=2
+}}}
+
+
+=== Requirements ===
+
+The [http://piwik.org/docs/requirements/ requirements are]:
+
+ * PHP version 5.1.3 or greater, We highly recommend using at least PHP 5.3 as it is much more memory efficient than previous PHP versions, we have: PHP 5.2.6-1+lenny10 with Suhosin-Patch 0.9.6.2 (cli), when the server is migrated to squeeze we will get a new php, it can wait till then.
+ * MySQL version 4.1 or greater, we have 5.0.51a-24+lenny5-log
+ * (enabled by default) PHP extension pdo and pdo_mysql, weh have these already installed and they are configured via /etc/php5/apache2/conf.d/pdo.ini and /etc/php5/apache2/conf.d/pdo_mysql.ini
+ * PHP GD extension, installed already
+ * Increase your PHP memory_limit value in your php.ini config file to be at least memory_limit = 128M, we have 256M already in /etc/php5/apache2/php.ini
+