Web Server Log File Analysis

The PiwikServer stats are very good at tracking people who consent to be tracked, however they don't track bots, and abusive people who don't want to be tracked. The difference in the traffic is quite stark, for example on 26th June 2013 the javascript based Piwik stats reported:

• 1106 visits
• 3314 page views

Where as the raw log files showed ten times as many page views:

• 7155 visits
• 32688 page views

Therefore to get a handel on what the web servers are doing, as opposed to what realy people are doing on the site, we need some tools other than Piwik.