Last modified 3 years ago
Last modified on 01/29/14 16:06:47
Table of Contents
Site Load Times
This page is to document the time the site takes to load.
2014-01-29
For reference, the following was run a few times on wiki:PuffinServer:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/
And the results were compared and this is a slow one:
Completed 200 requests
Finished 200 requests
Server Software: nginx
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 13252 bytes
Concurrency Level: 10
Time taken for tests: 0.859 seconds
Complete requests: 200
Failed requests: 0
Write errors: 0
Total transferred: 2758044 bytes
HTML transferred: 2650400 bytes
Requests per second: 232.74 [#/sec] (mean)
Time per request: 42.966 [ms] (mean)
Time per request: 4.297 [ms] (mean, across all concurrent requests)
Transfer rate: 3134.35 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 1 1 1.5 1 8
Processing: 4 11 6.6 9 47
Waiting: 3 10 6.5 8 46
Total: 4 13 6.9 11 54
Percentage of the requests served within a certain time (ms)
50% 11
66% 15
75% 17
80% 17
90% 22
95% 24
98% 31
99% 36
100% 54 (longest request)
And this is a fast one:
Completed 200 requests
Finished 200 requests
Server Software: nginx
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 13248 bytes
Concurrency Level: 10
Time taken for tests: 0.200 seconds
Complete requests: 200
Failed requests: 0
Write errors: 0
Total transferred: 2757424 bytes
HTML transferred: 2649600 bytes
Requests per second: 998.54 [#/sec] (mean)
Time per request: 10.015 [ms] (mean)
Time per request: 1.001 [ms] (mean, across all concurrent requests)
Transfer rate: 13444.29 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.2 0 2
Processing: 3 9 7.0 8 55
Waiting: 2 9 6.9 7 55
Total: 3 10 7.0 8 55
Percentage of the requests served within a certain time (ms)
50% 8
66% 10
75% 13
80% 14
90% 19
95% 23
98% 28
99% 38
100% 55 (longest request)
2013-10-20
See LoadTimesOctThirteen.
2013-05-29
The slowness documented yesterday, LoadTimes#a2013-05-28 was due to redis being unavailable due to the password missing from the /data/conf/global.inc file, this was fixed on ticket:554#comment:5, following the fix the speed of the site is back to normal:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/
LOG: Response code = 200
Completed 200 requests
Finished 200 requests
Server Software: nginx
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 10049 bytes
Concurrency Level: 10
Time taken for tests: 0.197 seconds
Complete requests: 200
Failed requests: 128
(Connect: 0, Receive: 0, Length: 128, Exceptions: 0)
Write errors: 0
Total transferred: 2143788 bytes
HTML transferred: 2007624 bytes
Requests per second: 1016.38 [#/sec] (mean)
Time per request: 9.839 [ms] (mean)
Time per request: 0.984 [ms] (mean, across all concurrent requests)
Transfer rate: 10639.16 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.2 0 1
Processing: 2 9 7.4 7 79
Waiting: 2 8 7.4 6 78
Total: 2 9 7.4 7 80
Percentage of the requests served within a certain time (ms)
50% 7
66% 9
75% 11
80% 12
90% 17
95% 22
98% 26
99% 28
100% 80 (longest request)
2013-05-28
The front page index.php now takes around 5 seconds to generate, for example, following is a test done from ParrotServer, see ticket:554 for more on this issue:
ab -n 1 -v 4 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/
This is ApacheBench, Version 2.3 <$Revision: 655654 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking www.transitionnetwork.org (be patient)...INFO: POST header ==
---
GET / HTTP/1.0
Accept-Encoding: gzip
Host: www.transitionnetwork.org
User-Agent: ApacheBench/2.3
Accept: */*
---
LOG: header received:
HTTP/1.1 200 OK
Server: nginx
Date: Tue, 28 May 2013 18:08:04 GMT
Content-Type: text/html; charset=utf-8
Connection: close
Vary: Accept-Encoding
X-Backend: C
X-Allow-Redis: YES
X-Purge-Level: 6
X-Cookie-Domain: .transitionnetwork.org
X-Redis-Prefix: www.transitionnetwork.org_
X-Accel-Expires:
Cache-Control: public, max-age=0
Last-Modified: Tue, 28 May 2013 18:07:58 +0000
Expires: Sun, 11 Mar 1984 12:00:00 GMT
Vary: Cookie
X-Engine: Octopus 1.0 ET
X-Device: normal
X-Speed-Cache: EXPIRED
X-Speed-Cache-Key: /
X-NoCache: Cache
X-GeoIP-Country-Code: GB
X-GeoIP-Country-Name: United Kingdom
X-Server-Name: www.transitionnetwork.org
Content-Encoding: gzip
�
LOG: Response code = 200
..done
Server Software: nginx
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 10052 bytes
Concurrency Level: 1
Time taken for tests: 5.696 seconds
Complete requests: 1
Failed requests: 0
Write errors: 0
Total transferred: 10735 bytes
HTML transferred: 10052 bytes
Requests per second: 0.18 [#/sec] (mean)
Time per request: 5695.665 [ms] (mean)
Time per request: 5695.665 [ms] (mean, across all concurrent requests)
Transfer rate: 1.84 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 5695 5695 0.0 5695 5695
Waiting: 5695 5695 0.0 5695 5695
Total: 5696 5696 0.0 5696 5696
For comparison with older tests documented on this page:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/
Server Software: nginx
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 9768 bytes
Concurrency Level: 10
Time taken for tests: 5.539 seconds
Complete requests: 200
Failed requests: 1
(Connect: 0, Receive: 0, Length: 1, Exceptions: 0)
Write errors: 0
Total transferred: 2090586 bytes
HTML transferred: 1953787 bytes
Requests per second: 36.11 [#/sec] (mean)
Time per request: 276.929 [ms] (mean)
Time per request: 27.693 [ms] (mean, across all concurrent requests)
Transfer rate: 368.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.2 0 1
Processing: 2 35 391.0 6 5537
Waiting: 2 35 391.0 5 5537
Total: 2 36 391.1 6 5538
Percentage of the requests served within a certain time (ms)
50% 6
66% 9
75% 11
80% 13
90% 15
95% 21
98% 29
99% 44
100% 5538 (longest request)
Requesting the front page 200 times running 10 concurrent processes over time -- the site is now roughly back to the speed it had when it was running with apache without varnish, two years ago:
- LoadTimes#a2013-05-28 5.539 seconds wiki:PuffinServer
- LoadTimes#a2013-01-28 0.253 seconds wiki:NewLiveServer
- LoadTimes#a2013-01-28 0.262 seconds wiki:PuffinServer
- LoadTimes#a2011-07-13 3.417 seconds wiki:NewLiveServer without varnish
- LoadTimes#a2011-07-05 5.131 seconds wiki:NewLiveServer without varnish
2013-01-31
A script was written to test the nearby post code search, see ticket:466#comment:55
2013-01-28
Comparing the existing live server, wiki:NewLiveServer with the new wiki:PuffinServer.
apache bench
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/
Server Hostname: www.transitionnetwork.org
Server Port: 80
Document Path: /
Document Length: 10272 bytes
Concurrency Level: 10
Time taken for tests: 0.253 seconds
Complete requests: 200
Failed requests: 0
Write errors: 0
Total transferred: 2150344 bytes
HTML transferred: 2058286 bytes
Requests per second: 790.39 [#/sec] (mean)
Time per request: 12.652 [ms] (mean)
Time per request: 1.265 [ms] (mean, across all concurrent requests)
Transfer rate: 8298.90 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 1 3 1.0 3 5
Processing: 4 9 9.3 6 48
Waiting: 1 5 7.9 3 44
Total: 4 12 9.3 9 52
Percentage of the requests served within a certain time (ms)
50% 9
66% 10
75% 10
80% 11
90% 15
95% 38
98% 46
99% 47
100% 52 (longest request)
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://newlive.puffin.webarch.net/
Server Hostname: newlive.puffin.webarch.net
Server Port: 80
Document Path: /
Document Length: 9248 bytes
Concurrency Level: 10
Time taken for tests: 0.262 seconds
Complete requests: 200
Failed requests: 0
Write errors: 0
Total transferred: 1973433 bytes
HTML transferred: 1849600 bytes
Requests per second: 762.21 [#/sec] (mean)
Time per request: 13.120 [ms] (mean)
Time per request: 1.312 [ms] (mean, across all concurrent requests)
Transfer rate: 7344.61 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 1 0.5 1 3
Processing: 4 12 13.2 8 144
Waiting: 2 10 13.3 6 143
Total: 5 13 13.1 9 145
Percentage of the requests served within a certain time (ms)
50% 9
66% 12
75% 15
80% 16
90% 24
95% 33
98% 40
99% 86
100% 145 (longest request)
Server Hostname: tn.i-jk.co.uk
Server Port: 80
Document Path: /
Document Length: 10881 bytes
Concurrency Level: 10
Time taken for tests: 0.569 seconds
Complete requests: 200
Failed requests: 0
Write errors: 0
Total transferred: 2319227 bytes
HTML transferred: 2196972 bytes
Requests per second: 351.57 [#/sec] (mean)
Time per request: 28.444 [ms] (mean)
Time per request: 2.844 [ms] (mean, across all concurrent requests)
Transfer rate: 3981.31 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 7 8 0.3 8 9
Processing: 18 20 3.1 19 50
Waiting: 10 11 3.2 10 42
Total: 26 28 3.2 27 58
Percentage of the requests served within a certain time (ms)
50% 27
66% 27
75% 27
80% 28
90% 28
95% 32
98% 40
99% 44
100% 58 (longest request)
2011-07-13
The varnish settings for the dev server and the live server are exactly the same. However the dev server is serving pages via varnish:
lynx -head -dump http://dev.transitionnetwork.org/ X-Varnish-Cache: HIT
And the live server is not:
lynx -head -dump http://www.transitionnetwork.org/ X-Drupal-Cache: HIT X-Varnish-Cache: MISS
Note the X-Varnish-Cache: HIT header from the dev server and the X-Drupal-Cache: HIT from the live server.
live server
apache bench
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/ Time taken for tests: 3.417 seconds Requests per second: 58.53 [#/sec] (mean) Time per request: 170.863 [ms] (mean) Percentage of the requests served within a certain time (ms) 50% 135 66% 179 75% 214 80% 247 90% 325 95% 407 98% 638 99% 705 100% 795 (longest request)
curl
curl -o /dev/null https://www.transitionnetwork.org/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 30668 0 30668 0 0 449k 0 --:--:-- --:--:-- --:--:-- 14.6M
2011-07-08
dev server
HTTPS tests only.
pingdom
Times out after loading just a few objects.
curl
Varied between 1 and 7 seconds, for example:
curl -o /dev/null https://dev.transitionnetwork.org/
Dload Upload Total Spent Left Speed
100 30808 0 30808 0 0 16579 0 --:--:-- 0:00:01 --:--:-- 38413
2011-07-07
The following results were generated with https redirecting to http so they are invalid for https.
Dev Server
Running Varnish on port 80 and apache on 443.
apache bench
On port 80, this is with the first hit being passed to apache:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://dev.transitionnetwork.org/ Time taken for tests: 4.302 seconds Percentage of the requests served within a certain time (ms) 50% 7 66% 8 75% 9 80% 55 90% 753 95% 2988 98% 2991 99% 2991 100% 2993 (longest request)
This is for subsequent requests which don't hit apache:
Time taken for tests: 0.183 seconds Percentage of the requests served within a certain time (ms) 50% 7 66% 7 75% 8 80% 8 90% 9 95% 19 98% 40 99% 41 100% 41 (longest request)
pingdom
- http://tools.pingdom.com/?url=http://dev.transitionnetwork.org/
- Total loading time: 2 seconds
Wow, compare this with the last test!
- http://tools.pingdom.com/?url=https://dev.transitionnetwork.org/
- Total loading time: 3.2 seconds
Load Impact
HTTP: http://loadimpact.com/result/dev.transitionnetwork.org/-d25171ed06575a89080ba08b0ab371bc
Clients 10 20 30 40 50 Delay (ms) 449 495 443 433 465
It won't run the HTTPS test today without paying them.
curl
For port 80 we consistently get around 30 mili seconds via Varnish:
curl -o /dev/null http://dev.transitionnetwork.org/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 30856 100 30856 0 0 2327k 0 --:--:-- --:--:-- --:--:-- 28.4M
On 3 different machines this ism't working, I don't understand why:
curl -o /dev/null https://dev.transitionnetwork.org/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
2011-07-05
Summary for the live server:
- The front page, HTML only of the live site, not running varnish takes around 0.1 seconds to load
- The front page of the live site, plus css / js / images etc takes over 30 seconds via pingdom
Issues for the live server:
- ETags and one CSS expression
Summary for the dev server:
- Very fast on port 80 via Varnish, less than two seconds for the page and all objects
- Very slow for port 443, 7 seconds just for the HTML
Issues for the dev server:
- Speed up port 443 accesses!
- Etag and gzipping of js files
Detailed info follows:
Live Server
This is before Varnish has been deployed and also tests have only be done using http as https requests get a 302 redirect back to http.
apache bench
Requests were done from another machine in the same rack, 200 requests for the front page, 10 at a time, using http, this was done several times and the results below are for an average result, some were faster and some were slower, the first request took about 4 seconds and almost all the rest were less that 0.1 second:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://www.transitionnetwork.org/ LOG: Response code = 200 LOG: header received: HTTP/1.1 200 OK Date: Tue, 05 Jul 2011 12:02:58 GMT Server: Apache X-Drupal-Cache: HIT Etag: "1309867375-0" Cache-Control: public, max-age=0 Last-Modified: Tue, 05 Jul 2011 12:02:55 +0000 Expires: Sun, 11 Mar 1984 12:00:00 GMT Vary: Cookie,Accept-Encoding Content-Encoding: gzip Content-Length: 7727 Connection: close Content-Type: text/html; charset=utf-8 Time taken for tests: 5.131 seconds Complete requests: 200 Percentage of the requests served within a certain time (ms) 50% 57 66% 66 75% 74 80% 77 90% 100 95% 4014 98% 4019 99% 4039 100% 4050 (longest request)
YSlow
- The page has a total of 29 HTTP requests and a total weight of 421.8K bytes with empty cache
- This page has 3 external stylesheets. Try combining them into one.
- This page has 17 external background images. Try combining them with CSS sprites.
- There are a total of 1 CSS expression:
- http://www.transitionnetwork.org/sites/default/files/css/css_9bf5bdd80b33ef2e38c9b89845c474c9.css
- CSS expressions (supported in IE beginning with Version 5) are a powerful, and dangerous, way to dynamically set CSS properties. These expressions are evaluated frequently: when the page is rendered and resized, when the page is scrolled, and even when the user moves the mouse over the page. These frequent evaluations degrade the user experience.
- There are 27 components with misconfigured ETags (all css js and images)
pingdom
The test here will run for 30 secs max and it generally takes longer than that to load the front page, in part because (as far as I can see) pingdom loads all images referenced in the CSS even if the pages doesn't use them. Some stats:
- Total objects: 76 (677.5 KB)
- (X)HTML: 1 (32.8KB)
- CSS: 3 (92.7KB)
- Scripts: 1 (150.7KB)
- Images: 71 (401.2KB)
Dev Server
Running Varnish on port 80 and apache on 443.
apache bench
On port 80, this is with the first hit being passed to apache:
ab -v 4 -n 200 -c 10 -H "Accept-Encoding: gzip" http://dev.transitionnetwork.org/ LOG: Response code = 200 LOG: header received: HTTP/1.1 200 OK Server: Apache Cache-Control: public, max-age=3600 Last-Modified: Tue, 05 Jul 2011 12:51:05 +0000 Expires: Sun, 11 Mar 1984 12:00:00 GMT Vary: Cookie,Accept-Encoding ETag: "1309870265" Content-Encoding: gzip Content-Type: text/html; charset=utf-8 Content-Length: 7353 Date: Tue, 05 Jul 2011 12:51:07 GMT X-Varnish: 1553439536 1553439337 Age: 0 Via: 1.1 varnish Connection: close X-Varnish-Cache: HIT Time taken for tests: 1.616 seconds Complete requests: 200 Percentage of the requests served within a certain time (ms) 50% 3 66% 3 75% 3 80% 3 90% 4 95% 4 98% 5 99% 1412 100% 1412 (longest request)
This is for subsequent requests which don't hit apache:
Time taken for tests: 0.149 seconds Complete requests: 200 Percentage of the requests served within a certain time (ms) 50% 7 66% 7 75% 8 80% 8 90% 9 95% 9 98% 10 99% 11 100% 12 (longest request)
YSlow
- Make fewer HTTP requests
- This page has 3 external stylesheets. Try combining them into one.
- This page has 14 external background images. Try combining them with CSS sprites.
- There are 2 plain text components that should be sent compressed
- There is 1 component with misconfigured ETags
pingdom
Load time between 1 and 1.5 seconds *total*!
- Total objects: 72 (809.7 KB)
- (X)HTML: 1 (31.4KB)
- CSS: 3 (95.8KB)
- Scripts: 1 (113.2KB)
- Images: 61 (364.7KB)
- Other: 6 (204.7KB)
However for HTTPS it times out before loading many objects:
curl
For port 80 we consistently get around 30 mili seconds via Varnish:
curl -o /dev/null http://dev.transitionnetwork.org/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 32177 100 32177 0 0 2714k 0 --:--:-- --:--:-- --:--:-- 29.7M
Unlike ab we can use curl for port 443, just loading the front page HTML file takes around 7 seconds:
curl -o /dev/null https://dev.transitionnetwork.org/
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 32076 0 32076 0 0 4545 0 --:--:-- 0:00:07 --:--:-- 8172
