1 | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | Test id | PT-20160818 | |||||||||||||
3 | Test name | Product image performance test | |||||||||||||
4 | Version | 0.1.0-alpha | |||||||||||||
5 | Date | 08/18/2016 | |||||||||||||
6 | Req. count | 500 | |||||||||||||
7 | Browser | Google chrome | |||||||||||||
8 | Image resize | 200px | |||||||||||||
9 | Image quality | 90 | |||||||||||||
10 | Conclusions | - The generation of the image (loading, rezising, plant watermark and saving) takes the most time. - The server cache brought an average of 52.6% gain in performance in both fixtures. - The times of a simple roundtrip are almost the same of a full image generation, both with or without server cache. This is unacceptable and must be improved | |||||||||||||
11 | |||||||||||||||
12 | F01 | Testing local dsl | |||||||||||||
13 | # | Take | Type | Server cache | Kb transfered | Load time (s) | Take | Avg. load time | |||||||
14 | 1 | 1 | Full request (no client cache) | No | 3100 | 60 | 1 | 64.50 | |||||||
15 | 2 | 1 | Full request (no client cache) | No | 3100 | 66 | 2 | 15.20 | |||||||
16 | 3 | 1 | Full request (no client cache) | No | 3100 | 66 | 3 | 63.00 | |||||||
17 | 4 | 1 | Full request (no client cache) | No | 3100 | 66 | 4 | 10.74 | |||||||
18 | 5 | 2 | Full request (no client cache) | Yes | 3100 | 15.16 | |||||||||
19 | 6 | 2 | Full request (no client cache) | Yes | 3100 | 15.15 | |||||||||
20 | 7 | 2 | Full request (no client cache) | Yes | 3100 | 15.21 | |||||||||
21 | 8 | 2 | Full request (no client cache) | Yes | 3100 | 15.28 | |||||||||
22 | 9 | 3 | Roundtrip (304) | No | 134 | 66 | |||||||||
23 | 10 | 3 | Roundtrip (304) | No | 134 | 60 | |||||||||
24 | 11 | 3 | Roundtrip (304) | No | 134 | 66 | |||||||||
25 | 12 | 3 | Roundtrip (304) | No | 134 | 60 | |||||||||
26 | 13 | 4 | Roundtrip (304) | Yes | 129 | 10.97 | |||||||||
27 | 14 | 4 | Roundtrip (304) | Yes | 129 | 10.52 | |||||||||
28 | 15 | 4 | Roundtrip (304) | Yes | 129 | 11.2 | |||||||||
29 | 16 | 4 | Roundtrip (304) | Yes | 129 | 10.28 | |||||||||
30 | |||||||||||||||
31 | F04 | Staging bilbao | |||||||||||||
32 | # | Take | Type | Server cache | Kb transfered | Load time (s) | Take | Avg. load time | |||||||
33 | 1 | 1 | Full request (no client cache) | No | 3600 | 66 | 1 | 67.50 | |||||||
34 | 2 | 1 | Full request (no client cache) | No | 3600 | 66 | 2 | 11.48 | |||||||
35 | 3 | 1 | Full request (no client cache) | No | 3600 | 72 | 3 | 58.85 | |||||||
36 | 4 | 1 | Full request (no client cache) | No | 3600 | 66 | 4 | 9.88 | |||||||
37 | 5 | 2 | Full request (no client cache) | Yes | 3600 | 11.99 | |||||||||
38 | 6 | 2 | Full request (no client cache) | Yes | 3600 | 11.37 | |||||||||
39 | 7 | 2 | Full request (no client cache) | Yes | 3600 | 11.2 | |||||||||
40 | 8 | 2 | Full request (no client cache) | Yes | 3600 | 11.37 | |||||||||
41 | 9 | 3 | Roundtrip (304) | No | 89 | 58.54 | |||||||||
42 | 10 | 3 | Roundtrip (304) | No | 89 | 58.56 | |||||||||
43 | 11 | 3 | Roundtrip (304) | No | 89 | 58.78 | |||||||||
44 | 12 | 3 | Roundtrip (304) | No | 89 | 59.5 | |||||||||
45 | 13 | 4 | Roundtrip (304) | Yes | 88.8 | 9.65 | |||||||||
46 | 14 | 4 | Roundtrip (304) | Yes | 88.8 | 10.08 | |||||||||
47 | 15 | 4 | Roundtrip (304) | Yes | 88.8 | 9.84 | |||||||||
48 | 16 | 4 | Roundtrip (304) | Yes | 88.8 | 9.96 | |||||||||
49 | |||||||||||||||
1 | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | Test id | PT-20160826 | |||||||||||||
3 | Test name | Product image performance test | |||||||||||||
4 | Version | 0.1.2-alpha | |||||||||||||
5 | Date | 08/26/2016 | |||||||||||||
6 | Req. count | 500 | |||||||||||||
7 | Browser | Google chrome | |||||||||||||
8 | Image resize | 200px | |||||||||||||
9 | Image quality | 90 | |||||||||||||
10 | Conclusions | - Improvement of a 90.38% in roundtrip time - The load time of a roundtrip with or without server cache is almost identical (and it should be) | |||||||||||||
11 | |||||||||||||||
12 | F01 | Testing local dsl | |||||||||||||
13 | # | Take | Type | Server cache | Kb transfered | Load time (s) | Take | Avg. load time | |||||||
14 | 1 | 1 | Full request (no client cache) | No | 3100 | 72 | 1 | 67.50 | |||||||
15 | 2 | 1 | Full request (no client cache) | No | 3100 | 66 | 2 | 15.78 | |||||||
16 | 3 | 1 | Full request (no client cache) | No | 3100 | 66 | 3 | 6.48 | |||||||
17 | 4 | 1 | Full request (no client cache) | No | 3100 | 66 | 4 | 6.65 | |||||||
18 | 5 | 2 | Full request (no client cache) | Yes | 3100 | 15.4 | |||||||||
19 | 6 | 2 | Full request (no client cache) | Yes | 3100 | 15.34 | |||||||||
20 | 7 | 2 | Full request (no client cache) | Yes | 3100 | 15.37 | |||||||||
21 | 8 | 2 | Full request (no client cache) | Yes | 3100 | 16.99 | |||||||||
22 | 9 | 3 | Roundtrip (304) | No | 135 | 6.5 | |||||||||
23 | 10 | 3 | Roundtrip (304) | No | 135 | 6.51 | |||||||||
24 | 11 | 3 | Roundtrip (304) | No | 135 | 6.47 | |||||||||
25 | 12 | 3 | Roundtrip (304) | No | 135 | 6.42 | |||||||||
26 | 13 | 4 | Roundtrip (304) | Yes | 130 | 6.8 | |||||||||
27 | 14 | 4 | Roundtrip (304) | Yes | 130 | 6.78 | |||||||||
28 | 15 | 4 | Roundtrip (304) | Yes | 130 | 6.57 | |||||||||
29 | 16 | 4 | Roundtrip (304) | Yes | 130 | 6.43 | |||||||||
30 | |||||||||||||||
31 | F04 | Staging bilbao | |||||||||||||
32 | # | Take | Type | Server cache | Kb transfered | Load time (s) | Take | Avg. load time | |||||||
33 | 1 | 1 | Full request (no client cache) | No | 3600 | 66 | 1 | 61.38 | |||||||
34 | 2 | 1 | Full request (no client cache) | No | 3600 | 59.65 | 2 | 16.29 | |||||||
35 | 3 | 1 | Full request (no client cache) | No | 3600 | 60 | 3 | 5.26 | |||||||
36 | 4 | 1 | Full request (no client cache) | No | 3600 | 59.85 | 4 | 5.29 | |||||||
37 | 5 | 2 | Full request (no client cache) | Yes | 3600 | 16.35 | |||||||||
38 | 6 | 2 | Full request (no client cache) | Yes | 3600 | 16.29 | |||||||||
39 | 7 | 2 | Full request (no client cache) | Yes | 3600 | 16.23 | |||||||||
40 | 8 | 2 | Full request (no client cache) | Yes | 3600 | 16.27 | |||||||||
41 | 9 | 3 | Roundtrip (304) | No | 142 | 5.37 | |||||||||
42 | 10 | 3 | Roundtrip (304) | No | 142 | 5.27 | |||||||||
43 | 11 | 3 | Roundtrip (304) | No | 142 | 5.19 | |||||||||
44 | 12 | 3 | Roundtrip (304) | No | 142 | 5.22 | |||||||||
45 | 13 | 4 | Roundtrip (304) | Yes | 137 | 5.42 | |||||||||
46 | 14 | 4 | Roundtrip (304) | Yes | 137 | 5.21 | |||||||||
47 | 15 | 4 | Roundtrip (304) | Yes | 137 | 5.19 | |||||||||
48 | 16 | 4 | Roundtrip (304) | Yes | 137 | 5.34 | |||||||||
49 | |||||||||||||||
1 | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | Test id | PT-20160901 | ||||||||||||||
3 | Test name | Configuration parsing of different formats | ||||||||||||||
4 | Version | 0.1.2-alpha | ||||||||||||||
5 | Date | 09/01/2016 | ||||||||||||||
6 | Req. count | 500 | ||||||||||||||
7 | Browser | Google chrome | ||||||||||||||
8 | Image resize | 200px | ||||||||||||||
9 | Image quality | 90 | ||||||||||||||
10 | Conclusions | - The difference between JSON and PHP config parsing are practically 0 between the full and roudtrip requests (0.07 and 0.01 respectivelly) - YAML configuration parsing is the most expensive, with an average of 12.7% and 17.8% more load time in full and roudtrip requests respectivelly - The lowest load time is obtained using JSON configuration parsing | ||||||||||||||
11 | ||||||||||||||||
12 | ||||||||||||||||
13 | F04 | Staging bilbao | ||||||||||||||
14 | # | Take | Type | Server cache | Configuration source | Load time (s) | Take | Avg. load time | ||||||||
15 | 1 | full-yaml | Full request (no client cache) | Yes | yaml | 10.34 | full-json | 9.17 | ||||||||
16 | 2 | full-yaml | Full request (no client cache) | Yes | yaml | 10.39 | full-php | 9.24 | ||||||||
17 | 3 | full-json | Full request (no client cache) | Yes | json | 9.13 | full-yaml | 10.37 | ||||||||
18 | 4 | full-json | Full request (no client cache) | Yes | json | 9.21 | roundtrip-json | 5.33 | ||||||||
19 | 5 | full-php | Full request (no client cache) | Yes | php | 9.28 | roundtrip-php | 5.34 | ||||||||
20 | 6 | full-php | Full request (no client cache) | Yes | php | 9.19 | roundtrip-yaml | 6.29 | ||||||||
21 | 7 | roundtrip-yaml | Roundtrip (304) | No | yaml | 6.21 | ||||||||||
22 | 8 | roundtrip-yaml | Roundtrip (304) | No | yaml | 6.36 | ||||||||||
23 | 9 | roundtrip-json | Roundtrip (304) | No | json | 5.3 | ||||||||||
24 | 10 | roundtrip-json | Roundtrip (304) | No | json | 5.36 | ||||||||||
25 | 11 | roundtrip-php | Roundtrip (304) | No | php | 5.31 | ||||||||||
26 | 12 | roundtrip-php | Roundtrip (304) | No | php | 5.37 | ||||||||||
27 | ||||||||||||||||
28 | ||||||||||||||||
29 | ||||||||||||||||
30 | ||||||||||||||||
1 | ||||||
|---|---|---|---|---|---|---|
2 | Versions image retrieval performance comparison | |||||
3 | ||||||
4 | 0.1.0-alpha | 0.1.2-alpha | ||||
5 | Full request, without server cache | 66.00 | 64.44 | |||
6 | Full request, with server cache | 13.34 | 16.03 | |||
7 | Roundtrip (304) | 60.92 | 5.87 | |||
8 | ||||||
9 | ||||||
10 | ||||||
11 | ||||||
12 | ||||||
13 | ||||||
14 | ||||||
15 | ||||||
16 | ||||||
17 | ||||||
18 | ||||||
19 | ||||||
20 | ||||||
21 | ||||||
22 | ||||||
23 | ||||||
24 | ||||||
25 | ||||||
26 | ||||||
27 |
1 | Code | Name | Server location | Client Location | Download speed (Kb/s) | Upload speed (Kb/s) | Latency (ms) |
|---|---|---|---|---|---|---|---|
2 | F01 | Testing local dsl | Development mac | Same network | 2048 | 1024 | 5 |
3 | F04 | Staging bilbao | ESXi zeus | Same network | 10240 | 10240 | 2.6 |
4 | F05 | Staging Remote AWS | AWS Sao Paulo instance | Bilbao | |||
5 | F06 | Staging Remote inverted | ESXi zeus | AWS Sao Paulo instance |
1 | Browsers | Boolean | Request type |
|---|---|---|---|
2 | Google Chrome | Yes | Full request (no client cache) |
3 | Mozilla Firefox | No | Roundtrip (304) |