ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAH
1
TestedResultsMetrics
2
Server
Server command line
Tested stack
Performance test tool
Test command line
Test conditions
Requests number
RPCp50Avgp90Maxstdev200599500MemoryCPUInterruptsThreadsGCNetwork
3
akka-http, 2.4.11
java -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9999 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=10.0.1.107 -cp benchmark-akka-http-assembly-1.0.jar com.anyclip.benchmark_akka_http.AkkaHttpStarter
one route, GET, path with parameter, constant output
wrk
wrk -t30 -c64 -d5m http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
30 threads, 64 concurrent, 5 minutes
19421124647171.26677.268.64100%1.5GB80%143K4009.26MB/s
4
ab
ab -c 64 -n 4000000 -k http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
64 concurrent, 4000000 requests
4000000669551112110.8100%1GB80%110K400411KB/s
5
weighttp
weighttp -n 10000000 -c 64 -t 30 -k http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
30 threads, 64 concurrent, 1000000 requests
1000000068089100%1.5GB80%35K4009.974MB/s
6
7
spray, 1.3.1 (akka - 2.3.6)
java -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9999 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=10.0.1.107 -cp spray_benchmark-assembly-1.0.jar com.anyclip.spray_bnchmark.Boot
one route, GET, path with parameter, constant output
wrk
wrk -t30 -c64 -d5m http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
30 threads, 64 concurrent, 5 minutes
20032561667621.63208.155.781.3GB80%150K4009.49MB/s
8
ab
ab -c 64 -n 4000000 -k http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
64 concurrent, 4000000 requests
4000000669831112051.2100%--1.3GB75%120K4001.68KB/s
9
weighttp
weighttp -n 10000000 -c 64 -t 30 -k http://10.0.1.107:8080/dictionaries/seg/suggestions?ngr=1
30 threads, 64 concurrent, 1000000 requests
1000000066777100%1.3GB80%120K3809.7MB/s
10
11
4 routes, GET, static path, long example
wrk -t30 -c64 -d5m http://10.0.1.37:8080/api/static
30 threads, 64 concurrent, 5 minutes
7155452239672122.3100%1.5GB60%180K40070.28MB/s
12
ab -n 5000000 -c 64 -k http://10.0.1.37:8080/api/static
64 concurrent, 5000000 requests
50000002389623363446.1100%1.5GB60%180K40070MB/s
13
weighttp -n 10000000 -c 64 -t 30 -k http://10.0.1.37:8080/api/static
30 threads, 64 concurrent, 1000000 requests
1000000023769100%1.5GB60%180K40070MB/s
14
15
16
scalatra 2.4.1 on embeded jetty
java -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=9999 -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Djava.rmi.server.hostname=10.0.1.37 -Xms4096m -Xmx4096m -jar benchmark-scalatra-api-assembly-1.0.jar
many routes, GET, constant path, constant output
wrk
wrk -t30 -c64 -d5m http://10.0.1.107:8080/sample/staticsmall
30 threads, 64 concurrent, 5 minutes
11233876374352.9181614.671.5GB60%100K100-7004.18MB/s
17
ab
ab -n 500000 -c 64 -k http://10.0.1.37:8080/sample/staticsmall
64 concurrent, 500000 requests
500000377541224092.3100%1.5GB60%100K100-7005.07MB/s
18
19
20
many routes, GET, constant path, constant long output
wrk
wrk -t30 -c64 -d5m http://10.0.1.37:8080/sample/static
30 threads, 64 concurrent, 5 minutes
9381531312611.94206.271.411.5GB47%85K100-70086.34MB/s
21
ab -n 500000 -c 64 -k http://10.0.1.37:8080/sample/static
64 concurrent, 500000 requests
50000002500423363445100%1.5GB40%95K100-70071MB/s
22
weighttp -n 10000000 -c 64 -t 30 -k http://10.0.1.107:8080/sample/static
1000000024883100%1.5GB47%90K100-70070MB/s
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100