Operator API performance

	A	B	C	D
1	Tests conducted on 01/16/2018. Experimental platform, 13" Macbook Pro 2016, 3.3 GHz Intel Core i7, 16GB RAM, power plugged in. Mesos build configuration: `../configure CXXFLAGS='-Wno-deprecated-declarations -O2' --disable-python --disable-java --enable-optimize`
2
3
4	v1.3.1
5	GetState Latency	v0	v1 protobuf	v1 JSON
6	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	575.43	597.72	4,290.49
7	10k agents, 100K tasks, 100K completed tasks (s)	6.24	6.11	47.18
8	20k agents, 200K tasks, 200K completed tasks (s)	14.01	13.33	111.32
9
10	GetState Latency, Normalized to v0	v0	v1 protobuf	v1 JSON
11	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	1.00	1.04	7.46
12	10k agents, 100K tasks, 100K completed tasks (s)	1.00	0.98	7.56
13	20k agents, 200K tasks, 200K completed tasks	1.00	0.95	7.95
14	Average	1.00	0.99	7.65
15
16
17	v1.4.1
18	GetState Latency	v0	v1 protobuf	v1 JSON
19	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	540.12	485.83	3,837.10
20	10k agents, 100K tasks, 100K completed tasks (s)	5.62	5.11	39.31
21	20k agents, 200K tasks, 200K completed tasks (s)	11.59	10.90	87.59
22
23	GetState Latency, Normalized to v0	v0	v1 protobuf	v1 JSON
24	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	1.00	0.90	7.10
25	10k agents, 100K tasks, 100K completed tasks (s)	1.00	0.91	7.00
26	20k agents, 200K tasks, 200K completed tasks (s)	1.00	0.94	7.56
27	Average	1.00	0.92	7.22
28
29
30	v1.5
31	GetState Latency	v0	v1 protobuf	v1 JSON
32	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	518.04	338.266	860.302
33	10k agents, 100K tasks, 100K completed tasks (s)	5.408	3.506	8.818
34	20k agents, 200K tasks, 200K completed tasks (s)	11.246	7.062	19.732
35
36	GetState Latency, Normalized to v0	v0	v1 protobuf	v1 JSON
37	1k agents, 10K tasks, 10K completed tasks (milliSeconds)	1.00	0.65	1.66
38	10k agents, 100K tasks, 100K completed tasks (s)	1.00	0.65	1.63
39	20k agents, 200K tasks, 200K completed tasks (s)	1.00	0.63	1.75
40	Average	1.00	0.64	1.68
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100