ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
Note: Eigen's multithreading relies on OpenMP, not available in production on mobile platforms. Eigen is what TensorFlow Lite used before ruy. EigenTensor and ruy's multithreading use only c++11 threads. OpenBLAS' multithreading was not easily available to us so was left out in these benchmarks.
2
3
4
5
6
7
8
9
10
11
12
13
XXXXXXXXXXX Float cubic
14
15
16
17
18
19
20
21
22
### cpumask=0f numthreads=1
23
24
25
sizeruyEigenEigenTensorOpenBLAS
26
162.6791.0491.141.203
27
242.6881.3461.4731.512
28
324.5872.0992.4182.3
29
485.7742.7893.1233.044
30
646.173.2013.3813.568
31
967.0373.8213.6044.401
32
1287.4743.9253.9994.816
33
1927.6024.5334.8015.376
34
2566.9144.364.3575.117
35
3848.1245.0384.9285.802
36
5128.3135.5355.6716.108
37
7689.0715.3075.3086.473
38
10249.1135.3425.3486.739
39
15369.445.5095.5576.987
40
20489.3815.415.3597.099
41
30727.2985.7665.7677.309
42
40968.8035.6495.7067.283
43
44
45
46
### cpumask=0f numthreads=4
47
48
49
sizeruyEigenEigenTensor
50
162.5851.0281.099
51
242.7751.3441.46
52
324.7422.0842.38
53
4810.243.53.104
54
6414.85.5023.433
55
9620.387.7494.84
56
12825.037.5877.489
57
19228.3610.748.525
58
25628.0111.754.251
59
38431.8614.696.857
60
51232.8316.2710.75
61
76836.5618.0416.46
62
102435.8419.0818.32
63
153637.2320.3819.84
64
204836.720.9419.86
65
307234.8421.921.47
66
409637.4722.1821.43
67
68
69
70
### cpumask=0f numthreads=1 BENCHMARK_ONLY_MATMUL=1
71
72
73
sizeruyEigenEigenTensorOpenBLAS
74
162.6121.8931.6532.162
75
242.8262.0371.8722.304
76
324.5493.3883.1683.665
77
485.7244.1493.9334.569
78
646.2994.4964.0745.071
79
967.0165.1744.2055.846
80
1287.3525.0224.6136.251
81
1927.4545.3775.2816.25
82
2567.024.8774.595.692
83
3848.0795.4665.2116.319
84
5128.3075.6555.4776.513
85
7689.2275.4115.2736.754
86
10249.1225.4955.3586.88
87
15369.3475.6145.6327.074
88
20489.4485.525.9097.188
89
30727.2435.8025.7767.411
90
40967.2735.7395.6357.381
91
92
93
94
### cpumask=0f numthreads=4 BENCHMARK_ONLY_MATMUL=1
95
96
97
sizeruyEigenEigenTensor
98
162.681.8921.63
99
242.8912.0221.915
100
324.753.3633.151