ABCDEFGHIJKLMNOPQRSTU
1
Dataset
Delta TPC-DS 3TB
2
Cluster16+1 (i3.2xlarge)
3
Spark3.2.0 EMR
4
WarmupNo
5
6
7
REFREFREFREF
8
Delta OSS
(2.0.0rc1: 2_12)
Max Spark Cluster Allocation (16 executors / 8 cores / 42Gb)
Delta OSS
(1.2.0: 2_12)
Max Spark Cluster Allocation (16 executors / 8 cores / 42Gb)
Hudi (0.11.1, Spark Datasource)
Max Spark Cluster Allocation (16 executors / 8 cores / 42Gb)

MT DISABLED
Hudi (fd7d25ab63 master, Spark Datasource)
Max Spark Cluster Allocation (16 executors / 8 cores / 42Gb)

MT DISABLED
9
Execution time (ms)Execution time (ms)Execution time (ms)Execution time (ms)
10
call_center32474305121557513164
11
catalog_page11769120941174910436
12
catalog_returns80707805998003384662
13
catalog_sales660488653273649076690123
14
customer29447305162492126093
15
customer_address
65984662065246557226
16
customer_demographics
928682811019510003
17
date_dim6329625657766202
18
household_demographics
4364419748545249
19
income_band4065433250485009
20
inventory21915216704091438756
21
item9808973096758845
22
promotion4206415543074696
23
reason4640447041904634
24
ship_mode3895428440644271
25
store4918470147245126
26
store_returns861128723110137196428
27
store_sales800589792724902179854555
28
time_dim5226533556675095
29
warehouse4074380245574186
30
web_page4881404552534599
31
web_returns40050395914635947310
32
web_sales326113329593346340331925
33
web_site3846335450975177
34
35
Delta (2.0.0_rc1)Delta (1.2)Hudi (0.11.1)Hudi (master)
36
Total2221220823392319
37
Relative (to best)100.59%100.00%105.93%105.03%
38
39
Data Files #151941519416,51515191
40
Size (in GB)924.7924.71000924.7
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100