ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
2
Quantitative Decay Analysis SheetTest Name #001 (Example: "Add Social Proof on Homepage"Test Name #002Test Name #003Test Name #004Test Name #005Test Name #006Test Name #007Test Name #008Test Name #009Test Name #010Test Name #011Test Name #012Test Name #013Test Name #014Test Name #015Test Name #016Test Name #017Test Name #018Test Name #019Test Name #020
3
Original
Test Data
›››
Started On01.01.2020
4
Ended On01.02.2020
5
Affected KPICVR
6
Baseline CVR (or target KPI)21.00%
7
Minimum Detectable Effect4.00%
8
Confidence Level (α)95%
9
Statistical Power (β)80%
10
Sample Size (per Variant)37,068
11
# of Variants (with Control)2
12
Result - Control's KPI22.22%
13
Result - Best Variant's KPI22.89%
14
Result - Relative KPI Uplift3.02%
15
Test End ResultUplift Found!
16

Decay Detection
Test Data
›››
Started On01.04.2020
17
Ended On01.05.2020
18
Affected KPICVR
19
Baseline CVR (or target KPI)21.00%
20
Minimum Detectable Effect4.00%
21
Confidence Level (α)95%
22
Statistical Power (β)80%
23
Sample Size (per Variant)37,068
24
Result - Control's KPI22.22%
25
Result - Variant's KPI22.39%
26
Result - Relative KPI Uplift0.77%
27
Follow-up Test End ResultUplift Still Found!
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100