ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
What this is: Value of information BOTEC for Development Innovation Lab (DIL) RCT of vouchers for water chlorination. Key parameters are in light blue.
2
3
CostsValueNotes
4
Cost of the evaluation (millions)$10Rough guess
5
6
Cost-effectiveness (CE) of water chlorination interventionsValue
Not used in calculations; for interpretation only
7
Average CE of Dispensers for Safe Water (DSW) (x cash)10.8
Average of rough CE estimates across countries where water chlorination CE is above ~6x cash
8
Average CE of in-line water chlorination (ILC) (x cash)13.5
Average of rough CE estimates across countries where water chlorination CE is above ~6x cash
9
Average CE of vouchers (x cash)19.9
Average of rough CE estimates across countries where water chlorination CE is above ~6x cash
10
Overall CE of water chlorination interventions we might fund (x cash)13.7
For the overall average, we place a 50% weight on the cost-effectiveness of water chlorination via Dispensers for Safe Water (DSW), compared to 25% weight for the other two interventions, since the implementation infrastructure is already in place for DSW and thus that program may be easier to scale. For more information on DSW, see this page: https://www.givewell.org/research/grants/evidence-action-dispensers-for-safe-water-January-2022
11
12
Basic parametersValue
13
How long we would fund DSW and other water chlorination interventions if they met our bar (years)10
Guess. Using similar value to other value of information BOTECs.
14
Cost-effectiveness of counterfactual opportunity (x cash)10
Guess. Expected cost-effectiveness of counterfactual use of funds in 2025.
15
Units of value generated per philanthropic dollar spent, GiveDirectly0.00335
Top charities cost-effectiveness analysis
16
Discount rate for opportunities getting worse over time5%
This assumes that the cost-effectiveness of opportunities decays over a 10-year period. Using similar value to other value of information BOTECs.
17
18
Effect of vouchers evaluation on cost-effectiveness estimates
19
ValueNotes
20
Scenario 0: No evaluation
21
Annual funding to water chlorination interventions (millions)$46
Guess. If we didn't fund the evaluation, we would use our current best guess of cost-effectiveness and recommend funding to areas that are above the cost-effectiveness of counterfactual programs we might recommend funding (our current bar for recommending funding is 10x cash).
22
Best guess on average CE of water chlorination interventions under this scenario (x cash)10
Conservative guess, see cell B10. We use a lower value than the 13.7x cash calculated in cell B10 to account for uncertainty in that estimate and to avoid overstating the cost-effectiveness of the RCT.
23
24
Scenario 1: Negative update on CE (Opportunities estimated to be 10-13x cash are now below our bar of 10x cash)
25
Probability of scenario (assuming we fund the evaluation)15%Guess
26
Change in annual funding to water chlorination interventions in this scenario (millions)-$14
If the evaluation provides a negative update on cost-effectiveness, we would reduce the amount we recommend to water chlorination interventions since there would be fewer gaps that are above our bar.
27
Best guess on average CE of water chlorination interventions under this scenario (x cash)8
Guess. Assuming opportunities estimated to be 10-13x cash are now below our bar of 10x cash, such that the average CE of water chlorination interventions falls from ~10x cash to 8x cash.
28
Increase in units of value from evaluation in this scenario per year91,900Calculation
29
30
Scenario 2: Cost-effectiveness stays the same (cost-effectiveness stays at 10x cash)
31
Probability of scenario (assuming we fund the evaluation)70%
Guess. Our bar was 8x cash when we approved a January 2022 grant to DSW; since we now have a 10x cash bar, this effectively means that water chlorination interventions have to become more cost-effective to "stay the same" (i.e. meet our bar).
32
Annual funding to water chlorination interventions in this scenario (millions)$46
Guess. If we get confirmation of our current cost-effectiveness estimates, we would likely recommend funding opportunities currently estimated to be at least 10x cash. It is also possible that we may want to recommend more funding to these programs, even if our cost-effectiveness best guess stays the same, due to the increased confidence in our estimates. This would depend on our level of confidence in the evaluation results.
33
Best guess on average CE of water chlorination interventions under this scenario (x cash)10
Conservative guess, see cell B10. We use a lower value than the 13.7x cash calculated in cell B10 to account for uncertainty in that estimate and to avoid overstating the cost-effectiveness of the RCT.
34
Increase in units of value from evaluation in this scenario per year0Calculation
35
36
Scenario 3: Positive update on CE (Opportunities estimated to be 7-10x cash are now at/above our bar)
37
Probability of scenario (assuming we fund the evaluation)15%Guess
38
Change in annual funding to water chlorination interventions in this scenario (millions)$39
Conservative estimate. If we get a positive update on cost-effectiveness, we're likely to direct more funding to water chlorination interventions, since even more may meet our bar and we'd be more confident in the underlying evidence.
39
Best guess on average CE of water chlorination interventions under this scenario (x cash)12
Guess. Assuming opportunities estimated to be 7-10x cash are now at/above our bar, such that average cost-effectiveness of water chlorination interventions moves from being ~10x cash to 12x cash.
40
Increase in units of value from evaluation in this scenario per year262,763Calculation
41
42
Total increase in units of value from evaluation per year53,199Calculation
43
Present-discounted value of increase in units of value from evaluation410,792Calculation
44
45
Cost-effectiveness from value of information (x cash)12Calculation
46
47
Ad hoc adjustments
48
Risk that we learn this is above/below our bar and are wrong-20%
Rough guess. On the one hand, we think this is likely to be a well-powered, well-executed RCT, which makes us think we should reduce this adjustment from -20%. On the other hand, updating incorrectly would be very costly given how important this trial is to our overall CE estimates and future funding of water quality interventions, which makes us think it should be higher. We believe these considerations net out to around -20%.
49
Risk that pilot/study is funded without us in a few years-10%
Given the study authors and potential interest from other funders, we believe it is reasonable to assume that some version of this study might be funded within a few years.
50
Benefit from influencing other funders/value to broader research community30%
Guess. We have increased this adjustment from our default 20% because mortality studies are rare, particularly in the water, sanitation, and hygiene (WASH) field.
51
Downside adjustment0%
52
53
Cost-effectiveness from value of information (x cash), post-adhoc adjustments12
54
55
Percent of value from each scenario
56
Scenario 1: Negative update (Opportunities estimated to be 10-13x cash are now below our bar of 10x cash)26%Calculation
57
Scenario 2: Cost-effectiveness stays the same (cost-effectiveness stays at 10x cash)0%Calculation
58
Scenario 3: Positive update (Opportunities estimated to be 7-10x cash are now at/above our bar)74%Calculation
59
CheckWe're goodCalculation
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100