A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | What this is: Value of information BOTEC for Development Innovation Lab (DIL) RCT of vouchers for water chlorination. Key parameters are in light blue. | |||||||||||||||||||||||||
2 | ||||||||||||||||||||||||||
3 | Costs | Value | Notes | |||||||||||||||||||||||
4 | Cost of the evaluation (millions) | $10 | Rough guess | |||||||||||||||||||||||
5 | ||||||||||||||||||||||||||
6 | Cost-effectiveness (CE) of water chlorination interventions | Value | Not used in calculations; for interpretation only | |||||||||||||||||||||||
7 | Average CE of Dispensers for Safe Water (DSW) (x cash) | 10.8 | Average of rough CE estimates across countries where water chlorination CE is above ~6x cash | |||||||||||||||||||||||
8 | Average CE of in-line water chlorination (ILC) (x cash) | 13.5 | Average of rough CE estimates across countries where water chlorination CE is above ~6x cash | |||||||||||||||||||||||
9 | Average CE of vouchers (x cash) | 19.9 | Average of rough CE estimates across countries where water chlorination CE is above ~6x cash | |||||||||||||||||||||||
10 | Overall CE of water chlorination interventions we might fund (x cash) | 13.7 | For the overall average, we place a 50% weight on the cost-effectiveness of water chlorination via Dispensers for Safe Water (DSW), compared to 25% weight for the other two interventions, since the implementation infrastructure is already in place for DSW and thus that program may be easier to scale. For more information on DSW, see this page: https://www.givewell.org/research/grants/evidence-action-dispensers-for-safe-water-January-2022 | |||||||||||||||||||||||
11 | ||||||||||||||||||||||||||
12 | Basic parameters | Value | ||||||||||||||||||||||||
13 | How long we would fund DSW and other water chlorination interventions if they met our bar (years) | 10 | Guess. Using similar value to other value of information BOTECs. | |||||||||||||||||||||||
14 | Cost-effectiveness of counterfactual opportunity (x cash) | 10 | Guess. Expected cost-effectiveness of counterfactual use of funds in 2025. | |||||||||||||||||||||||
15 | Units of value generated per philanthropic dollar spent, GiveDirectly | 0.00335 | Top charities cost-effectiveness analysis | |||||||||||||||||||||||
16 | Discount rate for opportunities getting worse over time | 5% | This assumes that the cost-effectiveness of opportunities decays over a 10-year period. Using similar value to other value of information BOTECs. | |||||||||||||||||||||||
17 | ||||||||||||||||||||||||||
18 | Effect of vouchers evaluation on cost-effectiveness estimates | |||||||||||||||||||||||||
19 | Value | Notes | ||||||||||||||||||||||||
20 | Scenario 0: No evaluation | |||||||||||||||||||||||||
21 | Annual funding to water chlorination interventions (millions) | $46 | Guess. If we didn't fund the evaluation, we would use our current best guess of cost-effectiveness and recommend funding to areas that are above the cost-effectiveness of counterfactual programs we might recommend funding (our current bar for recommending funding is 10x cash). | |||||||||||||||||||||||
22 | Best guess on average CE of water chlorination interventions under this scenario (x cash) | 10 | Conservative guess, see cell B10. We use a lower value than the 13.7x cash calculated in cell B10 to account for uncertainty in that estimate and to avoid overstating the cost-effectiveness of the RCT. | |||||||||||||||||||||||
23 | ||||||||||||||||||||||||||
24 | Scenario 1: Negative update on CE (Opportunities estimated to be 10-13x cash are now below our bar of 10x cash) | |||||||||||||||||||||||||
25 | Probability of scenario (assuming we fund the evaluation) | 15% | Guess | |||||||||||||||||||||||
26 | Change in annual funding to water chlorination interventions in this scenario (millions) | -$14 | If the evaluation provides a negative update on cost-effectiveness, we would reduce the amount we recommend to water chlorination interventions since there would be fewer gaps that are above our bar. | |||||||||||||||||||||||
27 | Best guess on average CE of water chlorination interventions under this scenario (x cash) | 8 | Guess. Assuming opportunities estimated to be 10-13x cash are now below our bar of 10x cash, such that the average CE of water chlorination interventions falls from ~10x cash to 8x cash. | |||||||||||||||||||||||
28 | Increase in units of value from evaluation in this scenario per year | 91,900 | Calculation | |||||||||||||||||||||||
29 | ||||||||||||||||||||||||||
30 | Scenario 2: Cost-effectiveness stays the same (cost-effectiveness stays at 10x cash) | |||||||||||||||||||||||||
31 | Probability of scenario (assuming we fund the evaluation) | 70% | Guess. Our bar was 8x cash when we approved a January 2022 grant to DSW; since we now have a 10x cash bar, this effectively means that water chlorination interventions have to become more cost-effective to "stay the same" (i.e. meet our bar). | |||||||||||||||||||||||
32 | Annual funding to water chlorination interventions in this scenario (millions) | $46 | Guess. If we get confirmation of our current cost-effectiveness estimates, we would likely recommend funding opportunities currently estimated to be at least 10x cash. It is also possible that we may want to recommend more funding to these programs, even if our cost-effectiveness best guess stays the same, due to the increased confidence in our estimates. This would depend on our level of confidence in the evaluation results. | |||||||||||||||||||||||
33 | Best guess on average CE of water chlorination interventions under this scenario (x cash) | 10 | Conservative guess, see cell B10. We use a lower value than the 13.7x cash calculated in cell B10 to account for uncertainty in that estimate and to avoid overstating the cost-effectiveness of the RCT. | |||||||||||||||||||||||
34 | Increase in units of value from evaluation in this scenario per year | 0 | Calculation | |||||||||||||||||||||||
35 | ||||||||||||||||||||||||||
36 | Scenario 3: Positive update on CE (Opportunities estimated to be 7-10x cash are now at/above our bar) | |||||||||||||||||||||||||
37 | Probability of scenario (assuming we fund the evaluation) | 15% | Guess | |||||||||||||||||||||||
38 | Change in annual funding to water chlorination interventions in this scenario (millions) | $39 | Conservative estimate. If we get a positive update on cost-effectiveness, we're likely to direct more funding to water chlorination interventions, since even more may meet our bar and we'd be more confident in the underlying evidence. | |||||||||||||||||||||||
39 | Best guess on average CE of water chlorination interventions under this scenario (x cash) | 12 | Guess. Assuming opportunities estimated to be 7-10x cash are now at/above our bar, such that average cost-effectiveness of water chlorination interventions moves from being ~10x cash to 12x cash. | |||||||||||||||||||||||
40 | Increase in units of value from evaluation in this scenario per year | 262,763 | Calculation | |||||||||||||||||||||||
41 | ||||||||||||||||||||||||||
42 | Total increase in units of value from evaluation per year | 53,199 | Calculation | |||||||||||||||||||||||
43 | Present-discounted value of increase in units of value from evaluation | 410,792 | Calculation | |||||||||||||||||||||||
44 | ||||||||||||||||||||||||||
45 | Cost-effectiveness from value of information (x cash) | 12 | Calculation | |||||||||||||||||||||||
46 | ||||||||||||||||||||||||||
47 | Ad hoc adjustments | |||||||||||||||||||||||||
48 | Risk that we learn this is above/below our bar and are wrong | -20% | Rough guess. On the one hand, we think this is likely to be a well-powered, well-executed RCT, which makes us think we should reduce this adjustment from -20%. On the other hand, updating incorrectly would be very costly given how important this trial is to our overall CE estimates and future funding of water quality interventions, which makes us think it should be higher. We believe these considerations net out to around -20%. | |||||||||||||||||||||||
49 | Risk that pilot/study is funded without us in a few years | -10% | Given the study authors and potential interest from other funders, we believe it is reasonable to assume that some version of this study might be funded within a few years. | |||||||||||||||||||||||
50 | Benefit from influencing other funders/value to broader research community | 30% | Guess. We have increased this adjustment from our default 20% because mortality studies are rare, particularly in the water, sanitation, and hygiene (WASH) field. | |||||||||||||||||||||||
51 | Downside adjustment | 0% | ||||||||||||||||||||||||
52 | ||||||||||||||||||||||||||
53 | Cost-effectiveness from value of information (x cash), post-adhoc adjustments | 12 | ||||||||||||||||||||||||
54 | ||||||||||||||||||||||||||
55 | Percent of value from each scenario | |||||||||||||||||||||||||
56 | Scenario 1: Negative update (Opportunities estimated to be 10-13x cash are now below our bar of 10x cash) | 26% | Calculation | |||||||||||||||||||||||
57 | Scenario 2: Cost-effectiveness stays the same (cost-effectiveness stays at 10x cash) | 0% | Calculation | |||||||||||||||||||||||
58 | Scenario 3: Positive update (Opportunities estimated to be 7-10x cash are now at/above our bar) | 74% | Calculation | |||||||||||||||||||||||
59 | Check | We're good | Calculation | |||||||||||||||||||||||
60 | ||||||||||||||||||||||||||
61 | ||||||||||||||||||||||||||
62 | ||||||||||||||||||||||||||
63 | ||||||||||||||||||||||||||
64 | ||||||||||||||||||||||||||
65 | ||||||||||||||||||||||||||
66 | ||||||||||||||||||||||||||
67 | ||||||||||||||||||||||||||
68 | ||||||||||||||||||||||||||
69 | ||||||||||||||||||||||||||
70 | ||||||||||||||||||||||||||
71 | ||||||||||||||||||||||||||
72 | ||||||||||||||||||||||||||
73 | ||||||||||||||||||||||||||
74 | ||||||||||||||||||||||||||
75 | ||||||||||||||||||||||||||
76 | ||||||||||||||||||||||||||
77 | ||||||||||||||||||||||||||
78 | ||||||||||||||||||||||||||
79 | ||||||||||||||||||||||||||
80 | ||||||||||||||||||||||||||
81 | ||||||||||||||||||||||||||
82 | ||||||||||||||||||||||||||
83 | ||||||||||||||||||||||||||
84 | ||||||||||||||||||||||||||
85 | ||||||||||||||||||||||||||
86 | ||||||||||||||||||||||||||
87 | ||||||||||||||||||||||||||
88 | ||||||||||||||||||||||||||
89 | ||||||||||||||||||||||||||
90 | ||||||||||||||||||||||||||
91 | ||||||||||||||||||||||||||
92 | ||||||||||||||||||||||||||
93 | ||||||||||||||||||||||||||
94 | ||||||||||||||||||||||||||
95 | ||||||||||||||||||||||||||
96 | ||||||||||||||||||||||||||
97 | ||||||||||||||||||||||||||
98 | ||||||||||||||||||||||||||
99 | ||||||||||||||||||||||||||
100 |