ABCDEFGHIJKLMNOPQRSTUV
1
LEEPOverallMadagascarZimbabweSierra LeoneBoliviaNigerAngolaGhanaRwandaUgandaNigeriaBurundiBeninSenegalCôte d’IvoireUzbekistanMalawiPakistanBotswanaSourceNotes
2
Active Country
This row indicates which countries are being included in the final cost-effectiveness number.
Malawi and Pakistan are excluded since they have already been successes, whilst Botswana is excluded since the program has been shut down
3
User inputs
4
Duration of benefits (years)40404040404040404040404040404040404040User inputWe use 40 years, the same gap as GiveWell do for the income benefits of malaria/deworming prevention. Deworming effects children at a similar age, so seems appropriate here.
5
Discount rate4%4%4%4%4%4%4%4%4%4%4%4%4%4%4%4%4%4%4%User input
6
Income doublings per DALY averted2222222222222222222User input
7
# Children poisoned / year
8
Children (0-19) with lead poisoning (BLL > 5 μg/dL)4,850,5375,709,8352,297,1913,231,15412,500,2674,738,1291,731,7861,327,3555,243,55043,178,2143,053,1333,148,8291,896,6215,252,2191,642,2793,431,43341,121,401216,886
The Toxic Truth Report (UNICEF)
Original source is from The Toxic Truth (pages 67 - 72)
9
Annual additional children with lead poisoning (BLL > 5 μg/dL)242,527285,492114,860161,558625,013236,90686,58966,368262,1782,158,911152,657157,44194,831262,61182,114171,5722,056,07010,844We assume that if x 0-19 year olds have a BLL > 5 μg/dL, then x/20 will be additionally have a BLL > 5 μg/dL each year
10
Proportion of lead poisoning attributable to paint20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%20%LEEP Malawi CEAWe assume that paint accounts for approximately 20% of lead exposure in most low- and middle- income countries. This is based on a subjective estimate from LEEP's cost-effectiveness analysis in Malawi
However, is a highly uncertain estimate, with limited data available. A report from Rethink Priorities states: "Our impression from conversations and the gray literature is that lead paint and unsafe recycling of lead acid batteries are the largest sources of exposure in LMICs". Unfortunately, it is challenging to directly estimate this percentage.
11
Annual additional children with lead poisoning due to paint (BLL > 5 μg/dL)48,50557,09822,97232,312125,00347,38117,31813,27452,436431,78230,53131,48818,96652,52216,42334,314411,2142,169
12
Health Burden
13
Annual DALYs due to lead poisoning (<20 year olds)4,0622,4981,5569116,3222,0892,0621,6576,13420,6103,0591,8161,4302,4362,6223,67572,45586GBD ResultsData from Global Burden of Disease
The 0-19 age range is selected to be consistent with data from the Toxic Truth Report
14
Annual DALYs from lead poisoning for 1 child0.00080.00040.00070.00030.00050.00040.00120.00120.00120.00050.00100.00060.00080.00050.00160.00110.00180.0004DALYs each year, for an average child poisoned by lead
15
Present value lifetime DALYs from lead poisoning for 1 child0.0170.0090.0140.0060.0100.0090.0250.0260.0240.0100.0210.0120.0160.0100.0330.0220.0360.008We estimate how many DALYs the average child will experience over their lifetime. We use a present value formula, discounting future years. This is the same method that GiveWell use to estimate longterm health benefits [see this cell for an example]
16
Income Burden
17
Average Blood Lead Levels (BLL)4.89.26.36.512.14.22.93.73.84.95.65.43.95.12.44.74.93.9
Data from Leadpollution.org
We take a simple mean average of blood lead levels (BLL) in each country.
18
IQ loss for average child1.233.492.002.104.300.920.260.670.721.281.641.540.771.390.001.181.280.77
Rethink Priorities - relationship between Blood lead level (μg/dl) and IQ loss
We use a function mapping BLL to IQ, estimated by Rethink Priorities' report on lead exposure. This function comes from estimates in Lanphear et al. (2005)
Copied below is a table illustrating IQ loss from a 1 unit increase in BLL (μg/dl), at different BLLs.
Blood lead level (μg/dl) | IQ loss per μg/dl [95% confidence interval]
------------------------------------------------------------------------------------------------------
0-2.4 | -
2.4-10 | 0.51 [0.32-0.70]
10-20 | 0.19 [0.12-0.26]
20+ | 0.11 [0.07-0.15]
19
% income loss from 1 drop in IQ0.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.00220.0022
Income benefits of Education
We estimate this based on our analysis about the income returns to improved education - see here
20
% income loss from lead poisoning for 1 child0.27%0.77%0.44%0.46%0.95%0.20%0.06%0.15%0.16%0.28%0.36%0.34%0.17%0.30%0.00%0.26%0.28%0.17%
21
Ln(income) lost each year, for an average child poisoned by lead0.0030.0080.0040.0050.0090.0020.0010.0010.0020.0030.0040.0030.0020.0030.0000.0030.0030.002Converts income to ln(income)
22
Present value lifetime ln(income) cost from lead poisoning for 1 child 0.080.210.120.130.260.060.020.040.040.080.100.090.050.080.000.070.080.05We assume the average child poisoned by lead will earn income approximately 10 years after poisoning, and then continue for 40 years. This is the same method that GiveWell use to estimate longterm economic benefits [see this cell for an example]. We multiply by 2 to account for the same household multiplier as deworming.
23
Present value income doublings lost from lead poisoning for 1 child 0.110.310.180.190.380.080.020.060.060.110.140.140.070.120.000.100.110.07Converts ln(income) to income doublings
24
Time inputs
25
Paint market growth rate5%5%5%5%5%5%5%5%5%5%5%5%5%5%5%5%5%5%5%
Paint market growth rate and market share of solvent vs water-based.xlsx
We assume a prior of 5% growth in the paint market, based on LEEP's anlaysis
26
Frequency of repainting or replacement3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%3.5%4%AssumptionOnce anti-lead regulations are put in place, people replace leaded paint with non-lead paint. There is little empirical evidence on how frequently people repaint their homes, but a rate of 3.5% per year implies half of houses are repainted every 20 years. This lines up with anecodetal evidence from LEEP
27
Compliance with regulation (after passing law)50%50%50%50%50%50%50%50%50%50%50%50%50%50%50%50%50%50%50%We assume that approximately 50% of paint manufacturers (by market share) will comply with new lead paint regulations. We have high uncertainty over this number, as no follow-up study has yet been conducted to see if the sale of leaded paints does fall following government regulation. Follow-up studies conducted by LEEP should better inform this number.
28
Change in children poisoned before regulation (%)1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%1.00%CalculationThe number of children poisoned grows proportionally to the growth of the paint market. This is then discounted back by 4% for each future year
29
Change in children poisoned after regulation (%)-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%-3.25%CalculationThe number of children poisoned declines as lead-painted houses are slowly replaced with lead-free painted houses.
This is then discounted back by 4% for each future year
30
Scenario 1: LEEP launches a program in country
31
Year in which regulations are implemented 202320242024202420242025202520252025202520252025202520252025202220242023AssumptionAn input, based upon when we expect regulations to start taking effect. Inputs are based on how much time LEEP has spent in the country
32
Children poisoned before regulation48,505114,76846,17464,946251,255143,57052,47540,220158,8851,308,34392,51395,41357,470159,14749,7630826,5402,169
33
Children poisoned after regulation1,116,4141,311,117527,491741,9512,870,3651,084,821396,502303,9051,200,5409,885,891699,032720,942434,2421,202,525376,009791,2129,442,47249,919
34
Total children poisoned1,164,9191,425,884573,664806,8983,121,6201,228,391448,977344,1251,359,42511,194,234791,545816,355491,7111,361,672425,772791,21210,269,01252,088
35
Present value DALYs due to lead paint20,08112,8417,9994,68332,49811,14811,0048,84332,735109,98916,3259,6917,63113,00013,99317,443372,451425
36
Present value Income doublings lost due to lead paint126,436437,405101,093149,4691,178,732100,02810,16320,24486,1181,265,533114,497110,71833,372166,237082,3021,160,9353,535
37
Income doubling-equivalents lost166,598463,086117,090158,8351,243,728122,32432,17137,930151,5881,485,511147,147130,10048,635192,23727,985117,1871,905,8374,385Describes both health and economic impacts in terms of income-doublings lost
38
Scenario 2: Government intervenes several years later than LEEP
39
Years before government would intervene without LEEP5555555555555555555This is how many years we estimate LEEP will bring forward regulations by. We are highly uncertain when to expect the government to intervene, in absence of LEEP's action. LEEP very roughly estimates a time lag of (at least) 5 years, although they are also highly uncertain of this.
40
Year of regulation without LEEP intervention202820292029202920292030203020302030203020302030203020302030202720292028
41
Children poisoned before regulation298,406411,881165,709233,080901,711392,586143,490109,980434,4633,577,605252,973260,902157,148435,182136,074175,0382,966,30713,343
42
Children poisoned after regulation1,069,1001,250,505503,106707,6522,737,6711,030,246376,555288,6161,140,1439,388,553663,865684,673412,3961,142,028357,093760,5579,005,95847,804
43
Total children poisoned1,367,5051,662,386668,814940,7323,639,3831,422,832520,045398,5971,574,60612,966,157916,837945,574569,5441,577,210493,166935,59411,972,26561,146
44
Present value DALYs due to lead paint23,57314,9719,3255,46037,88812,91312,74610,24337,917127,39918,90911,2258,83915,05816,20820,626434,227499
45
Present value Income doublings lost due to lead paint148,424509,954117,860174,2601,374,240115,86111,77223,44899,7491,465,853132,620128,24338,655192,550097,3201,353,4924,150
46
Income doubling-equivalents lost195,570539,895136,511185,1801,450,016141,68737,26443,933175,5821,720,651170,438150,69456,333222,66632,415138,5722,221,9465,148Describes both health and economic impacts in terms of income-doublings lost
47
Expected value of LEEP
48
Additional income doublings attributable to LEEP's intervention (conditional on successful program)28,97276,80919,42126,345206,28919,3635,0926,00423,995235,14023,29220,5937,69830,4294,43021,385316,108763
49
Prior on successful execution of a LEEP program67%83%67%67%60%60%60%50%48%50%50%50%50%50%50%100%100%0%[redacted][redacted]
50
Expected children saved from lead poisoning135,733196,29763,75089,669310,657116,66442,64127,236103,287885,96162,64664,61038,916107,76933,697144,3821,703,2530
51
Expected Income doubling-equivalents gained (total program)19,41263,75113,01217,651123,77311,6183,0553,00211,517117,57011,64610,2973,84915,2142,21521,385316,1080
52
Program Cost
53
Rough % costs by country for 2023 (adjusted)7%7%0%4%7%7%6%4%6%13%4%4%6%6%4%3%13%[redacted]LEEP provided data on the % of funding that went to different countries in 2023. This helps us estimate approximate cost per country per year, going forward
54
Cost per country per year$900,000$64,585$64,585$3,355$31,873$64,585$64,585$52,842$31,873$52,842$120,783$31,873$31,873$52,842$52,842$31,873$24,324$120,783NAEstimate based on data from LEEP
55
Years in country555555555555555555NAWe assume it takes 5 years for LEEP to fully execute an intervention in each country
56
Total program cost$3,766,076$322,926$322,926$16,775$159,366$322,926$322,926$264,212$159,366$264,212$603,914$159,366$159,366$264,212$264,212$159,366$121,622$603,914NA
57
Initial Cost-effectiveness
58
Income doubling-equivalents (in active countries only)427,583
59
Program Cost (in active countries)$3,766,076
60
$s/Income doubling-equivalents (active countries)$8.81$16.64$5.07$1.29$9.03$2.61$27.80$86.47$53.09$22.94$5.14$13.68$15.48$68.64$17.37$71.95$5.69$1.91NA
61
Initial GD estimate (active countries)37x19x64x251x36x124x12x4x6x14x63x24x21x5x19x5x57x170x
62
63
AdjustmentsAdjustments based on external factors (outside the CEA)
64
Government counterfactual adjustment
We deflate the estimate because regulating lead paint requires government to spend money - money that might otherwise have been put to something valuable
65
Approximate salary for government official$505$1,267$461$3,523$533$2,999$2,176$966$964$2,184$238$1,303$1,599$2,486$2,255$645$1,597$7,738We assume a goverment official's salary is approximately the same as the countries' GDP per capita
66
FTE required in each country0.60.30.20.20.50.70.70.30.94.40.30.30.30.60.70.44.70.1We (very roughly) guess that it takes about 1 FTE of government work, for every 50 million people. These numbers pass a basic sanity check, being in the same order of magnitude as LEEP's guesses for how much resourcing lead exposure regulations require
67
Annual cost to government$20,148$303$380$92$705$267$2,099$1,523$290$868$9,610$71$391$480$1,492$1,579$258$7,506$774
68
Value of government health spending (xGD)2.182.182.182.182.182.182.182.182.182.182.182.182.182.182.182.182.182.182.18
We assume lead exposure regulation is paid for out of health spending. GiveWell estimate low- and middle income health spending is very roughly 2x as cost-effective as GiveDirectly. GiveWell assumes government health spend is valued at roughly 12.1 WELLBYs per $1000, whereas $1000 given to GiveDirectly generates 5.9 WELLBYs [according to our GiveDirectly analysis].
69
Government health cost to double income$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62$148.62This converts the value of government spending in terms of multiples of GiveDirectly, into a value in terms of $s/ income doubling
70
Lost income doublings136231521410266503310112515
71
Income doubling-equivalents gained (after government spending adjustment)427,44719,40963,74913,01117,646123,77111,6033,0453,00011,512117,50511,64510,2943,84615,2042,20421,383316,058NA
72
FP adjustments
73
Quality of analysis discount20%We adjust our analysis for the fact that, relative to GiveWell's cost-effectiveness analysis, we am more likely to have made an error (since GiveWell dedicate more resources to their cost-effectiveness estimates. As such, they rely less heavily on a starting sceptical prior about any charities' cost-effectiveness [see this blogpost on the rationale for this]
74
Final cost-effectiveness
75
Income doubling-equivalents gained (after all adjustments)341,95815,52850,99910,40914,11799,0179,2832,4362,4009,20994,0049,3168,2353,07712,1641,76317,106252,846NA
76
$/ Income doubling$11.01$20.8$6.3$1.6$11.3$3.3$34.8$108.5$66.4$28.7$6.4$17.1$19.4$85.9$21.7$90.4$7.1$2.4NA
77
GD Multiple29.4x15.6x51.1x200.9x28.7x99.3x9.3x3.0x4.9x11.3x50.4x18.9x16.7x3.8x14.9x3.6x45.5x135.6xNA
78
79
80
81
82
83
Expected Impact stats
84
Cost $3,766,076
85
Expected children prevented from lead poisoning2,279,535
86
Cost to prevent one child from lead poisoning (in expectation)$1.65
87
Equivalent iq increase per child0.105
88
89
90
91
92
93
94
95
96
97
98
99
100