ABCDEGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJ
1
Q1Q2Q3Q4UnitTypeInput type
Geographic level
Uncertainty notes
Impact on CE estimate
SourceNotes
2
Note: Cells where uncertainty analysis may be useful are filled with light red
3
Benefits
4
Contraceptive protection and discontinuation
5
Couple-years protection per dose administered0.250.250.250.25CYPInputFact (hard-coded)GlobalUSAID
Klau mentioned in our interview that Sayana Press is releasing a longer release version of the injection over 4-6 months (though that they may not decide to switch since, anecdotally, women may prefer the three-month version as it gives them the opportunity to travel and to feel part of the community, potentially even selling market products near the clinic)
6
Effectiveness of Sayana Press at preventing pregnancy (no missed doses)99%99%99%99%percentInputFact (hard-coded)NHS
"If used correctly, with no missed doses, Sayana Press® has a failure rate of around 1 woman in 100
per year. In practice it has a failure rate of 6 women in 100 per year."
7
Rate of injectable discontinuation while in need of protection35%35%35%percentInputLiteratureNigeria
See interview with Kaleigh, may be underestimated for rural areas
Track20
Interview Notes - Kaleigh McDaniels, Gates Foundation
See "Contraceptive Discontinuation Rates and Method Switching (first 12 months)" for "Injectable" method; data from 2018 DHS in Nigeria
Celine said in our interview that there are a number of reasons why women might discontinue use, including financial circumstances and moving
Kaleigh MacDaniels assumed that this number would be higher in rural areas, where access and partner objections may encourage discontinuation.
8
Reduction in rate of discontinuation while in need due to Lafiya distribution model30%30%30%percentAssumptionInterview Notes - Kaleigh McDaniels, Gates Foundation
When asked, Kaleigh MacDaniels responded that this adjustment would be "modest" (but "would have an impact" since "most women discontinue for reasons outside of access," including spousal opposition, side effects, and wanting to get pregnant. She suggested that higher rates of self-injection tend to improve continuation, which suggests access is still an important consideration.
9
Rate of injectable discontinuation due to desire to get pregnant13%13%13%percentAssumptionLafiya Nigeria Main Dashboard (May 2024) [RP internal]
Data on "Reasons you decided to use Sayana-Press" suggests that 47% (i.e. 8032 out of 16,972 from January-April of 2024) of those surveyed decided to use Sayana Press for birth spacing reasons. A healthy birth spacing interval is generally considered ~2 years. Since eight injections would provide protection for two years, and we assume the duration since last pregnancy will be approximately uniformly distributed over a two-year time period across women in the sample, we assume that on average 1/8 of women discontinue from quarter to quarter due to the desire to get pregnant.
10
Overall discontinuation rate23%23%23%percentCalculationLafiya Nigeria Main Dashboard (May 2024) [RP internal]
Data on "Repeated Lafiya Nigeria users" suggests that 29% of those surveyed from January-April 2024 are repeated users, up from 26% in 2023.
11
Women reached by Lafiya Sisters
12
Health workers trained per quarter607594health workersInputEstimateLafiya operational areasTime series model' cell C6
Lafiya estimates about 160 Lafiya Sisters total by end of 2024
13
Health worker dropout rate3%3%3%percentInputEstimateLafiya operational areasCost and benefit drivers' cell B26
"Annual dropout rate of Lafiya Sisters from participating in the intervention" is 10% based on organizational experience
14
Health workers60119191280health workersInputProgram inputLafiya operational areasKick-off Materials - Rethink Priorities - Lafiya
According to LN's dashboard, there were about 60 Lafiya Sisters in Q1 2024, and in the kickoff document LN shared in May 2024 they state that "...we currently have 104 Sisters and expect to scale to ~260 Sisters by the end of the year." We increase the number of trained Lafiya Sisters by 1.25 each quarter to calibrate the model to these data and estimates.
15
Number of visits per health worker each quarter141141141141health workersInputProgram dataLafiya operational areasLafiya Nigeria Main Dashboard (May 2024) [RP internal]
Between January to April 2024, Lafiya Sisters averaged between 47 and 48 visits per month.
16
Number of community outreach sessions per quarter7.57.57.57.5sessionsInputProgram dataLafiya operational areasInterview Notes - Klau Chmielowska and Celine Kamsteeg, Lafiya Nigeria
Klau and Celine mentioned that there are 5-10 outreaches per month in our kickoff call, which we confirmed with them in our interview
17
Number of women reached per community outreach session30303030womenInputProgram dataLafiya operational areasInterview Notes - Maryam Kaoje [shared with Maryam]
Interview Notes - Klau Chmielowska and Celine Kamsteeg, Lafiya Nigeria
Maryam said that "during community outreach activities about 30 women are met" while Klau and Celine suggested this number is closer to 50. We take the conservative estimate.
18
Total number of women reached for counselling8,68516,93427,09139,638womenCalculation
This metric only accounts for women who took LN's surveys, meaning that they had demand for contraceptives and received counseling from a Lafiya Sister
19
Sense check: LN had conducted 11.3K surveys by end of April 2024Lafiya Nigeria Main Dashboard (May 2024)
20
Type and outcome of visits
21
Number of established clients reached (injection administration)6,22712,47620,096womenCalculation
22
% established clients (injection administration)37%46%51%percentInput
This input seems likely to increase as more women are reached in a given state (and Klau agreed in the interview, mentioning that the recent scaling makes it difficult to know where a metric like '% repeat users' will stabilize), though it could also decline if LN is successful in encouraging women to self-inject
Lafiya Nigeria Main Dashboard (May 2024), 'Apr 2024', cell I9
In the most recent month's surveys (April 2024), about 33% of women surveyed are repeat clients.
23
Sense check: This figure is ~28% for Jan-Mar 2024, but increases to ~33% in Apr 2024
24
Number of new clients reached that adopt8,0779,95713,59218,174womenCalculation
25
% that adopt on first visit with Lafiya Sister93%93%93%93%percentInputProgram dataLafiya operational areasLafiya Nigeria Main Dashboard (May 2024)
'Data 2024' cell L11
26
% of women reached this quarter that adopt93%59%50%46%percentCalculationData questions for Lafiya [shared with Klau and Celine]
"Women need a new injection every 3 months, so the same woman might appear multiple times in our surveys. So women reached [does not equal] number of surveys."
27
% who have never used contraceptives44%44%44%44%percentCalculation
According to LN's surveys in 2024, only 31.4% of respondents are new to contraception, though the question asked in Lafiya's surveys pertains to use of contraceptives any time prior to the survey (i.e. not necessarily at the time of the visit with the Lafiya Sister).

My understanding is that in 2024, out of 10,560 respondents (excluding those who only received counseling):
-3311 (31.4%) are first-time contraceptive users
-4248 (40.2%) had previously used a contraceptive method
-3001 (28.4%) used SP before

Since ~29% of respondents are 'repeated LN users', I assume that all of the 3001 (i.e. 28.4% of respondents) who had used SP before are repeated users and are therefore irrelevant in determining the percent of new adopters that are not using contraception. Therefore, the percent of adopters who are first-time contraception users becomes 3311/(3311+4248) or 3311/7579, and the percent of adopters who had used contraceptives previously is 4248/7579.

My main uncertainty is the extent to which 'switchers' were using a contraceptive method prior to switching to SP. So I think the lower bound is that 31.4% of new clients go from no contraceptive to SP, while some number of switchers were not on any contraceptive at the time of the visit, creating an upper bound of 31.4%+40.2% = 71.6%. Given the high rate of stockouts, it seems likely that the number is higher than 31.4%, though I am not sure by how much. The cell below allows for adjustment of this percentage, which can be used for uncertainty analysis until a data-supported approach becomes available.
28
% who have used contraceptives in their lifetime ("previous contraceptive users")
56%56%56%56%percentInputLiteratureRural NigeriaLafiya Nigeria Main Dashboard (May 2024)See cell above
29
% of previous contraceptive users with current unmet demand90%90%90%90%percentAssumptionSee cell above
Kaleigh MacDaniels' best guess is that the number of current contraceptive users among women who had previously used contraceptives in their lifetime would be "really low," and she sent a paper (Adedini et al., 2023) analyzing DHS data that suggests that among LMICs, the modern contraceptive prevalence rate in Nigeria is relatively very low at 12% (2% in Sokoto State in the North West), and the discontinuation rate is relatively high at 41%. The discontinuation rate for all contraceptive methods in Nigeria is highest in the North West at 50.1% (see abstract).
30
Number of adopters with counterfactually unmet demand7,6229,39712,82617,151
adopters with unmet demand
Calculation
31
Total doses distributed8,07716,18426,06838,270dosesCalculation
32
Sense check: total doses distributed through April 2024 ~16K [for Q1+0.3Q2]; LN estimates 115K for 2024
Lafiya Nigeria Main Dashboard (May 2024)
Almost 16K doses distributed from January-April 2024
33
Maternal health outcomes
34
Percent of unintended pregnancies that end in a live birth52%52%52%52%percentCalculation
35
Percent of unintended pregnancies that end in abortion48%48%48%48%percentInputLiteratureNigeriaGuttmacher Data Center
Guttmacher Institute (2022)
Nigeria-specific estimate from 2015-2019
36
Percent of abortions that are unsafe60%60%60%60%percentInputLiteratureNigeriaPMA2020, p. 1
"More than 6 out of 10 abortions were considered most unsafe..."
37
Unintended pregnancies averted, as percent of CYP (Guttmacher)29%29%29%29%percentInputLiteratureGlobalGuttmacher Institute (2011)
We use the Guttmacher Institute's recommendation (accounting for method use failure) for converting CYPs into unintended pregnancies averted: "...we make the following revised recommendations for applying Adding It Up findings to estimates of CYP: For CYPs calculated using USAID or other conversion factors that take method use-failure into account, use a ratio of 0.288 for estimating unintended pregnancies averted per CYP. For CYPs based on conversion factors that do not adjust for use-failure, use a ratio of 0.249. In either situation, use the same impact ratio across all developing world regions."
38
Unintended pregnancies averted, per user (MSI)44%44%44%44%percentInputLiteratureGlobalMSI, p. 28
Users (adopters) * pregnancies with no method
39
Unsafe abortions averted, as percent of unintended pregnancies averted29%29%29%29%percentCalculation
40
Maternal deaths per unintended pregnancy#REF!#REF!#REF!#REF!deathsCalculationMSI Impact 2 v6 - 'LAPM_Maternal Deaths' sheet
41
Prior birth interval (PBI) coefficient0.0560.0560.0560.056
child deaths averted per live birth averted
InputLiteratureNigeriaMSI Impact 2 v6 sheet
42
Intervention impacts
43
Additional contraceptive users7,6229,39712,82617,151additional usersCalculation
44
Additional couple-years of protection1906234932074288CYPCalculation
45
Unintended pregnancies averted (MSI method)33546093962414486unintended pregnanciesCalculation
46
Unintended pregnancies averted (Lafiya method)35185435875412851unintended pregnanciesCalculation
47
Unsafe abortions averted966175527724172unsafe abortionsCalculation
48
Live births averted1,7443,1695,0057,533live birthsCalculation
49
Deaths averted - Total (MSI approach)#REF!#REF!#REF!#REF!deathsCalculation
50
Maternal deaths averted (MSI approach)#REF!#REF!#REF!#REF!maternal deathsCalculationMSI (2023), p. 35
Unintended pregnancies averted x maternal deaths per unintended pregnancy
51
Child deaths averted (MSI approach)#REF!#REF!#REF!#REF!child deathsCalculation
Possibly unreliable, see notes
MSI (2023), p. 36
Live births averted x PBI coefficient
"Note: this estimate may be unreliable because there is currently very limited data about the linkages between CPR, birth spacing and child mortality. This part of Impact 2 will be updated as improved research becomes available."
52
Child DALYs averted (MSI approach)8,25715,00323,69535,665child DALYsCalculation
54
Maternal DALYs averted#REF!#REF!#REF!#REF!maternal DALYsCalculation
59
Total DALYs averted#REF!#REF!#REF!#REF!DALYsCalculation
60
61
Costs
64
Training and personnel costs
65
Training costs$7,200$7,020$8,645$10,678USDCalculation
67
Health worker compensation and equipment$5,545$6,947$9,674$13,056USDCalculation
77
Staff costs$20,388$20,426$20,463$20,538USDCalculationCost-effectiveness analysis Lafiya Nigeria_May24 [RP internal]
Pulled from LN's CEA
88
Program equipment and administration costs
89
Sayana Press and pregnancy test costs$3,530$7,072$11,392$16,724USDCalculation
93
SurveyCTO cost$0$0$0$0USDInputFixed cost
94
SMS program costs$30$30$30$30USDInputProgram input Cost-effectiveness analysis Lafiya Nigeria_May24
Pulled from LN's CEA
95
Organizational administration costs
96
Stakeholder engagement$13$13$13$13USDInputProgram input
97
Monitoring and evaluation costs$6,660$6,660$6,660$6,660USDInputProgram input
98
Quarterly travel costs$3,148$3,148$3,148$3,148USDInputProgram inputCost-effectiveness analysis Lafiya Nigeria_May24 [RP internal]
Pulled from LN's CEA
99
Other administrative costs$2,238$2,238$2,238$2,238USDInputProgram input
100
Total quarterly program cost$46,299$51,582$61,160$73,067USDCalculation
101
Contingency10%10%10%10%percentAssumption
102
103
Cost-effectiveness
104
Cost per DALY#REF!#REF!#REF!#REF!USDCalculation
105
Cost per maternal DALY#REF!#REF!#REF!#REF!USDCalculation
106
Cost per death averted#REF!#REF!#REF!#REF!USDCalculation
107
Cost per maternal death averted#REF!#REF!#REF!#REF!USDCalculation
108
Cost per additional CYP$24$22$19$17USDCalculation
109
Cost per additional contraceptive user$6$5$5$4USDCalculation
110
Cost per unintended pregnancy averted$14$8$6$5USDCalculation
111
Cost per unsafe abortion averted$48$29$22$18USDCalculation
112
113
114
115
116
Benefits not yet considered
117
Lafiya:
118
Newborn and infant health benefits
119
Income/education benefits
120
Agency and autonomy benefits
121
Disposable income per household (relative to cash transfers)
122
SWB increase relative to cash transfers
123
124
RP:
125
Environmental (climate, consumption)
126
Costs to families (antenatal care, post-abortion care, delivery, complications + post-birth costs of raising a child)
127
Costs to health and education systems
128
Government programs/budgets (e.g. social safety nets)
129
Broader economic benefits (female workforce participation, educated electorates, etc.)
130
Avoiding: secondary effects related to population ethics