A | B | C | D | E | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | AA | AB | AC | AD | AE | AF | AG | AH | AI | AJ | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Q1 | Q2 | Q3 | Q4 | Unit | Type | Input type | Geographic level | Uncertainty notes | Impact on CE estimate | Source | Notes | |||||||||||||||||||||||
2 | Note: Cells where uncertainty analysis may be useful are filled with light red | ||||||||||||||||||||||||||||||||||
3 | Benefits | ||||||||||||||||||||||||||||||||||
4 | Contraceptive protection and discontinuation | ||||||||||||||||||||||||||||||||||
5 | Couple-years protection per dose administered | 0.25 | 0.25 | 0.25 | 0.25 | CYP | Input | Fact (hard-coded) | Global | USAID | Klau mentioned in our interview that Sayana Press is releasing a longer release version of the injection over 4-6 months (though that they may not decide to switch since, anecdotally, women may prefer the three-month version as it gives them the opportunity to travel and to feel part of the community, potentially even selling market products near the clinic) | ||||||||||||||||||||||||
6 | Effectiveness of Sayana Press at preventing pregnancy (no missed doses) | 99% | 99% | 99% | 99% | percent | Input | Fact (hard-coded) | NHS | "If used correctly, with no missed doses, Sayana Press® has a failure rate of around 1 woman in 100 per year. In practice it has a failure rate of 6 women in 100 per year." | |||||||||||||||||||||||||
7 | Rate of injectable discontinuation while in need of protection | 35% | 35% | 35% | percent | Input | Literature | Nigeria | See interview with Kaleigh, may be underestimated for rural areas | Track20 Interview Notes - Kaleigh McDaniels, Gates Foundation | See "Contraceptive Discontinuation Rates and Method Switching (first 12 months)" for "Injectable" method; data from 2018 DHS in Nigeria Celine said in our interview that there are a number of reasons why women might discontinue use, including financial circumstances and moving Kaleigh MacDaniels assumed that this number would be higher in rural areas, where access and partner objections may encourage discontinuation. | ||||||||||||||||||||||||
8 | Reduction in rate of discontinuation while in need due to Lafiya distribution model | 30% | 30% | 30% | percent | Assumption | Interview Notes - Kaleigh McDaniels, Gates Foundation | When asked, Kaleigh MacDaniels responded that this adjustment would be "modest" (but "would have an impact" since "most women discontinue for reasons outside of access," including spousal opposition, side effects, and wanting to get pregnant. She suggested that higher rates of self-injection tend to improve continuation, which suggests access is still an important consideration. | |||||||||||||||||||||||||||
9 | Rate of injectable discontinuation due to desire to get pregnant | 13% | 13% | 13% | percent | Assumption | Lafiya Nigeria Main Dashboard (May 2024) [RP internal] | Data on "Reasons you decided to use Sayana-Press" suggests that 47% (i.e. 8032 out of 16,972 from January-April of 2024) of those surveyed decided to use Sayana Press for birth spacing reasons. A healthy birth spacing interval is generally considered ~2 years. Since eight injections would provide protection for two years, and we assume the duration since last pregnancy will be approximately uniformly distributed over a two-year time period across women in the sample, we assume that on average 1/8 of women discontinue from quarter to quarter due to the desire to get pregnant. | |||||||||||||||||||||||||||
10 | Overall discontinuation rate | 23% | 23% | 23% | percent | Calculation | Lafiya Nigeria Main Dashboard (May 2024) [RP internal] | Data on "Repeated Lafiya Nigeria users" suggests that 29% of those surveyed from January-April 2024 are repeated users, up from 26% in 2023. | |||||||||||||||||||||||||||
11 | Women reached by Lafiya Sisters | ||||||||||||||||||||||||||||||||||
12 | Health workers trained per quarter | 60 | 75 | 94 | health workers | Input | Estimate | Lafiya operational areas | Time series model' cell C6 | Lafiya estimates about 160 Lafiya Sisters total by end of 2024 | |||||||||||||||||||||||||
13 | Health worker dropout rate | 3% | 3% | 3% | percent | Input | Estimate | Lafiya operational areas | Cost and benefit drivers' cell B26 | "Annual dropout rate of Lafiya Sisters from participating in the intervention" is 10% based on organizational experience | |||||||||||||||||||||||||
14 | Health workers | 60 | 119 | 191 | 280 | health workers | Input | Program input | Lafiya operational areas | Kick-off Materials - Rethink Priorities - Lafiya | According to LN's dashboard, there were about 60 Lafiya Sisters in Q1 2024, and in the kickoff document LN shared in May 2024 they state that "...we currently have 104 Sisters and expect to scale to ~260 Sisters by the end of the year." We increase the number of trained Lafiya Sisters by 1.25 each quarter to calibrate the model to these data and estimates. | ||||||||||||||||||||||||
15 | Number of visits per health worker each quarter | 141 | 141 | 141 | 141 | health workers | Input | Program data | Lafiya operational areas | Lafiya Nigeria Main Dashboard (May 2024) [RP internal] | Between January to April 2024, Lafiya Sisters averaged between 47 and 48 visits per month. | ||||||||||||||||||||||||
16 | Number of community outreach sessions per quarter | 7.5 | 7.5 | 7.5 | 7.5 | sessions | Input | Program data | Lafiya operational areas | Interview Notes - Klau Chmielowska and Celine Kamsteeg, Lafiya Nigeria | Klau and Celine mentioned that there are 5-10 outreaches per month in our kickoff call, which we confirmed with them in our interview | ||||||||||||||||||||||||
17 | Number of women reached per community outreach session | 30 | 30 | 30 | 30 | women | Input | Program data | Lafiya operational areas | Interview Notes - Maryam Kaoje [shared with Maryam] Interview Notes - Klau Chmielowska and Celine Kamsteeg, Lafiya Nigeria | Maryam said that "during community outreach activities about 30 women are met" while Klau and Celine suggested this number is closer to 50. We take the conservative estimate. | ||||||||||||||||||||||||
18 | Total number of women reached for counselling | 8,685 | 16,934 | 27,091 | 39,638 | women | Calculation | This metric only accounts for women who took LN's surveys, meaning that they had demand for contraceptives and received counseling from a Lafiya Sister | |||||||||||||||||||||||||||
19 | Sense check: LN had conducted 11.3K surveys by end of April 2024 | Lafiya Nigeria Main Dashboard (May 2024) | |||||||||||||||||||||||||||||||||
20 | Type and outcome of visits | ||||||||||||||||||||||||||||||||||
21 | Number of established clients reached (injection administration) | 6,227 | 12,476 | 20,096 | women | Calculation | |||||||||||||||||||||||||||||
22 | % established clients (injection administration) | 37% | 46% | 51% | percent | Input | This input seems likely to increase as more women are reached in a given state (and Klau agreed in the interview, mentioning that the recent scaling makes it difficult to know where a metric like '% repeat users' will stabilize), though it could also decline if LN is successful in encouraging women to self-inject | Lafiya Nigeria Main Dashboard (May 2024), 'Apr 2024', cell I9 | In the most recent month's surveys (April 2024), about 33% of women surveyed are repeat clients. | ||||||||||||||||||||||||||
23 | Sense check: This figure is ~28% for Jan-Mar 2024, but increases to ~33% in Apr 2024 | ||||||||||||||||||||||||||||||||||
24 | Number of new clients reached that adopt | 8,077 | 9,957 | 13,592 | 18,174 | women | Calculation | ||||||||||||||||||||||||||||
25 | % that adopt on first visit with Lafiya Sister | 93% | 93% | 93% | 93% | percent | Input | Program data | Lafiya operational areas | Lafiya Nigeria Main Dashboard (May 2024) 'Data 2024' cell L11 | |||||||||||||||||||||||||
26 | % of women reached this quarter that adopt | 93% | 59% | 50% | 46% | percent | Calculation | Data questions for Lafiya [shared with Klau and Celine] | "Women need a new injection every 3 months, so the same woman might appear multiple times in our surveys. So women reached [does not equal] number of surveys." | ||||||||||||||||||||||||||
27 | % who have never used contraceptives | 44% | 44% | 44% | 44% | percent | Calculation | According to LN's surveys in 2024, only 31.4% of respondents are new to contraception, though the question asked in Lafiya's surveys pertains to use of contraceptives any time prior to the survey (i.e. not necessarily at the time of the visit with the Lafiya Sister). My understanding is that in 2024, out of 10,560 respondents (excluding those who only received counseling): -3311 (31.4%) are first-time contraceptive users -4248 (40.2%) had previously used a contraceptive method -3001 (28.4%) used SP before Since ~29% of respondents are 'repeated LN users', I assume that all of the 3001 (i.e. 28.4% of respondents) who had used SP before are repeated users and are therefore irrelevant in determining the percent of new adopters that are not using contraception. Therefore, the percent of adopters who are first-time contraception users becomes 3311/(3311+4248) or 3311/7579, and the percent of adopters who had used contraceptives previously is 4248/7579. My main uncertainty is the extent to which 'switchers' were using a contraceptive method prior to switching to SP. So I think the lower bound is that 31.4% of new clients go from no contraceptive to SP, while some number of switchers were not on any contraceptive at the time of the visit, creating an upper bound of 31.4%+40.2% = 71.6%. Given the high rate of stockouts, it seems likely that the number is higher than 31.4%, though I am not sure by how much. The cell below allows for adjustment of this percentage, which can be used for uncertainty analysis until a data-supported approach becomes available. | |||||||||||||||||||||||||||
28 | % who have used contraceptives in their lifetime ("previous contraceptive users") | 56% | 56% | 56% | 56% | percent | Input | Literature | Rural Nigeria | Lafiya Nigeria Main Dashboard (May 2024) | See cell above | ||||||||||||||||||||||||
29 | % of previous contraceptive users with current unmet demand | 90% | 90% | 90% | 90% | percent | Assumption | See cell above | Kaleigh MacDaniels' best guess is that the number of current contraceptive users among women who had previously used contraceptives in their lifetime would be "really low," and she sent a paper (Adedini et al., 2023) analyzing DHS data that suggests that among LMICs, the modern contraceptive prevalence rate in Nigeria is relatively very low at 12% (2% in Sokoto State in the North West), and the discontinuation rate is relatively high at 41%. The discontinuation rate for all contraceptive methods in Nigeria is highest in the North West at 50.1% (see abstract). | ||||||||||||||||||||||||||
30 | Number of adopters with counterfactually unmet demand | 7,622 | 9,397 | 12,826 | 17,151 | adopters with unmet demand | Calculation | ||||||||||||||||||||||||||||
31 | Total doses distributed | 8,077 | 16,184 | 26,068 | 38,270 | doses | Calculation | ||||||||||||||||||||||||||||
32 | Sense check: total doses distributed through April 2024 ~16K [for Q1+0.3Q2]; LN estimates 115K for 2024 | Lafiya Nigeria Main Dashboard (May 2024) | Almost 16K doses distributed from January-April 2024 | ||||||||||||||||||||||||||||||||
33 | Maternal health outcomes | ||||||||||||||||||||||||||||||||||
34 | Percent of unintended pregnancies that end in a live birth | 52% | 52% | 52% | 52% | percent | Calculation | ||||||||||||||||||||||||||||
35 | Percent of unintended pregnancies that end in abortion | 48% | 48% | 48% | 48% | percent | Input | Literature | Nigeria | Guttmacher Data Center Guttmacher Institute (2022) | Nigeria-specific estimate from 2015-2019 | ||||||||||||||||||||||||
36 | Percent of abortions that are unsafe | 60% | 60% | 60% | 60% | percent | Input | Literature | Nigeria | PMA2020, p. 1 | "More than 6 out of 10 abortions were considered most unsafe..." | ||||||||||||||||||||||||
37 | Unintended pregnancies averted, as percent of CYP (Guttmacher) | 29% | 29% | 29% | 29% | percent | Input | Literature | Global | Guttmacher Institute (2011) | We use the Guttmacher Institute's recommendation (accounting for method use failure) for converting CYPs into unintended pregnancies averted: "...we make the following revised recommendations for applying Adding It Up findings to estimates of CYP: For CYPs calculated using USAID or other conversion factors that take method use-failure into account, use a ratio of 0.288 for estimating unintended pregnancies averted per CYP. For CYPs based on conversion factors that do not adjust for use-failure, use a ratio of 0.249. In either situation, use the same impact ratio across all developing world regions." | ||||||||||||||||||||||||
38 | Unintended pregnancies averted, per user (MSI) | 44% | 44% | 44% | 44% | percent | Input | Literature | Global | MSI, p. 28 | Users (adopters) * pregnancies with no method | ||||||||||||||||||||||||
39 | Unsafe abortions averted, as percent of unintended pregnancies averted | 29% | 29% | 29% | 29% | percent | Calculation | ||||||||||||||||||||||||||||
40 | Maternal deaths per unintended pregnancy | #REF! | #REF! | #REF! | #REF! | deaths | Calculation | MSI Impact 2 v6 - 'LAPM_Maternal Deaths' sheet | |||||||||||||||||||||||||||
41 | Prior birth interval (PBI) coefficient | 0.056 | 0.056 | 0.056 | 0.056 | child deaths averted per live birth averted | Input | Literature | Nigeria | MSI Impact 2 v6 sheet | |||||||||||||||||||||||||
42 | Intervention impacts | ||||||||||||||||||||||||||||||||||
43 | Additional contraceptive users | 7,622 | 9,397 | 12,826 | 17,151 | additional users | Calculation | ||||||||||||||||||||||||||||
44 | Additional couple-years of protection | 1906 | 2349 | 3207 | 4288 | CYP | Calculation | ||||||||||||||||||||||||||||
45 | Unintended pregnancies averted (MSI method) | 3354 | 6093 | 9624 | 14486 | unintended pregnancies | Calculation | ||||||||||||||||||||||||||||
46 | Unintended pregnancies averted (Lafiya method) | 3518 | 5435 | 8754 | 12851 | unintended pregnancies | Calculation | ||||||||||||||||||||||||||||
47 | Unsafe abortions averted | 966 | 1755 | 2772 | 4172 | unsafe abortions | Calculation | ||||||||||||||||||||||||||||
48 | Live births averted | 1,744 | 3,169 | 5,005 | 7,533 | live births | Calculation | ||||||||||||||||||||||||||||
49 | Deaths averted - Total (MSI approach) | #REF! | #REF! | #REF! | #REF! | deaths | Calculation | ||||||||||||||||||||||||||||
50 | Maternal deaths averted (MSI approach) | #REF! | #REF! | #REF! | #REF! | maternal deaths | Calculation | MSI (2023), p. 35 | Unintended pregnancies averted x maternal deaths per unintended pregnancy | ||||||||||||||||||||||||||
51 | Child deaths averted (MSI approach) | #REF! | #REF! | #REF! | #REF! | child deaths | Calculation | Possibly unreliable, see notes | MSI (2023), p. 36 | Live births averted x PBI coefficient "Note: this estimate may be unreliable because there is currently very limited data about the linkages between CPR, birth spacing and child mortality. This part of Impact 2 will be updated as improved research becomes available." | |||||||||||||||||||||||||
52 | Child DALYs averted (MSI approach) | 8,257 | 15,003 | 23,695 | 35,665 | child DALYs | Calculation | ||||||||||||||||||||||||||||
54 | Maternal DALYs averted | #REF! | #REF! | #REF! | #REF! | maternal DALYs | Calculation | ||||||||||||||||||||||||||||
59 | Total DALYs averted | #REF! | #REF! | #REF! | #REF! | DALYs | Calculation | ||||||||||||||||||||||||||||
60 | |||||||||||||||||||||||||||||||||||
61 | Costs | ||||||||||||||||||||||||||||||||||
64 | Training and personnel costs | ||||||||||||||||||||||||||||||||||
65 | Training costs | $7,200 | $7,020 | $8,645 | $10,678 | USD | Calculation | ||||||||||||||||||||||||||||
67 | Health worker compensation and equipment | $5,545 | $6,947 | $9,674 | $13,056 | USD | Calculation | ||||||||||||||||||||||||||||
77 | Staff costs | $20,388 | $20,426 | $20,463 | $20,538 | USD | Calculation | Cost-effectiveness analysis Lafiya Nigeria_May24 [RP internal] | Pulled from LN's CEA | ||||||||||||||||||||||||||
88 | Program equipment and administration costs | ||||||||||||||||||||||||||||||||||
89 | Sayana Press and pregnancy test costs | $3,530 | $7,072 | $11,392 | $16,724 | USD | Calculation | ||||||||||||||||||||||||||||
93 | SurveyCTO cost | $0 | $0 | $0 | $0 | USD | Input | Fixed cost | |||||||||||||||||||||||||||
94 | SMS program costs | $30 | $30 | $30 | $30 | USD | Input | Program input | Cost-effectiveness analysis Lafiya Nigeria_May24 | Pulled from LN's CEA | |||||||||||||||||||||||||
95 | Organizational administration costs | ||||||||||||||||||||||||||||||||||
96 | Stakeholder engagement | $13 | $13 | $13 | $13 | USD | Input | Program input | |||||||||||||||||||||||||||
97 | Monitoring and evaluation costs | $6,660 | $6,660 | $6,660 | $6,660 | USD | Input | Program input | |||||||||||||||||||||||||||
98 | Quarterly travel costs | $3,148 | $3,148 | $3,148 | $3,148 | USD | Input | Program input | Cost-effectiveness analysis Lafiya Nigeria_May24 [RP internal] | Pulled from LN's CEA | |||||||||||||||||||||||||
99 | Other administrative costs | $2,238 | $2,238 | $2,238 | $2,238 | USD | Input | Program input | |||||||||||||||||||||||||||
100 | Total quarterly program cost | $46,299 | $51,582 | $61,160 | $73,067 | USD | Calculation | ||||||||||||||||||||||||||||
101 | Contingency | 10% | 10% | 10% | 10% | percent | Assumption | ||||||||||||||||||||||||||||
102 | |||||||||||||||||||||||||||||||||||
103 | Cost-effectiveness | ||||||||||||||||||||||||||||||||||
104 | Cost per DALY | #REF! | #REF! | #REF! | #REF! | USD | Calculation | ||||||||||||||||||||||||||||
105 | Cost per maternal DALY | #REF! | #REF! | #REF! | #REF! | USD | Calculation | ||||||||||||||||||||||||||||
106 | Cost per death averted | #REF! | #REF! | #REF! | #REF! | USD | Calculation | ||||||||||||||||||||||||||||
107 | Cost per maternal death averted | #REF! | #REF! | #REF! | #REF! | USD | Calculation | ||||||||||||||||||||||||||||
108 | Cost per additional CYP | $24 | $22 | $19 | $17 | USD | Calculation | ||||||||||||||||||||||||||||
109 | Cost per additional contraceptive user | $6 | $5 | $5 | $4 | USD | Calculation | ||||||||||||||||||||||||||||
110 | Cost per unintended pregnancy averted | $14 | $8 | $6 | $5 | USD | Calculation | ||||||||||||||||||||||||||||
111 | Cost per unsafe abortion averted | $48 | $29 | $22 | $18 | USD | Calculation | ||||||||||||||||||||||||||||
112 | |||||||||||||||||||||||||||||||||||
113 | |||||||||||||||||||||||||||||||||||
114 | |||||||||||||||||||||||||||||||||||
115 | |||||||||||||||||||||||||||||||||||
116 | Benefits not yet considered | ||||||||||||||||||||||||||||||||||
117 | Lafiya: | ||||||||||||||||||||||||||||||||||
118 | Newborn and infant health benefits | ||||||||||||||||||||||||||||||||||
119 | Income/education benefits | ||||||||||||||||||||||||||||||||||
120 | Agency and autonomy benefits | ||||||||||||||||||||||||||||||||||
121 | Disposable income per household (relative to cash transfers) | ||||||||||||||||||||||||||||||||||
122 | SWB increase relative to cash transfers | ||||||||||||||||||||||||||||||||||
123 | |||||||||||||||||||||||||||||||||||
124 | RP: | ||||||||||||||||||||||||||||||||||
125 | Environmental (climate, consumption) | ||||||||||||||||||||||||||||||||||
126 | Costs to families (antenatal care, post-abortion care, delivery, complications + post-birth costs of raising a child) | ||||||||||||||||||||||||||||||||||
127 | Costs to health and education systems | ||||||||||||||||||||||||||||||||||
128 | Government programs/budgets (e.g. social safety nets) | ||||||||||||||||||||||||||||||||||
129 | Broader economic benefits (female workforce participation, educated electorates, etc.) | ||||||||||||||||||||||||||||||||||
130 | Avoiding: secondary effects related to population ethics |