ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMANAO
1
Monthly numbers for weighted averages
2
March 2020April 2020May 2020June 2020July 2020August 2020September 2020October 2020Nov 2020Dec 2020Jan 2021Feb 2021March 2021April 2021May 2021June 2021July 2021August 2021September 2021October 2021November 2021December 2021January 2022February 2022March 2022April 2022May 2022June 2022July 2022August 2022September 2022October 2022November 2022December 2022Total in 2022 Total since March 2020 (end of RCT)
3
Number of infants enrolled in New Incentives' program7,6056,5503,9907,4885,8805,6565,8425,4144,7105,4027,0587,55212,94712,65317,46227,11517,60122,2776,88614,79010,86814,66816,31335,11541,66034,03248,26561,39149,67566,59156,84569,84667,43580,677627,845858,259
4
Number of incentives disbursed (estimated)30,02428,53017,85632,60429,64328,27526,52023,88023,22925,63625,37627,88038,58440,71048,65069,03663,67280,66140,39241,34642,24548,63759,09099,729143,682133,791150,675179,626171,954203,388195,160205,440220,695244,9802,008,2102,841,596
5
Number of disbursement days 1112951558741723725780796801884793820137817701946313826533507237622972485286131104749684263717175945495531196411480128401471316332114,583148,678
6
7
Metrics used to calculate New Incentives cost per infant immunized:
8
CategoryHow do we use itIndicatorComparison: result during RCTMarch - December 2020In 2021 (Jan to December)In 2022 (Jan to December)In last 6 months (July to December 2022)Since March 2020 (end of RCT)MetricYear 2 (June 2020 - May 2021)Year 3 (June 2021 - May 2022)Year 4 to date (June 2022 - December 2022)Calendar Year 2022 (Jan to Dec 2022)
9
Timing of enrollmentEstimate the rate of repeat enrollments for calculating cost per enrolled child; update estimation of benefits in CEA if needed% of beneficiaries that received BCG at point of enrollment-99%100%80%75%85%Number of infants enrolled98,064289,590452,460627,845
10
% of enrollments older than 6 months at point of enrollment-5%12%14%16%13%Infant has 1 BCG scar at return visit (as reported by field officer)97.23%98.55%99.03%98.95%
11
Retention (enrolled infants complete the vaccination schedule)Compare to result from during the RCT to update estimation of benefits in CEARetention rate: PENTA193%97%96%95%94%96%Infant has two or more BCG scars at return visit (as reported by field officer)0.04%0.06%0.03%0.03%
12
Retention rate: PENTA290%92%91%90%88%91%
13
Retention rate: PENTA389%90%87%87%84%87%
14
Retention rate: Measles 191%91%87%88%88%88%
15
Retention rate: Measles 2---70%61%70%
16
Repeat enrollmentsUpdate cost per enrolled child estimateInfant checked by field officer for old BCG scars and has old scars-1%2%22%28%16%
17
Infant has 1 BCG scar at return visit (as reported by field officer)97%94%98%99%99%98%
18
Infant has two or more BCG scars at return visit (as reported by field officer)0.0%0%0%0.0%0.0%0.1%
19
Infant has 1 BCG scar at return visit (from Supervision Caregiver Interviews)-84%91%94.8%96.5%93.5%
20
Infant has two or more BCG scars at return visit (from Supervision Caregiver Interviews)-1%1%0.6%0.5%0.6%
21
% enrollments flagged as second enrollment within 20 km vicinity-3.57%11%4.5%3.9%6.0%
22
Supply-side issuesCompare to result from during the RCT to update estimation of benefits in CEA% immunization days offering CCTs (incentives)--85.483.382.583.7
23
% of disbursement days reporting supply-side data-99.298.397.897.697.9
24
Stockouts of any vaccine per 100 disbursement days8.22.716.947.360.339.6
25
Stockouts of directly incentivized vaccines per 100 disbursement days6.81.812.410.210.410.1
26
Stockouts of indirectly incentivized vaccines per 100 disbursement days1.30.94.537.149.929.5
27
Stockouts of rota vaccines per 100 disbursement days----33.533.5
28
% of disbursement days with stockout of any vaccine6.52.214.830.537.726.2
29
% of disbursement days with stockout of any directly incentivized vaccine6.01.611.58.58.48.7
30
% of disbursement days with stockout of any indirectly incentivized vaccine0.40.73.321.929.417.5
31
% of disbursement days with stockout of rota vaccine----2222
32
% of disbursement days with runouts of any vaccine20.63.4554
33
Infants not served per 100 disbursement days373392474054
34
% of disbursement days where caregivers left without vaccination due to wait times-0.2%0.5%0.6%0.6%0.6%
35
Reduction in real value of cash incentiveFollow over time to see if value of transfer decreases; adjust benefits if soConsumer price index for Nigeria (from the World Bank)268303354--354
36
New Incentives transfers for infant who completes full schedule through measles 1 (in naira)4,0004,0004,000--4,000
37
Value of transfers relative to RCT-88%76%--76%
38
% of disbursements where caregivers have recorded 0 as transportation cost75%75%74%68%67%70%
39
Average transportation cost (in naira) across disbursements, where non-zero transportation cost is recorded7979819910394
40
Fraud preventionCompare to result from during the RCT to update estimation of benefits in CEA% of cash transfers with photo of caregiver with incentive100%100%100%100%100%100%
41
% of disbursements where caregivers report giving dashes (tips) to clinic or New Incentives staff0.1%0%0%0.4%0.5%0.3%
42
% of disbursement days audited5%4%7%9%9%8%
43
% disbursement days supervised by a manager-13%8%10%10%10%
44
% of audits and supervision visits reporting suspected clinic staff fraud4%9%4%4%3%4%
45
% of audits and supervision visits reporting suspected New Incentives staff fraud0.95%0%0%0%0%0%
46
% of audits and supervision visits reporting suspected caregiver or community member fraud12.95%20%3%1%1%3%
47
% audits visits reporting Gold Pen protocol not followed by clinic staff-22%27%15%8%18%
48
% supervision visits reporting Gold Pen protocol not followed by clinic staff-8%13%15%10%14%
49
% disbursement days where a vaccine was reported as given but there was stockout of that vaccine-1%2%1%1%1%
50
SecurityFollow to see if we are failing to account for important downside of the programNumber of security incidents reported involving New Incentives staff per 100 disbursement days-0.40.30.30.30.3
51
Collecting information regularly and communicating it to staff-Not updated
52
Providing training for new staff and ongoing training for all staff-Not updated
53
Program quality Follow to see if program quality deteriorates over time; reconsider program scale and estimation of benefits if so# of clinics where program is paused (for at least one day) due to program quality issues---9512895
54
# of operational clinics -119667231827631936
55
% of clinics where program is paused (for at least one day) due to program quality issues ---4.12%4.65%-
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100