ABCDEFGHIJKLMNOPQRSTUVWXYZAAABACADAEAFAGAHAIAJAKALAMANAOAPAQARASATAUAV
1
Monthly numbers for weighted averages
2
March 2020April 2020May 2020June 2020July 2020August 2020September 2020October 2020Nov 2020Dec 2020Jan 2021Feb 2021March 2021April 2021May 2021June 2021July 2021August 2021September 2021October 2021November 2021December 2021January 2022February 2022March 2022April 2022May 2022June 2022July 2022August 2022September 2022October 2022November 2022December 2022January 2023February 2023March 2023April 2023May 2023June 2023July 2023August 2023September 2023October 2023November 2023December 2023
3
Number of infants enrolled in New Incentives' program7,6056,5503,9907,4885,8805,5875,5995,3734,7055,4017,0587,55312,94912,65217,46627,11517,61522,2896,88614,79010,86714,67016,31835,16841,72734,19548,26261,39349,70667,22657,09369,72969,19180,11194,57072,99885,63889,930111,82090,249117,039213,628162,030163,931158,229158,449
4
Number of incentives disbursed30,05828,24717,65432,68529,36128,06026,66423,90623,57625,35725,31427,49439,06041,10147,69868,88362,69979,98339,50841,40842,37148,54659,471100,395140,902132,406150,002181,835176,530210,019190,803211,254228,796241,072296,959200,722268,364295,655410,426352,259456,402625,633546,513626,922620,934608,998
5
Number of disbursement sessions1,1009445567387217177737877978757898141,3421,7261,9173,0622,5533,3692,2732,2562,4532,8153,0644,6366,6216,2106,9849,1529,16111,34210,97312,21914,14515,52217,81314,86816,84316,68621,27620,27925,82831,99130,95034,85035,35436,539
6
7
Metrics used to calculate New Incentives' cost per infant immunized:
8
CategoryHow do we use itIndicatorComparison: result during RCTMarch - December 2020In 2021 (Jan to December)In 2022 (Jan to December)In 2023 (Jan to December)Since March 2020 (end of RCT)MetricMarch 2020 - Dec 20202021 (Jan - Dec)2022 (Jan - Dec)2023 (Jan - Dec)
9
Timing of enrollmentEstimate the rate of repeat enrollments for calculating cost per enrolled child; update estimation of benefits in CEA if needed% of beneficiaries that received BCG at point of enrollment-99%100%80%79%81%Number of infants enrolled58,178171,910630,1191,518,511
10
% of enrollments older than 6 months at point of enrollment-5%12%14%14%14%
11
Retention (enrolled infants complete the vaccination schedule)Compare to result from during the RCT to update estimation of benefits in CEARetention rate: PENTA193%97%97%97%96%96%
12
Retention rate: PENTA290%92%91%93%92%92%
13
Retention rate: PENTA389%90%87%91%88%89%
14
Retention rate: Measles 191%91%87%90%87%89%
15
Retention rate: Measles 2---75%75%75%
16
Repeat enrollmentsUpdate cost per enrolled child estimateInfant has 1 BCG scar at return visit (as reported by field officer)97%94.01%97.89%98.95%99.64%98%
17
Infant has two or more BCG scars at return visit (as reported by field officer)0.0%0.44%0.09%0.03%0.01%0.0%
18
% enrollments flagged as second enrollment within 20 km vicinity-4.7%3.0%3.4%
19
Supply-side issuesCompare to result from during the RCT to update estimation of benefits in CEA% immunization days offering CCTs (incentives)--85.182.588.987.1
20
% of disbursement sessions reporting supply-side data-99.7100.4101.2101.1101.0
21
Stockouts of any vaccine per 100 disbursement sessions8.22.717.449.345.143.8
22
Stockouts of directly incentivized vaccines per 100 disbursement sessions6.81.812.710.614.113.0
23
Stockouts of indirectly incentivized vaccines per 100 disbursement sessions1.31.04.638.731.030.9
24
% of disbursement sessions with stockout of any vaccine6.52.315.231.728.227.9
25
% of disbursement sessions with stockout of any directly incentivized vaccine6.01.611.88.911.710.9
26
% of disbursement sessions with stockout of any indirectly incentivized vaccine0.40.73.422.816.517.0
27
% of disbursement sessions with stockout of rota vaccine---241315
28
% of disbursement sessions with runouts of any vaccine20.63.4576
29
Infants not served per 100 disbursement sessions373394487871
30
Infants not served as a % of total disbursements1.00%4.21%2.63%4.43%3.86%
31
Reduction in real value of cash incentiveFollow over time to see if value of transfer decreases; adjust benefits if soConsumer price index for Nigeria (from the World Bank)268303354421525
32
Cash transfers for infant who completes full immunization schedule (in naira)4,0004,0004,0004,5006,000
33
Value of transfers relative to RCT-88%76%71%76%77%
34
% of disbursements where caregivers have recorded 0 as transportation cost75%75%73%68%68%68%
35
Average one-way transportation cost (in naira) across disbursements, where non-zero transportation cost is recorded79798199149130
36
Fraud preventionCompare to result from during the RCT to update estimation of benefits in CEA% of cash transfers with photo of caregiver with incentive100%100%100%100%100%100%
37
% of disbursements where caregivers report giving dashes (tips) to clinic or New Incentives staff0.1%0%0%0.4%0.3%0.3%
38
% of disbursement days audited5%0%5%8%8%8%
39
% disbursement days supervised by a manager-13%8%11%12%12%
40
% of audits and supervision visits reporting suspected clinic staff fraud4%10%4%4%4%4%
41
% of audits and supervision visits reporting suspected New Incentives staff fraud0.9%0.0%0.0%0.2%0.3%0.2%
42
% of audits and supervision visits reporting suspected caregiver or community member fraud13.0%29%3%1%1%2%
43
% audits visits reporting Gold Pen protocol not followed by clinic staff-22%27%14%7%11%
44
% supervision visits reporting Gold Pen protocol not followed by clinic staff-8%13%15%6%9%
45
% disbursement days where a vaccine was reported as given but there was stockout of that vaccine-1%2%1%1%1%
46
SecurityFollow to see if we are failing to account for important downside of the programNumber of security incidents reported involving New Incentives staff per 100 disbursement days-0.40.20.10.10.1
47
Program quality Follow to see if program quality deteriorates over time; reconsider program scale and estimation of benefits if so# of clinics where program is paused (for at least one day) due to program quality issues---95149136
48
# of operational clinics -11866323164874-
49
% of clinics where program is paused (for at least one day) due to program quality issues ---4.11%3.06%-
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100