Additional notes

2014-2015

Don't know was often a predefined answer a monitor could select. "Other" was an option that allowed the monitor to write in an answer. We are unsure how these answers were treated in the analysis of the data.

247 schools were observed on deworming day. See Deworm the World, Kenya Narrative Report - Year 3, Quarter 3. Pg 5. We are not sure how many were observed on coverage validation day.

Unclear, but we think yes

Yes, children select which tablet they took

We focus on questions related to Albendazole in our analysis. Deworm the World also supports some treatments for schistosomiasis (treated with Praziquantel) in Kenya, but the large majority of schools surveyed were only treating with Albendazole. Of the five schools monitors observed that were also treating with Praziquantel, all five reported that they had sufficient Praziquantel. We chose sample questions to present based on a) what we thought was easy to understand, b) our sense of what information would be most likely to change our view about Deworm the World, and c) the metrics that we felt were most comparable to the metrics we had chosen for India's program, so that we could compare the two programs. Our analysis provides slightly different results than what was presented in the monitoring report. For example, the most recent summary report from Kenya reported that 98% of schools visited on Deworming Day had ordered sufficient drugs, 9% of schools were observed to run out of drugs during Deworming Day, and 92% of head teachers reported that their school had sufficient drugs. We do not know the reasons for this discrepancy. Both the summary report's results and the results from our own data analysis indicate a high level of school preparedness for Deworming Day. We are not sure what to make of the fact that some of the figures reported seem to slightly contradict each other. If 9% of schools were observed to run out of drugs, then 98% couldn't have ordered a sufficient number of drugs. We include several schools in our analysis that monitors did not record observations for (reasons include that the school was closed or did not exist).

Don't know/Don't remember was often an option monitors could select. Unclear how these responses were treated in the data analysis.

Nearly—unclear how classes were selected within schools on deworming day and mop-up day. "Random Child Selection Table" used to choose a child for the interview

123 schools on deworming day, 124 on mop-up day, 748 schools for coverage validation

Some, but not rigorous. Students were shown the deworming pill and asked if that was the pill they took.

Sigma Research and Consulting Private Limited

Don't know/Don't remember was often an option monitors could select. Unclear how these responses were treated in the data analysis.

58 schools on DD, 89 schools on MUD, 253 schools on coverage validation day. 1 child per school was interviewed on DD and MUD. 3 children per school were interviewed for coverage validation. For Anganwadis, 61 were visited on DD, 90 on MUD, and 249 on coverage validation day.

Some, but not rigorous. Students were shown the deworming pill and asked if that was the pill they took.

SPECTRA Research and Development Private Limited

Don't know/don't remember and "other" were predefined responses the monitor could chose. Unclear how those responses were used in the analysis.

125 schools on deworming day, 125 on mop-up day, and 750 on coverage validation day

Some, but not rigorous. Students were shown the deworming pill and asked if that was the pill they took.

State Institute of Health and Family Welfare

Don't know/don't remember and "other" were predefined responses the monitor could chose. Unclear how those responses were used in the analysis.

Nearly—unclear how classes were selected

125 schools on deworming day, 125 on mop-up day, 375 for coverage validation. 1 child interviewed per school on deworming day and mop-up day, 3 children per school on coverage validation day.

Some, but not rigorous. Students were shown the deworming pill and asked if that was the pill they took.

"Don't know/don't remember" and "no response" were predefined responses the monitor could chose. Unclear how those responses were used in the analysis.

Essentially—due to complications, not all randomly selected school were sampled

490 schools (550 intended). 73 Anganwadi canters. 3 children interviewed per school.

Some, but not rigorous. Students were shown the deworming pill and asked if that was the pill they took.

Deworm the World only performed coverage validation in Chhattisgarh. Deworm the World provided "light" technical assistance to Chhattisgarh in 2015.

Collaborative Research and Training Center on Neglected Tropical Diseases at the Arba Minch University

Appear to have been counted separately

Nearly - monitors watched the first fifty enrolled children on Deworming Day

Between 38.4% and 87.4%

About 70% - 92%

Coverage validation was not implemented

Note: Received but not reviewed.

Note: Received but not reviewed.

Note: Received but not reviewed.

Note: Received but not reviewed.

Note: Received but not reviewed.

Note: Received but not reviewed.

Note: Received but not reviewed.

Center for Environment and Health Studies

90 schools on Deworming Day, 72 on Mop-up Day, and 98 on Coverage Validation Day

Coverage validation was conducted several days (3-4) after the MDA, to avoid recall bias

Center for Environment and Health Studies

Randomized (but process not fully explained)

80 schools on deworming day

Some, but not rigorous.

60 schools selected to visit on deworming day, 58 actually observed.

Not entirely clear; perhaps around 95%

Not entirely clear; but probably high (above 90%)

Coverage validation was not implemented

540 schools (of 420 targeted) and 84 anganwadis (of 210 targeted) for process monitoring; 1680 schools (of 1680 targeted) and 4509 children (of 5040 targeted; 4509 is 3 from each school that reported conducting deworming during coverage validation) for coverage validation.

78.7% for schools; 71.4% for anganwadis

75.6% for schools; 66.7% for anganwadis

87.7% of schools; 79.6% of anganwadis

41.4% of schools; 35.7% of anganwadis

66.3% of schools; 56.3% of anganwadis

Sigma Research and Consulting Private Limited

320 schools and 160 anganwadis for process monitoring, 400 schools and 400 anganwadis for coverage validation (matches the number targeted). 1176 students (of 1200 targeted) for coverage validation.

94.4% for schools; 96.3% for anganwadis

93.1% of schools; 91.3% of anganwadis

95.0% of schools; 98.8% of anganwadis

50.6% of schools; 61.3% of anganwadis

76.5% of schools; 67.3% of anganwadis

0.71 in schools; 0.85 in anganwadis

259 schools (292 intended) and 132 anganwadis (146 intended) for process monitoring. 337 schools (365 intended), 978 students (1095 intended), 343 anganwadis (365 intended) for coverage validation.

74.9% for schools; 75.0% for anganwadis

94.2% of schools; 78.0% of anganwadis

96.4% of schools; 93.0% of anganwadis

37.1% of schools; 37.1% of anganwadis

75.2% of schools; 54.3% of anganwadis

0.74 in schools; 0.69 in anganwadis

Yes, with the exception of one district which was excluded

500 schools, 500 anganwadis (matches targets). 1203 students (of 1500 targeted).

52.2% of schools; 62.1% of anganwadis

66.8% of schools; 76.0% of anganwadis

31.9% of schools; 55.6% of anganwadis

70.8% of schools; 64.0% of anganwadis

0.51 in schools; 0.84 in anganwadis

Yes, with the exception of one district which was excluded

409 schools (400 targeted) and 205 anganwadis (200 targeted) for process monitoring; 498 schools and 500 anganwadis (of 500 targeted, for both) and 1359 students (of 1500 targeted) for coverage validation.

57.7% for schools; 75.1% for anganwadis

78.0% of schools; 85.4% of anganwadis

79.7% of schools; 93.6% of anganwadis

55.8% of schools; 69.3% of anganwadis

64.6% of schools; 62.2% of anganwadis

0.66 in schools; 0.78 in anganwadis

2015-2016

265 schools for process monitoring; 142 schools for coverage validation

Not entirely clear, but probably high (above 95%).

Not reported; some were interviewed in groups.

Not reported; 2% of children reported insufficient drugs.

Note: We have received a coverage survey from Deworm the World's partner in Ethiopia, the Schistosomiasis Control Initiative. See https://docs.google.com/spreadsheets/d/1Cb4By-WyxzaCSi_9AidxTHnZjrBwkMjj-RfK2jdRO9A/edit#gid=1487323759.

Note: Received but not reviewed. We reviewed the 2016 report, above, and the August 2017 report, below.

"Don't know" is treated as a valid response, separate from "Yes" and "No"

Yes, possibly excepting 4 of 31 districts

193 schools and 191 anganwadis for process monitoring (200 of each targeted); 495 schools and 495 anganwadis (500 of each targeted) and 1390 students (1500 targeted) for coverage validation

76% of schools; 71% of anganwadis

97% of schools; 86% of anganwadis

94% of schools; 94% of anganwadis

45% of schools; 51% of anganwadis

67% of schools; 59% of anganwadis

Not reported; coverage validation found 97%

Some, not rigorous

Yes, possibly excepting 4 of 31 districts

0.47 for schools; 0.73 for anganwadis

Note: Received but not reviewed. We reviewed the 2016 report, above, and the August 2017 report, below.

"Don't know" is treated as a valid response, separate from "Yes" and "No"

249 schools and 251 anganwadis (250 of each targeted) for process monitoring; 625 schools and 625 anganwadis (625 of each targeted) for coverage validation

65% of schools; 79% of anganwadis

78% of schools; 85% of anganwadis

87% of schools; 90% of anganwadis

47% of schools; 52% of anganwadis

60% of schools; 54% of anganwadis

Not reported; coverage validation found 96%

Some, not rigorous

0.45 in schools; 0.80 in anganwadis

State Institute of Health and Family Welfare

"Don't know" is treated as a valid response, separate from "Yes" and "No"

250 schools and 250 anganwadis (250 of each targeted) for process monitoring; 625 schools and 625 anganwadis (625 of each targeted) and 1780 children (1875 targeted) for coverage validation

80% of schools; 82% of anganwadis

86% of schools; 91% of anganwadis

91% of schools; 94% of anganwadis

65% of schools; 72% of anganwadis

80% of schools; 61% of anganwadis

Not reported; coverage validation found 98%

Some, not rigorous

0.81 in schools; 0.76 in anganwadis

Note: Received but not reviewed. We reviewed the 2016 report, above.

Note: Received but not reviewed. We reviewed the 2016 report, above.

Note: Received but not reviewed. We reviewed the 2016 report, above.

"Don't know" is treated as a valid response, separate from "Yes" and "No"

Partially (11 out of 35 districts were excluded due to rescheduling NDD)

131 schools and 133 anganwadis for process monitoring; 693 schools and 693 anganwadis for coverage validation

81% of schools; 83% of anganwadis

79% of schools; 94% of anganwadis

92% of schools; 96% of anganwadis

68% of schools; 62% of anganwadis

86% of schools; 74% of anganwadis

Not reported; coverage validation found 96%

Some, not rigorous

Partially (11 out of 35 districts were excluded due to rescheduling NDD)

82% of government schools; 45% of private schools

0.76 in schools; 1.11 in anganwadis

"Don't know" is treated as a valid response, separate from "Yes" and "No"

153 schools, 163 anganwadis

63% of schools; 63% of anganwadis

88% of schools; 85% of anganwadis

85% of schools; 89% of anganwadis

24% of schools; 28% of anganwadis

66% of schools; 59% of anganwadis

Not reported; coverage validation found 94%

Some, not rigorous

0.58 in schools; 1.06 in anganwadis

"Don't know" is treated as a valid response, separate from "Yes" and "No"

200 schools and 200 anganwadis for process monitoring; 500 schools and 500 anganwadis for coverage validation

62% of schools; 71% of anganwadis

77% of schools; 74% of anganwadis

86% of schools; 82% of anganwadis

68% of schools; 62% of anganwadis

56% of schools; 47% of anganwadis

Not reported; coverage validation found 95%

Some, not rigorous

0.49 in schools; 1.04 in anganwadis

"Don't know" is treated as a valid response, separate from "Yes" and "No"

249 schools and 250 anganwadis (250 of each targeted) for process monitoring; 625 schools and 625 anganwadis (625 of each targeted) for coverage validation

57% of schools; 72% of anganwadis

61% of schools; 67% of anganwadis

72% of schools; 72% of anganwadis

25% of schools; 27% of anganwadis

64% of schools; 64% of anganwadis

Not reported; coverage validation found 91%

Some, not rigorous

0.56 in schools; 1.15 in anganwadis

Note: Received but not reviewed. We reviewed the 2016 report, above.

Note: Received but not reviewed. We reviewed the 2016 report, above.

Note: Received but not reviewed. We reviewed the 2016 report, above.

Monitoring team employed by Evidence Action

"Don't know" is treated as a valid response, separate from "Yes" and "No"

2% of schools – 295 planned, 296 actual for process monitoring; 60 students for coverage validation

Not entirely clear, but probably high

No more than 83% fully following protocol

Generally within a week, but up to three months

Center for Environment and Health Studies

Yes, with some replacement

66 schools for process monitoring (87 schools counting satellite schools); 132 schools for coverage validation

97% on deworming day; 100% within 3 days

Yes, with some replacement

"Don't know" is treated as a valid response, separate from "Yes" and "No"

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

Note: Received but not reviewed in detail.

"Don't know" is treated as "No"

Not reported; 100% of teachers reported having sufficient drugs

Not reported; likely high

Implied to be 100%

Coverage validation was not implemented

Coverage validation was not implemented

"Don't know" is treated as "No"

Not reported; likely high

Variable; often an adult is present

Some, not rigorous

"Don't know" is treated as "No"

Yes, excepting one school that couldn't be located

Not reported; likely high

Implied to be 100%

Coverage validation was not implemented

Coverage validation was not implemented

"Don't know" is treated as "No"

Implied to be 100% of schools that reported administering deworming

Coverage validation was not implemented

Coverage validation was not implemented

"Don't know" is treated as "No"

96% (reported, not observed)

Not reported; likely high

Variable; often an adult is present

Some, not rigorous

"Don't know" is treated as "No"

Not reported; likely high

Implied to be 100% of schools visited

Coverage validation was not implemented

Coverage validation was not implemented

"Don't know" is treated as "No"

Not reported; likely high

Not reported; implied to be high

Variable; often an adult is present

Some, not rigorous