| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | General tips for extraction in the Admin panel (dashboard) of DEP: - You need to first add the author name field (a required field) before you can edit other fields - To avoid data not being saved, after making any changes in the extraction form, make sure you click on any blank space, before closing the record page. Otherwise the changes may not be saved. You will know that the data is saved when a small pop up window appears with a green tick box followed by a 'Changes saved' message. | |||||||||||||||||||||||||
2 | Code | Subcode | Field input criteria | Description | How many options? | Unique or from list? | Should this be judged based on inclusion criteria or identified studies? | |||||||||||||||||||
3 | SR Guidance | If a SR has no includable studies, please extract each field in accordance with the authors inclusion criteria. | One answer | Unique | ||||||||||||||||||||||
4 | Source project | Data required | Select the project for which you are creating the record. When you select the project name from the dropdown list and click 'Yes' in the confirmation pop-up, the record will be auto-assigned to that project in the ‘Manage projects’ tab. If you have any doubts about what project to choose, please contact your project coordinator for guidance. | One answer | Select from list | NA | ||||||||||||||||||||
5 | Title | Data required | Use only the English version of the publication's main title. If paper is not written in English and has the title translated, use the translated version of the title. If the publication does not provide an English version, include the title in its original language. Please enter title in title case. “Title case” means all words should be capitalized except short prepositions, articles, and conjunctions (a, the, of, from, and, but, by, ....). E.g., “Examining the Reliability of Self-Reported Data on School Participation”. Ensure there are no line breaks. | One answer | Unique | NA | ||||||||||||||||||||
6 | Database Source | Leave blank | LEAVE BLANK | Leave blank | NA | |||||||||||||||||||||
7 | Study Status | Data required | Select one of the following: • Completed • Protocol/ongoing • Ongoing (3ie) | One answer | Select from list | NA | ||||||||||||||||||||
8 | Short Title | Leave blank | LEAVE BLANK | Leave blank | NA | |||||||||||||||||||||
9 | Foreign Title | Leave blank if none | When publication is not written in English, code the original title using original accents and special characters. Example: Intervenção educacional em equipes do Programa de Saúde da Família para promoção da amamentação If not applicable, leave blank. | One per box, can add more as needed (automatically created) | Unique | NA | ||||||||||||||||||||
10 | Language | Data required | Select full text language that applies: English, French, Spanish, Portuguese or Other. | One answer | Select from list | NA | ||||||||||||||||||||
11 | Author Information | Author Name | Data required | Enter all authors one by one. The format is "Last name/s", "First name" "Second name" (if any). Example: Sabet, Shayda; Sabet, Shayda M.; Sabet, Shayda Mae When a publication only provides first name initials and last name, coder will have to perform a cursory online search using the name and paper title to find the author/s' full name. If search is unsuccessful, author/s will be coded following the format: "Last name/s", "First name initial" "Second name initial" (if any). Example: Miranda, J. Miranda, J. M. When extracting author names in the admin panel, please select the most complete name from the dropdown. | One per box, can add more as needed | Type into bar and select pre-existing option if possible | NA | |||||||||||||||||||
12 | Author Affiliation Institution | Data required, select "999" from the dropdown if none | Code the institution with which the author is affiliated according to what is noted in the article. Code the full name of the institution and its abbreviation (if relevant) in brackets. For example: International Initiative for Impact Evaluation (3ie). If no information is included in the paper code as "999". Do not spend time looking for this information elsewhere if it's not reported in the paper. If there are multiple affiliation institutions, we should capture all. | One per box, can add more as needed | Type into bar and select pre-existing option if possible | NA | ||||||||||||||||||||
13 | Author Affiliation Institution Department | Data required, select "999" from the dropdown if none | Code the faculty, department, lab, etc. within the affiliated institution. For example “Faculty of Economics” If no information is included in the paper code as "999". Do not spend time looking for this information elsewhere if it's not reported in the paper. We do not need to capture multiple departments in separate rows. | One per box, can add more as needed | Type into bar and select pre-existing option if possible | NA | ||||||||||||||||||||
14 | Author Affiliation Country | Data required, select "Not reported" if none | If specified or obvious, select country in which author’s institutional affiliation sits. If the institution’s headquarters are in one country but the organization has affiliates or country offices all over the world (such as the World Bank or JPAL), and the affiliation mentioned does not specify a country office, then select the HQ country. For example, if the affiliated mentioned is simply “JPAL” select United States, if it says “JPAL Africa”, then select South Africa. Select "Not reported" if country is not easily determined. | One per box, can add more as needed | Type into bar and select pre-existing option if possible | NA | ||||||||||||||||||||
15 | Publication Information | Publication Outlet | Data required, select "not applicable" if none | Choose the name of the publication outlet from the dropdown list, usually a journal name. If it is a working paper choose the name of the working paper series (e.g. NBER Working Paper); if it is a thesis choose the name of the academic institution. If it cannot be found, select 'Other'. If none of the above apply, select 'not applicable'. | One answer | Select from list | NA | |||||||||||||||||||
16 | Publication Outlet Other | Leave blank if none | If you chose other above, follow the below instructions, and otherwise leave blank For Journals - Use full journal name. Do not abbreviate name. Do not include "The" at the beginning. Example: Journal of Development Effectiveness For working papers - use the series name. Example: World Bank Policy Research Working Paper For reports - use the publishing institution. Example: Innovations for Poverty Action (IPA) For conference papers - “Proceedings of the <conference name>” Example: Proceedings of the 30th International Conference of Agricultural Economists. For theses - use the name of the academic institution. Example: University of Maryland | One answer | Unique | NA | ||||||||||||||||||||
17 | Volume/Series number | Leave blank if none | Use Arabic numerals (do not use Roman numerals) For working papers, record the series number. If no information is specified, leave blank. | One answer | Unique | NA | ||||||||||||||||||||
18 | Journal Issue | Leave blank if none | Type in a study's journal issue. If this is not applicable, leave blank. | One answer | Unique | NA | ||||||||||||||||||||
19 | Pages | Leave blank if none | For example: 321-340 If no page numbers given in reference, leave blank. If the paper is not from a journal (e.g., a working paper), leave blank, even if the pages of the PDF are numbered 1-n. | One answer | Unique | NA | ||||||||||||||||||||
20 | Year of Publication | Data required, select "999" from dropdown if none | Select the year when the the paper was published online (i.e., the date the paper was made available online, not the submission or acceptance dates). Only enter the print publication date if no online publicaton date is provided. The format is YYYY. If the study does not provide information about the publication year select 999. | One answer | Select from list | NA | ||||||||||||||||||||
21 | Publisher Location | Leave blank | LEAVE BLANK | NA | ||||||||||||||||||||||
22 | DOI | Data required, "No DOI" if none | Code the study's DOI. If no information is found, code as "No DOI". Example: 10.1007/s11127-017-0452-x | One answer | Unique | NA | ||||||||||||||||||||
23 | Abstract | Data required, "No abstract" if none | Copy and paste study's abstract, adhering to the following guidelines: 1. Make sure to remove any line breaks that are not in the original abstract (i.e., those that are added when copying text from a PDF). 2. If the abstract has sub-headings, put these in the abstract field and format them with the "Heading 4" style. 3. Check for any html tags (e.g., <bold>) or strange characters that show up after pasting (e.g., sometimes hyphens or ampersands get replaced with random characters). 4. If there's no author-supplied abstract, see if you can find a paragraph or a few sentences that summarise the study (its objectives, design, and findings) and paste that in instead. 5. If there's no suitable text from the paper to use as an abstract, code as: "No abstract". | One answer | Unique | NA | ||||||||||||||||||||
24 | Open Access | Data required | If the study's full-text content is available free from the publisher, code as "Yes". If the study has paywalls code as "No". If the paper is not available free from the official publisher, but there is an unpublished version available (e.g., a draft/preprint on the author’s website), code this as “No”. | One answer | select yes or no | NA | ||||||||||||||||||||
25 | 3ie Produced | Data required | Always select "No". Studies that were produced by 3ie will be created and completed by the respective project teams. | One answer | select yes or no | NA | ||||||||||||||||||||
26 | Publication Type | Data required | Select from list: Journal article Published working paper (these include discussion papers and technical reports/papers, if they are part of a series) Published report (such as a report published by an INGO or a donor agency, not as a working paper but as a final product) 3ie Series report (select if a 3ie-branded working paper) 3ie Grantee final report (select for a 3ie-funded impact evaluation) 3ie-funded ongoing study Book or book chapter Thesis Published protocol (select if a published protocol, registration or pre-analysis plan) Ongoing study (select if not a registered study or published protocol, but for example, a description of the study on an organisational or authors’ personal webpage) | One answer | Select from list | NA | ||||||||||||||||||||
27 | Publication URL | Leave blank if none | If the study is a journal article enter URL of the landing page from the journal publisher's website; if the study is a published working paper or published report, enter URL of the document’s landing page from the publishing website; If the study is a published working paper or published report and there is not a landing page, provide URL of the full-text PDF. | One answer | Unique | NA | ||||||||||||||||||||
28 | Other Resources | Leave blank if none | If you identify a linked publication, please provide the study IDs on the DEP DEX tracker (or notify your core team). If you’re confident extracting linked publications, proceed to the next steps: Step 1: You must create a heading by typing the phrase 'Related resources' in H1 heading style at the top of the text box. This must be followed directly underneath by the phrase 'Other research papers produced by this study' in normal (bold) heading style. All related resources should be in a bulleted list in normal text style. Please ensure to review the 'How to record linked publications' document for more detailed instructions: https://docs.google.com/document/d/122OrGendvWSKQXmIvCz7J_-lFyBY7jTM/edit?usp=sharing&ouid=104106522238672409226&rtpof=true&sd=true_wnEktVEqSmu6viuEG8Bbogt70n5WXkvP-AY_oyYRQ?e=VliuQc. Step 2: Any relevant information (i.e. geographic information, outcomes, transparency data) from the linked paper that is not present in the top paper, should also be included. | One answer | NA | |||||||||||||||||||||
29 | Minutes (Publication Tab) | Data required | Record the total amount of time spent extracting the Publication info tab. | One answer | Unique | NA | ||||||||||||||||||||
30 | Sector Information | Sector Name (WB Taxonomy) | Data required | Based on studies included in the review, select ONE sector that captures the intervention being evaluated. Refer to the World Bank taxonomy document for guidance: • Agriculture, fishing & forestry • Education • Energy & extractives • Financial sector • Health • Social protection • Industry, trade & services • Information & communications technologies • Public administration • Transportation • Water, sanitation & waste management See attached taxonomy for definitions. | One answer | Select from list | Inclusion criteria | |||||||||||||||||||
31 | Sub-Sector Name (WB Taxonomy) | Data required | Based on studies included in the review, select all sub-sectors that apply according to the sector indicated in previous column. You can add more than one sub-sector in this field if any are applicable. See World Bank taxonomy for definitions. | Multiple answers, as necessary | type into bar, exactly as written in WB taxonomy PDF, and select from list when appropriate answer is shown. | Inclusion criteria | ||||||||||||||||||||
32 | Primary Theme (WB Taxonomy) | Data required | Based on studies included in the review, select one theme that applies. See World Bank taxonomy for definitions. | One answer | Select from list | Inclusion criteria | ||||||||||||||||||||
33 | Primary Sub-Theme (WB Taxonomy) | Data required | Based on studies included in the review, select all sub-themes that apply according to the theme indicated in previous column. For two or more sub-themes for one theme, enter in a new row. (Note: the dropdown menu will show only sub-themes for the theme you selected in the previous column. You must select a theme in the previous column to access the dropdown for this field.) See World Bank taxonomy for definitions. | One answer | Select from list | Inclusion criteria | ||||||||||||||||||||
34 | Additional Theme (WB Taxonomy) | Leave blank if none | Based on the studies included in the review, select one theme that applies. See World Bank taxonomy for definitions. If no other themes are applicable, leave blank. If necessary you can add additional theme codes. Press the green plus button to do so. | One answer | Select from list | Inclusion criteria | ||||||||||||||||||||
35 | Additional Sub-Theme (WB Taxonomy) | Leave blank if none | Based on studies included in the review, select all sub-themes that apply according to the theme indicated in previous column. For two or more sub-themes for one theme, enter in a new row. (Note: the dropdown menu will show only subthemes for the theme you selected in the previous column. You must select a theme in the previous column to access the dropdown for this field.) See World Bank taxonomy for definitions. If no other themes are applicable, leave blank. If necessary you can add additional theme codes. Press the green plus button to do so. | One answer | Select from list | Inclusion criteria | ||||||||||||||||||||
36 | Primary DAC Code | Data required | Based on studies included in the review, select sector that applies according to the intervention evaluation: • Education (110) • Health (120) • Population policies/programmes and reproductive health (130) • Water and sanitation (140) • Government and civil society (150) • Other social infrastructure and services (160) • Economic activities (210_through_332) • General environmental protection (410) • Other multisector (430) • General budget support (510) • Developmental food aid/Food security assistance (520) • Other commodity assistance (530) • Debt relief (600) • Emergency Response (720) • Reconstruction relief and rehabilitation (730) • Disaster prevention and preparedness (740) • Administrative costs of donors (910) • Refugees in donor countries (930) • Unallocated/unspecified (998) See “DAC-CRS-CODES UPDATED” for reference. Can be located at http://www.oecd.org/development/financing-sustainable-development/development-finance-standards/purposecodessectorclassification.htm | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
37 | Secondary DAC Code | Data required | Based on studies included in the review, select the appropriate DAC5 (secondary) sector code for the intervention from the drop down list. This is restricted by the selection for the DAC5 code (primary) in the previous field. See “DAC-CRS-CODES UPDATED” for reference. Can be located at http://www.oecd.org/development/financing-sustainable-development/development-finance-standards/purposecodessectorclassification.htm | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
38 | CRS-Voluntary Code | Data required | Based on the studies included in the review, select the CRS or voluntary code associated with the intervention. This is restricted by the selection for the DAC5 code in the previous field. See “DAC-CRS-CODES UPDATED” for reference. Can be located at http://www.oecd.org/development/financing-sustainable-development/development-finance-standards/purposecodessectorclassification.htm | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
39 | Primary DAC Code (Additional) | Leave blank and do not add rows if none | If necessary you can add additional sets of DAC codes. Press the green plus button to do so. | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
40 | Secondary DAC Code (Additional) | Leave blank and do not add rows if none | If necessary you can add additional sets of DAC codes. Press the green plus button to do so. | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
41 | CRS-Voluntary Code (Additional) | Leave blank and do not add rows if none | If necessary you can add additional sets of DAC codes. Press the green plus button to do so. | One answer | Use DAC excel sheet to choose correct code, and select from list | Inclusion criteria | ||||||||||||||||||||
42 | UN Sustainable Development Goals | Data required | Using the dropdown lists, select which of the Sustainable Development Goals (SDGs) that are applicable/relevant to the outcomes. Make up to three (3) selections. Tip: It is helpful to compare the outcomes of the paper with those in the SDG taxonomy, to identify the relevant goals. It's likely that any study on the DEP will be applicable to at least one SGD goal. In the rare case you're unable to identify a suitable SDG, you must flag this on the DEP DEX Tracker (or notify your core team). | Multiple answers, as necessary Ocassionally 'UN SDGs' based on inclusion criteria could be different from 'UN SDGs' of the studies included in the analysis. In such situations use the latter approach. | Select from list | Inclusion criteria | ||||||||||||||||||||
43 | Population | Leave blank | LEAVE BLANK | |||||||||||||||||||||||
44 | Other Topics | Data required, Select "Not applicable" from dropdown if none | Based on studies included in the review, select one or more other topics that apply. • Agricultural technology • Business training • Cash transfers • Community driven development • Cost-benefit/effectiveness analysis • Farmer field schools • Humanitarian aid • Microfinance • Payment for ecosystem services • Performance-/results-based financing • Rotating savings and credit associations If none applicable, select "Not applicable" See Other topics definitions sheet for definitions. | Multiple answers, as necessary Ocassionally 'Other topics' based on inclusion criteria could be different from 'Other topics' of the studies included in the analysis. In such situations use the latter approach. | Select from list | In rare situations, 'Other topics' based on inclusion criteria could be different from 'Other topics' of the studies included in the analysis. In such situations use the latter approach. | ||||||||||||||||||||
45 | Equity Focus | Data required | Select one or more as applicable to the review: • Does not address gender or equity • Sub-group analysis by sex • Sub-group analysis (other than sex) • Heterogeneity analysis (other than sub-group) • Equity sensitive analytical framework • Equity sensitive methodology • Equity sensitive research process • Measures effects on an inequality outcome • Research ethics informed by equity See gender and equity protocol page for definitions. | Multiple answers, as necessary | Select from list | NA | ||||||||||||||||||||
46 | Equity Dimension | Data required. Auto-populated with 'Not applicable' if 'Does not address gender or equity' option is chosen as Equity focus. | If the review does address gender or equity please select one or more dimensions below: • Age (e.g. old or young age but only if the choice of that group is driven by equity considerations) • Caste • Conflict-affected (only if that was a comp of intervention targeting; not every study taking place in a fragile or conflict-affected area should be coded as such) • Culture (includes language) • Disability (medical, physical, neurological, mental disorders) • Displaced populations (including refugees) • Education • Ethnicity • Head of household (female headed) • HIV/AIDS (people with or at risk of HIV) • Land size • Land ownership • Place of residence (rural, urban, peri-urban, informal dwellings) • Religion • Socioeconomic status (income or poverty status) • Social capital • Sex (includes the use of the term gender meaning the biological sex of a person) • Sexual orientation • Sexual identity • Other (vulnerable group not typified by any of the above). Could include: orphans, sex workers, survivors of sexual violence etc.) See gender and equity protocol page for definitions. Note: this field will be auto-populated with 'Not applicable' if you select 'Does not address gender or equity' for equity focus. | Multiple answers, as necessary | Select from list | NA | ||||||||||||||||||||
47 | Equity Description | Data required. Auto-populated with 'Not applicable' if 'Does not address gender or equity' option is chosen as Equity focus. | Provide a description of how the review considers gender and equity, and for which population to corroborate answers above (page numbers). The correct format is: Rationale for Equity focus code 1 (page nr); Rationale for Equity focus code 2 (page nr) and so on. There should be clear and concise excerpts. Please do not extract full pages. Where necessary, be sure to add table numbers. E.g. Subgroup analysis by sex (table 6, page 8); Inequality outcome measured: "gender inequality index which shows the loss in potential human development due to inequality between female and male achievements in these dimensions. It ranges from 0, where women and men fare equally, to 1, where one gender fares as poorly as possible in all measured dimensions" (page 9 and Table 8)" Note: this field will be auto-populated with 'Not applicable' if you select 'Does not address gender or equity' for equity focus. | Written answer, can be copy pasted from study | Unique | NA | ||||||||||||||||||||
48 | Keywords | Data required | Enter all author provided keywords, one per row. If the author does not provide any or if there are important keywords you think are missing, please add them (if your add your own keywords, maximum of 6 in total) Please ensure there are no unecessary punctuation marks or special characters | Multiple answers, as necessary | type into bar, but select pre-existing options if possible. | NA | ||||||||||||||||||||
49 | Minutes (Sector Tab) | Data required | Record the total amount of time spent extracting the Sector info tab. | One answer | Unique | NA | ||||||||||||||||||||
50 | Continent Name | Data required | Select the continent/region in which the included studies were conducted: ● East Asia and Pacific ● Europe and Central Asia ● Latin America and Caribbean ● Middle East and North Africa ● North America ● South Asia ● Sub-Saharan Africa ● Multi-continent (select this if the review found studies from more than 15 countries across multiple continents, and no disaggregated effects provided for each country) If multiple continents, add in new row. Choose 'Not applicable (no studies)' if a review found no studies. | One answer per box (can press green plus to add more) | Select from list | Based on what authors found (same for DEP and EGM projects). Select not applicable if there are no included studies | ||||||||||||||||||||
51 | Country Name | Data required | Select the countries in which the included studies were conducted (drop down menu).There is a Multi-country option for situations when there are more than 15 countries, and no disaggregated effects provided for each country. Choose 'Not applicable (no studies)' if a review found no studies. Choose 'Not reported' if the countries are not clearly mentioned. | One answer per box (can press green plus to add more) | Select from list | Based on what authors found (same for DEP and EGM projects). Select not applicable if there are no included studies | ||||||||||||||||||||
52 | Country Income Level | AUTO-POPULATED | Automatically indicates income level when country name selected. It is the country's World Bank Income level status based on the year from the First Year of Intervention field, or if empty than the Year of publication. | NA | ||||||||||||||||||||||
53 | FCV Country | AUTO-POPULATED | Automatically indicates FCV status when country name selected. It is the country's World Bank Fragility, Conflict and Violence classification based on the year from the First Year of Intervention field, or if empty than the Year of publication. | NA | ||||||||||||||||||||||
54 | Minutes (Geographic Tab) | Data required | Record the total amount of time spent extracting the Geographic info tab. | One answer | Unique | NA | ||||||||||||||||||||
55 | Methodological information | Review Type | Leave blank | LEAVE BLANK (for 3ie core team to fill in) Effectiveness or Other | One answer | Select from list | NA | |||||||||||||||||||
56 | Quantitative Method | Leave blank | LEAVE BLANK (for 3ie core team to fill in) If the review uses a quantitative method, please select the relevant choice from the following options: Description of a range of effect sizes Meta-analysis Meta-regression Narrative/thematic synthesis Not applicable Other Vote Counting | one answer | Select from list | NA | ||||||||||||||||||||
57 | Qualitative Method | Leave blank | LEAVE BLANK (for 3ie core team to fill in) If the review uses a qualitative method, please select the relevant choice from the following options: Comparative analysis Content analysis Interpretive synthesis Meta-ethnography Narrative synthesis Not applicable Other | one answer | Select from list | NA | ||||||||||||||||||||
58 | Quality Assesment Tool | Leave blank | LEAVE BLANK (for 3ie core team to fill in) Select the quality assessment tool used by the authors from the options below: Cochrane - Risk of Bias Tool Cochrane - other tool (non-randomised studies) EPOC ICDG Newcastle-Ottowa No risk of bias assessment Other | one answer | Select from list | NA | ||||||||||||||||||||
59 | Extract Comment | Leave blank | written answer | written answer | NA | |||||||||||||||||||||
60 | Minutes (Methods Tab) | Leave blank | Record the total amount of time spent extracting the Methods info tab. | One answer | Unique | NA | ||||||||||||||||||||
61 | Researching Funding Agency Name | Data required, "Not specified" if none | Input the name of the agenc(ies) funding the review (note: this is not the same as organizations that fund the program). If the name of the agency is not listed in the dropdown, select "Other". Note: only report this information if it is provided in the paper. You do not need to search online. | One answer per box (can press green plus to add more) | Type into bar and select pre-existing option if possible | NA | ||||||||||||||||||||
62 | Researching Funding Agency Category | Data required, "Not specified" if none | This field will auto-populate unless you have selected "Other" for the agency name. If you selected "Other" for agency name and you can identify the agency type, select one of the following: • Government agency • International Aid Agency • International Financial Institution • Non-Profit Organization • For-Profit Firm • Academic Institution • Charitable or Private Foundation • Not specified See Funding and implementing agency sheet for definitions. If the study does not provide sufficient information to identify the agency type, code as "Not specified". | One answer per box (can press green plus to add more) | Select from list | NA | ||||||||||||||||||||
63 | Minutes (Agency Tab) | Data required | Record the total amount of time spent extracting the Agency info tab. | One answer | Unique | NA | ||||||||||||||||||||
64 | Intervention Information | Overall Number of Studies | Data required, "0" if empty | Please enter the overall number of studies included in the analysis of the effects. Do not count studies used for the sole purpose of examining barriers and facilitators, or excluded entirely from the analysis of effects by being judged as low quality by the authors. If the review is empty, write 0. | One answer | written answer | This number relates to studies included in the analysis of the effects (vs studies examining barriers and facilitators, or excluded studies deemed as low quality). | |||||||||||||||||||
65 | Overall Number of High Quality Studies | Data required, "Not specified" if none | Please enter the overall number of high quality studies included in the review. If not specified, write 'Not specified'. If authors do not provide a combined measure of quality for each study mention it, but do not make a judgement. | One answer | written answer | If authors do not provide a combined measure of quality for each study mention it, but do not make a judgement. | ||||||||||||||||||||
66 | Overall Number of Medium Quality Studies | Data required, "Not specified" if none | Please enter the overall number of medium quality studies included in the review. If not specified, write not specified. If authors do not provide a combined measure of quality for each study mention it, but do not make a judgement. | One answer | written answer | If authors do not provide a combined measure of quality for each study mention it, but do not make a judgement. | ||||||||||||||||||||
67 | Intervention (DEP Taxonomy) | Data required | Using the combined interventions taxonomy, locate the appropriate codes for each of the evaluated interventions. Make sure the code is correctly applied by reading the code's definition in full. Do not make a decision based only on the name. When extracting the interventions and outcomes in the DEP, you will see that you can add multiple interventions, and the outcomes will be nested underneath them. You can add a new intervention by pressing the green plus. Separate interventions should be added if a review reports the analysis of effects disaggregated into distinct intervention categories. For example, if a review reports the effects of conditional cash transfers (CCTs) (Intervention 1) separately from unconditional cash transfers (UCTs) (Intervention 2). But if a review only reports the combined effects of cash transfers (some of them conditional , others unconditional) then both CCTs and UCTs would be coded under Intervention 1. Interventions should be captured at the lowest, disaggregated level. If a review examines the effects of CCTs or UCTs you should NOT use the broader intervention group code (e.g. Social transfers) that it may be classified under in the taxonomy hierarchy. You would only record intervention codes found in the included studies. E.g. if a review found studies of production quotas, minimum agricultural product tarrifs, and export quotas, then only the three disaggregated intervention codes (lowest level) related to those three interventions should be captured. If however the review reports findings from studies with a variety of types of agricultural market policies which you can not capture effectively with our lower levels of aggregation codes, you should use the SR Tracker sheet to notify the core team that a higher level of aggregation code is needed. You must: a) list several of the interventions found (e.g. production quotas, minimum agricultural product tarrifs, export quotas, export levies, import quotas and import tarrifs and so on) and b) identify the most appropriate high-level intervention group (e.g. 'Agricultural market policies' ) that those interventions would fall under. Note: If you're absolutely sure that there is no appropriate intervention code, you can select "Other intervention". If you select this option you must suggest the following for a new intervention code: name, sector, broad group, intervention group, intervention group definition, disaggregated intervention and definition in the "Other category suggestions" sheet in the DEP DEX Tracker (or notify your core team). TIME-SAVING TIP: - Instead of having to select the same interventions/outcomes again for different arms, click on the black square + icon next to the Intervention field. This will create a copy of the intervention with all its outcomes nested under it. - Given the large number of codes in the DEP intervention taxonomy it might be easier to copy the ‘disaggregated intervention’ into the Intervention field. | multple answers, as necessary | Copy paste from intervention taxonomy | Based on analysis Clarify the level of aggregation. Try to use the lowest, but use higher if necesary. | ||||||||||||||||||||
68 | Intervention Description | Data required | Use this open answer field to enter a description of the included interventions, up to a paragraph or so; more detailed information will be preferred. Be selective and concise with the excerpts being transcribed here as to ensure accurate and precise descriptions of the intervention. Include page numbers with every excerpt extracted. There will be an 'Intervention description' field corresponding to every intervention created in the field above. The format should follow: One line sentence describing the treatment in your own words. The text from the paper with information about the intervention and the page number/s (e.g. (Page: 10). There should be clear and concise excerpts with sufficient information to justify all selected codes. Do not extract full pages. | descriptive, can be pasted from study with page numbers | Unique | Based on analysis Clarify the level of aggregation. Try to use the lowest, but use higher if necesary. | ||||||||||||||||||||
69 | Outcome Information | Outcome (DEP Taxonomy) | Data required | Using the outcome taxonomy, locate the appropriate codes for each of the outcomes measured by the included studies. Make sure the code is correctly applied by reading the code's definition in full. Do not make a decision based only on the code name. You would only code outcome codes based on the analysis, or in the case of narrative synthesis, based on findings reported from the included studies (not the inclusion criteria). E.g. if a narrative synthesis only reports findings from studies that measure risk of sexual and gender-based violence (SGBV), incidence of SGBV and attitudes about intimate partner violence (IPV) attitudes, then only the three disaggregated outcome codes (lowest level) related to those three outcomes should be captured. If however, the synthesis reports findings from studies with a variety of violence-related outcomes which you can not capture effectively with our lower levels of aggregation codes, you should use the SR Tracker sheet to notify the core team that a higher level of aggregation code is needed. You must: a) list several of the outcomes found (e.g. SGBV incidence, SGBV risk, IPV attitudes, Social norms regarding violence, Perceptions of the use of violence for conflict resolution and so on) and b) identify the most appropriate high-level outcome group (e.g. 'Physical security & violence' ) that those outcomes would fall under. Outcomes should be captured at the level of specificity of the taxonomy. Typically, there are three scenarios: - When a paper reports multiple outcomes more specific than any of the ones that we have in the taxonomy, and there is a single code at the lowest level of our taxonomy that captures what all the more specific outcomes are measuring, then choose that single code that captures all of them. For example, a study might report separate outcome measures for household expenditures on rice, maize and wheat. While the DEP taxonomy doesn’t include outcomes that are this specific, since these outcome measures are all examples of "Household expenditure on food", we would use that code for capturing all of these more specific outcome measures. - When a paper reports outcomes that fit multiple codes in our taxonomy, then use the most specific code available. You should select all applicable codes from the lowest level even if a higher code exists. For example, if a study reports “On-farm work time” and “Non-farm work time”, those should be coded as separate outcomes even if a higher level outcome such as “Overall work time” exists in the taxonomy. You would only use the “Overall work time” code if a study (also) contains a measure of work time which combines time spent on non-farm and on-farm activities. - When a paper reports outcomes at a level more general than the lowest level of the taxonomy, and hence cannot be classified under any existing codes, please use the “Other” option and report it to your coordinator. Occasionally, the DEP team may decide to create codes at a higher level, but in most cases, there are only codes at the lowest level represented in the dropdown list. Note: If you're absolutely sure that there is no appropriate outcome code, you can select "Other outcome". If you select this option you must suggest the following for a new outcome code: name, sector, broad group, outcome group, outcome group definition, disaggregated outcome and definition in the "Other category suggestions" sheet in the DEP DEX Tracker (or notify your core team). TIME-SAVING TIPS: - Instead of having to select the same outcomes again for different interventions, click on the black square + icon next to the Intervention field. This will create a copy of the intervention with all its outcomes nested under it. - Given the large number of codes in the DEP outcome taxonomy it might be easier to copy the ‘disaggregated outcome’ into the Outcome field. | one anser per box, can add more with + sign | copy paste from outcome taxonomy | Based on analysis Clarify the level of aggregation. Try to use the lowest, but use higher if necesary. | |||||||||||||||||||
70 | Outcome Description | Data required | Use this open answer field to enter, in the author’s own words, a description of the outcome. Be selective and concise with the excerpts being transcribed here to ensure accurate and precise descriptions of the outcome. Include page numbers with every excerpt extracted. Do this for each outcome. The format should follow: One line sentence describing the outcome with clear and concise excerpts and the page and table number (e.g. (Pages: 10-11, Table: 8)). Where there are no descriptions, please capture the indicator along with the page and table numbers." If there are multiple indicators at a lower level of aggregation to the taxonomy we should include these in the description but not add any further outcome fields. | descriptive, can be pasted from study with page numbers | Unique | Based on analysis Clarify the level of aggregation. Try to use the lowest, but use higher if necesary. | ||||||||||||||||||||
71 | Indicator | Leave blank | LEAVE BLANK | NA | ||||||||||||||||||||||
72 | Subgroup | Leave blank | LEAVE BLANK | NA | ||||||||||||||||||||||
73 | Effect Size data | Leave blank | LEAVE BLANK | NA | ||||||||||||||||||||||
74 | Summary Information | All fields | Leave blank | LEAVE BLANK UNLESS YOU HAVE BEEN ASKED TO EXTRACT IT | NA | |||||||||||||||||||||
75 | Critical appraisal information | All fields | Leave blank | LEAVE BLANK UNLESS YOU HAVE BEEN ASKED TO EXTRACT IT | ||||||||||||||||||||||
76 | Screening information | All fields | Leave blank | LEAVE BLANK UNLESS YOU ARE ASKED TO SCREEN THE STUDY AS PER DEP INCLUSION-EXCLUSION CRITERIA | ||||||||||||||||||||||
77 | Transparency Information | Primary Dataset Available? | Data required, "Does not use primary data" if none. | Code whether or not the author has made their dataset publicly available. This field is for data that is collected from the studies included in the review. Scan the paper to see if there is an explicit mention of the dataset being made publicly available; if it does exist, it would probably be mentioned in the same region of the paper as ‘acknowledgements,’ ‘funding sources,’ footnotes, etc. IF it is mentioned, locate the dataset and code as appropriate. IF there is no mention in the paper or landing page, then code ‘No’, there is no need to track down the dataset if it is not disclosed. Coding options are as follows: • Yes • No • Request access • Behind paywall “Request access” is applicable when the dataset is visible on the page, however, it is necessary to first secure permission from the author/dataset owner in order to access the file. This is also the appropriate code when the user is required to contact the custodian of the dataset for access directly. “Behind paywall” is applicable when the dataset is visible on the page, however, it is necessary to pay a fee or subscription to gain access to download the file. Do NOT contact any authors or officials for access to the dataset. | One answer | Select from list | ||||||||||||||||||||
78 | Primary Dataset Location | Data required. | This is an open answer field to record the name of the database/organization hosting the principal primary dataset (e.g. Harvard Dataverse, etc.). Be sure to code the name of the source, not the name of the dataset itself. Code "999" if the location is not specified/unknown. | One answer | unique | |||||||||||||||||||||
79 | Primary Dataset URL | Leave blank if none | Enter the URL of the principal primary dataset landing page which consists of data from studies included in the review. | One answer | Unique | |||||||||||||||||||||
80 | Primary Dataset Format | Data required, "999" if none. | In what software format(s) is the dataset available: • Stata • SAS • SPSS • CSV • XLS/XLSX • Other Code "999" if the format is not specified/unknown. | Multiple answers, as necessary | select from list | |||||||||||||||||||||
81 | Analysis Code Availability? | Data required | If the statistical code to replicate the authors’ results is provided along with the dataset or mentioned as available in the text. Select from options below as appropriate: • Yes • No • Request access • Behind paywall “Request access” is applicable when the stat code is visible on the page, however, it is necessary to first secure permission from the author in order to access the file. This is also the appropriate code when the user is required to contact the custodian of the dataset for access directly. “Behind paywall” is applicable when the stat code is visible on the page, however, it is necessary to pay a fee or subscription to gain access to download the file. | One answer | Select from list | |||||||||||||||||||||
82 | Analysis Code Format | Data required, "No analysis code" if none. | Which format is the statistical code for running the analysis made available in? • Stata • R • Python • SAS • SPSS • SQL • Excel • Other If none, code as “No analysis code”. Use “Not specified”, when it is not clear or presented how the stat code will be made available. | One answer | Select from list | |||||||||||||||||||||
83 | Analysis Code Format - Other | Leave blank if none | If the statistical code is not in any of the above formats, enter the name of the format used here, otherwise leave blank. | One answer | Unique | |||||||||||||||||||||
84 | Study Materials Available? | Data required | Search the paper and landing page for mention of additional study materials included with the paper. Tip: Check appendices for study materials. Select from options below as appropriate: • Yes • No • Request access • Behind paywall “Request access” is applicable when the study materials are visible on the page, however, it is necessary to first secure permission from the author/webmaster in order to access the file. This is also the appropriate code when the user is required to contact the custodian of the materials for access directly. “Behind paywall” is applicable when the study materials are visible on the page, however, it is necessary to pay a fee or subscription to gain access to download the file. | One answer | Select from list | |||||||||||||||||||||
85 | Study Materials | Data required, "No study materials" if none. | Which study materials are publicly available? • Data extraction template • List of all studies included in the SR • PRISMA checklist • Quality assessment tool • Codebook/data dictionary • Risk of bias assessment • Other (It's not necesary to extract every appendix only those that go beyond (semi-)standard/traditiona methodological reporting, e.g. intermediate results, data summaries, trial protocols and CONSORT checklists (in case of randomized trials), details about constructing the dataset) If materials are not open-access and it is unclear what the material is, then code as “Not specified”. Materials should be coded regardless whether they appear within the body of report or not (e.g. as an appendix). Code those study materials as found by actively searching the text and the study’s landing page. Note: this will auto-populate if you have selected "No" for "Study materials availability" | Multiple answers, as necessary | select from list | |||||||||||||||||||||
86 | Study Materials - Other | Data required, "Not applicable" if none. | List any other study materials IF: A. There are study materials related to the study available, beyond what is captured above, enter them here; or B. Study materials are available on request or behind a paywall, AND ill-defined (e.g. “Supplemental Material 1”). IF neither ‘A’ or ‘B’, then code as “Not applicable”. Describe additional materials as presented by the author. Be sure not to record the additional materials by location (e.g. “Annex A”). | Multiple answers, as necessary | Unique | |||||||||||||||||||||
87 | Study Registration | Data required | First, scan the paper for any mention of study registration. If not, check the registries listed below to see if the study has been registered. If the study appears in one or more of these registries, code as “Yes”. Otherwise, code as “No”. Tips: For some studies, especially in health-related interventions, the registration will be under the trial name or trial number, which should be made clear by the study itself. Otherwise, try title or author searches. | One answer | Select from list | |||||||||||||||||||||
88 | Study Reg Location | Data required, select "Not applicable" from dropdown if none. | Which registry has the study been registered in? Please check the following registries to find if the study has been registered, or look for a mention in the paper. • Campbell Collaboration registry [socialscienceregistry.org] • Cochrane library [cochranelibrary.com] • Prospero [crd.york.ac.uk/PROSPERO] • DARE Open Science Framework [www.crd.york.ac.uk/CRDWeb/] • Development Evidence Portal [developmentevidence.3ieimpact.org] If found in a source above, code the appropriate registry, otherwise if a registry is mentioned check to see the one used is in the dropdown list (after the "--"). If the registry is not on that list, please enter the name of the registry as a new tag. Tips: For some studies, especially in health-related interventions, the registration may be under the study name or study number, which should be made clear by the study itself. Otherwise, try title or author searches. Note: this will auto-populate if you have selected "No" for "Study registration". | One answer | Select from list | |||||||||||||||||||||
89 | Study Reg URL | Leave blank if none | Enter the URL of the registration study landing page. Note: this will auto-populate if you have selected "No" for "Study registration". | One answer | Unique | |||||||||||||||||||||
90 | Pre-Analysis Plan | Data required | Code “Yes” if the study has a pre-analysis plan, this should be made clear in the paper, or on the pre-registration webpage for the study. Protocols can be considered pre-analysis plans. IF the study’s protocol is mentioned, but it is temporarily embargoed, code “Yes”. | One answer | Select from list | |||||||||||||||||||||
91 | Ethics Approval | Data required | Code “Yes” if ethics approval or institutional review board approval is referenced in the paper. If an IRB certificate is found, but is not mentioned anywhere in the paper, code “Yes” for this field. | One answer | Select from list | |||||||||||||||||||||
92 | Minutes (Transparency Tab) | Data required | Record the total amount of time spent extracting the Transparency info tab. | One answer | Unique | |||||||||||||||||||||
93 | Screening Tab | DEP | Data required | If the study meets DEP's inclusion criteria, please ensure this field is coded "Yes". If you are assigned a study and this field is coded as "No", please stop extracting and alert the DEP team. | Select from list | |||||||||||||||||||||
94 | Exclusion Reason | Autopopulated | If you are coding for the DEP team, you do not need to code this field | |||||||||||||||||||||||
95 | Exclusion – Open Answer | Autopopulated | If you are coding for the DEP team, you do not need to code this field | |||||||||||||||||||||||
96 | Screened By | Data required | Please enter your name in this field for all studies you extract on the DEP | Unique | ||||||||||||||||||||||
97 | Screening Date | Data required | Please enter the date you coded the study | Select from calendar | ||||||||||||||||||||||
98 | Minutes (Screening Tab) | Data required | Record the total amount of time spent extracting the Screening Tab. Note: this field should not be used to enter the total amount of time for a study. It should onlu be used to record time on the screening tab | Unique | ||||||||||||||||||||||
99 | ||||||||||||||||||||||||||
100 | ||||||||||||||||||||||||||