|Randomized Controlled Trial|
RCT, methods, evaluation approach
An introduction and methods to Random Controlled Trials
Resource for methods
A list of evaluation methods
Resources for methods
outcome mapping, methods, evaluation approach
An introduction and methods to outcome mapping
Resource for methods
development evaluation, methods, evaluation approach
An introduction and methods to developmental evaluation
Resource for methods
A Developmental Evaluation Primer
Jamie A.A. Gamble
developmental evaluation, methods
A Practitioner's Guide to Developmental Evaluation
Elizabeth Dozois, Marc Langlois, Natasha Blanchet-Cohen
developmental evaluation, methods, child rights and development
|Impact Evaluation Series|
evaluation webinar, UNICEF, impact evaluation methods
A series of webinars on the methods of impact evaluation
Resources for methods
|Eight Free Training Webinars|
|evaluation webinar, AEA||webinar||Mid||2013|
Eight webinars on the methods of impact evaluation
Resources for methods
|The Management Set|
Rikha Sharma Rain
development skills, management consulting, trends in foundations
A critique of current approach to development that has grown out of management consulting, prioritising data-driven cultures, efficiency over 'classic development skills' like diplomcy, familiarity with local cultures, bureaucracies, etc.
Data-driven development is a new trend and isn't the full toolset.
How This Stove Could Save Thousands of Lives in Mexico
cooking stoves, Mexico, participatory, entrepreneurs, Unreasonable, InfraRural
The story of how an entrepreneurial team developed local, healthier, cooking and heating stoves for BOP households in Mexico
Process: situational studies > capacity building workshops with community > M&E w/ three visits to each home with a stove
Design Leaders Answer: How do you track your design's effectiveness? Part 2
Matthew Smith, Mohan Ramaswamy
design metrics, effetiveness, goals, Fathom & Draft, ROI, Work & Co
A look at how design leaders measure their design effectiveness
Choose (with your client) on 2 to 3 measurable goals
What is Social Impact Assessment?
McKinsey & Company
social impact assessment, learning driven assessment, best practice
An overview of McKinsey 'learning driven assessment' and ten core beliefs about best practices. And links to a databse with tools, methods, etc.
Resource for values.
The History of Social Impact Assessment
McKinsey & Company
history, social impact assessment, industries
A summarised history of where 'social impact assessment' started and how it has moved through various industries.
Is design set to be the next industry for impact assessment? How will this change methods / applications?
You Don't Have to Call it "Impact" to Have One
impact investment, inputs, problem-solvers, Village Capital
An impact investor shares what values they look for in successful, impactful ventures.
Don't start with volume based inputs and metrics: look for quality problem sovlers.
|Krochet Kids||Krochet Kids|
impact model, metrics, values
The impact model and metrics of Krochet Kids, a school and business aimed at empowering the women of Northern Uganda and Peru with the assets, skills, and knowledge to lift themselves and their families out of poverty.
Beautiful storytelling and visualisation of metrics.
ABC of Behaviour Change Theories
Susan Michie, Robert West, Rona Campbell, Jamie Brown & Heather Gainforth
|behaviour change, theory||reading||Mid|
A book that covers different theories of behaviour change and how to use them.
Abhijit Banerjee and Esther Duflo
randomised controlled trials, absence, povery action lab, India, teachers, health providers
Article covering the use of randomized control trials to evaluate absentee incentives.
Simple ways to test technology as a vehicle for other goals.
Beyond RCTs: How Rapid-Fire Testing Can Build Better Financial Products
Aaron Dibner-Dunlap, Yumna Rathore
ranomised controlled trials, a/b tests, rapid-fire, nimble evalbualtion, Innovations for Poverty Action
A look at how rapid-fire tests can help designers understand small interventions and features to acheive first-order outcomes.
Pros & Cons of rapid vs. long RCTs. Short tests are good for 'first-order outcomes' that don't have any theory or prior evidence.
Six Theory of Change Pitfalls to Avoid
theory of change, best practice, tips
Tips for how to develop robust theories of change.
Resource for methods. Make a 'learning agenda' and keep it updated.
|Rethinking the E Word|
evidence, measurement and evaluation, evidence-based
Three ways to think of evidence to best incorporate in evidence-based practice.
Field experience and informed opinions are ALSO evidence.
practitioner, randomized controlled trials, evaluation
Our mission is to partner with clients to generate and use rigorous evidence to improve social impact. Depending on client needs, we help diagnose social sector challenges, design and test potential solutions, and operationalize those solutions found to be most impactful. We believe that client-centered, rigorous, and responsive evaluation is essential to help managers maximize program impact.
De-bunking the burden myth, impact data goes lean
lean data, target population, evaluation, social impact, annie duflo
Summary of how Acumen used lean impact evaluation to understand if a client was serving their target population.
Database for standard metrics and how to use them for impact evaluations.
Resource for methods.
Getting Real About How to Solve the Problems That Matter
measuring design, impact, Unreasonable, Measured Summit, health
Information and examples from a summit to disucss and share practices, methods, values, etc. on measuring design.
Potential interesting case studies.
|Digital Social Innovation|
framework, measuring, open
An open source tool that facilitates the assessment of Digital Social Innovation projects, taking into account values like knowledge sharing, technological openness and societal impact.
Seems too generic and flexible. Would like to see case studies, metrics don't follow IRIS, and the prompts are very based on 'volumes'.
best practices, resource, evaluation
Overviews and guidance on conducting impact evaluations.
Resource for methods. Practitioner.
|Innovation for Povery Action|
practitioner, impact evaluation, non-profits, policy, annie duflo
Innovations for Poverty Action (IPA) is a research and policy non-profit that discovers and promotes effective solutions to global poverty problems.
practitioner, non profit, international development, evidence-informed
3ie is an international grant-making NGO promoting evidence-informed development policies and programmes. We are the global leader in funding and producing high-quality evidence of what works, how, why and at what cost in international development.
Blue Marble Evaluation Resources
resources, developmental evaluation, systems, complexity, conservation, environment, michael quinn patton
A collection of recourses for evaluating complex global systems.
Michael Quinn Patton
developmental evaluation, micahel quinn patton, best practices
A book on how to conduct developmental evaluation, principles, and case studies.
sdg, evaluation, community
A summary of activity and work related to evaluating the SDGs.
practitioner, innovation, design, human-centred, financial inclusion, sanitation, agriculture, alternative energy, behavioural science, randomized controlled trials
GRID Impact is a global research, innovation and design firm that specializes in human-centered approaches to complex social and economic challenges. We create scalable social impact in domains such as financial inclusion, sanitation, agriculture and alternative energy.
How are they running their small-scale RCTs?
intervention, employment, vulnerable youth, social, jennie winhall
A NExTWORK intervention is rooted in a local network of firms that offer internships to young unemployed people.
Many months of design and experimentation before formal evaluation.
social impact, governance
Reboot is a social impact firm dedicated to inclusive development and accountable governance. We work with governments, foundations, and civil society to achieve their missions.
Developmental Evaluation for Public Sector Innovation
government innovation, evidence, William and Floar Hewlett Foundation, implementation, transparency, governance, digital strategy
A year-long developmental evaluation, working with the Government of Mexico to provide strategic guidance to their subjects while the programs are still ongoing. The goal of our developmental evaluation was to support implementation, and to engage with the open government community to better understand why public sector innovations succeed or fail.
Implementing Innovation: A User’s Manual for Open Government Programs
impementing, innovation, user manual, developmental evaluation, public sector, best practices
A hands-on resource with practical advice for government changemakers as they navigate the challenges of implementing programs in the public sector.
Build government support and aligne with legal and regulatory frameworks, etc. from the beginning. 9-12 months for desining, piloting, and implementing a new innovation.
practitioners, agriculture, video, education, sustainable, random controlled trials
Digital Green is a not-for-profit international development organization that uses an innovative digital platform for community engagement to improve lives of rural communities across South Asia and Sub-Saharan Africa.
Inspirational example of how design, interation, and evaluation can lead to impact.
evaluation, technology, povery, suitability, scalability, sustainability, d-lab, case studies
The Comprehensive Initiative on Technology Evaluation (CITE) is the first-ever program dedicated to developing methods for product evaluation in global development. CITE is led by an interdisciplinary team at the Massachusetts Institute of Technology (MIT), and draws upon diverse expertise to evaluate products using a 3-S methodology.
|Design That Matters|
practitioners, poverty, product design
A product design company setting the standard for best practice in design for poor communities in the developing world. We are pushing the limits of technology in rapid prototyping and low-volume manufacturing to bring great design to communities currently missed by commercial markets. Our goal is to deliver a better quality of service, and a better quality of life, to millions of beneficiaries through products designed for our partner social enterprises.
Going where the market are, there is actually money to support for-profit, good quality design.
foundation, poverty, metrics, social impact
As a non-profit, we raise charitable donations that allow us to make patient long-term debt or equity investments in early-stage companies providing reliable and affordable access to agricultural inputs, quality education, clean energy, healthcare services, formal housing, and safe drinking water to low-income customers.
W.K. Kellogg Foundation Evaluation Handbook
non-profit, evaluation, framework, programs, logic model, communications plan
A handbook that provides a framework for thinking about evaluation as a relevant and useful program tool. It was written primarily for project directors who have direct responsibility for the ongoing evaluation.
|The Campbell Collaboration|
evidence, review, methods, policy, international development
The Campbell Collaboration promotes positive social and economic change through the production and use of systematic reviews and other evidence synthesis for evidence-based policy and practice.
consulting, strategy, evaluation
FSG is a mission-driven consulting firm for leaders in search of large-scale, lasting social change. Through our combination of customized consulting services, powerful ideas, and learning communities, we help foundations, businesses, nonprofits, and governments around the world accelerate progress.
Prioritize, Capitalize, Right Size and More: 5 Insights from the Skoll Foundation on Monitoring and Evaluation
foundation, program, evaluation
What matters for Ehren Reed, the Skoll Foundation’s Director of Evaluation, when he is looking at the measurements social entrepreneurial organizations use.
impact investing, social entrepreneurship, Jed Emerson
Blended Value: a broader way of thinking about the nature of value creation by organizations (whether for-profit, nonprofit or hybrid) and through the application of capital (whether philanthropic, below-market or market rate).
What do we mean by 'impact'?
impact, evaluation, methods, betterevaluation
International development is fixated with impact. But how do we know we’re all talking about the same thing?
"A variety of things are being labelled as impact." Counterfactual 'impact' looks for the 'causes of an effect' while some in development are looking more broadly at any long-term effect 'effects of a cause.'
|What is impact?|
Simon Hearn, Methods Lab
methods, impact evaluation, simon hearn
|SDGS Report 2016||UN|
sdg, statistics, metrics, sustainability, un
2016 report on status of the SDGs.
sustainable development, knowledge platform, indicators, sdgs, interagency
Information on who at the UN is developing and measuring indicators for the sdgs.
Impact: A Design Perspective
|IDEO.org||impact, design, ideo||reading||Low||2015|
IDEO.org's perspective about how they are creating impact.
Wide persepective, they seem to be capturing all metrics. I'm missing an opportunity to have more of a counterfactual analysis of different design options towards one outcome.
When Will Design Get Serious About Impact?
impact, design, dalberg, capacity-building
"How do we successfully migrate fresh insights and innovative models into sustained strategies that incorporate proven models?...defining a clear path to prototype and test which factors are most critical to impact in practice; and gathering sufficient data to extrapolate the broader significance of our findings"
How Would Farmers Measure the Impact of Financial Solutions?
Dalberg DIG, Learning Lab
human-centred design, impact, research, rural agricultural finance
Thoughtful technique to use HCD interviews to understand what 'impact' meant to actual recipients of a project to inform metrics.
|Institute for Fiscal Studies|
impact, policy, microeconomics, NextWork
Our goal at the Institute for Fiscal Studies is to promote effective economic and social policies by better understanding how policies affect individuals, families, businesses and the government's finances.
social change, digital, impact measurement, kieron kirkland
CAST is accelerating the use of technology for social impact, they help organisations use technology to deliver their social mission and get early stage ideas to scale. Kieron Kirkland is working on tools to measure impact.
Using Data for Action and for Impact
data, impact, collection, financial data, non-profits, funders, big data
In the non-profit sector, the data flow for impact data is broken. Shifting mindsets and disruption are opening new opportunities to get better at measuring 'why does it matter' with our social approaches.
Q&A About Drawing Logic Models
logic models, impact assessment, best practices, visualisation
Structure, visualisations, and best practices in making logic models.
"Carol's work showed that logic models don't always have to be in the form input->process->outputs->outcomes->impact. Instead she showed how useful it can be to focus on teasing out the different possible causal paths between program activities and its outcomes."
|Theory of Change||Patricia Rogers|
theory of change, best practice, tips, methodology, unicef, vocabulary
An overview of why and how to make theory of changes and key methodologies and termonologies.
Propensity score matching.
|Theory of Change Examples|
theory of change, non-profits
A collection of more traditional policy and non-profit theory of changes.
Digital Green Theory of Change
digital green, theory of change, agriculture, monitoring and evaluation
Reflections and learnings for improving Digital Green's data collection, organisational culture, and ultimately impact assessment.
Good learnings about scaling up m&e to make it more credible and cost-effective.
Making Sense of Social Impact, Theory of Change
theory of change, acumen, best practices
A step-by-step guide to making a theory of change.
Start by identifying target customer (and then measure to make sure you are hitting them). Identify what needs to be verified through further evidence review.