1 of 17

MONITORIMI DHE VLERËSIMI PËR POLITIKAT E SHTETIT TË SË DREJTËS

Webinar 2

Krijimi i një Sistemi MEL

2 of 17

Setting up a Policy Monitoring and Evaluation System (P-MEL)

  • Policy Monitoring, Evaluation and Learning System (MPI) is an important policy management instrument, applied to improve the efficacy of policies in reaching their objectives.
  • The specific features of a P-MEL system depend on several factors
    • capacities to implement and provide information, data and analyses
    • costs and funding
    • the time frame for impacts to materialize (short-term vs. long term)
    • the designing choice on monitoring or evaluation indicators (quantitative, qualitative)
    • the issue of multiple outcomes
    • relevance to policymakers.

3 of 17

4 of 17

Setting up a Policy Monitoring and Evaluation System

5 of 17

Policy Review and analyses – Theory of Change (ToC)

  • The theory of change (ToC) provides the blueprint or pathway by mapping out long-term goals and linking them to preconditions, specifying the causal link between changes and preconditions
    • A theory of change can help navigate the connection between the policy engagement process and the results.
  • Causal chain model the theory of change is based on a set of logical or causal connections; usually a set of inputs, activities, outputs, outcomes and impact.
  • Dimensions of influence is based on a set of outcomes presumed to be important to enabling policy influence;
  • Actor-centered theory of change is focused on the change in behaviour of different actors. This approach provides a clear focus for M&E activities. One familiar framework that works in this way is Outcome Mapping.

6 of 17

Policy Review and analyses – Theory of Change (ToC)

  • Theories of change can be expressed in many forms but ultimately should explain how you get from “here” to “there.”1 ;
  • Theory of change is both a process and a product (Vogel 2012). At its simplest, the theory of change is a ‘description of a sequence of events that is expected to lead to a particular desired outcome.
  • Theory of change starts from a baseline analysis of the context and issues and maps out the logical sequence of changes that are expected to result from a policy or reform agenda
  • Theory of change is most effective when it is used throughout the policy cycle;
  • The theory of change framework is very helpful to guide stakeholder engagement and communication;

7 of 17

Logic Model, Evaluation Approach and methodology

  • ToC summarises work at the strategic level defining causality, the Logic Model unpacks the implementation paradigm of the ToC by defining interventions.
  • ToC provides a roadmap or a blue print of achieving an outcome, the Logic Model provides intervention inputs and activities, the outputs they will produce, and the connections between these outputs and the desired outcomes.
  • Evaluation Approach and Mixed Method
    •  Comprehensive Evaluation
    •  Formative Evaluation
    •  Process Evaluation
    •  Outcome Evaluation/ Impact Evaluation
  • Finalizing the Evaluation Question and Enquiry area based on the ToC, Log frame and evaluation approach

8 of 17

Setting up a Policy Monitoring and Evaluation System (P-MEL) – Log Frame

  • The Log Frame method is an instrument employed by analysts, planners and managers for: problem analysis, objective formulation, planning, implementation and monitoring and evaluation
  • The LogFrame approach comprises three major phases, i.e. problem and context analysis, objective analysis, and the planning phase
  • Problem and context analysis
    •  Identification and analysis of stakeholders.
    •  Identification and analysis of the existing negative situation, i.e. the problem/s, their causes (problem hierarchy, problem tree) and their inter- relationships.
  • Objective analysis
    •  Development of a future positive situation by reformulating problems into corresponding objectives (objective hierarchy, objective tree);
    •  Review, assessment and further amendment of the objective tree.
  • Planning
    •  Strategy analysis and choice.
    •  Identification of specific measures / activities to be carried out in pursuance
    • of each selected objective.
    •  Detailed scheduling and planning of identified measures / activities.
    •  Documentary summary in form of a Planning Matrix.

9 of 17

10 of 17

Setting up a Policy Monitoring and Evaluation System (P-MEL) – Indicators of Monitoring and Evaluation

11 of 17

Budget Support Evaluation Approach - Relevance

12 of 17

Efficiency

13 of 17

Intervention, Monitoring and Learning

14 of 17

Effectiveness

15 of 17

Sustainability

16 of 17

Cross cutting and communication

17 of 17

FALEMINDERIT PËR VËMENDJEN!

Këto webinare janë pjesë përbëse e Moduleve të Integrurara për MEL të Politikave të Shtetit të së Drejtës, përgatitur nga Lëvizja Europiane në Shqipëri në kuadër të projektit “Ndërtimi i Partneritetit mbi Çështjet Themelore: Fuqizimi i OSHC-ve për procesin e anëtarësimit në BE” financuar nga Bashkimi Evropian.