TDA/SAP Methodology Training Course Module 2 Section 5
Participatory Monitoring and Evlaution
1. 1
Participatory Monitoring and Evaluation
Dann Sklarew, GEF IW:LEARN
LAC Regional Workshop on Public Participation
in
Transboundary Waters Management
Montevideo, Uruguay, 6-9 December 2006
2. 2
Objectives
Define key terms for Monitoring and Evaluation
Participatory M&E
Introduce new GEF expectations for M&E
Consider who should be involved in M&E
Consider Stakeholders’ M&E expectations
Introduce a proposal for increased participation in
M&E for GEF Projects
Vet tools for PM&E
3. 3
Definitions
Indicators – quantitative or qualitative measures of level of attainment towards objectives in
meaningful and practical way. (see references in Chapter 9 of Handbook)
Monitoring – collection of indicator information before (baseline), during (progress) and
through after (impact) project implementation.
Reported annually to GEF
Evaluation – Independent assessment of progress towards achieving outputs and success in
realizing expected results (impacts).
Reported to GEF midway through big projects and at end of all projects.
Participatory Monitoring and Evaluation (PM&E) –ongoing consultation with
stakeholders to determine what should be monitored, incorporates many perspectives into how to do,
interpret and apply learning from M&E.
Might not be reported to GEF, but must be reported to stakeholders to sustain mandate, ownership, transparency
and local benefits from any project or interventions.
Monitoring and Evaluation Plan – strategic plan for collecting and “digesting” data to
derive and measure change in M&E indicators – or even PM&E indicators throughout the project
(and beyond). Also include plan for M&E of implementation of Stakeholder Involvement Plan.
So, what are GEF’s Expectations?
AND
WHAT ARE YOUR STAKEHOLDERS’ EXPECTATIONS?
4. 7
New Type of GEF IW M & E Indicator:
Catalytic Impact Indicators
• New requirement to report on catalytic impacts of GEF projects
during Replenishment cycles.
• Need to record and project spin-off catalytic results:
– new conventions, treaties, protocols, legal reforms
– catalysis in IAs: internalized in CAS or by new partnerships
– with IAs & multilateral & bilateral organizations
– results from GEF IW learning activities
5. 8
•In order to utilize the framework as a tracking tool for
Replenishment results/targets, an Annual Scorecard for each
project will submitted. Part A: annual results (last 12 months) and
Part B: cumulative results (since beginning of project).
•For all projects, agencies would also annually report on
implementation progress (% of scheduled disbursement;
delivery of outputs in line with original schedule; co-financing
on schedule) to contribute to a portfolio characterization.
•Two tracking tools will be maintained for results reporting for
Replenishment purposes by the IW Task Force: a Coverage
Indicator Tracking Tool, and a Results Indicator Tracking Tool
(with annual and cumulative tables – see attached example).
6. 9
GEF IW Scorecard Template—GEF IW Scorecard Template—
Annual Report of ResultsAnnual Report of Results
to Contribute to the Tracking Toolsto Contribute to the Tracking Tools
Part A: Annual Results Report
quantitative; or 0-1 / 0-3 rating
I. Process Indicators:
______: _____; ______;
II. Stress Reduction Indicators:
______; ______; ______;
III. Catalytic Impact Indicators:
______; _____: ______:
IV. Implementation progress:
outputs; % disbursement; co-fin.
Part B: Cumulative Results Report
Roll ups of progress toward the different types of
indicators listed in Part A / logframe on a
cumulative basis for the life of the project.
I. _____; ______; ______;
II. _____; ______; _____;
III. _____; ______; _____;
IV. _____; ______; _____;
Subcommittee formed to develop the
Template for the Scorecard
7. 10
Participatory M&E
Who should be involved?
What do they want to monitor and evaluate?
When to involve them in M&E planning and
implementation, practically speaking?
What tools should be used? (see p. 152 / pgna. __)
9. 12
M&E Plan for Participation
What are appropriate indicators for good
participation?
How to evaluate “unacceptable” levels of
indicators…? E.g.,
gender min. vs. gender balance
disparity across partner nations in capacity or
intent to monitor participation
Final comments?