This document provides guidance on developing analysis and feedback loops for monitoring and evaluation. It outlines a 4-step process: 1) review client map, indicators and tools; 2) map anticipated information flow; 3) document decisions; 4) review plan against resources. Feedback loops should meet client needs within project capabilities. A case example demonstrates reflection cycles, knowledge management schedules, and data flow management. Common pitfalls include designs that are unmanageable or lose focus on serving multiple clients' needs. Continuing education options are provided.
4. GETTING
STARTED
Stay within limits of
project resources and
capabilities! Only use
feedback loops that
meet the needs of M&E
clients!
3
May 22, 2012
5. MATERIALS / INPUTS
RECOMMENDED
Market Engagement Indicator Information
Sheet
M&E systems from other CARE projects or
programs
Information on any donor requirements on
feedback loops (reporting frequency, content
required, etc.)
4
May 22, 2012
6. STEP-BY-STEP GUIDE
• Review your M&E CLIENT Map, Resources &
Capabilities, Indicators and Tools
1
• Map the Anticipated Flow of Information: Point of
Collection Point of Analysis M&E Client(s)
2
• Document Your Decisions
3
• Review your Plan against your Resources and
Capacity Table
4
5
May 22, 2012
7. STEP-BY-STEP GUIDE:
STEP 1
Take a moment to:
•Review your M&E client map and
the decisions you have made about
indicators and tools
•Re-review your assessment of the
resources and capabilities of the
project
6
May 22, 2012
8. STEP-BY-STEP GUIDE
• Review your M&E CLIENT Map, Resources &
Capabilities, Indicators and Tools
1
• Map the Anticipated Flow of Information:
Point of Collection Point of Analysis
2 M&E Client(s)
• Document Your Decisions
3
• Review your Plan against your Resources and
Capacity Table
4
7
May 22, 2012
9. STEP-BY-STEP GUIDE:
STEP 2
Consider Information Flow from both Types of
Routine Measurement
Indicators Routine Observation
•Consider how to make the •Almost always intended to
gathered data useful for as serve field staff and project
many people as possible managers first
•Data flows upward from •Ensures the project is able to
participants through field staff quickly understand, reflect and
and a series of other internal act on the direct experiences
clients before reaching the and perceptions of field staff
donor and managers
•Feedback from the donor may •‘Paths’ for this information will
or may not be strong, but is be very short feedback loops
progressively diluted •Findings from these collections
can be quickly analyzed and
8 channeled to key M&E clients
May 22, 2012
10. STEP-BY-STEP GUIDE:
STEP 2
Donor
Example of a Common Donor-
HQ / focused M&E System Feedback
Senior CO
Staff
Loop
Project
Key Manager
-Data flow
-Feedback loop
Field
Line width illustrates Coordinator
strength of data flow
Participant
Field Links to other local
Firm
Staff stakeholders
9
May 22, 2012
Participant
HH
11. STEP-BY-STEP GUIDE:
STEP 2Donor
Example of an Ideal M&E
HQ / Senior System with Feedback
CO Staff
Loops
Project
Key
Manager
-Data flow
-Feedback loop
Field
Line width illustrates
strength of data flow Coordinator
Participant
Firm Field Links to other local
Staff stakeholders
10
Participan
May 22, 2012
t
HH
12. STEP-BY-STEP GUIDE:
STEP Loop Participatory Exercise
Feedback 2
• Convene a meeting of CARE program staff and
implementing partners
• Build a diagram on the wall using different colors
of note cards and different colors of string
• Facilitate a discussion regarding placement of
cards and strings and whether this will meet M&E
goals
• Document outputs of the meeting.
11
May 22, 2012
13. STEP-BY-STEP GUIDE
• Review your M&E CLIENT Map, Resources &
Capabilities, Indicators and Tools
1
• Map the Anticipated Flow of Information: Point of
Collection Point of Analysis M&E Client(s)
2
• Document Your Decisions
3
• Review your Plan against your Resources and
Capacity Table
4
12
May 22, 2012
14. STEP-BY-STEP GUIDE:
STEP 3
•Fill in the final columns in the M&E Indicator
Information Sheet:
Data Collection Frequency
Data Analysis and Feedback Loop Description
Data Collection Responsibility
•Develop a narrative description of the data collection
frequencies, alignment with priority M&E client
needs, feedback loop structure and rationale and
data collection responsibilities.
13
May 22, 2012
15. STEP-BY-STEP GUIDE
• Review your M&E CLIENT Map, Resources &
Capabilities, Indicators and Tools
1
• Map the Anticipated Flow of Information: Point of
Collection Point of Analysis M&E Client(s)
2
• Document Your Decisions
3
• Review your Plan against your Resources
and Capacity Table
4
14
May 22, 2012
16. STEP-BY-STEP GUIDE:
STEP 4
Again, review decisions against
project resources and capacities!
15
May 22, 2012
17. CASE EXAMPLE
SDVC
• Tasks, frequency and output in a regular
reflection cycle
• Schedule of knowledge
management
16
May 22, 2012
18. CASE EXAMPLE
SDVC M&E Staff’s Role Distribution
Technical Posted at Rangpur
Coordinator- Lead in Design
M&E
Implement M&E tasks at Rangpur
Reporting and Information sharing
Directly Supervise TO-M&E and
Indirectly M&ESO
Represent M&E Unit internally and
externally.
Technical Posted at Bogra
Officer-M&E
Assist TC-M&E in design
Ensure Data entry & data
management
M&E Support
Officer Implement M&E tasks at Bogra
Assist TC-M&E in reporting
17
May 22, 2012
Data backup and filing
19. CASE EXAMPLE
SCHEMATIC DIAGRAM OF SDVC DATA FLOW
MANAGEMENT Field level
Project Participants
Team level
Field Facilitators
Project Officers (Team leaders)
Region
M&E Support Technical Officer- &National
Officer M&E level
CARE-B Technical Coordinator-M&E SDVC Staffs GOB/Private
sectors/INGO
International
level
CARE-USA DONOR Other International
Audiences
18
May 22, 2012
20. COMMON
PITFALLS
Designing a system that is unmanageable. It is important to balance
interests with resources and focus on the priority feedback loops. This is why
it is important to review the resources and capacity sheet as the conclusion of
this step.
Losing focus on the multiple clients you are trying to serve. As many
M&E systems focus largely on meeting donor expectations, it is easy to
narrow down your feedback loops to focus on that particular client at the
expense of all others. Be sure that the feedback loops you design will be
sufficient to meet the needs of multiple M&E clients. If this seems impossible,
you may need to engage the donor in additional discussions about how the
M&E system will be structured.
19
May 22, 2012
22. Want to Learn More?
Multiple ways to continue the discussion
and continue learning:
• Initiate a monthly session on the M&E guide and
case studies from across CARE. Contact
cpennotti@care.org
• Join the Market Engagement Community of
Practice on LinkedIn.
• Join a task force to review and refine the universal
21
indicators. Contact nardi@careinternational.org
May 22, 2012
Hinweis der Redaktion
Dive into detail on these rules on page 63.
Some avenues for creating short feedback loops include: -Weekly or monthly status meetings for staff at different levels within the team;-The establishment of specialized task forces responsible for sharing observations, analyzing what these mean for the project and communicating this back to the team; -Quarterly presentations and project reviews by key staff and clients; -Weekly or routine team texts or email exchanges about particular indicators