SlideShare ist ein Scribd-Unternehmen logo
1 von 26
Making M&E Accessible to Grassroots Organizations Webinar presented to GlobalGiving grantees DRAFT 17 May 2011 Jennifer Lentfer of  www.how-matters.org
Acknowledgements  & Thanks Child-focused groups in Lesotho in an M&E training developed specifically for community-based organizations by Insideout/Otherwise. Supported by Firelight Foundation.  Photo credit: J. Lentfer
Webinar Overview ,[object Object],[object Object],[object Object],[object Object],[object Object]
Expected Outcomes  of Webinar ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
M&E? RESULTS? FEAR Policing SCRUTINY PRESSURE! End of Funding? Confusion DISTRUST BURDEN
Monitoring & Evaluation: The International Development Paradigm Objectives Statements Performance Indicator Statements Measurement Methods / Data Sources Goal Strategic Objectives Intermediate Results Outputs Activities Critical Assumptions
TRUE OR FALSE? 1. A key purpose of M&E is to help organizations assess achievements.  5. The results of grassroots organizations’ work is easy to measure. 3. M&E activities will automatically lead to improved programming.  7. “Knowing” is most accurate when you experience something firsthand.  9. The human dimensions of community work are more important than the numbers. EXERCISE
Jennifer’s  Guiding Principles in M&E ,[object Object],[object Object],[object Object],[object Object]
Jennifer’s  Guiding Principles in M&E ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
M&E: What’s the Difference? Monitoring Evaluation Ongoing process Event that occurs periodically Recordkeeping/Tracking Activities Analyzing results Observing trends Assessing impact Mainly descriptive, recording inputs, outputs, and activities (e.g. How many children received supplementary school feeding?)  More analytical and examines processes  (e,g. Did implementing school feeding successfully increase attendance levels?) Allows us to make adjustments or corrective actions in a project  Informs future programming for all stakeholders  Data collection is part of day-to-day management & activities Additional, special data may be collected using research methodologies Is objective and systematic Is objective and systematic
M&E: What’s the Difference? EXERCISE We monitor… We evaluate… 1. A child’s height and weight. 1. Whether children are growing at a normal rate. 2. The number of weekly visits to chronically ill people. 2. The effectiveness of home-based care. 3. The number of families planting improved crop varieties. 3. An increase/ decrease in food security. 4.  The number of people trained in human rights. 4.  Whether reports of human rights abuses have increased or decreased and why.
Choosing M&E Methods Cost Complexity Existing records  (e.g.  household lists) Routine statistics Focus groups Specific sample surveys Key informant interviews Observation Special or ’point’ studies Keep expectations realistic.
Making M&E Accessible De-technicalize language. ROADMAP  TO  MONITORING What are we trying to change?  Where do we want to get to?  How are we going to get there?  What do we expect to happen along the way?  OUTPUT OUTCOME IMPACT How do we know we are on the right road? problem analysis goals, objectives strategy, activities RESULTS indicators, baseline, targets
Making M&E Accessible OUTPUT OUTCOME IMPACT ACTIVITIES Have the activities taken place? The very first result of an activity. Organizations have direct control over this result. What happened next? Change of behavior in participants. Organizations have less control over this result. So what? Change at population/ societal level. Organizations have very little control, if any. RESULTS
Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Healthier children Children receive more nutritious food School feeding Children weight and height increased ?
Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS HIV+ people visited in their homes Home-based care for HIV+ people HIV+ people live longer HIV+ people have increased BMI and ART adherence ?
Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Farmers oriented on improved crop varieties More farmers harvesting improved varieties Extension services offered to farmers Increased food security ?
Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Community members trained in human rights Human rights training Human rights more widely upheld Increased reporting of human rights violations ?
Determining Results EXERCISE
Data Collection Tips ,[object Object],[object Object],[object Object],[object Object],[object Object],If you collect, use and analyze information appropriately, you will be documenting the eyes and voices of the community about how your programs affect their lives.
Making M&E Accessible ,[object Object],[object Object],[object Object],[object Object],Simple Steps in Data Analysis Staff of child-focused organizations in Lesotho engaged in data compilation during in M&E training developed by Insideout/Otherwise  and supported by Firelight Foundation.  Photo credit: J. Lentfer
Challenges? What is your organization facing?  What do you anticipate? Staff of child-focused organizations in Zambia engaged in practical exercises during M&E training developed specifically for community-based organizations by Insideout/Otherwise. Supported by Firelight Foundation. Photo credit: J. Lentfer
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges:  Reality Check “ Absence of computers to process data and store the information so it can be easily accessed.” “ We now need to be able to cross the river more frequently.”
What to focus on  going forward ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Remember: G reat work does not equal great M&E. Poor M&E does not equal poor work. Good luck in your M&E efforts! THANK YOU

Weitere ähnliche Inhalte

Was ist angesagt?

Hands on webinar
Hands on webinarHands on webinar
Hands on webinarBeth Kanter
 
Audience engagement in the new digital. Audience first conference, 16 July 2014
Audience engagement in the new digital. Audience first conference, 16 July 2014Audience engagement in the new digital. Audience first conference, 16 July 2014
Audience engagement in the new digital. Audience first conference, 16 July 2014CharityComms
 
Social Media To Promote Employee Wellness
Social Media To Promote Employee WellnessSocial Media To Promote Employee Wellness
Social Media To Promote Employee Wellnesssgreentcu
 
The Data Informed Nonprofit: SalesForce Foundation Webinar
The Data Informed Nonprofit:  SalesForce Foundation WebinarThe Data Informed Nonprofit:  SalesForce Foundation Webinar
The Data Informed Nonprofit: SalesForce Foundation WebinarBeth Kanter
 
Avoid these 10 mistakes in your internal communications strategy
Avoid these 10 mistakes in your internal communications strategyAvoid these 10 mistakes in your internal communications strategy
Avoid these 10 mistakes in your internal communications strategyVing
 
Building A Content News Engine AAMC, #GIA17 Ron Petrovich
Building A Content News Engine AAMC, #GIA17 Ron Petrovich   Building A Content News Engine AAMC, #GIA17 Ron Petrovich
Building A Content News Engine AAMC, #GIA17 Ron Petrovich Mayo Clinic
 
Results-Based Accountability Professional Certification Information Session
Results-Based Accountability Professional Certification Information SessionResults-Based Accountability Professional Certification Information Session
Results-Based Accountability Professional Certification Information SessionClear Impact
 
Social Marketing and Youth through a Community Collaborative Project
Social Marketing and Youth through a Community Collaborative ProjectSocial Marketing and Youth through a Community Collaborative Project
Social Marketing and Youth through a Community Collaborative ProjectYTH
 
Social Media and Hospital Reputation
Social Media and Hospital ReputationSocial Media and Hospital Reputation
Social Media and Hospital ReputationLee Aase
 
Achieving Equitable Outcomes with Results-Based Accountability
Achieving Equitable Outcomes with Results-Based Accountability Achieving Equitable Outcomes with Results-Based Accountability
Achieving Equitable Outcomes with Results-Based Accountability Clear Impact
 
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...VolunteerMatch
 
How Social Media is Changing Healthcare
How Social Media is Changing HealthcareHow Social Media is Changing Healthcare
How Social Media is Changing HealthcareLee Aase
 
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...Lisa Gualtieri
 
Social Media in Health Care - Engagement
Social Media in Health Care - EngagementSocial Media in Health Care - Engagement
Social Media in Health Care - EngagementKent State University
 
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15CSV_UK
 

Was ist angesagt? (20)

Hands on webinar
Hands on webinarHands on webinar
Hands on webinar
 
Alignment slides
Alignment slidesAlignment slides
Alignment slides
 
Compyle webinar
Compyle webinarCompyle webinar
Compyle webinar
 
Audience engagement in the new digital. Audience first conference, 16 July 2014
Audience engagement in the new digital. Audience first conference, 16 July 2014Audience engagement in the new digital. Audience first conference, 16 July 2014
Audience engagement in the new digital. Audience first conference, 16 July 2014
 
Social Media To Promote Employee Wellness
Social Media To Promote Employee WellnessSocial Media To Promote Employee Wellness
Social Media To Promote Employee Wellness
 
The Data Informed Nonprofit: SalesForce Foundation Webinar
The Data Informed Nonprofit:  SalesForce Foundation WebinarThe Data Informed Nonprofit:  SalesForce Foundation Webinar
The Data Informed Nonprofit: SalesForce Foundation Webinar
 
Avoid these 10 mistakes in your internal communications strategy
Avoid these 10 mistakes in your internal communications strategyAvoid these 10 mistakes in your internal communications strategy
Avoid these 10 mistakes in your internal communications strategy
 
Building A Content News Engine AAMC, #GIA17 Ron Petrovich
Building A Content News Engine AAMC, #GIA17 Ron Petrovich   Building A Content News Engine AAMC, #GIA17 Ron Petrovich
Building A Content News Engine AAMC, #GIA17 Ron Petrovich
 
Results-Based Accountability Professional Certification Information Session
Results-Based Accountability Professional Certification Information SessionResults-Based Accountability Professional Certification Information Session
Results-Based Accountability Professional Certification Information Session
 
Social Marketing and Youth through a Community Collaborative Project
Social Marketing and Youth through a Community Collaborative ProjectSocial Marketing and Youth through a Community Collaborative Project
Social Marketing and Youth through a Community Collaborative Project
 
Social Media and Hospital Reputation
Social Media and Hospital ReputationSocial Media and Hospital Reputation
Social Media and Hospital Reputation
 
PRC/MI Reverse Site Visit
PRC/MI Reverse Site VisitPRC/MI Reverse Site Visit
PRC/MI Reverse Site Visit
 
Achieving Equitable Outcomes with Results-Based Accountability
Achieving Equitable Outcomes with Results-Based Accountability Achieving Equitable Outcomes with Results-Based Accountability
Achieving Equitable Outcomes with Results-Based Accountability
 
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...
Integrating Virtual Opportunities and Remote Volunteers into your Volunteer P...
 
How Social Media is Changing Healthcare
How Social Media is Changing HealthcareHow Social Media is Changing Healthcare
How Social Media is Changing Healthcare
 
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...
Small Screens, Big Changes: Frontiers in Mobile Technology for Nutrition, Hea...
 
Social Media in Health Care - Engagement
Social Media in Health Care - EngagementSocial Media in Health Care - Engagement
Social Media in Health Care - Engagement
 
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15
CSV NNVIA Measuring Impact of Volunteering event - Iona Joy - 27.03.15
 
PPMA Seminar 2016 - Designing public services for the digital age
PPMA Seminar 2016 - Designing public services for the digital agePPMA Seminar 2016 - Designing public services for the digital age
PPMA Seminar 2016 - Designing public services for the digital age
 
CKX: Social Impact Measurement Around the Globe
CKX: Social Impact Measurement Around the Globe CKX: Social Impact Measurement Around the Globe
CKX: Social Impact Measurement Around the Globe
 

Andere mochten auch

Monitoring and Evaluation: A Primer
Monitoring and Evaluation: A PrimerMonitoring and Evaluation: A Primer
Monitoring and Evaluation: A PrimerJennifer Lentfer
 
19 ways to prevent your nonprofit’s demise
19 ways to prevent your nonprofit’s demise19 ways to prevent your nonprofit’s demise
19 ways to prevent your nonprofit’s demiseJennifer Lentfer
 
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...Jennifer Lentfer
 
Santa Cruz International Meet Up Mar 10
Santa Cruz International Meet Up Mar 10Santa Cruz International Meet Up Mar 10
Santa Cruz International Meet Up Mar 10Jennifer Lentfer
 
SEO: Getting Personal
SEO: Getting PersonalSEO: Getting Personal
SEO: Getting PersonalKirsty Hulse
 
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika AldabaLightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldabaux singapore
 

Andere mochten auch (9)

Monitoring and Evaluation: A Primer
Monitoring and Evaluation: A PrimerMonitoring and Evaluation: A Primer
Monitoring and Evaluation: A Primer
 
19 ways to prevent your nonprofit’s demise
19 ways to prevent your nonprofit’s demise19 ways to prevent your nonprofit’s demise
19 ways to prevent your nonprofit’s demise
 
Our truejob
Our truejobOur truejob
Our truejob
 
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...
Values and Evidence—Not at Odds: Seeking a Healthier Relationship With Result...
 
Santa Cruz International Meet Up Mar 10
Santa Cruz International Meet Up Mar 10Santa Cruz International Meet Up Mar 10
Santa Cruz International Meet Up Mar 10
 
Storytelling and M&E
Storytelling and M&EStorytelling and M&E
Storytelling and M&E
 
SEO: Getting Personal
SEO: Getting PersonalSEO: Getting Personal
SEO: Getting Personal
 
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika AldabaLightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
 
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job? Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
 

Ähnlich wie M&E for GlobalGiving grantees

Best Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMBest Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMGreenlights
 
Mentor our kids 050514-v1 bak
Mentor our kids 050514-v1 bakMentor our kids 050514-v1 bak
Mentor our kids 050514-v1 bakJerry Cahn
 
Performance Management for Nonprofits: Simplifying and Maximizing Organizati...
Performance Management for Nonprofits:  Simplifying and Maximizing Organizati...Performance Management for Nonprofits:  Simplifying and Maximizing Organizati...
Performance Management for Nonprofits: Simplifying and Maximizing Organizati...Community IT Innovators
 
Make Your Data Work for You
Make Your Data Work for YouMake Your Data Work for You
Make Your Data Work for YouVia Evaluation
 
Evaluation and Assessment for Busy Professionals
Evaluation and Assessment for Busy ProfessionalsEvaluation and Assessment for Busy Professionals
Evaluation and Assessment for Busy ProfessionalsSara Rothschild
 
New Thinking On How To Measure Nonprofit Effectiveness
New Thinking On How To Measure Nonprofit EffectivenessNew Thinking On How To Measure Nonprofit Effectiveness
New Thinking On How To Measure Nonprofit EffectivenessIsaac Castillo
 
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Barbara O'Neill
 
Leadership Learning Community
Leadership Learning CommunityLeadership Learning Community
Leadership Learning CommunityBeth Kanter
 
Decision Making Techniques for Not for Profits
Decision Making Techniques for Not for ProfitsDecision Making Techniques for Not for Profits
Decision Making Techniques for Not for ProfitsKent McDonald
 
Results Based Accountability for Food Sector
Results Based Accountability for Food SectorResults Based Accountability for Food Sector
Results Based Accountability for Food SectorLauren-Glenn Davitian
 
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...Measuring Mission Value of Digital Communications in the Public Sector and 9 ...
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...Scott Burns
 
Measuring and Capturing Value of Government Communication
Measuring and Capturing Value of Government CommunicationMeasuring and Capturing Value of Government Communication
Measuring and Capturing Value of Government CommunicationGovLoop
 
Tsipporah Top of FormResults of the EvaluationThe results of.docx
Tsipporah Top of FormResults of the EvaluationThe results of.docxTsipporah Top of FormResults of the EvaluationThe results of.docx
Tsipporah Top of FormResults of the EvaluationThe results of.docxwillcoxjanay
 
Kansas City Keynote Deck
Kansas City Keynote DeckKansas City Keynote Deck
Kansas City Keynote DeckBeth Kanter
 
Measure Your Organization’s Impact with Performance Management with Josie All...
Measure Your Organization’s Impact with Performance Management with Josie All...Measure Your Organization’s Impact with Performance Management with Josie All...
Measure Your Organization’s Impact with Performance Management with Josie All...Blackbaud Pacific
 
I'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullI'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullYTH
 
Determing & Demonstrating Value with the Logic Model
Determing & Demonstrating Value with the Logic ModelDeterming & Demonstrating Value with the Logic Model
Determing & Demonstrating Value with the Logic ModelRebecca Jones
 

Ähnlich wie M&E for GlobalGiving grantees (20)

Mekong ict camp
Mekong ict campMekong ict camp
Mekong ict camp
 
Best Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNMBest Practices in Nonprofit Impact Measurement , CNM
Best Practices in Nonprofit Impact Measurement , CNM
 
Mentor our kids 050514-v1 bak
Mentor our kids 050514-v1 bakMentor our kids 050514-v1 bak
Mentor our kids 050514-v1 bak
 
UWSEM MBAI Training Curriculum
UWSEM MBAI Training CurriculumUWSEM MBAI Training Curriculum
UWSEM MBAI Training Curriculum
 
Performance Management for Nonprofits: Simplifying and Maximizing Organizati...
Performance Management for Nonprofits:  Simplifying and Maximizing Organizati...Performance Management for Nonprofits:  Simplifying and Maximizing Organizati...
Performance Management for Nonprofits: Simplifying and Maximizing Organizati...
 
Make Your Data Work for You
Make Your Data Work for YouMake Your Data Work for You
Make Your Data Work for You
 
Evaluation and Assessment for Busy Professionals
Evaluation and Assessment for Busy ProfessionalsEvaluation and Assessment for Busy Professionals
Evaluation and Assessment for Busy Professionals
 
New Thinking On How To Measure Nonprofit Effectiveness
New Thinking On How To Measure Nonprofit EffectivenessNew Thinking On How To Measure Nonprofit Effectiveness
New Thinking On How To Measure Nonprofit Effectiveness
 
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
 
Methodologies and approaches to evaluation in third sector organisations / Je...
Methodologies and approaches to evaluation in third sector organisations / Je...Methodologies and approaches to evaluation in third sector organisations / Je...
Methodologies and approaches to evaluation in third sector organisations / Je...
 
Leadership Learning Community
Leadership Learning CommunityLeadership Learning Community
Leadership Learning Community
 
Decision Making Techniques for Not for Profits
Decision Making Techniques for Not for ProfitsDecision Making Techniques for Not for Profits
Decision Making Techniques for Not for Profits
 
Results Based Accountability for Food Sector
Results Based Accountability for Food SectorResults Based Accountability for Food Sector
Results Based Accountability for Food Sector
 
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...Measuring Mission Value of Digital Communications in the Public Sector and 9 ...
Measuring Mission Value of Digital Communications in the Public Sector and 9 ...
 
Measuring and Capturing Value of Government Communication
Measuring and Capturing Value of Government CommunicationMeasuring and Capturing Value of Government Communication
Measuring and Capturing Value of Government Communication
 
Tsipporah Top of FormResults of the EvaluationThe results of.docx
Tsipporah Top of FormResults of the EvaluationThe results of.docxTsipporah Top of FormResults of the EvaluationThe results of.docx
Tsipporah Top of FormResults of the EvaluationThe results of.docx
 
Kansas City Keynote Deck
Kansas City Keynote DeckKansas City Keynote Deck
Kansas City Keynote Deck
 
Measure Your Organization’s Impact with Performance Management with Josie All...
Measure Your Organization’s Impact with Performance Management with Josie All...Measure Your Organization’s Impact with Performance Management with Josie All...
Measure Your Organization’s Impact with Performance Management with Josie All...
 
I'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullI'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana Bull
 
Determing & Demonstrating Value with the Logic Model
Determing & Demonstrating Value with the Logic ModelDeterming & Demonstrating Value with the Logic Model
Determing & Demonstrating Value with the Logic Model
 

M&E for GlobalGiving grantees

  • 1. Making M&E Accessible to Grassroots Organizations Webinar presented to GlobalGiving grantees DRAFT 17 May 2011 Jennifer Lentfer of www.how-matters.org
  • 2. Acknowledgements & Thanks Child-focused groups in Lesotho in an M&E training developed specifically for community-based organizations by Insideout/Otherwise. Supported by Firelight Foundation. Photo credit: J. Lentfer
  • 3.
  • 4.
  • 5. M&E? RESULTS? FEAR Policing SCRUTINY PRESSURE! End of Funding? Confusion DISTRUST BURDEN
  • 6. Monitoring & Evaluation: The International Development Paradigm Objectives Statements Performance Indicator Statements Measurement Methods / Data Sources Goal Strategic Objectives Intermediate Results Outputs Activities Critical Assumptions
  • 7. TRUE OR FALSE? 1. A key purpose of M&E is to help organizations assess achievements. 5. The results of grassroots organizations’ work is easy to measure. 3. M&E activities will automatically lead to improved programming. 7. “Knowing” is most accurate when you experience something firsthand. 9. The human dimensions of community work are more important than the numbers. EXERCISE
  • 8.
  • 9.
  • 10. M&E: What’s the Difference? Monitoring Evaluation Ongoing process Event that occurs periodically Recordkeeping/Tracking Activities Analyzing results Observing trends Assessing impact Mainly descriptive, recording inputs, outputs, and activities (e.g. How many children received supplementary school feeding?) More analytical and examines processes (e,g. Did implementing school feeding successfully increase attendance levels?) Allows us to make adjustments or corrective actions in a project Informs future programming for all stakeholders Data collection is part of day-to-day management & activities Additional, special data may be collected using research methodologies Is objective and systematic Is objective and systematic
  • 11. M&E: What’s the Difference? EXERCISE We monitor… We evaluate… 1. A child’s height and weight. 1. Whether children are growing at a normal rate. 2. The number of weekly visits to chronically ill people. 2. The effectiveness of home-based care. 3. The number of families planting improved crop varieties. 3. An increase/ decrease in food security. 4.  The number of people trained in human rights. 4.  Whether reports of human rights abuses have increased or decreased and why.
  • 12. Choosing M&E Methods Cost Complexity Existing records (e.g. household lists) Routine statistics Focus groups Specific sample surveys Key informant interviews Observation Special or ’point’ studies Keep expectations realistic.
  • 13. Making M&E Accessible De-technicalize language. ROADMAP TO MONITORING What are we trying to change? Where do we want to get to? How are we going to get there? What do we expect to happen along the way? OUTPUT OUTCOME IMPACT How do we know we are on the right road? problem analysis goals, objectives strategy, activities RESULTS indicators, baseline, targets
  • 14. Making M&E Accessible OUTPUT OUTCOME IMPACT ACTIVITIES Have the activities taken place? The very first result of an activity. Organizations have direct control over this result. What happened next? Change of behavior in participants. Organizations have less control over this result. So what? Change at population/ societal level. Organizations have very little control, if any. RESULTS
  • 15. Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Healthier children Children receive more nutritious food School feeding Children weight and height increased ?
  • 16. Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS HIV+ people visited in their homes Home-based care for HIV+ people HIV+ people live longer HIV+ people have increased BMI and ART adherence ?
  • 17. Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Farmers oriented on improved crop varieties More farmers harvesting improved varieties Extension services offered to farmers Increased food security ?
  • 18. Results: which is which? OUTPUT Have the activities taken place? OUTCOME What happened next? IMPACT So what? ACTIVITY RESULTS Community members trained in human rights Human rights training Human rights more widely upheld Increased reporting of human rights violations ?
  • 20.
  • 21.
  • 22. Challenges? What is your organization facing? What do you anticipate? Staff of child-focused organizations in Zambia engaged in practical exercises during M&E training developed specifically for community-based organizations by Insideout/Otherwise. Supported by Firelight Foundation. Photo credit: J. Lentfer
  • 23.
  • 24. Challenges: Reality Check “ Absence of computers to process data and store the information so it can be easily accessed.” “ We now need to be able to cross the river more frequently.”
  • 25.
  • 26. Remember: G reat work does not equal great M&E. Poor M&E does not equal poor work. Good luck in your M&E efforts! THANK YOU

Hinweis der Redaktion

  1. Keywords: monitoring, evaluation, M&E, GlobalGiving, Jennifer Lentfer, how-matters.org, international aid, philanthropy, organizational development, grassroots organizations, community-based organizations
  2. to interact with fellow participants focus on sharing experiences and problem-solving
  3. Not just an extraneous tool Most important – INCREASED CONFIDENCE articulate their successes and challenges and to mobilize resources to sustain their programs Help grantees tell their own story - build c onfidence in asking “so what?”
  4. Baggage exists – inaccessibility of M&E paradigm
  5. 13 M&E – research discipline, project-based Example: Would YOU know how to measure % of children age 6-59 months below -2 z score wt/ht?
  6. by supporting organizational development where they are - i.e. having realistic and appropriate expectations depending on the capacity level of a partner Can’t stress the importance of realizing the difference between your donors’ information needs and those of your grantees. Though inexorably linked, strengthening the capacity of grantee-partners to monitor and evaluate their programs is not equivalent to fulfilling Firelight’s information needs about our own theory of change and advocacy. Therefore, the two initiatives will inform each other, but be carried out separately.
  7. Impact - such a loaded & over-used word communities can see ‘impact’ even if it’s difficult to describe…
  8. Monitoring is a process that systematically observes events and activities related to our work. When we monitor, we gather information regularly to check our progress. Evaluation , on the other hand, is the assessment of a program’s relevance, efficiency, effectiveness, and impact on the target population and beneficiaries. We evaluate periodically .
  9. Exercise – read for response A child’s height and weight. Whether children are growing at a normal rate. The effectiveness of home-based care. The number of weekly visits to chronically ill people. An increase/ decrease in food security. The number of families planting improved crop varieties. The number of people trained in human rights. Whether reports of human rights abuses have increased or decreased and why.
  10. This slide shows the trade-offs in cost and complexity among different methods of data collection. Can also think of M&E as regular/routine (part of everyday duties such as beneficiary records) or special/periodic (which require additional time, resources, planning such as household surveys) Consider the level of financial/human resources available. The effort expended should match the improvement in decision-making.
  11. These are abstract concepts - but understandable. Your logic does not equal your partners - other ways of knowing exist that are not empirical Aims to build grantees’ capacity to measure their own progress in a more meaningful way. Training is practical and experiential, to apply principles to organizations’ day-to-day work.
  12. M&E is about testing assumptions - that should be the new definition of building “evidence” Indicators - completely theoretical concept
  13. EXERCISE Healthier children Children receive more nutritious food School feeding Children weight and height increased HIV+ people visited in their homes HIV+ people have increased BMI and ART adherence HIV+ people live longer Home-based care for HIV+ people Farmers oriented on improved crop varieties Extension services offered to farmers Increased food security More farmers harvesting improved varieties Community members trained in human rights Human rights more widely upheld Increased reporting of human rights violations Human rights training
  14. , e.g. who is responsible, when and how often it is needed, how feedback will be shared, etc M&E doesn’t need to be complicated. Use a mix of quantitative (numerical, precise) and qualitative (in-depth, aspects of people’s lives) methods to understand your beneficiaries more fully. This will give us an improved and deeper understandings of how our programs are affecting the lives of the people we serve. 
  15. A ssume nothing – transport (road and water), recordkeeping skills, volunteer staff, basic planning, beneficiary selection, funding insecurity, illiteracy, large catchment areas, financial mgmt the first issue each org different, different capacities/types of programming (e.g. orgs with smaller #s of case work vs. community mobilization) Not surprising considering output-level results are easier to comprehend and directly related to day-to-day activities. Outcomes is the new part.
  16. already overburdened workloads A ssume nothing – transport (road and water), recordkeeping skills, volunteer staff, basic planning, beneficiary selection, funding insecurity, illiteracy, large catchment areas, financial mgmt the first issue
  17. it’s about internalizing the importance of M&E – shifts in organizational culture from emergency/crisis mode to planning & reflection  More important than standardized administrative procedures, M&E activities constitute an informed process of reflection . Ultimately, M&E must be a learning/management tool for an organization. Process of transformation to a learning organization does not happen overnight. What happens within the organization is the most important factor in “institutionalizing” reflective practices.
  18. It’s not about the indicators. It’s about reflection and learning . Sing your own praises!