SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Distinguished Evaluator SeriesBuilding Evaluation Capacity June 14, 2011
An Invitation  to tell it  Like it is
Evaluation HOOP? HELP? NOT-FOR PROFIT
In what ways is evaluation a hoop  to jump through for not-for-profits?
In what ways is evaluation a help for not-for-profits?
How did HFGC evaluation get from 1998 to 2011?
We had some lofty evaluation thoughts Funder and  NFP  on the same page Increase Sustainability Data Driven Decision Making Empowering
How Do For-Profits and Not-For-Profits Differ? For-Profits Not-For-Profits Care  Center Cost  Center Care Center Cost Center
How are Research and Evaluation Designs  Different? Basic Research Applied Research Evidence Based -Practice Evaluation
Who should do the evaluating? External Evaluator Internal Evaluator (build internal capabilities)
Lots of Reading  on Evaluation State-of the Art
Learned from Grantees
KaZammmm
Logic Model Process Evaluations (What you do) Formative Stuff Outcome Evaluations (What happens because you do it) Summative Stuff
Logic Model (Logical Framework) Activities and Outcomes Approach  Project theory Story Approach Story of why and how the project works Demonstrates connections between program science, the program operations, and expected outcomes
What We Sort of Knew and Where We Didn’t Know Much Problem Intervention Outcomes
Problem Intervention Goal Objectives ,[object Object]
Implementation
SustainabilityOutcomes
Created a mutually agreeable evaluation plan HFGC created the boxes (evaluation forms)  Grantees filled boxes in a way that worked for them HFGC shared the wisdom learned over time from successful and unsuccessful projects  Evaluation plan part of mutual expectations in contract
Evaluation Use Grantees asked to review plan quarterly Make changes if needed Review next quarter Get assistance from Program Officer if needed HFGC  learned that groups of similar grantees helped one another established grantee groups  Grantees provided input and plan simplified
We Learned that  to truly be useful  that grantmaking was more than $$$ Workshops Evaluation Communications Business Plan Many others Policy and advocacy work Individual and Group consultation Technical Assistance
We evaluated our approaches to evaluation Grantee Perception Study Sustainability Study Workshop Evaluations

Weitere ähnliche Inhalte

Was ist angesagt?

Embedding BCE: Project summary
Embedding BCE: Project summaryEmbedding BCE: Project summary
Embedding BCE: Project summary
BCE A&E
 
Relationship Mangement: Challenges, Processes & Pitfalls
Relationship Mangement: Challenges, Processes & PitfallsRelationship Mangement: Challenges, Processes & Pitfalls
Relationship Mangement: Challenges, Processes & Pitfalls
BCE A&E
 
Project Management Workshop Overview
Project Management Workshop OverviewProject Management Workshop Overview
Project Management Workshop Overview
sundong
 

Was ist angesagt? (15)

Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes
Jisc Advance BCE Evidencing Outcomes Benefits & OutcomesJisc Advance BCE Evidencing Outcomes Benefits & Outcomes
Jisc Advance BCE Evidencing Outcomes Benefits & Outcomes
 
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
Introduction to Evaluation Consulting - Jennifer Bisgard, Khulisa Management ...
 
Embedding BCE: Project summary
Embedding BCE: Project summaryEmbedding BCE: Project summary
Embedding BCE: Project summary
 
MSc Thesis Presentation
MSc Thesis PresentationMSc Thesis Presentation
MSc Thesis Presentation
 
Relationship Mangement: Challenges, Processes & Pitfalls
Relationship Mangement: Challenges, Processes & PitfallsRelationship Mangement: Challenges, Processes & Pitfalls
Relationship Mangement: Challenges, Processes & Pitfalls
 
Principles of Economics - Outputs vs. Outcomes
Principles of Economics - Outputs vs. OutcomesPrinciples of Economics - Outputs vs. Outcomes
Principles of Economics - Outputs vs. Outcomes
 
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
Positive Youth Development (PYD) Framework toolkit application modules - Dr B...
 
Project Management Overview
Project Management OverviewProject Management Overview
Project Management Overview
 
Project Management Workshop Overview
Project Management Workshop OverviewProject Management Workshop Overview
Project Management Workshop Overview
 
Project Management Overview
Project Management OverviewProject Management Overview
Project Management Overview
 
Unit 5 discussion directionspost your initial response to the
Unit 5 discussion directionspost your initial response to the Unit 5 discussion directionspost your initial response to the
Unit 5 discussion directionspost your initial response to the
 
1 proposal writing 3-3
1 proposal writing 3-31 proposal writing 3-3
1 proposal writing 3-3
 
Capabilities
CapabilitiesCapabilities
Capabilities
 
Uma devi discuss the purpose of the capability maturity model.c
Uma devi discuss the purpose of the capability maturity model.cUma devi discuss the purpose of the capability maturity model.c
Uma devi discuss the purpose of the capability maturity model.c
 
Leader In Understanding
Leader In UnderstandingLeader In Understanding
Leader In Understanding
 

Andere mochten auch

The growthofideasbornfromplatforms3
The growthofideasbornfromplatforms3The growthofideasbornfromplatforms3
The growthofideasbornfromplatforms3
dpward82
 
dianamerlisafajardo 81tolerancia
dianamerlisafajardo 81toleranciadianamerlisafajardo 81tolerancia
dianamerlisafajardo 81tolerancia
dianamelisafajardo
 

Andere mochten auch (16)

UNIT4 Nationaal Uitgeverscongres 2011
UNIT4 Nationaal Uitgeverscongres 2011UNIT4 Nationaal Uitgeverscongres 2011
UNIT4 Nationaal Uitgeverscongres 2011
 
EAUC 2014 presentation on energy visualisation
EAUC 2014 presentation on energy visualisationEAUC 2014 presentation on energy visualisation
EAUC 2014 presentation on energy visualisation
 
The growthofideasbornfromplatforms3
The growthofideasbornfromplatforms3The growthofideasbornfromplatforms3
The growthofideasbornfromplatforms3
 
Slidehow
SlidehowSlidehow
Slidehow
 
Hoe zet je customer engagement in binnen e-commerce (Emerce eRetail 2013)
Hoe zet je customer engagement in binnen e-commerce (Emerce eRetail 2013)Hoe zet je customer engagement in binnen e-commerce (Emerce eRetail 2013)
Hoe zet je customer engagement in binnen e-commerce (Emerce eRetail 2013)
 
For My Valentines
For My ValentinesFor My Valentines
For My Valentines
 
dianamerlisafajardo 81tolerancia
dianamerlisafajardo 81toleranciadianamerlisafajardo 81tolerancia
dianamerlisafajardo 81tolerancia
 
Cookiewetgeving en de gevolgen
Cookiewetgeving en de gevolgenCookiewetgeving en de gevolgen
Cookiewetgeving en de gevolgen
 
Scope 3 Emissions
Scope 3 EmissionsScope 3 Emissions
Scope 3 Emissions
 
Conversie naar de winkelvloer en andersom lr
Conversie naar de winkelvloer en andersom lrConversie naar de winkelvloer en andersom lr
Conversie naar de winkelvloer en andersom lr
 
E-commerce Vooruitgedacht
E-commerce VooruitgedachtE-commerce Vooruitgedacht
E-commerce Vooruitgedacht
 
Auto km 0
Auto km 0Auto km 0
Auto km 0
 
UNIT4 WNF CMNL 07 september 2010
UNIT4 WNF CMNL 07 september 2010UNIT4 WNF CMNL 07 september 2010
UNIT4 WNF CMNL 07 september 2010
 
Auto usate
Auto usateAuto usate
Auto usate
 
ATM Security Taining Moscow
ATM Security Taining MoscowATM Security Taining Moscow
ATM Security Taining Moscow
 
Green light
Green lightGreen light
Green light
 

Ähnlich wie 2011 Distinguished Evaluator: The Health Foundation of Greater Cincinnati

Building stronger systems for sl os and program review
Building stronger systems for sl os and program reviewBuilding stronger systems for sl os and program review
Building stronger systems for sl os and program review
harrindl
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
eaquals
 
Learning focused Evaluation
Learning focused EvaluationLearning focused Evaluation
Learning focused Evaluation
Michele Garvey
 
Workbook for Designing a Process Evaluation
 Workbook for Designing a Process Evaluation  Workbook for Designing a Process Evaluation
Workbook for Designing a Process Evaluation
MoseStaton39
 
Workbook for Designing a Process Evaluation .docx
Workbook for Designing a Process Evaluation .docxWorkbook for Designing a Process Evaluation .docx
Workbook for Designing a Process Evaluation .docx
AASTHA76
 
Workbook for Designing a Process Evaluation
 Workbook for Designing a Process Evaluation  Workbook for Designing a Process Evaluation
Workbook for Designing a Process Evaluation
MikeEly930
 
Pd Community Partnerships C6
Pd Community Partnerships C6Pd Community Partnerships C6
Pd Community Partnerships C6
ocasiconference
 

Ähnlich wie 2011 Distinguished Evaluator: The Health Foundation of Greater Cincinnati (20)

Building stronger systems for sl os and program review
Building stronger systems for sl os and program reviewBuilding stronger systems for sl os and program review
Building stronger systems for sl os and program review
 
Writing Effective NSF Proposals
Writing Effective NSF ProposalsWriting Effective NSF Proposals
Writing Effective NSF Proposals
 
Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2
 
Black, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomesBlack, Adam Dr - Efficacy and how to improve learner outcomes
Black, Adam Dr - Efficacy and how to improve learner outcomes
 
IAG impact and learning team
IAG   impact and learning teamIAG   impact and learning team
IAG impact and learning team
 
Learning focused Evaluation
Learning focused EvaluationLearning focused Evaluation
Learning focused Evaluation
 
Outputs, outcomes and benefits
Outputs, outcomes and benefitsOutputs, outcomes and benefits
Outputs, outcomes and benefits
 
Performance Improvement Culture
Performance Improvement CulturePerformance Improvement Culture
Performance Improvement Culture
 
Benchmarking For Best Practice
Benchmarking For Best PracticeBenchmarking For Best Practice
Benchmarking For Best Practice
 
Going Beyond Evaluation Buzzwords
Going Beyond Evaluation BuzzwordsGoing Beyond Evaluation Buzzwords
Going Beyond Evaluation Buzzwords
 
Rethinking Evaluation
Rethinking EvaluationRethinking Evaluation
Rethinking Evaluation
 
Module 8 - Monitoring and Evaluation
Module 8 - Monitoring and EvaluationModule 8 - Monitoring and Evaluation
Module 8 - Monitoring and Evaluation
 
01 Om At Training W Kshop Definition B
01 Om At Training W Kshop   Definition B01 Om At Training W Kshop   Definition B
01 Om At Training W Kshop Definition B
 
Workbook for Designing a Process Evaluation
 Workbook for Designing a Process Evaluation  Workbook for Designing a Process Evaluation
Workbook for Designing a Process Evaluation
 
Workbook for Designing a Process Evaluation .docx
Workbook for Designing a Process Evaluation .docxWorkbook for Designing a Process Evaluation .docx
Workbook for Designing a Process Evaluation .docx
 
Workbook for Designing a Process Evaluation
 Workbook for Designing a Process Evaluation  Workbook for Designing a Process Evaluation
Workbook for Designing a Process Evaluation
 
Program & Proposal Development
Program & Proposal DevelopmentProgram & Proposal Development
Program & Proposal Development
 
Introduction to logic models
Introduction to logic modelsIntroduction to logic models
Introduction to logic models
 
Community Partnerships
Community PartnershipsCommunity Partnerships
Community Partnerships
 
Pd Community Partnerships C6
Pd Community Partnerships C6Pd Community Partnerships C6
Pd Community Partnerships C6
 

Kürzlich hochgeladen

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 

Kürzlich hochgeladen (20)

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptx
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-IIFood Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
Food Chain and Food Web (Ecosystem) EVS, B. Pharmacy 1st Year, Sem-II
 
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural ResourcesEnergy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
 

2011 Distinguished Evaluator: The Health Foundation of Greater Cincinnati

  • 1. Distinguished Evaluator SeriesBuilding Evaluation Capacity June 14, 2011
  • 2. An Invitation to tell it Like it is
  • 3. Evaluation HOOP? HELP? NOT-FOR PROFIT
  • 4. In what ways is evaluation a hoop to jump through for not-for-profits?
  • 5. In what ways is evaluation a help for not-for-profits?
  • 6. How did HFGC evaluation get from 1998 to 2011?
  • 7. We had some lofty evaluation thoughts Funder and NFP on the same page Increase Sustainability Data Driven Decision Making Empowering
  • 8. How Do For-Profits and Not-For-Profits Differ? For-Profits Not-For-Profits Care Center Cost Center Care Center Cost Center
  • 9. How are Research and Evaluation Designs Different? Basic Research Applied Research Evidence Based -Practice Evaluation
  • 10. Who should do the evaluating? External Evaluator Internal Evaluator (build internal capabilities)
  • 11. Lots of Reading on Evaluation State-of the Art
  • 14. Logic Model Process Evaluations (What you do) Formative Stuff Outcome Evaluations (What happens because you do it) Summative Stuff
  • 15. Logic Model (Logical Framework) Activities and Outcomes Approach Project theory Story Approach Story of why and how the project works Demonstrates connections between program science, the program operations, and expected outcomes
  • 16.
  • 17. What We Sort of Knew and Where We Didn’t Know Much Problem Intervention Outcomes
  • 18.
  • 21. Created a mutually agreeable evaluation plan HFGC created the boxes (evaluation forms) Grantees filled boxes in a way that worked for them HFGC shared the wisdom learned over time from successful and unsuccessful projects Evaluation plan part of mutual expectations in contract
  • 22. Evaluation Use Grantees asked to review plan quarterly Make changes if needed Review next quarter Get assistance from Program Officer if needed HFGC learned that groups of similar grantees helped one another established grantee groups Grantees provided input and plan simplified
  • 23. We Learned that to truly be useful that grantmaking was more than $$$ Workshops Evaluation Communications Business Plan Many others Policy and advocacy work Individual and Group consultation Technical Assistance
  • 24. We evaluated our approaches to evaluation Grantee Perception Study Sustainability Study Workshop Evaluations
  • 25. Revisit Use of Evaluation (2011-????)
  • 26. So for the rest of the day we will Look at how others around the country are evaluating (PBS film) Reflect on evaluation in our organizations Hear a panel of experts and the wisdom of the audience

Hinweis der Redaktion

  1. Audience Discussion
  2. Discussion examples of the way evaluation is a helpRural CIT teams can be the national modelCMHC can get large federal grantsNew programs can disseminate outcomes and become a levy partner
  3. Not-for-profit mission directed but revenue is importantFor-profit Care is important because without it there is no profit
  4. Basic Research done in universities and laboratories. Involves the research method . Expensive.Applied Research to see if it works in the real world. Rigor control or comparison groups. Uses research method. If it works and it is practice oriented we say we have an evidence-based practice.Evaluation the practice has already been researched and shown to be effective we want to know if we get the same outcomes with our clients.
  5. Internal evaluator -Increased capacity External evaluator – need capacity for monitoring and interaction with the evaluator. Should be in the contract.
  6. 6.6 million results when you search for “logic model”
  7. First is there a use or does it use up precious resources?If there is a use what it is, what has happened in technology and otherwise that should influence what and how we evaluate?