Guidance Note on CGIAR Research Programs (CRPS) Commissioned Evaluations . Presentation by Sirkka Immonen to Evaluation Community of Practice participants, 2nd annual ECOP workshop, 2014

1. CGIAR Evaluation Community of Practice Workshop Strengthening the evaluation process Guidance and Standards
September 2014

2. Purpose of Guidance
To be helpful reference document
Intended to those commissioning and carrying out evaluations
For increasing quality, consistency and harmonization

3. From Policy to Guidance for CCEEs
Principles:
1.
Professional
2.
Quality management
3.
Targeted audiences
4.
Tailored to R4D
5.
Mutual accountability
6.
Reinforced by managers
7.
Independent, ethical
8.
Equity sensitive
9.
Efficient
Derive from Policy Tool for promoting “fit for purpose” evaluations:
•
Useful
•
Credible
•
Accurate
•
Ethical
•
Of high quality
Guidance on Process
•
Based on Standards
•
Reflecting Policy
POLICY
STANDARDS
GUIDANCE # 2

4. R O L E S A N D R E S P O N S I B I L I T I E S
MANAGING
Covered in Guidance
PLANNING
DESIGNING
REPORTING AND FOLLOW-UP

5. Purpose of CCEE
•
Input to CRP management for learning and adjustment
•
Meet funders’ need for accountability
•
Input to CRP evaluations
•
Scope: main evaluation criteria

6. Annex 2 to Standards
Purpose of CCEE
•
Input to CRP management for learning and adjustment
•
Meet funders’ need for accountability
•
Input to CRP evaluations
•
Scope: main evaluation criteria

7. Roles and responsibilities
CRP governing body
CCEE oversight body
Evaluation manager
Team leader and team
CRP management and staff

8. S 7.1 Appropriate safeguards will be in place for CGIAR evaluation staff to protect independence
Roles and responsibilities
CRP governing body
CCEE oversight body
Evaluation manager
Team leader and team
CRP management and staff

9. Planning and designing
CRP management plans
•Timeliness
•Evidence from monitoring
•Funding

10. S 6.1 The CGIAR will promote a ‘culture of evaluations’ that actively plans and welcomes evaluation and promotes constructive learning
Planning and designing
CRP management plans
•Timeliness
•Evidence from monitoring
•Funding

11. Planning and designing
Evaluation manager designs

Terms of Reference with:
•
Criteria and emphasis
•
Resources
•
Data/information needs
•
Tentative approaches
•
Expected products and timelines
•
Skills and qualities of evaluators

Logistics

Communication

12. S 1.1 Evaluation will have clear ToR covering objectives, scope, evaluation questions, approach and methodology, management and governance
S 1.3 Evaluation will address the relevant international evaluation criteria
Planning and designing
Evaluation manager designs

Terms of Reference with:
•
Criteria and emphasis
•
Resources
•
Data/information needs
•
Tentative approaches
•
Expected products and timelines
•
Skills and qualities of evaluators

Logistics

Communication

13. Managing
Selection and contracting teams
Briefing evaluators
Inception phase
Field visits
Quality assurance
Communication

14. S 4.2 Specialist and development-focused nature of CGIAR research will be reflected in selection of evaluators
Managing
Selection and contracting teams
Briefing evaluators
Inception phase
Field visits
Communication

15. S 1.2 Inception Report will further elaborate the TOR, regarding evaluation framework, approach and methodology
Managing
Selection and contracting teams
Briefing evaluators
Inception phase
Field visits
Communication

16. Reporting and follow-up
Circulating draft for comments and factual accuracy
Evaluators are independent in their conclusions and recommendations
Recommendations; supported by evidence, action- oriented and practical
Communication of evaluation results
Management response

17. S 6.2 Evaluations will be communicated publicly in appropriate formats for stakeholders
S 6.3 There will be a formal and systematic management response to each evaluation
Reporting and follow-up
Circulating draft for comments and factual accuracy
Evaluators are independent in their conclusions and recommendations
Recommendations; supported by evidence, action- oriented and practical
Communication of evaluation results
Management response

18. Annexes to Standards and Guidance
Annex 1 – Glossary of Evaluation Terms
Annex 2 – Interpretation of International Evaluation Criteria
Guidance on key aspects:
Terms of Reference
Inception Report
Evaluation Report