SlideShare ist ein Scribd-Unternehmen logo
1 von 19
‚Show me the money‛:
Generating evidence from and
    for accountability in
    Humanitarian work

 Christina Laybourn (One World Trust) and
  Alice Obrecht (Humanitarian Futures
               Programme)
Accountability and evidence:
        Where two worlds collide…


Expectations
                                Analysing evidence
                   External
                                Collecting evidence
                   party(ies)
                                Identifying evidence
  ‘Reality’

       Accountability             Evidence use
Accountability and evidence:
          Where two worlds collide…


                                 Expectations
Evidence:
information
                 Analysing evidence
supporting the
                                                           External
comparison of    Collecting evidence
                                                           party(ies)
organisational   Identifying evidence
reality to set
expectations
                                       ‘Reality’

                                               Accountability
Accountability and evidence:
Where two worlds collide…


 Analysing evidence
                                        External
 Collecting evidence                    party(ies)
 Identifying evidence
                        Accountability:
                        mechanisms
                        through which
   Evidence use         external parties
                        are engaged in
                        an organisation’s
                        evidence use
Overview
• Part 1: The contribution of evidence to assuring
  accountability

• Part 2: Putting it to use: accountability mechanisms
  as evidence generators

• Part 3: Limitations of accountability and evidence
  practice in Humanitarianism
The contribution of evidence to assuring
          accountability: self regulatory initiatives
                                            Humanitarian Accountability
                                        Partnership: Certification against
                                     the 2012 Standard in Accountability
                                               and Quality Management
Steering Committee
for Humanitarian                       16 Certified members, 12 further
Response Peer                              members have undertaken a
Review                                    “baseline analysis” against the
                                                                Standard
CARE, Save the                                          Disasters Emergency
Children, ICRC, IFRC,                               Committee: Accountability
Lutheran World                                                   Framework
Federation, Oxfam, C
aritas, ACT Alliance                           Action Aid, Age UK, British Red
and UNHCR                                       Cross, CARE, CAFOD, Christian
                                                  Aid, Concern, Islamic Relief,
                                               Merlin, Plan, Save the Children,
                                                        Tearfund, World Vision
i- Identification of evidence
HAP Standard Certification      DEC Accountability Framework   SCHR Peer Reviews




Baseline analysis against the   Self-assessment against the    Self-assessment at head office
Standard (either internal or    framework                      and two selected countries
external)                       Independent audit of 5 ways    No set assessment
Internal review of compliance   of working in 2 countries,     framework, but agreed areas
across all sites                chosen by auditors             for investigation
Independent Audit (every 3      “Peer” workshops of 2-3        Head quarter visits and Field
years, 18 month review          agencies and auditor to        visits to 2 countries by staff
checks progress)                discuss findings               from 2 peer agencies and an
                                Discussions between pairs of   independent facilitator
                                CEOs                           Group discussion by 9 CEOs of
                                                               findings
ii- Collection of evidence
HAP Standard Certification    DEC Accountability Framework   SCHR Peer Reviews




Desk review of documents      Desk review of submitted        Field visits include desk
at head office                evidence: looking for          reviews as well as
At least 1 programme site     evidence of Policy/            interviews with staff,
visit (chosen by auditors)    Procedure, Application and     partners and disaster
                              Assurance mechanisms           affected persons.
                              Meeting with key staff to      Head office desk reviews
                              discuss evidence               and interviews
iii- Analysis of evidence
HAP Standard Certification         DEC Accountability Framework   SCHR Peer Reviews




Certification against the          Component of DEC               Learning exercise
HAP Standard                       membership                     Summary of lessons learnt
Areas for improvement              “Improvement                   published
identified and addressed           Commitments” of changes        “12 months on” reports on
Summaries are published            to be made by next year        progress against peer
                                   2011/12 process published      review recommendations
                                   a summary report
Putting It To Use: Accountability
           mechanisms as evidence generators
                                                           • Reflective
                                                             perspectives on
                                                             organisational
                                       Participatory
                                        evaluations          achievements


• Adequacy of
  current activities to    Feedback                                   • Urgent needs
  meet stated needs
                          mechanisms                                  • Contextual
• Evidence of serious                                                   challenges
  misconduct/ fraud                                                   • Beneficiary
• Community
                                                Consultations           entitlements
  satisfaction (!)                                                    • Community
                                                                        skills/ ability
                                                                        to contribute
Putting It To Use: Accountability
 mechanisms as evidence generators
             Head
             office




            Country
            offices
EVIDENCE               LEARNING



              Field
             offices
Limitations of evidence and
          accountability practice


1.   Internal organisational barriers to evidence-accountability cross
     fertilisation




2.   The backwards-looking orientation of evidence-based policy
Limitations of evidence and accountability practice:
                 1. Internal barriers




EVIDENCE                          LEARNING
Limitations of evidence and accountability practice:
                 1. Internal barriers




   EVIDENCE                       LEARNING
Limitations of evidence and accountability practice
  2. Backwards-looking and short term perspectives




                     Evidence-based
                                               ?
                                              Black
                        strategy
                                              swan
                                              event
Limitations of evidence and accountability practice
  2. Backwards-looking and short term perspectives

               Greater
                                   Better use of
           involvement of
                                  evidence from
           stakeholders in
                                  accountability
          the evidence use
                                   mechanisms
               process



    Sensitivity to            Improved
     process and
    to drivers of              learning
       change


          Knowledge that              Better
             supports            accountability to
          anticipatory &          future disaster
             adaptive                affected
            capacities             populations
Dialogues for Disaster Anticipation and Resilience
•   Community-based and national workshops in
    advance of rains to inform design
•   Transmission of information before and over the
    course of the rainy season
•   Community-based evaluation after the rains
•   Technical consultation
•   Cross exchange learning
Dialogues for Disaster Anticipation and Resilience
http://www.elrha.org/dialogues
Thank you!
CLaybourn@OneWorldTrust.orgAlice.Obrecht@kcl.ac.uk

Weitere ähnliche Inhalte

Ähnlich wie "Show me the money": evidence from and for accountability (Christina Laybourne, One World Trust, and Alice Obrecht, HFP)

Improvement of the ngo’s performance
Improvement of  the ngo’s performanceImprovement of  the ngo’s performance
Improvement of the ngo’s performance
Divyanshu Singh
 
Stuck Somewhere In The Middle
Stuck Somewhere In The MiddleStuck Somewhere In The Middle
Stuck Somewhere In The Middle
Beverly Hill
 
International standards where there is no evidence? (Rob Allport et al)
International standards where there is no evidence? (Rob Allport et al)International standards where there is no evidence? (Rob Allport et al)
International standards where there is no evidence? (Rob Allport et al)
ALNAP
 
Virginia qm summit final
Virginia qm summit finalVirginia qm summit final
Virginia qm summit final
Adam Thompson
 
Effectiveness: Improve It Framework - Ben Jackson, Bond
Effectiveness: Improve It Framework - Ben Jackson, BondEffectiveness: Improve It Framework - Ben Jackson, Bond
Effectiveness: Improve It Framework - Ben Jackson, Bond
NIDOS
 

Ähnlich wie "Show me the money": evidence from and for accountability (Christina Laybourne, One World Trust, and Alice Obrecht, HFP) (20)

PPMA National Service Debate at CIPD Conf 8 Nov 2012 - Rob Briner
PPMA National Service Debate at CIPD Conf 8 Nov 2012 - Rob BrinerPPMA National Service Debate at CIPD Conf 8 Nov 2012 - Rob Briner
PPMA National Service Debate at CIPD Conf 8 Nov 2012 - Rob Briner
 
Value chain development in the Livestock and Fish Research Program
Value chain development in the Livestock and Fish Research ProgramValue chain development in the Livestock and Fish Research Program
Value chain development in the Livestock and Fish Research Program
 
Basic Internal Auditing Presentation
Basic Internal Auditing PresentationBasic Internal Auditing Presentation
Basic Internal Auditing Presentation
 
Reflections on monitoring a large-scale civil society WASH initiative: Lesson...
Reflections on monitoring a large-scale civil society WASH initiative: Lesson...Reflections on monitoring a large-scale civil society WASH initiative: Lesson...
Reflections on monitoring a large-scale civil society WASH initiative: Lesson...
 
Creating an outcomes framework for your organisation
Creating an outcomes framework for your organisationCreating an outcomes framework for your organisation
Creating an outcomes framework for your organisation
 
Improvement of the ngo’s performance
Improvement of  the ngo’s performanceImprovement of  the ngo’s performance
Improvement of the ngo’s performance
 
WRI Update: Governance of Forests Initiative (GFI)
WRI Update: Governance of Forests Initiative (GFI)WRI Update: Governance of Forests Initiative (GFI)
WRI Update: Governance of Forests Initiative (GFI)
 
Stuck Somewhere In The Middle
Stuck Somewhere In The MiddleStuck Somewhere In The Middle
Stuck Somewhere In The Middle
 
International standards where there is no evidence? (Rob Allport et al)
International standards where there is no evidence? (Rob Allport et al)International standards where there is no evidence? (Rob Allport et al)
International standards where there is no evidence? (Rob Allport et al)
 
PhD Plan of Analysis Seminar_apurva_pandya 29feb2012
PhD Plan of Analysis Seminar_apurva_pandya 29feb2012PhD Plan of Analysis Seminar_apurva_pandya 29feb2012
PhD Plan of Analysis Seminar_apurva_pandya 29feb2012
 
Virginia qm summit final
Virginia qm summit finalVirginia qm summit final
Virginia qm summit final
 
My view imprint 2011
My view imprint 2011My view imprint 2011
My view imprint 2011
 
Towards a new model for evaluation of intangibles
Towards a new model for evaluation of intangiblesTowards a new model for evaluation of intangibles
Towards a new model for evaluation of intangibles
 
Effectiveness: Improve It Framework - Ben Jackson, Bond
Effectiveness: Improve It Framework - Ben Jackson, BondEffectiveness: Improve It Framework - Ben Jackson, Bond
Effectiveness: Improve It Framework - Ben Jackson, Bond
 
Module 7: Recommendations management
Module 7: Recommendations managementModule 7: Recommendations management
Module 7: Recommendations management
 
WQD2011 - Breakthrough Process Improvement - Tawam Hospital - The Surgical Ad...
WQD2011 - Breakthrough Process Improvement - Tawam Hospital - The Surgical Ad...WQD2011 - Breakthrough Process Improvement - Tawam Hospital - The Surgical Ad...
WQD2011 - Breakthrough Process Improvement - Tawam Hospital - The Surgical Ad...
 
Essence of Audit Quality - Governance Tool
Essence of Audit Quality - Governance ToolEssence of Audit Quality - Governance Tool
Essence of Audit Quality - Governance Tool
 
The use of evidence in achieving ir cs mission
The use of evidence in achieving ir cs missionThe use of evidence in achieving ir cs mission
The use of evidence in achieving ir cs mission
 
Quality audit
Quality auditQuality audit
Quality audit
 
Monitoring-fit for purpose?
Monitoring-fit for purpose?Monitoring-fit for purpose?
Monitoring-fit for purpose?
 

Mehr von ALNAP

Disaster risk management in nepal
Disaster risk management in nepalDisaster risk management in nepal
Disaster risk management in nepal
ALNAP
 
Comisión Nacional de Prevención de Riesgos y Atención de Emergencias
Comisión Nacional de Prevención de Riesgos y Atención de EmergenciasComisión Nacional de Prevención de Riesgos y Atención de Emergencias
Comisión Nacional de Prevención de Riesgos y Atención de Emergencias
ALNAP
 
Government Forum for Government Response - an overview
Government Forum for Government Response - an overviewGovernment Forum for Government Response - an overview
Government Forum for Government Response - an overview
ALNAP
 
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
ALNAP
 
Jamaican government experience and learning on disaster response
Jamaican government experience and learning on disaster responseJamaican government experience and learning on disaster response
Jamaican government experience and learning on disaster response
ALNAP
 
Disaster Management Initiatives in India
Disaster Management Initiatives in IndiaDisaster Management Initiatives in India
Disaster Management Initiatives in India
ALNAP
 
Disaster Response dialogue
Disaster Response dialogueDisaster Response dialogue
Disaster Response dialogue
ALNAP
 
International assistance for major disasters in Indonesia
International assistance for major disasters in IndonesiaInternational assistance for major disasters in Indonesia
International assistance for major disasters in Indonesia
ALNAP
 
Simulation a tool to strengthen capabilities in India
Simulation  a tool to strengthen capabilities in IndiaSimulation  a tool to strengthen capabilities in India
Simulation a tool to strengthen capabilities in India
ALNAP
 
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
ALNAP
 
Data, evidence and access to information
Data, evidence and access to informationData, evidence and access to information
Data, evidence and access to information
ALNAP
 
Response analysis in food security crises: a 'road map'
Response analysis in food security crises: a 'road map'Response analysis in food security crises: a 'road map'
Response analysis in food security crises: a 'road map'
ALNAP
 

Mehr von ALNAP (20)

Gf john's presentation
Gf john's presentationGf john's presentation
Gf john's presentation
 
From best practice to best fit: changing to a more flexible approach to human...
From best practice to best fit: changing to a more flexible approach to human...From best practice to best fit: changing to a more flexible approach to human...
From best practice to best fit: changing to a more flexible approach to human...
 
ALNAP PPT FOR MONTREUX XIII | 'From best practice to best fit'
ALNAP PPT FOR MONTREUX XIII  |  'From best practice to best fit'ALNAP PPT FOR MONTREUX XIII  |  'From best practice to best fit'
ALNAP PPT FOR MONTREUX XIII | 'From best practice to best fit'
 
ALNAP PPT FOR OFDA | 50 years: From best practice to best fit
ALNAP PPT FOR OFDA | 50 years: From best practice to best fitALNAP PPT FOR OFDA | 50 years: From best practice to best fit
ALNAP PPT FOR OFDA | 50 years: From best practice to best fit
 
Strengthening humanitarian leadership teams: Rethinking leadership?
Strengthening humanitarian leadership teams: Rethinking leadership?Strengthening humanitarian leadership teams: Rethinking leadership?
Strengthening humanitarian leadership teams: Rethinking leadership?
 
'Learning from disaster' study launch presentation
'Learning from disaster' study launch presentation'Learning from disaster' study launch presentation
'Learning from disaster' study launch presentation
 
A networked response? 2013 presentation
A networked response? 2013 presentationA networked response? 2013 presentation
A networked response? 2013 presentation
 
Disaster risk management in nepal
Disaster risk management in nepalDisaster risk management in nepal
Disaster risk management in nepal
 
Comisión Nacional de Prevención de Riesgos y Atención de Emergencias
Comisión Nacional de Prevención de Riesgos y Atención de EmergenciasComisión Nacional de Prevención de Riesgos y Atención de Emergencias
Comisión Nacional de Prevención de Riesgos y Atención de Emergencias
 
Government Forum for Government Response - an overview
Government Forum for Government Response - an overviewGovernment Forum for Government Response - an overview
Government Forum for Government Response - an overview
 
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
Monitoring and evaluation: The Caribbean Disaster Emergency Management Agency...
 
Jamaican government experience and learning on disaster response
Jamaican government experience and learning on disaster responseJamaican government experience and learning on disaster response
Jamaican government experience and learning on disaster response
 
Disaster Management Initiatives in India
Disaster Management Initiatives in IndiaDisaster Management Initiatives in India
Disaster Management Initiatives in India
 
Disaster Response dialogue
Disaster Response dialogueDisaster Response dialogue
Disaster Response dialogue
 
International assistance for major disasters in Indonesia
International assistance for major disasters in IndonesiaInternational assistance for major disasters in Indonesia
International assistance for major disasters in Indonesia
 
Simulation a tool to strengthen capabilities in India
Simulation  a tool to strengthen capabilities in IndiaSimulation  a tool to strengthen capabilities in India
Simulation a tool to strengthen capabilities in India
 
Humanitarian leadership: who's in charge here?
Humanitarian leadership: who's in charge here?Humanitarian leadership: who's in charge here?
Humanitarian leadership: who's in charge here?
 
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
Cracks in the machine: is the humanitarian system fit for purpose? (Peter Wal...
 
Data, evidence and access to information
Data, evidence and access to informationData, evidence and access to information
Data, evidence and access to information
 
Response analysis in food security crises: a 'road map'
Response analysis in food security crises: a 'road map'Response analysis in food security crises: a 'road map'
Response analysis in food security crises: a 'road map'
 

"Show me the money": evidence from and for accountability (Christina Laybourne, One World Trust, and Alice Obrecht, HFP)

  • 1. ‚Show me the money‛: Generating evidence from and for accountability in Humanitarian work Christina Laybourn (One World Trust) and Alice Obrecht (Humanitarian Futures Programme)
  • 2. Accountability and evidence: Where two worlds collide… Expectations Analysing evidence External Collecting evidence party(ies) Identifying evidence ‘Reality’ Accountability Evidence use
  • 3. Accountability and evidence: Where two worlds collide… Expectations Evidence: information Analysing evidence supporting the External comparison of Collecting evidence party(ies) organisational Identifying evidence reality to set expectations ‘Reality’ Accountability
  • 4. Accountability and evidence: Where two worlds collide… Analysing evidence External Collecting evidence party(ies) Identifying evidence Accountability: mechanisms through which Evidence use external parties are engaged in an organisation’s evidence use
  • 5. Overview • Part 1: The contribution of evidence to assuring accountability • Part 2: Putting it to use: accountability mechanisms as evidence generators • Part 3: Limitations of accountability and evidence practice in Humanitarianism
  • 6. The contribution of evidence to assuring accountability: self regulatory initiatives Humanitarian Accountability Partnership: Certification against the 2012 Standard in Accountability and Quality Management Steering Committee for Humanitarian 16 Certified members, 12 further Response Peer members have undertaken a Review “baseline analysis” against the Standard CARE, Save the Disasters Emergency Children, ICRC, IFRC, Committee: Accountability Lutheran World Framework Federation, Oxfam, C aritas, ACT Alliance Action Aid, Age UK, British Red and UNHCR Cross, CARE, CAFOD, Christian Aid, Concern, Islamic Relief, Merlin, Plan, Save the Children, Tearfund, World Vision
  • 7. i- Identification of evidence HAP Standard Certification DEC Accountability Framework SCHR Peer Reviews Baseline analysis against the Self-assessment against the Self-assessment at head office Standard (either internal or framework and two selected countries external) Independent audit of 5 ways No set assessment Internal review of compliance of working in 2 countries, framework, but agreed areas across all sites chosen by auditors for investigation Independent Audit (every 3 “Peer” workshops of 2-3 Head quarter visits and Field years, 18 month review agencies and auditor to visits to 2 countries by staff checks progress) discuss findings from 2 peer agencies and an Discussions between pairs of independent facilitator CEOs Group discussion by 9 CEOs of findings
  • 8. ii- Collection of evidence HAP Standard Certification DEC Accountability Framework SCHR Peer Reviews Desk review of documents Desk review of submitted Field visits include desk at head office evidence: looking for reviews as well as At least 1 programme site evidence of Policy/ interviews with staff, visit (chosen by auditors) Procedure, Application and partners and disaster Assurance mechanisms affected persons. Meeting with key staff to Head office desk reviews discuss evidence and interviews
  • 9. iii- Analysis of evidence HAP Standard Certification DEC Accountability Framework SCHR Peer Reviews Certification against the Component of DEC Learning exercise HAP Standard membership Summary of lessons learnt Areas for improvement “Improvement published identified and addressed Commitments” of changes “12 months on” reports on Summaries are published to be made by next year progress against peer 2011/12 process published review recommendations a summary report
  • 10. Putting It To Use: Accountability mechanisms as evidence generators • Reflective perspectives on organisational Participatory evaluations achievements • Adequacy of current activities to Feedback • Urgent needs meet stated needs mechanisms • Contextual • Evidence of serious challenges misconduct/ fraud • Beneficiary • Community Consultations entitlements satisfaction (!) • Community skills/ ability to contribute
  • 11. Putting It To Use: Accountability mechanisms as evidence generators Head office Country offices EVIDENCE LEARNING Field offices
  • 12. Limitations of evidence and accountability practice 1. Internal organisational barriers to evidence-accountability cross fertilisation 2. The backwards-looking orientation of evidence-based policy
  • 13. Limitations of evidence and accountability practice: 1. Internal barriers EVIDENCE LEARNING
  • 14. Limitations of evidence and accountability practice: 1. Internal barriers EVIDENCE LEARNING
  • 15. Limitations of evidence and accountability practice 2. Backwards-looking and short term perspectives Evidence-based ? Black strategy swan event
  • 16. Limitations of evidence and accountability practice 2. Backwards-looking and short term perspectives Greater Better use of involvement of evidence from stakeholders in accountability the evidence use mechanisms process Sensitivity to Improved process and to drivers of learning change Knowledge that Better supports accountability to anticipatory & future disaster adaptive affected capacities populations
  • 17. Dialogues for Disaster Anticipation and Resilience • Community-based and national workshops in advance of rains to inform design • Transmission of information before and over the course of the rainy season • Community-based evaluation after the rains • Technical consultation • Cross exchange learning
  • 18. Dialogues for Disaster Anticipation and Resilience http://www.elrha.org/dialogues

Hinweis der Redaktion

  1. In this first section, we discuss how evidence is used to assure the accountability of Humanitarian INGOs. We’re particularly looking at the methods that three collective accountability initiatives use to ascertain whether their member INGOs meet their standards of accountability. Rather than discussing individual cases of INGO’s themselves, it is perhaps more interesting to consider how INGOs are collectively asked to evidence accountability. In doing so I’m drawing on the One World Trusts experience analysing such initiatives through our CSO Self-regulatory Initiatives database, which you can find on our website.We’re comparing here three collective initiatives: the Humanitarian Accountability Partnership Certification, which I’m sure many of you are familiar with, the Steering Committee for Humanitarian Response Peer Review process, which is an alliance of eight major international humanitarian organisations and networks, and the UNHCR. And finally the UK’s Disasters Emergency Committee, which is a group of 14 UK based INGOs, who collectively raise funds in times of severe humanitarian emergencies. Part of membership of the DEC involves compliance with the DEC Accountability Framework, which is what we are looking at today. For the past three years the One World Trust has acted as external validators for the DEC’s accountability assessment process.