1. Sanitation and Hygiene in Asia Practitioners 'Workshop, Rajendrapur , 31 Jan - 3 Feb 2012
Supporting local government in 5 Asian countries
on sustainable sanitation & hygiene for all
Methodology for Performance Monitoring
Christine Sijbesma on behalf
of the whole SSH4A team
1

2. Contents
Bhutan
The SSH4A project
Nepal
Performance Monitoring Vietnam
Framework Laos
Some preliminary results
Methodological lessons
Cambodia

3. SSH4A project
 2 year project to support local governments to
provide Sustainable Sanitation and Hygiene for All
 5 Asian countries: Bhutan, Cambodia, Lao
PDR, Nepal, Vietnam
 Cooperation National and Local Gvts, SNV WASH Asia
and IRC Asia Region
 Financial support Civic Society Fund, AusAid and DGIS
core funding for SNV and IRC knowledge centres

4. Goal, targets, strategy
In brief:
 Support local governments within their own frameworks to
improve rural sanitation & hygiene through a holistic approach
 Enhanced access of 122,000 rural people and 120 schools to
sanitation and hygiene
 Duration in countries: June 2010 to Dec 2011 (18 months)
 Learning approach: learn by doing, monitoring and from each
other
 Focus on equity, sustainability and faster progress at scale

5. Five linked components
Learning & sharing
Between components

6. Performance Monitoring Framework
5 common performance indicators in Civic Society
WASH Fund:
# additional people with access to safe water (not in SSH4A)
# additional people with access to basic sanitation
# additional locations with hand washing facilities and soap
# additional schools with water sanitation & hand washing facilities
# additional water and sanitation service providers monitored
independently

7. Qualitative Information System (QIS)
 Developed by IRC and WSP for World Bank as participatory
gender and poverty sensitive project evaluation.
 Specific objective to quantify qualitative data on quality of
services, participation of women and the
poor, sustainability, empowerment, etc.
 Gradually developed into a participatory monitoring
methodology at scale.
 Used in India, Indonesia, Nepal, Sri
Lanka, Vietnam, Laos, Bhutan, Cambodia, Kenya, South
Africa, Colombia, Peru, etc.

8. Quantified qualitative indicators
Progress towards/in:
 Sanitary toilets in HHs and schools
 # toilets used in an increasingly hygienic way in HHs & schools
 # HHs & schools with increasingly adequate facilities for
handwashing with soap
 # Local sanitation enterprises (already numerical)
 Degree of female involvement in sanitation enterprises
 Level and quality of sanitation services
 Existence & quality of localized Behaviour Change
Communication (BCC) program at relevant admin. level(s)

9. Quantified qualitative indicators
Progress in governance:
 Multi-stakeholder cooperation in sector
 Pro-poor support mechanisms for sanitation
 Degree of influence of women/ excluded groups/ very poor
 Capacity of government and NGOs to facilitate quality CLTS at
community level & monitor & manage progress
Learning and Sharing: numerical, qualitative (no. & type of
presentations, workshops, meetings, gender of participants, etc. )

10. Measuring progress beyond
ODF and JMP (san) :
Source: Antoinette Kome, WASH team leader Asia Region, Nepal

11. Observations Cambodia (pilot 2 prov., 6 villages) Baseline Mid term
0 No toilet/ open defecation 14% 7%
1 Toilet but human faeces are not contained and are
accessible for human contact and contact by other animals 59% 7%
(=unimproved toilet)
2 Benchmark: Toilet + human faeces contained + inaccessible
for human contact and contact by other animals (= 14% 24%
improved sanitation) (pit and slab)
3 Toilet + human faeces contained in such a way that it is
inaccessible for human contact and contact by other
7% 15%
animals + no flies or rodents going in and out.
4 Toilet + human faeces contained in such a way that it is
inaccessible for human contact and contact by other
animals + no flies or rodents going in and out + human
faeces are contained in such a way that it cannot 6% 48%
contaminate surface- or ground-water.

12. Measuring equity on gender
Observation & reporting for 2 meetings: community and WASH Score
committee
No participation of women in meetings 0
Females attend the meetings, but do not speak 1
Females attend + speak, but not listened to 2
Females attend + speak + listened to, but do not influence decisions 3
Females attend + speak + listened to + influence decisions 4
Reasons for score:
In same way: equity for poor and gender in SMEs
Intended action:

13. Beyond MDG and JMP: total progress for toilet access and use
Aggregated data from 4 of 5 countries
Source: A. Kome, SNV

14. Progress Ind. 3a: handwashing observations
(without Laos)
Source: A. Kome, SNV

15. Capacity development for good quality CLTS
Nepal mid-term outcomes
Source: A. Kome, SNV

16. Pitfalls
Cannot be developed behind desk
Scales are programme and culture specific
Should measure outcomes, not inputs or outputs
Steps must be incremental; no gaps, no overlaps
No 2 or 3 combined options in one step
Avoid undefined concepts and subjective terms, e.g. ‘clean’

17. Pitfalls (2)
Proper sampling methods and size required for
representative data
Scales themselves must be pre-tested and piloted in the field
Reasons for scores are crucial for analysis
Is extractive without local discussions & use for action
If designed and used without expertise, data can be spurious

18. On-going progress, next steps
 Integration into national programs:
 Bhutan scaled up from 4 sub-districts to 1 and now 2 full districts
 Cambodia
 Laos
 Nepal : scaled up to one of 5 regions
 Vietnam: third province started
 Other ESAs come in to support at country level
 For near future aim for programmatic approach with multiple ESAs
 Methodological review done to enhance rigor of monitoring method
and data (available c. February 2012

19. More information, documents, photo story women
masons etc. e:
Sustainable sanitation and hygiene for all
http://www.irc.nl/page/57188