2. Botswana
Monitoring, Evaluation and
Research
Office Overview
Number of staff: 15
Number of dedicated M&E staff: 1
Workshop Attendees
Number of staff: 1
Name: Rudo M. Mhonde
Title: M&E Advisor
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
MALE CIRCUMCISION PEPFAR/CDC Expansion of Male Circumcision Services to Prevent HIV
in Botswana (MC Training and Service Delivery)
PRE‐SERVICE EDUCATION PEPFAR/CDC Strengthening PSE programs in Health Training
Institutions
Monitoring, Evaluation and Research Activities
Title of Program or Research/ Primary Monitoring or Study For Research and Evaluation Activities
Evaluation Activity Data Source(s) Name of IRB(s) That Approved Activity Project Status
Male Circumcision Facility registers, training register, n/a n/a
mentoring tool
Pre Service Education Training registers, site visit n/a n/a
assessment tool
A Study of Adverse Events Related Client interviews, facility registers JHU SPH, CDC, MOH HRDC Awaiting approval from JHU, CDC and MOH HRDC
to Male Circumcision In Botswana Review Boards
Assessment of In‐service HIV and Health care provider interviews, JHU SPH, MOH HRDC CDC Non research determination obtained from MOH HRDC
AIDS Training Methods and management interviews, Event (Botswana) and JHU SPH Review Boards. Awaiting
Models in Botswana Costing worksheet, focus group approval from CDC
discussions
Male circumcision Facility registers, Facility quality JHU SPH for routine monitoring being Multi‐country ethical clearance under way
assessment developed
M&E‐related success story or
achievement of our program
• Jhpiego has trained 72 Health
care providers on MC (including
SMC M&E & QA) since
November 2010. SMC data
quality has improved
considerably in facilities where
Rudo Msipa Mhonde Introduction to Computing
A trainee recording data during SMC
the health care providers were
M&E Advisor Lesson Gaborone IHS, Computer
Lab Training
trained.
• Jhpiego has set up proxy networks in IHSs after monitoring challenges with internet access and connectivity. All students now have individual
internet accounts.
• Two protocols for a study on Adverse Events Related to Male Circumcision In Botswana and an Assessment of In‐service HIV and AIDS Training
Methods and Models in Botswana have been submitted and the latter has been approved.
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these
challenges?
1. Final National SMC M&E framework not yet in place so it is difficult to develop a final Periodic review and reorientation of M&E plans, budgets
Jhpiego SMC M&E plan. MOH and CDC yet to give final guidance on Jhpiego focus area and continuous consultation with MOH and CDC.
(Training /Service delivery).
2. Changing targets and unclear reporting guidelines due to changes in Jhpiego SOW and Maintaining close collaboration with MOH in planning
MOH SMC scale up plans. processes.
3. Lack of current textbooks and journals for student use in Health Institutions E‐granary installed and increased wireless internet access
This poster was made possible by the generous support of the
American people through the United States Agency for International
Development (USAID), under the terms of the Leader with Associates
Cooperative Agreement GHS‐A‐00‐08‐00002‐00. The contents are the
responsibility of the Maternal and Child Health Integrated Program
(MCHIP) and do not necessarily reflect the views of USAID or the
United States Government.
3. Ethiopia
Monitoring, Evaluation & Research
Country Director
Office Overview
Number of staff: 49 Deputy Country
Finance & Admin
Director
Director
Number of dedicated M&E staff: 3 Technical Director
HCT Team
Workshop Attendees Infection Prevention (IP)
Maternal Neonatal and
Child Health (MNCH)
Number of staff:2 Male Performance Improvement (PI) Team
Circumcisio Unit
Ephrem Daniel, M&E Advisor n
(MC) Team Pre-service Education (PSE)
Tsigereda Bekele, M&E Officer
Monitoring and Evaluation
(M&E) Unit
Senior Program Officer
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
HIV CDC/JHU TSEHAI Male Circumcision, HIV Counseling and Testing
HIV DoD Male Circumcision
MNH USAID/MCHIP Multiple MNH Activities
MNH Pathfinder/IFHP BEmONC training and SBM-R
MNH UNICEF BEmONC training and SBM-R
Monitoring, Evaluation and Research Activities
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
Male circumcision Facility registers JHU IRB for routine monitoring Multi-country ethical clearance under way
being developed
Community Kangaroo Mother Client interviews, facility JHU SPH, EPHA (local) Protocol development is on the final stage
Care registers
Cultural barriers affecting Literature review, focus group JHU SPH, EPHA (local) Literature review started to prepare the protocol
women’s utilization of discussion and key informant
optimal MNH practices interview
Preservice program Faculty interviews, student JHU SPH, EPHA (local) Protocol development is underway
evaluation interviews, document review,
M&E-related success story or achievement
• Use of TIMS to monitor all PEPFAR Ethiopia-supported training courses and to follow-up/track providers post
training
• Importance of M&E was given due attention and it is organized as a unit with three full-time staff
• M&E unit had been instrumental to improve program outcomes by providing evidence-based and timely feedback
- E.g. Data from the M&E unit was instrumental in showing the decline in MC clients and the need of demand
generation to increase MC uptake
- To shift to opt-out testing approach to improve the proportion of MC clients who are tested for HIV
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Delayed roll out of the new Ethiopian HMIS Use program funds to print and distribute the new HMIS tools to MCHIP
supported sites
2. Absence of baseline data in the SBM-R implementing facilities to Key output/outcome indicators were selected to be included as part of SBM-R
show improvement of service delivery standards to new programs
3. Absence of unique identifiers for individuals is a huge challenge for In addition to names, we use phone numbers to identify individuals
data quality in TIMS
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
4. Monitoring, Evaluation and Research in Ghana:
a shared commitment and responsibility
Country Office staff: 4; Dedicated M&E staff: 0
Workshop Attendee: Joyce Ablordeppey, Sr Technical Advisor
Ghana Team Sr Technical
Advisor*
Country Sr Technical
Director* Advisor*
Finance & Admin
Assistant
* M&E responsibilities
Overview of Technical Areas and Donors
Technical Areas Primary Donor/Mechanism Program Interventions
HIV USAID/MCHIP SBM-R, pre-service
MALARIA USAID/MCHIP SBM-R, pre-service
FAMILY PLANNING USAID/MCHIP SBM-R, pre-service
TUBERCULOSIS USAID/MCHIP SBM-R, pre-service
POST-PARTUM FAMILY PLANNING USAID/MCHIP SBM-R, pre-service
NEWBORN RESUSCITATION (HBB) USAID/MCHIP SBM-R, pre-service
Monitoring, Evaluation and Research Activities
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
Assessing Quality of 1. SBMR Assessments (tutors, JHU IRB application to be IRB application
Education, Student clinical preceptors, students) submitted
Competency and 2. Survey of women one year
Postpartum Family post delivery in well baby clinic
Planning Uptake - A
Comparison Study
Success Story: Using SBMR Data for Advocacy Baseline Assessment:
% Standards achieved in HIV, TB, Malaria and FP
• This year MCHIP in Ghana is focusing on strengthening Average performance of of 23 schools Teaching Materials; Knowledge & Skills
HIV, TB, Malaria and FP in pre-service education for
Midwives, Public and Community Health Nurses
• SBMR baseline assessment data was used to
communicate with the National Programmes for HIV,
TB and Malaria to secure their commitment and
resources to strengthening pre-service education
• After a presentation and discussion on the results,
each program committed trainers for a 2 week period
to train tutors, provided resource materials and
committed ongoing support to schools
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Limited indicators for pre-service Some indicators that we are using include: 1. % of schools participating; 2. % tutors trained; 3. # students who
activities (e.g. PEPFAR indicators focus have received training from tutors trained; 4. competence of students trained; 5. Utilization of services
on in-service training)
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
5. Jhpiego, Baltimore
Monitoring, Evaluation and Research
Jhpiego Global M&E Vision
Jhpiego measures program results in terms of improved health
Office Overview and lives saved drawing on an organization-wide results framework that
Number of dedicated M&E staff: 12 articulates pathways and milestones leading to impact.
Workshop Attendees
Number of staff: 10 Key Activities:
Sr. M&E Advisors: Eva Bazant, Young Mi Kim 1. Support country programs to: develop M&E plans and frameworks, develop data collection
tools, analyze qualitative and quantitative data, identify areas and methods for data quality
Health Informatics Advisor: Ed Bunker improvement, displaying data including mapping, providing results information systems
RISE Project Director: Catherine Schenck-Yglesias 2. Design and implement operations research in priority areas for the organization
M&E Advisors: Mary Drake, Megan Harris, Mainza Lukobo-Durrell, Reena Sethi, Maya Tholandi
3. Support the dissemination of Jhpiego’s program and technical results
Director, MER: Linda Fogarty
Jhpiego Results Framework
GOAL:
Health Status Improved and Lives Saved
Strategic Objective:
Use of MCH/FP/HIV/AIDS Services Increased and Positive Health Behavior Adopted in
the Population
Intermediate Result 1: Intermediate Result 2: Intermediate Result 3: Intermediate Result 4:
Health Systems Strengthened Quality of Health Services Improved Availability of Quality Health Services Increased Improved Health Knowledge, Attitudes and
Capacity for Community Action
Elements Necessary for a Functional M&E System: Developing M&E Standards
To support organizational and country program growth we are developing M&E standards based on UNAIDS
Organizing Framework for a Functional M&E System. Country programs need 1) a dedicated M&E unit with well-
defined relationships between HQ and field staff, 2) sufficient numbers of trained, dedicated M&E staff
representing a wide range of skills (including GIS, health informatics, data analysis, etc), 3) strong ties to program
staff, facility staff, and government representatives, 4) an annually updated M&E plan, 5) a budget sufficient to
strengthen and maintain a high-quality M&E system, 6) ongoing activities to enhance data use across the
organization, including global MER meetings, 7) strong monitoring systems from facility to HQ, 8) ability to
implement targeted surveys to support program development, 9) databases such as RISE and TIMS to
communicate results across the organization, 10) routine (annual) data quality audits in all country programs,
11) expertise to carry out program evaluations to demonstrate technical program successes and research to fill
gaps in knowledge, and 12) publishing and presenting Jhpiego’s program successes and technical innovations.
Success Story: Tremendous Organizational and MER Growth
Current MER Capacity and Organizational Commitment:
Where we work
• Fully staffed HQ MER unit with wide range of expertise across M&E
competencies
• Quantitative and qualitative research capacity and commitment to
impact evaluation
• Investment in information systems to assist country programs and
organization to track and publish results (RISE, TIMS, SBMR database)
• Advocating for M&E components in new programs; commitment to
5-10% of all program funds for M&E
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Integrating more successfully into Global Program Operations Attending regional, country and GPO general meetings; assisting with quarterly country
review reporting; providing M&E-specific LOE guidance for program planning, budgeting
2. Helping to ensure data quality at the program level Involvement in quarterly country review reporting; providing routine data quality audit tools
and support; requesting annual country visits
3. Supporting RISE in a way that meets users’ needs across the organization Involving countries in RISE development process; providing in-person training at global
meeting; developing training guides; planning RISE support into technical assistance visits
4. Balancing new program development with program technical assistance Developing a system that tags and searches past proposals, (e.g., by country, donor, technical
area) to make future responses more efficient, richer, and more contextualized
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
6. Haiti
Monitoring, Evaluation and Research
PPFANI Program/ Contraintes Création des Structures sanitaires Communautaire
Dialogue communautaire
Situation de base
Résultats
L’Impact
Manque des connaissance comites des adultes •Amélioration des services •Support communautaire pour
profondes en matière SSR et PF amis-des- jeunes SSR et PF pour les jeunes
et jeunes
ACCESS -FP
•Institionalisation des services
amis-des-jeunes
Initiation des rapports sexuels a Individuel
l’âge de 12 à 14 ans
Family Planning Project
•Amélioration des
Recherche de base connaissances: PF, source
Rumeurs sur la PF participative d’information et services
Amélioration des SSR
Accessibility- Nippes
•Utilisation des méthodes
pour les jeunes mères
Office Overview Manque de communication
entre les parents/adultes et les
Développement des Social
jeunes filles
jeunes
Number of staff: 7 Manque d’opportunités stratégies/ •Amélioration de la
communication parents et
économiques interventions jeunes
Manques de satisfaction avec
Number of dedicated M&E staff: 1 les service SSR/PF
•Amélioration des
connaissances SSR dans la
communauté
L’élaboration des •Augmentation de la discussion
Facilitateurs matériaux
Workshop Attendees
de SSR
Politiques nationales
Number of staff: 1 Suivi du projet
Honore Marie Patrice, Technical Coordinator
Evaluation
Overview of Technical Areas and Donors
Technical Areas Primary Program Interventions
Donor/Mechanism
- Institutional strengthening (friends of youth service improvement, USAID FP for girls and young mothers
strengthening technical capacity, staff training, increase range of services, aged 15-24
availability of services, space for the provision of FP services)
- Community activities (creation of adult and young Committee, clubs,
development of awareness and education, radio equipment)
Results dissemination workshop
Monitoring, Evaluation and Research Activities
Title of Program or Research/ Primary Monitoring or Study Data Source(s) For Research and Evaluation
Evaluation Activity Activities
Name of IRB(s) That Project Status
Approved Activity
Operational research on low FP use Primary investigation: interviews, focus Minister of Health Completed
determinants by girls and young mothers group, institutional records in Haiti
(15 - 24 years) consultation,
Evolution de l'utilisation du debut à la fin du Asile- Centre de Sante
Achievements
1193
1200
projet
•Fewer early pregnancies in the rural community, 1000
Nombre de olients PF
•Fewer dropout in the second year of 1558
800
implementation of the project (statement by the 2000
600
Director of the school of Azile : less than 4 1500
15-24 yrs.
pregnancies compare to 20 in previous years.) 18 mois (Janv 08 – May 09) 400
1000 58
262
•FP is no longer a taboo, FP is part of the daily 200
80 16
life of the inhabitants of the area the integration of 500 0
0 7
young people with participatory research project 0 Condom Lo-femenal DMPA Norplant IUD Other
natural
utilisatrices de depart utilisatrices à la fin method
Types de methodesPF
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Inability for youth to negotiate their sexual relationship linked to Partnership established with professional / social institutions for preparing
their socio-economic situation (low income, unemployment) girls and young mothers to have a useful trade. Empowering women to
negotiate sexual relations (FP)
2. Young mothers lack of decision power. Men's participation in the activities, training of parents, clubs, and
Committee of surveillance of maternal mortality (the project champion)
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
7. INDIA
Monitoring, Evaluation and Research
Office Overview
Number of staff: 58 (MCHIP + Jhpiego)
Number of dedicated M&E staff: 02
Workshop Attendees
Number of staff: 1
Siddhartha Saha, M&E Advisor
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
Pre‐Service Education MCHIP Strengthening Pre‐service education, SBM‐R
Family Planning USAID/MCHIP Strengthening FP services, SBM‐R, Capacity building
Family Planning Bill & Melinda Gates Foundation Repositioning of PPFP/PPIUCD, SBM‐R, In‐Service Training, IEC/BCC
Family Planning Norway‐India Partnership Initiative (NIPI) Strengthening PPFP/PPIUCD services, In‐Service Training, IEC/BCC
Vaccine Preventable Disease USAID/MCHIP Capacity building, demonstration of best practices, Supportive
Supervision, New Born Tracking, synergies between PEI & RI
New Born Care USAID/MCHIP Supportive Supervision, In‐Service Trainings, Facility strengthening for
ENC
Water, Sanitation & Hygiene USAID/MCHIP Double –blinded RCT, IEC/BCC;
Monitoring, Evaluation and Research Activities
Title of Program or Research/ Primary Monitoring or Study Data For Research and Evaluation Activities
Evaluation Activity Source(s) Name of IRB(s) That Project Status
Approved Activity
Assessment of Postpartum Intrauterine Contraceptive Facility registers, Interviews, FGDs Protocol to be submitted
Device (PPIUCD) Services for IRB
Postpartum Systematic Screening in Jharkhand, India PPSS tool, Observations Protocol to be submitted
for IRB
MCHIP Immunization program in India WHO Thirty Cluster Survey, Supportive Protocol to be submitted
Supervision checklist for IRB
Assessment of Facility readiness for ENC/R in two Survey, Facility registers
selected districts of Jharkhand
‐
PPIUCD Facility Registers‐
Circulated in all PPIUCD service PPIUCD Facility Reporting format‐ Project Reporting Tools currently PPIUCD Multi‐site database
delivery sites in 19 states of India Standardized monthly reporting in MS Excel, being developed in providing information on PPIUCD
in around 40 facilities across system for all PPIUCD service MS Access for data entry and insertion, follow‐up etc. for
different projects delivery sites (this being new collation by project field staff program monitoring
(MCHIP/BMGF/NIPI) service yet to be integrated in
electronic HMIS).
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently
addressing these challenges?
1. Although, it is crucial to monitor the counseling of pregnant/post‐partum women, timing of A column is being added in the clinic registers to
counseling (during antenatal period/early labor or postpartum) and subsequent decision of record provision of family planning counseling
acceptance/non‐acceptance of PPFP/PPIUCD and method opted; however, the counseling services. The providers are also being sensitized
data is poorly recorded in the service records of the facility and is not captured in the about the need for this data and on how to capture
current HMIS. this data.
2. Measuring the practice of ‘Active Management of Third stage of Labor’ which includes (i) The use of uterotonic in third stage of labor will
administration of uterotonic (Inj. Oxytocin 10 I.U. intramuscular after delivery of baby, (ii) only be measured.
uterine massage, (iii) controlled cord traction. Although, use of uterotonic is recorded on
the case sheets but other two steps are not mentioned in the case sheets.
3. Number of newborns receiving essential newborn care including essential preventive care The health staff will be sensitized and supported for
and recognition of danger signs and referral through USG‐supported programs‐ prioritized recording some of the steps of essential newborn
facilities in focus districts only. At present the facilities do not record all the steps of care and resuscitation as proxy during the
essential newborn care in the case sheets or registers. mentoring visits to the facilities.
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS‐A‐00‐08‐00002‐00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
8. INDONESIA
Monitoring, Evaluation and Research
Office Overview
Number of staff: ~ 40
Number of dedicated M&E staff:
4 for MCHIP, including 2 Jhpiego staff
Workshop Attendees
Number of staff: 1
Mia Pesik, Senior Program Manager
Community formative research on health practices of the MCHIP key messages : FGD with Health Center Staffs
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
MNH USAID/MCHIP, ExxonMobil, Chevron Community, facility, health office management
Cervical Cancer Screening Ford Foundation VIA
Infection Prevention GITEC Pre-service infection prevention curriculum
Monitoring, Evaluation and Research Activities
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
Evaluation of Quality Clinical observations, facility JHU IRB Report writing
improvement interventions registers, provider interviews
Assessment of referral Interviews of postpartum JHU IRB Report writing
processes women
Handwashing practices Videotaping, in-depth London School of Hygiene and Report writing
amongst mothers with interviews, focus group Tropical Medicine (collaboration
newborns discussions with Unilever
Community formative Interview with community, JHU IRB Report writing
research on health practices health practices at health
of the MCHIP key messages center, midwives, and district
health office
CECAP Appreciative Inquiry Client interviews JHU IRB Report writing
Ongoing SBM-R initiatives SBM-R tools On-going
SBMR Calculator
• What? Develop a calculator to help midwives, health centers and
hospitals analyze their SBMR data
• Why? Total number of standard performance in each SBMR tool is
a lot and limitation of midwives, health centers and hospitals
staffs’ skills on Ms. Office (Excel) in order to generate the graphs.
No special data operator at midwives, health centers and hospitals
Main Menu to entry and analyze SBMR data also become the reason of the
calculator development.
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Prioritizing the key indicators—balancing between the “nice to Consultation with M&E team in Washington
know” and “need to know”
2. Using the existing data collection at district level to answer the key Assessment on the existing data collection system at district level (starts from
indicators the village, subdistrict and district level)
3. Prioritizing SBM-R standards—how to balance wanting to measure At this time, we are measuring broader quality but also feeling a need to be
compliance with key life-saving interventions and wanting to able to measure the most important life-saving interventions amongst those
measure broader quality of care standards
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
9. Liberia
Monitoring, Evaluation and Research
Office Overview
Number of staff:2 MCHIP, 2 RBHS
Number of dedicated M&E staff: 0
Workshop Attendees
Number of staff: 1
Comfort Gebeh, MCHIP FP/RH Advisor
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
EmONC, FP, Child Health, ASRH, HIV/AIDS,TB, USAID, sub on RBHS bilateral with JSI PSE, SBMR, training, policy/guidelines, clinical
Malaria, Mental Health, Emergency site strengthening
FP USAID/MCHIP Policy, in-service training, site renovation, BCC
Monitoring, Evaluation and Research Activities
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
Task Analysis Provider interviews JHSPH Complete
BPHS monitoring Service statistics, TIMS forms, n/a Ongoing
Reports from site TA visits
EPI/FP Integration Facility registers JHSPH – Submission pending Planning
FP Facility registers, TIMS forms, n/a Ongoing
Reports from site TA visits
PPH prevention TBD TBD Design
• Task analysis provided evidence to strengthen MNH
clinical practice requirements of PA and RN curricula
• Task analysis results presented at several
conferences, including upcoming Global Health
Council
• Increased availability of data on MNH services
Data Quality Exercise, FP Data Jan-March2011,
2 Hospitals
Indicator Facility Difference % Match
HIS Report Registers
New FP
289 120%
clients 1741 1452
Revisit FP
-134 96%
clients
3102 3236
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. Data quality Initial visit conducted and site-level plans made. MCHIP to provide regular
follow-up. Liaising with USAID bilateral where Jhpiego is sub to follow-up data
quality concerns for facilities supported by RBHS, and negotiating with USAID
to reorganize resources in order to provide regular sites visits that include
data quality and clinical technical assistance for non-RBHS MCHIP sites.
Considering development of job aid to standardize reporting.
2. Coordinated follow-up between MOH, MCHIP and RBHS Conduct joint site visits with MOH, MCHIP and RBHS (where applicable).
3. Use of data by facility staff Monthly mentoring monitoring visits with feedback to facility staff
This poster was made possible by the
generous support of the American
people through the United States Agency
for International Development (USAID),
under the terms of the Leader with
Associates Cooperative Agreement GHS-
A-00-08-00002-00. The contents are the
responsibility of the Maternal and Child
RBHS
Health Integrated Program (MCHIP) and
do not necessarily reflect the views of
USAID or the United States Government.
10. MALAWI
Monitoring, Evaluation and Research
Office Overview
Number of staff: 28
Number of dedicated M&E staff: 3
Workshop Attendees
Number of staff: 1
Aleisha Rozario, M&E Advisor
List the primary technical areas (e.g., MNH, HIV, etc.) covered by your program and your major donors,
Overview of Technical Areas and Donors for example:
Technical Area(s) Primary Donor/Mechanism Program Interventions
HIV USAID/MCHIP SBM-R in PMTCT, Male Circumcision,
MNH BEmONC, Community MNH/Mobilization, KMC,
SBM-R in RH
Child Health Water and Sanitation,
Malaria IEC, LLIN distribution
Performance Based Incentives linked to SBM-R
Helping Babies Breathe
PPFP, FP Social Marketing
List the primary monitoring, research and evaluation activities currently under way in your office, for
Monitoring, Evaluation and Research Activities example:
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
SBM-R evaluation Client interviews, provider WIRB and NHSRC/Malawi Manuscript submitted to Midwifery Journal
interviews, facility HMIS,
SBM-R assessments
Male circumcision Facility registers, mobile clinic JHU IRB for routine monitoring Multi-country ethical clearance under way
registers being developed
Malaria Tracking Results Client interviews COMREC Malawi IRB protocol submitted, awaiting review
Continuously (TRaC) Study
Family Planning TRaC Study Client interviews COMREC or NHSRC IRB being Protocol under draft
developed
Helping Babies Breathe Provider observations, client Concept note developed and under finalization
Evaluation interviews, service statistics
Increased coverage in MNH-PMTCT in MCHIP supported sites, Phalombe district Direct Obstetric Deaths decline as PQI scores increase, Machinga Disrtict Deliveries by SBA rise at Mpasa Health Center as PQI scores increase
Hospital
100 92.6 100 3.2 3.5 70 65 90
88.4 87.3 63
90 80.9 82.1 88
75.7 90 2.9 79.8 80
80 3.0 60
2.7
70 80 70
60 51.4 51.5 2.5 50
70 63 PQI RH 61.2 60
50 59.2
Percentage (%)
Percentage (%)
scores
Percentage
Percentage
60 40
40 2.0 50
24.5 Intervention 50 PQI score
30 23.3 Direct
19.8 39 30 40
20 Control 1.5 Obstetric % SBA
8.74 40 22
10 Death Rate 30
30 1.0 20
0 20
% of % preg. % preg. % preg. % HIV % HIV 20
0.5 10
pregn. women women women positive positive 10 10
women attending receiving newly preg. preg.
0 0.0 0 0
attending ANC in 1st >2 doses tested for women women
> 4 ANC trimester IPTp HIV receiving receiving 2008 2009 2010 2008 2009 2010
visits CPT ARVs
Key Monitoring, Evaluation and Research Challenges Description of up to three key M&E challenges for your unit
Challenges How did you or how are you currently addressing these challenges?
1. The Malawi National Health Sciences Committee (NHSRC) charges a USG and other donors in the country have taken up the issue with NHSRC to
10% fee based on the study budget for all approved studies. Because discuss an agreement. Operational research that may be considered as
the fee is considered unethical, this will limit Jhpiego’s participation in “development assistance” are being submitted for IRB approval and a waiver
any operational research to be conducted in the country. of the fee is requested.
2. HMIS system does not collect the host of indicators required by the MCHIP is looking into partnering with the MOH to set up a sentinel site
MCHIP program and there is tremendous resistance to introducing surveillance system for selected MNH, Malaria, and HIV related indicators.
parallel systems for data collection, unless approved by the MOH MCHIP will also explore the use of electronic systems to collect data at the
point of care.
3. Quality of data is generally poor, requiring active follow-up by M&E personnel have been included in all supportive supervision visits to
program staff. provide an opportunity for M&E mentoring and validation of data.
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.
11. MALI
Monitoring, Evaluation and Research
MALI Office Overview
Number of staff: 9 technical
Number of dedicated M&E staff: 2
MCHIP Chief of party
Dr Diarra
Workshop Attendees
Number of staff: 1
Dr Camara Tiguida
Maternal health /FP Newborn Health Child health/CCM Monitoring and
Program Assistante Advisor
Monitoring and Evaluation Manager Advisor Advisor Evaluation Manager
Mme Haidara Dr Kanté Dr Ouattara Dr Tiguida
Regianal cordinator of
Kayes Dr Yorotté
District Cordinator of
Kita District cordinator of
Diéma
Dr Lazare
Dr Lala
Overview of Technical Areas and Donors
Technical Area(s) Primary Donor/Mechanism Program Interventions
Maternal Health USAID/MCHIP Active Management of Third Stage of Labor
Organization of Islamic Conference Postpartum Family Planning
Postabortion Care
Oxytocin in Uniject Device
Newborn Health USAID/MCHIP Essential Newborn Care
Kangaroo Mother Care
Child Health USAID/MCHIP Community Case Management
Monitoring, Evaluation and Research Activities
Title of Program or Primary Monitoring or For Research and Evaluation Activities
Research/ Study Data Source(s) Name of IRB(s) That Approved Project Status
Evaluation Activity Activity
Baseline Assessments Client interviews, provider Ministry of Health Planning Phase
interviews, facility need
assessment
Use of matrons to provide Client interviews, provider Ministry of Health Planning Phase
LAM at community health interviews, facility HMIS,
center
Key Monitoring, Evaluation and Research Challenges
Challenges How did you or how are you currently addressing these challenges?
1. High expectations from the Mission in regards to measurable results We will work with the HMIS and existing data collection systems to build
within a short timeframe capacity and ensure effective and efficient data collection
This poster was made possible by the generous support of the American people
through the United States Agency for International Development (USAID), under the
terms of the Leader with Associates Cooperative Agreement GHS-A-00-08-00002-00.
The contents are the responsibility of the Maternal and Child Health Integrated
Program (MCHIP) and do not necessarily reflect the views of USAID or the United
States Government.