SlideShare a Scribd company logo
1 of 18
Download to read offline
Setting Up a Peer Review Process for CBOs:
         Conflicts and Challenges
               CCPH- Conference Toronto 2007

 Michael T. Wright, PhD, LICSW, MS   Karl Lemmen, Dipl.-Psych.
 Martina Block, Dipl.-Psych., MPH
 Hella von Unger, PhD

 Research Group Public Health        Deutsche AIDS-Hilfe
 Prof. Rolf Rosenbrock               The National German AIDS
 Social Science Research Center      Organization
 Berlin (WZB)
Project:
Establishing Structures for Quality
Assurance of HIV Prevention for ASOs in
Germany
 – Partners: WZB and Deutsche AIDS-Hilfe (DAH)
 – Funder: Federal Center for Health Education
   (Ministry of Health)
 – Timeline: 2006-2008
 – Needs assessment: 2004-2005
The National German AIDS Service Organisation



                         – Founded in 1983 by the
                           Aids-Hilfe movement
                         – 116 Member ASOs
                         – 1 National Office
Deutsche AIDS-Hilfe E.V.:
Community Focused prevention
Theoretical Basis: Structural Prevention

– Focussing on behavior in
  the social and political
  context
– Enhancing self-esteem
  and self-efficacy (e.g. for
  gay men)
– Working towards legal
  reforms (e.g. regarding
  drug use)
– “Making the healthy
  choice the easy choice!”
Goals of WZB/DAH Project
– National demonstration project to promote quality
  development through participatory research
– Filling the structural gap for quality assurance in
  community work in HIV prevention
– Contributing to the establishment of national
  structures for institutionalizing prevention services
  for socially disadvantaged groups
Guiding Principles
– Action research
– Community-driven questions and explanations
  (local theory)
– Community-driven methods
  (local quality assurance)
– Developing methods which are:
   –   Tailor-made
   –   Practical
   –   Useful
   –   Participatory
   –   Sound
– Focus on quality assurance
Project Components
1. Skill-Building Workshops
   – participatory curriculum, participatory methods
2. Methods Handbook
   – internet based, interactive
3. Individualized Consulting
   – project-driven focus
4. Quality Colloquium (formerly: Peer Review Process)
   – focus on prevention for MSM
5. Network of Researchers
   – promoting a new discussion in German on participatory
     research
Quality Colloquium – Pragmatic Basis

– Workers’ need for input from outside their projects
   – Results of needs assessment
   – More than an idea exchange or problem solving between projects
   – Critical appraisal with no effect on funding
Quality Colloquium – Theoretical Basis
– Quality is not an objective category
   – Defined in the context of a discussion (discourse)
– Various stakeholders play an important role in the
  discussion
   – Community members, project workers, funders, researchers
– Involving key stakeholders in a formal review process
  makes implicit processes explicit
   – Greater transparency
   – Setting of norms which extend beyond the review process
Quality Colloquium – Theoretical Basis
– Provides a forum for producing new forms of
  evidence for public health
– Judicial Principle (Keith Tones)
   –   Decision of a jury (of one’s peers)
   –   Plausibility (“beyond a reasonable doubt”)
   –   Validity of evidence is not restricted to scientific categories
   –   Social consensus plays a central role
– Diffusion of participatory norms
   – Through experience of participants
   – Through changing membership among the reviewers
Quality Colloquium: Structure and Goals
   – Voluntary
   – Question defined by the presenting project
   – Formal feedback on community-based work
      – “diagnostic” function (strengths and weaknesses)
      – not a certification
   – Panel consisting of community member,
     service provider, funder, researcher
      – from a different region than the presenting project
Quality Colloquium: Structure
                          Project
             Funder       Worker

                                    Researcher
 Community
  Member


                                           Moderator


                      Project
Quality Colloquium: Process
1. Information from Projects
    – annual report, completed questionnaire (including a description of their question)
2. Invitation to Reviewers
    – Based on needed expertise
3. Colloquium
    – 4 hours per project
    – Dialogue between project and reviewers until project’s question is answered
    – Feedback from the project to the reviewers and the moderator
    – Meeting of the reviewers to reflect on their work
4. Documentation/ Reflection
    – Project worker summarizes what s/he learned
    – Reviewers summarize as a group what they have learned (with particular attention
        to the review process itself)
5. Diffusion of Results
    – Basic information presented (description of project, question, names of all
        participants, date of the colloquium)
    – Lessons learned by the participants
6. Follow-up with the project
    – What effect has the input had on the work of the project?
Issues for Discussion

– Fear of being “judged” vs.
  Creating a supportive atmosphere of critical
  appraisal
– Building a pool of reviewers (particularly funders)
– Nationally or regionally based?
– Incentives for projects to present their work
– Incentives for reviewers
Advice/ Feedback 1

– Interesting model – extension of community advisory board model
  (“board swapping”) overcoming conflicts of interest
– Comparability of regions?
   – Would probably be adapted over time to the culture and
      context of each region
– Legitimizing the boards over time important, incorporation/
  recognition from other review processes
– Follow-up with the board: Effects on the board members in their
  own work as a result of serving on the board
– Discussion period between the review board and the project is
  important – very different than other review processes –
  opportunity to clarify the points – crucial to the success
Advice/ Feedback 2
–   Bias and accountability
     – Importance of work ahead of time on the part of the reviewers, reflecting on
         their own bias in the rule (managing their ego in the context of the role) –
         not the typical role in everyday work
     – Change process at individual level over the course of the discussion – your
         mind might change during the discussion – Need for reflection as a group
         in between?
–   Importance of a common language among all reviewers and respect for
    difference/ homogeneity of perspectives – a key task of the moderator
–   Practicality/ Representation
     – Might need more community representation to assure balance of view/
         opinion
     – Diversity of reviewers, or always the same people
     – Administration of the process
–   Accountability
     – What happens if the project of low quality?
Advice/ Feedback 3
–   How do you assure a commonness in the view of quality among the reviewers?
     – Discussion among the reviewers as a way to achieve that
–   Conflict between the project and the review panel – how to resolve
–   Setting up a culture of discourse is central element
     – How best to do that?
     – How much structure (training) or developed as one goes
–   How are peers chosen? (Bias)
     – Boundaries, type of feedback
–   Role of the facilitator in driving the process – does that distract from participatory
    intent
–   How does the group come to concensus?
     – Open-ended or consensus driven?
–   How does it relate to other models?
     – Continuous Quality Improvement
     – Other practice models around quality

More Related Content

Viewers also liked (8)

Lets begin product_manager
Lets begin product_managerLets begin product_manager
Lets begin product_manager
 
ALFA LIFT Elevators Ltd - http://www.alfalift.gr by Watercolor
ALFA LIFT Elevators Ltd - http://www.alfalift.gr by WatercolorALFA LIFT Elevators Ltd - http://www.alfalift.gr by Watercolor
ALFA LIFT Elevators Ltd - http://www.alfalift.gr by Watercolor
 
I like
I likeI like
I like
 
PCauto 论坛改版分享
PCauto 论坛改版分享PCauto 论坛改版分享
PCauto 论坛改版分享
 
2012 lemmen pq iq hiv-berlin-neu
2012 lemmen pq iq hiv-berlin-neu2012 lemmen pq iq hiv-berlin-neu
2012 lemmen pq iq hiv-berlin-neu
 
Commonwealth Games Delhi
Commonwealth Games DelhiCommonwealth Games Delhi
Commonwealth Games Delhi
 
Wright+lemmen et al quality in hiv-prevention-iq-hiv-berlin-meeting2010
Wright+lemmen et al quality in hiv-prevention-iq-hiv-berlin-meeting2010Wright+lemmen et al quality in hiv-prevention-iq-hiv-berlin-meeting2010
Wright+lemmen et al quality in hiv-prevention-iq-hiv-berlin-meeting2010
 
Wright lemmen levels of participation
Wright lemmen levels of participationWright lemmen levels of participation
Wright lemmen levels of participation
 

Similar to Wright, lemmen et al peer review process-ccph-conference-toronto2007

Digital Literacies Projects Interim Report Guide
Digital Literacies Projects Interim Report GuideDigital Literacies Projects Interim Report Guide
Digital Literacies Projects Interim Report Guide
Jay Allyson Dempster
 
Bruno Meessen at Btc nov 22, 2012 1
Bruno Meessen at Btc nov 22, 2012 1Bruno Meessen at Btc nov 22, 2012 1
Bruno Meessen at Btc nov 22, 2012 1
BelmaMalanda
 
07 project conceptualiation_kirkman
07 project conceptualiation_kirkman07 project conceptualiation_kirkman
07 project conceptualiation_kirkman
lindasahak
 

Similar to Wright, lemmen et al peer review process-ccph-conference-toronto2007 (20)

A Framework for Health IT Evaluation
A Framework for Health IT EvaluationA Framework for Health IT Evaluation
A Framework for Health IT Evaluation
 
Laura Eyre and Martin Marshall: Researchers in residence
Laura Eyre and Martin Marshall: Researchers in residence Laura Eyre and Martin Marshall: Researchers in residence
Laura Eyre and Martin Marshall: Researchers in residence
 
Digital Literacies Projects Interim Report Guide
Digital Literacies Projects Interim Report GuideDigital Literacies Projects Interim Report Guide
Digital Literacies Projects Interim Report Guide
 
"Designing practitioner research for impact" Miggie Pickton, DARTS4
"Designing practitioner research for impact" Miggie Pickton, DARTS4"Designing practitioner research for impact" Miggie Pickton, DARTS4
"Designing practitioner research for impact" Miggie Pickton, DARTS4
 
Information Ecosystem Standards
Information Ecosystem StandardsInformation Ecosystem Standards
Information Ecosystem Standards
 
DDL Programme Meeting Oct12
DDL Programme Meeting Oct12DDL Programme Meeting Oct12
DDL Programme Meeting Oct12
 
Centre for ageing better theory of change slides b (1)
Centre for ageing better theory of change slides b (1)Centre for ageing better theory of change slides b (1)
Centre for ageing better theory of change slides b (1)
 
B08 B4pc 142 Diapo Miedes En
B08 B4pc 142 Diapo Miedes EnB08 B4pc 142 Diapo Miedes En
B08 B4pc 142 Diapo Miedes En
 
Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...Composing the perfect research symphony – What are the key elements to conduc...
Composing the perfect research symphony – What are the key elements to conduc...
 
Bruno Meessen at Btc nov 22, 2012 1
Bruno Meessen at Btc nov 22, 2012 1Bruno Meessen at Btc nov 22, 2012 1
Bruno Meessen at Btc nov 22, 2012 1
 
Stakeholder Engagement Guide of Guides ACCESSIBLE2
Stakeholder Engagement Guide of Guides ACCESSIBLE2Stakeholder Engagement Guide of Guides ACCESSIBLE2
Stakeholder Engagement Guide of Guides ACCESSIBLE2
 
TCI Cluster Evaluation Meeting Oslo
TCI Cluster Evaluation Meeting Oslo TCI Cluster Evaluation Meeting Oslo
TCI Cluster Evaluation Meeting Oslo
 
Gai Moore, Sax Institute
Gai Moore, Sax InstituteGai Moore, Sax Institute
Gai Moore, Sax Institute
 
Making energy efficiency research relevant
Making energy efficiency research relevant Making energy efficiency research relevant
Making energy efficiency research relevant
 
Using Developmental Evaluation to Support Prototyping: A Workshop
Using Developmental Evaluation to Support Prototyping:A Workshop Using Developmental Evaluation to Support Prototyping:A Workshop
Using Developmental Evaluation to Support Prototyping: A Workshop
 
07 project conceptualiation_kirkman
07 project conceptualiation_kirkman07 project conceptualiation_kirkman
07 project conceptualiation_kirkman
 
Strategic planning for research uptake
Strategic planning for research uptakeStrategic planning for research uptake
Strategic planning for research uptake
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods
 
invoNET 2012 - Evans, Laterza & Davies
invoNET 2012 - Evans, Laterza & DaviesinvoNET 2012 - Evans, Laterza & Davies
invoNET 2012 - Evans, Laterza & Davies
 
Hm 418 harris ch14 ppt
Hm 418 harris ch14 pptHm 418 harris ch14 ppt
Hm 418 harris ch14 ppt
 

More from Deutsche AIDS-Hilfe (10)

AfroLebenVoice - Unsere Stimmen gegen Diskriminierung
AfroLebenVoice - Unsere Stimmen gegen DiskriminierungAfroLebenVoice - Unsere Stimmen gegen Diskriminierung
AfroLebenVoice - Unsere Stimmen gegen Diskriminierung
 
2012 hag lemmen pqe ohne
2012 hag lemmen pqe ohne2012 hag lemmen pqe ohne
2012 hag lemmen pqe ohne
 
Lemmen qualitaet ist geil-fachtag telefonberatung2010
Lemmen qualitaet ist geil-fachtag telefonberatung2010Lemmen qualitaet ist geil-fachtag telefonberatung2010
Lemmen qualitaet ist geil-fachtag telefonberatung2010
 
Lemmen qualitaetssicherung als baustelle-wzb-tagung.2006
Lemmen qualitaetssicherung als baustelle-wzb-tagung.2006Lemmen qualitaetssicherung als baustelle-wzb-tagung.2006
Lemmen qualitaetssicherung als baustelle-wzb-tagung.2006
 
Lemmen baustelle qualitaetssicherung-berlin2008
Lemmen baustelle qualitaetssicherung-berlin2008Lemmen baustelle qualitaetssicherung-berlin2008
Lemmen baustelle qualitaetssicherung-berlin2008
 
Lemmen pq-partizipative qualitaetsentwicklung- was heisst das. münchen2010
Lemmen pq-partizipative qualitaetsentwicklung- was heisst das. münchen2010Lemmen pq-partizipative qualitaetsentwicklung- was heisst das. münchen2010
Lemmen pq-partizipative qualitaetsentwicklung- was heisst das. münchen2010
 
Lemmen+gekeler evaluation und qualitätssicherung-erfurt2008
Lemmen+gekeler evaluation und qualitätssicherung-erfurt2008Lemmen+gekeler evaluation und qualitätssicherung-erfurt2008
Lemmen+gekeler evaluation und qualitätssicherung-erfurt2008
 
Pq hiv.de-lemmen+gekeler-dah-mitgliederversammlung-erfurt2008.ppt
Pq hiv.de-lemmen+gekeler-dah-mitgliederversammlung-erfurt2008.pptPq hiv.de-lemmen+gekeler-dah-mitgliederversammlung-erfurt2008.ppt
Pq hiv.de-lemmen+gekeler-dah-mitgliederversammlung-erfurt2008.ppt
 
HIV Neudiagnosen 2010
HIV Neudiagnosen 2010HIV Neudiagnosen 2010
HIV Neudiagnosen 2010
 
Syphilis Neudiagnosen 2010
Syphilis Neudiagnosen 2010Syphilis Neudiagnosen 2010
Syphilis Neudiagnosen 2010
 

Recently uploaded

Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Dipal Arora
 
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls DelhiRussian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
AlinaDevecerski
 

Recently uploaded (20)

Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any TimeTop Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
 
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
♛VVIP Hyderabad Call Girls Chintalkunta🖕7001035870🖕Riya Kappor Top Call Girl ...
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
 
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore EscortsVIP Call Girls Indore Kirti 💚😋  9256729539 🚀 Indore Escorts
VIP Call Girls Indore Kirti 💚😋 9256729539 🚀 Indore Escorts
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Gwalior Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Gwalior Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Dehradun Just Call 9907093804 Top Class Call Girl Service Available
 
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls DelhiRussian Escorts Girls  Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
Russian Escorts Girls Nehru Place ZINATHI 🔝9711199012 ☪ 24/7 Call Girls Delhi
 
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
 
Lucknow Call girls - 8800925952 - 24x7 service with hotel room
Lucknow Call girls - 8800925952 - 24x7 service with hotel roomLucknow Call girls - 8800925952 - 24x7 service with hotel room
Lucknow Call girls - 8800925952 - 24x7 service with hotel room
 
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
(Low Rate RASHMI ) Rate Of Call Girls Jaipur ❣ 8445551418 ❣ Elite Models & Ce...
 
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
Premium Bangalore Call Girls Jigani Dail 6378878445 Escort Service For Hot Ma...
 
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
Best Rate (Hyderabad) Call Girls Jahanuma ⟟ 8250192130 ⟟ High Class Call Girl...
 
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
 
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
Pondicherry Call Girls Book Now 9630942363 Top Class Pondicherry Escort Servi...
 
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
All Time Service Available Call Girls Marine Drive 📳 9820252231 For 18+ VIP C...
 
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
 

Wright, lemmen et al peer review process-ccph-conference-toronto2007

  • 1. Setting Up a Peer Review Process for CBOs: Conflicts and Challenges CCPH- Conference Toronto 2007 Michael T. Wright, PhD, LICSW, MS Karl Lemmen, Dipl.-Psych. Martina Block, Dipl.-Psych., MPH Hella von Unger, PhD Research Group Public Health Deutsche AIDS-Hilfe Prof. Rolf Rosenbrock The National German AIDS Social Science Research Center Organization Berlin (WZB)
  • 2. Project: Establishing Structures for Quality Assurance of HIV Prevention for ASOs in Germany – Partners: WZB and Deutsche AIDS-Hilfe (DAH) – Funder: Federal Center for Health Education (Ministry of Health) – Timeline: 2006-2008 – Needs assessment: 2004-2005
  • 3. The National German AIDS Service Organisation – Founded in 1983 by the Aids-Hilfe movement – 116 Member ASOs – 1 National Office
  • 5. Theoretical Basis: Structural Prevention – Focussing on behavior in the social and political context – Enhancing self-esteem and self-efficacy (e.g. for gay men) – Working towards legal reforms (e.g. regarding drug use) – “Making the healthy choice the easy choice!”
  • 6. Goals of WZB/DAH Project – National demonstration project to promote quality development through participatory research – Filling the structural gap for quality assurance in community work in HIV prevention – Contributing to the establishment of national structures for institutionalizing prevention services for socially disadvantaged groups
  • 7. Guiding Principles – Action research – Community-driven questions and explanations (local theory) – Community-driven methods (local quality assurance) – Developing methods which are: – Tailor-made – Practical – Useful – Participatory – Sound – Focus on quality assurance
  • 8. Project Components 1. Skill-Building Workshops – participatory curriculum, participatory methods 2. Methods Handbook – internet based, interactive 3. Individualized Consulting – project-driven focus 4. Quality Colloquium (formerly: Peer Review Process) – focus on prevention for MSM 5. Network of Researchers – promoting a new discussion in German on participatory research
  • 9. Quality Colloquium – Pragmatic Basis – Workers’ need for input from outside their projects – Results of needs assessment – More than an idea exchange or problem solving between projects – Critical appraisal with no effect on funding
  • 10. Quality Colloquium – Theoretical Basis – Quality is not an objective category – Defined in the context of a discussion (discourse) – Various stakeholders play an important role in the discussion – Community members, project workers, funders, researchers – Involving key stakeholders in a formal review process makes implicit processes explicit – Greater transparency – Setting of norms which extend beyond the review process
  • 11. Quality Colloquium – Theoretical Basis – Provides a forum for producing new forms of evidence for public health – Judicial Principle (Keith Tones) – Decision of a jury (of one’s peers) – Plausibility (“beyond a reasonable doubt”) – Validity of evidence is not restricted to scientific categories – Social consensus plays a central role – Diffusion of participatory norms – Through experience of participants – Through changing membership among the reviewers
  • 12. Quality Colloquium: Structure and Goals – Voluntary – Question defined by the presenting project – Formal feedback on community-based work – “diagnostic” function (strengths and weaknesses) – not a certification – Panel consisting of community member, service provider, funder, researcher – from a different region than the presenting project
  • 13. Quality Colloquium: Structure Project Funder Worker Researcher Community Member Moderator Project
  • 14. Quality Colloquium: Process 1. Information from Projects – annual report, completed questionnaire (including a description of their question) 2. Invitation to Reviewers – Based on needed expertise 3. Colloquium – 4 hours per project – Dialogue between project and reviewers until project’s question is answered – Feedback from the project to the reviewers and the moderator – Meeting of the reviewers to reflect on their work 4. Documentation/ Reflection – Project worker summarizes what s/he learned – Reviewers summarize as a group what they have learned (with particular attention to the review process itself) 5. Diffusion of Results – Basic information presented (description of project, question, names of all participants, date of the colloquium) – Lessons learned by the participants 6. Follow-up with the project – What effect has the input had on the work of the project?
  • 15. Issues for Discussion – Fear of being “judged” vs. Creating a supportive atmosphere of critical appraisal – Building a pool of reviewers (particularly funders) – Nationally or regionally based? – Incentives for projects to present their work – Incentives for reviewers
  • 16. Advice/ Feedback 1 – Interesting model – extension of community advisory board model (“board swapping”) overcoming conflicts of interest – Comparability of regions? – Would probably be adapted over time to the culture and context of each region – Legitimizing the boards over time important, incorporation/ recognition from other review processes – Follow-up with the board: Effects on the board members in their own work as a result of serving on the board – Discussion period between the review board and the project is important – very different than other review processes – opportunity to clarify the points – crucial to the success
  • 17. Advice/ Feedback 2 – Bias and accountability – Importance of work ahead of time on the part of the reviewers, reflecting on their own bias in the rule (managing their ego in the context of the role) – not the typical role in everyday work – Change process at individual level over the course of the discussion – your mind might change during the discussion – Need for reflection as a group in between? – Importance of a common language among all reviewers and respect for difference/ homogeneity of perspectives – a key task of the moderator – Practicality/ Representation – Might need more community representation to assure balance of view/ opinion – Diversity of reviewers, or always the same people – Administration of the process – Accountability – What happens if the project of low quality?
  • 18. Advice/ Feedback 3 – How do you assure a commonness in the view of quality among the reviewers? – Discussion among the reviewers as a way to achieve that – Conflict between the project and the review panel – how to resolve – Setting up a culture of discourse is central element – How best to do that? – How much structure (training) or developed as one goes – How are peers chosen? (Bias) – Boundaries, type of feedback – Role of the facilitator in driving the process – does that distract from participatory intent – How does the group come to concensus? – Open-ended or consensus driven? – How does it relate to other models? – Continuous Quality Improvement – Other practice models around quality