SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Implementing Empirically
      Supported Treatments:
    Keys to Promoting Success

       Adam M. Volungis, MA, LMHC
Presented at the 116th Annual Convention of the American
 Psychological Association, Boston, MA, August 16, 2008
Implementation –
Easier Said than Done
• Need for empirically supported treatments
  (ESTs) has never been more important than the
  present
  o Increasing high bar for accountability
  o Strongly influenced by managed care


• Implementing ESTs with demonstrated efficacy
  into a mental health setting does not guarantee
  effectiveness = compromised quality of care
Implementation –
Easier Said than Done
• Evidence-based interventions show the highest probability of
  success
      o With clients/problems for which it was designed
      o Demonstrate clinically relevant outcomes
         – In both scientific (clinical trials) and practical (community
           effectiveness) domains
• Although there are numerous “proven” treatments for a
  variety of presenting problems, very few are being
  transferred into actual practice (Hayes, 2005)

                          WHY?
Implementation –
Easier Said than Done
• Significant “gap” between research and application

                      WHY?
• Lag time between research results and translating into
  practice
• Practitioner perceived rigidity of treatment (e.g., manuals)
  and/or practitioners’ lack of knowledge of research results
  (e.g., attitude)
• Cost – implementation is often not cheap
• Organizational Factors
Efficacy to Effectiveness
• Efficacy – does the treatment work?
   o Treatment Efficacy (Best Practice [APA, 2000])


• Effectiveness – does the efficacious treatment work in
  real-world applications
   o Clinical Utility – “the applicability, feasibility, and usefulness
     of the intervention in the local or specific setting where it is to
     be offered” (Best Practice [APA, 2000, p.4])
Organizational Readiness
for Change (ORC)
• There are many organizational factors that cannot be
  ignored when implementing ESTs (Lehman, Greener, &
  Simpson, 2002)
  o   Motivational Readiness
  o   Institutional Resources
  o   Staff Attributes (Practitioner & Administrative)
  o   Organizational Climate
Implementation Case Example
•   A director of a community mental health agency wants to introduce an EST to the
    agency. There is increasing pressure to demonstrate client improvement and
    reduce cost. However, after discussing this idea with many of the staff and
    reviewing the agency’s resources the director has some significant concerns.
    There appears to be less than subtle resistance to providing services different
    from the status quo – e.g., “why change what already works?”, “I don’t want to
    lose my identity as a psychologist.” Furthermore, the current status of the
    agency does not appear to be well equipped with regard to technology and
    training resources. Finally, there has been concern about the overall
    organizational climate due to such factors as 2 consecutive years without staff
    raises and staff stress resulting from an increasing client load without
    corresponding increasing staff levels.
Motivational Readiness

• Includes perceptions by leadership and clinical staff
  of current status in regard to clinical (e.g., assessment
  & services) as well as organizational (e.g., clinical
  and financial record systems) functioning
   o Program need for improvement
   o Training needs
   o Pressure for change
Institutional Resources
 •   Offices
 •   Staffing
 •   Training Resources
 •   Computer
 •   E-communications
Staff Attributes
 •   Growth
 •   Efficacy
 •   Influence
 •   Adaptability
Organizational Climate
• Psychological climate is an individual employee’s well-being
  based upon perception of the psychological impact resulting from
  the experienced work environment (Hemmelgarn, Glisson, &
  James, 2006) – when psychological climate perceptions are shared
  within employees it then becomes Organizational Climate
   o   Clarity of mission goals
   o   Staff cohesiveness
   o   Staff autonomy
   o   Openness of communication
   o   Stress Measures
   o   Openness to change
Facilitating Implementation
• Suggestions (partially adapted from Simpson [2002]):
   o Demonstrate there is empirical support for it
   o Have discussions about its relative advantages over existing practices
   o Include staff in planning and when it will be adopted
       • “felt ownership”
   o Show evidence of cost-effectiveness
   o Emphasize the art component through demonstration
       • practitioners will not be robots
   o Consider necessary changes in technology
   o Plan for additional funding options, if necessary
   o Have a mission/climate that includes ESTs as an expectation (over the long-
     term)
Final Thoughts
• Relying on what “feels right” is OUT
• “What is right” – efficacy to effectiveness – with corresponding
  accountability is IN
   o Ethical considerations to provide quality care
   o Pragmatic considerations of managed care
• Yes, implementing EST’s may require time, money, cognitive
  shifts, etc.
   o BUT the services we provide should be about providing the BEST
     quality of care possible to clients
   o AND not implementing EST’s may ultimately be the most costly
     proposition (literally and figuratively) in the long-run
References
• Hayes, R. A. (2005). Introduction to evidence-based
      practices. In C. E. Stout and R. A. Hayes (Eds.), The
      evidence-based practice: Methods, models, and tools
      for mental health professionals (pp. 1-9). Hoboken, NJ:
      Wiley.
• Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006).
      Organizational culture and climate: Implications for
      services and interventions research. Clinical
      Psychology: Science and Practice, 13, 73-89.
• Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002).
      Assessing organizational readiness for change. Journal
      of Substance Abuse Treatment, 22, 197-209.
• Simpson, D. D. (2002). A conceptual framework for
      transferring research to practice. Journal of Substance
      Abuse Treatment, 22, 171-182.

Weitere ähnliche Inhalte

Was ist angesagt?

Health Care IT - 2008 Research
Health Care IT - 2008 ResearchHealth Care IT - 2008 Research
Health Care IT - 2008 ResearchMatthew Iscoe
 
Evidence-based design: definition and application in the healthcare setting
Evidence-based design: definition and application in the healthcare setting Evidence-based design: definition and application in the healthcare setting
Evidence-based design: definition and application in the healthcare setting Innovations2Solutions
 
Disabilities
DisabilitiesDisabilities
Disabilitiesshrm
 
Evidence-Based Design Thesis_PaulRamoie_2014
Evidence-Based Design Thesis_PaulRamoie_2014Evidence-Based Design Thesis_PaulRamoie_2014
Evidence-Based Design Thesis_PaulRamoie_2014Paul Ramoie
 
Managing Health and Safety Risk within the Workplace
Managing Health and Safety Risk within the WorkplaceManaging Health and Safety Risk within the Workplace
Managing Health and Safety Risk within the WorkplaceOPRA Psychology Group
 
MS and work - staying in work and leaving work well
MS and work - staying in work and leaving work wellMS and work - staying in work and leaving work well
MS and work - staying in work and leaving work wellMS Trust
 
Taking Control Of Workplace Safety
Taking Control Of Workplace SafetyTaking Control Of Workplace Safety
Taking Control Of Workplace Safetyladukepc
 
Communication plan
Communication planCommunication plan
Communication planChari Bowman
 
Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Health Evidence™
 
Interdependence theory
Interdependence theoryInterdependence theory
Interdependence theoryMeiling XU
 
Rims 2013 saving the city
Rims 2013 saving the cityRims 2013 saving the city
Rims 2013 saving the cityGary Eastes
 
Implementation assessment of OD - OD process - Organizational Change and De...
Implementation assessment of OD -  OD process -  Organizational Change and De...Implementation assessment of OD -  OD process -  Organizational Change and De...
Implementation assessment of OD - OD process - Organizational Change and De...manumelwin
 
Creating Employee Engagement Leeds South and East CCG
Creating Employee Engagement Leeds South and East CCGCreating Employee Engagement Leeds South and East CCG
Creating Employee Engagement Leeds South and East CCGMichael Barker
 
Why evaluate your program?
Why evaluate your program?Why evaluate your program?
Why evaluate your program?Eric Graig
 
Problem tree & cosequesces of innovation decision
Problem tree & cosequesces of innovation decisionProblem tree & cosequesces of innovation decision
Problem tree & cosequesces of innovation decisionSupta Sarkar
 

Was ist angesagt? (20)

Health Care IT - 2008 Research
Health Care IT - 2008 ResearchHealth Care IT - 2008 Research
Health Care IT - 2008 Research
 
Evidence-based design: definition and application in the healthcare setting
Evidence-based design: definition and application in the healthcare setting Evidence-based design: definition and application in the healthcare setting
Evidence-based design: definition and application in the healthcare setting
 
Disabilities
DisabilitiesDisabilities
Disabilities
 
Evidence-Based Design Thesis_PaulRamoie_2014
Evidence-Based Design Thesis_PaulRamoie_2014Evidence-Based Design Thesis_PaulRamoie_2014
Evidence-Based Design Thesis_PaulRamoie_2014
 
Managing Health and Safety Risk within the Workplace
Managing Health and Safety Risk within the WorkplaceManaging Health and Safety Risk within the Workplace
Managing Health and Safety Risk within the Workplace
 
Karen Horsch Evaluating Change V.2
Karen Horsch   Evaluating Change V.2Karen Horsch   Evaluating Change V.2
Karen Horsch Evaluating Change V.2
 
MS and work - staying in work and leaving work well
MS and work - staying in work and leaving work wellMS and work - staying in work and leaving work well
MS and work - staying in work and leaving work well
 
Taking Control Of Workplace Safety
Taking Control Of Workplace SafetyTaking Control Of Workplace Safety
Taking Control Of Workplace Safety
 
Cbi employee-health-absence-conference-chris-pugh
Cbi employee-health-absence-conference-chris-pughCbi employee-health-absence-conference-chris-pugh
Cbi employee-health-absence-conference-chris-pugh
 
published article scholars bulletin
published article scholars bulletinpublished article scholars bulletin
published article scholars bulletin
 
Communication plan
Communication planCommunication plan
Communication plan
 
Environmental analysis
Environmental analysisEnvironmental analysis
Environmental analysis
 
Action Research Seminar
Action Research SeminarAction Research Seminar
Action Research Seminar
 
Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...
 
Interdependence theory
Interdependence theoryInterdependence theory
Interdependence theory
 
Rims 2013 saving the city
Rims 2013 saving the cityRims 2013 saving the city
Rims 2013 saving the city
 
Implementation assessment of OD - OD process - Organizational Change and De...
Implementation assessment of OD -  OD process -  Organizational Change and De...Implementation assessment of OD -  OD process -  Organizational Change and De...
Implementation assessment of OD - OD process - Organizational Change and De...
 
Creating Employee Engagement Leeds South and East CCG
Creating Employee Engagement Leeds South and East CCGCreating Employee Engagement Leeds South and East CCG
Creating Employee Engagement Leeds South and East CCG
 
Why evaluate your program?
Why evaluate your program?Why evaluate your program?
Why evaluate your program?
 
Problem tree & cosequesces of innovation decision
Problem tree & cosequesces of innovation decisionProblem tree & cosequesces of innovation decision
Problem tree & cosequesces of innovation decision
 

Andere mochten auch

A Place Called Earth
A Place Called EarthA Place Called Earth
A Place Called Earthjapiarora
 
Mumbai Historical
Mumbai HistoricalMumbai Historical
Mumbai Historicaljapiarora
 
Prevention Of School Violence Through School Connectedness [Volungis, 2008]
Prevention Of School Violence Through School Connectedness [Volungis, 2008]Prevention Of School Violence Through School Connectedness [Volungis, 2008]
Prevention Of School Violence Through School Connectedness [Volungis, 2008]Adam Volungis
 
Planning On Passion - Adaptive Planning In Media
Planning On Passion - Adaptive Planning In MediaPlanning On Passion - Adaptive Planning In Media
Planning On Passion - Adaptive Planning In MediaPulsar Platform
 
Presentatie Océ Nederland
Presentatie Océ NederlandPresentatie Océ Nederland
Presentatie Océ NederlandOliebol
 
Latest Projects
Latest ProjectsLatest Projects
Latest Projectsiloveshare
 

Andere mochten auch (8)

A Place Called Earth
A Place Called EarthA Place Called Earth
A Place Called Earth
 
Mumbai Historical
Mumbai HistoricalMumbai Historical
Mumbai Historical
 
Prevention Of School Violence Through School Connectedness [Volungis, 2008]
Prevention Of School Violence Through School Connectedness [Volungis, 2008]Prevention Of School Violence Through School Connectedness [Volungis, 2008]
Prevention Of School Violence Through School Connectedness [Volungis, 2008]
 
About India
About IndiaAbout India
About India
 
Paradigm
ParadigmParadigm
Paradigm
 
Planning On Passion - Adaptive Planning In Media
Planning On Passion - Adaptive Planning In MediaPlanning On Passion - Adaptive Planning In Media
Planning On Passion - Adaptive Planning In Media
 
Presentatie Océ Nederland
Presentatie Océ NederlandPresentatie Océ Nederland
Presentatie Océ Nederland
 
Latest Projects
Latest ProjectsLatest Projects
Latest Projects
 

Ähnlich wie Implementing Empirically Supported Treatments

Organizational assessment
Organizational assessmentOrganizational assessment
Organizational assessmentsubhalaxmirout
 
Corporate Wellness 12 12 08
Corporate Wellness  12 12 08Corporate Wellness  12 12 08
Corporate Wellness 12 12 08johnkopacz
 
A wellness strategy implemented in an organisation
A wellness strategy implemented in an organisationA wellness strategy implemented in an organisation
A wellness strategy implemented in an organisationEmma Duane
 
Employer Work & Life Balance Policies and its impacty on Employee Performance
Employer Work & Life Balance Policies and its impacty on Employee PerformanceEmployer Work & Life Balance Policies and its impacty on Employee Performance
Employer Work & Life Balance Policies and its impacty on Employee PerformanceHussain Mumtaz
 
Practice Proposal Final.docx
Practice Proposal Final.docxPractice Proposal Final.docx
Practice Proposal Final.docxstudywriters
 
ACCA SST Handout.pptx
ACCA SST Handout.pptxACCA SST Handout.pptx
ACCA SST Handout.pptxDave Wilson
 
RESEARCH PAPER
RESEARCH PAPER RESEARCH PAPER
RESEARCH PAPER HASHTAG29
 
Evaluation – the 4 Ms: models, measures, monitoring and methods
Evaluation – the 4 Ms: models, measures, monitoring and methodsEvaluation – the 4 Ms: models, measures, monitoring and methods
Evaluation – the 4 Ms: models, measures, monitoring and methodsHealth and Care Innovation Expo
 
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...CesToronto
 
Improving clinical services: no magic bullet... some things work better than ...
Improving clinical services: no magic bullet... some things work better than ...Improving clinical services: no magic bullet... some things work better than ...
Improving clinical services: no magic bullet... some things work better than ...NIHR CLAHRC West Midlands
 
Hazards of Change - Lowering the risk of injury through intentional implement...
Hazards of Change - Lowering the risk of injury through intentional implement...Hazards of Change - Lowering the risk of injury through intentional implement...
Hazards of Change - Lowering the risk of injury through intentional implement...Australian Institute of Health & Safety
 
TeachingAccountability
TeachingAccountabilityTeachingAccountability
TeachingAccountabilityBarry Duncan
 
SOCW 6311 WK 1 responses Respond to at least two colleagues .docx
SOCW 6311 WK 1 responses Respond to at least two colleagues .docxSOCW 6311 WK 1 responses Respond to at least two colleagues .docx
SOCW 6311 WK 1 responses Respond to at least two colleagues .docxsamuel699872
 
L2 Strategic Operational Planning.pptx
L2 Strategic  Operational Planning.pptxL2 Strategic  Operational Planning.pptx
L2 Strategic Operational Planning.pptxssuserc89259
 
1  Kaplan University School of Health Sciences HI2.docx
1  Kaplan University School of Health Sciences HI2.docx1  Kaplan University School of Health Sciences HI2.docx
1  Kaplan University School of Health Sciences HI2.docxSONU61709
 
Organisational Health Audits
Organisational Health AuditsOrganisational Health Audits
Organisational Health AuditsDavid Alman
 
QI PLAN PART 22QI PLAN PART 25Running head QI.docx
QI PLAN PART 22QI PLAN PART 25Running head QI.docxQI PLAN PART 22QI PLAN PART 25Running head QI.docx
QI PLAN PART 22QI PLAN PART 25Running head QI.docxamrit47
 

Ähnlich wie Implementing Empirically Supported Treatments (20)

Organizational assessment
Organizational assessmentOrganizational assessment
Organizational assessment
 
Corporate Wellness 12 12 08
Corporate Wellness  12 12 08Corporate Wellness  12 12 08
Corporate Wellness 12 12 08
 
A wellness strategy implemented in an organisation
A wellness strategy implemented in an organisationA wellness strategy implemented in an organisation
A wellness strategy implemented in an organisation
 
Health planning
Health planningHealth planning
Health planning
 
Employer Work & Life Balance Policies and its impacty on Employee Performance
Employer Work & Life Balance Policies and its impacty on Employee PerformanceEmployer Work & Life Balance Policies and its impacty on Employee Performance
Employer Work & Life Balance Policies and its impacty on Employee Performance
 
Practice Proposal Final.docx
Practice Proposal Final.docxPractice Proposal Final.docx
Practice Proposal Final.docx
 
ACCA SST Handout.pptx
ACCA SST Handout.pptxACCA SST Handout.pptx
ACCA SST Handout.pptx
 
RESEARCH PAPER
RESEARCH PAPER RESEARCH PAPER
RESEARCH PAPER
 
Evaluation – the 4 Ms: models, measures, monitoring and methods
Evaluation – the 4 Ms: models, measures, monitoring and methodsEvaluation – the 4 Ms: models, measures, monitoring and methods
Evaluation – the 4 Ms: models, measures, monitoring and methods
 
Workplace counselling
Workplace counsellingWorkplace counselling
Workplace counselling
 
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
Demonstrating Research Impact: Measuring Return on Investment with an Impact ...
 
Improving clinical services: no magic bullet... some things work better than ...
Improving clinical services: no magic bullet... some things work better than ...Improving clinical services: no magic bullet... some things work better than ...
Improving clinical services: no magic bullet... some things work better than ...
 
Hazards of Change - Lowering the risk of injury through intentional implement...
Hazards of Change - Lowering the risk of injury through intentional implement...Hazards of Change - Lowering the risk of injury through intentional implement...
Hazards of Change - Lowering the risk of injury through intentional implement...
 
TeachingAccountability
TeachingAccountabilityTeachingAccountability
TeachingAccountability
 
SOCW 6311 WK 1 responses Respond to at least two colleagues .docx
SOCW 6311 WK 1 responses Respond to at least two colleagues .docxSOCW 6311 WK 1 responses Respond to at least two colleagues .docx
SOCW 6311 WK 1 responses Respond to at least two colleagues .docx
 
L2 Strategic Operational Planning.pptx
L2 Strategic  Operational Planning.pptxL2 Strategic  Operational Planning.pptx
L2 Strategic Operational Planning.pptx
 
1  Kaplan University School of Health Sciences HI2.docx
1  Kaplan University School of Health Sciences HI2.docx1  Kaplan University School of Health Sciences HI2.docx
1  Kaplan University School of Health Sciences HI2.docx
 
Organisational Health Audits
Organisational Health AuditsOrganisational Health Audits
Organisational Health Audits
 
QI PLAN PART 22QI PLAN PART 25Running head QI.docx
QI PLAN PART 22QI PLAN PART 25Running head QI.docxQI PLAN PART 22QI PLAN PART 25Running head QI.docx
QI PLAN PART 22QI PLAN PART 25Running head QI.docx
 
SHRD -Chapter 6.ppt
SHRD -Chapter 6.pptSHRD -Chapter 6.ppt
SHRD -Chapter 6.ppt
 

Implementing Empirically Supported Treatments

  • 1. Implementing Empirically Supported Treatments: Keys to Promoting Success Adam M. Volungis, MA, LMHC Presented at the 116th Annual Convention of the American Psychological Association, Boston, MA, August 16, 2008
  • 2. Implementation – Easier Said than Done • Need for empirically supported treatments (ESTs) has never been more important than the present o Increasing high bar for accountability o Strongly influenced by managed care • Implementing ESTs with demonstrated efficacy into a mental health setting does not guarantee effectiveness = compromised quality of care
  • 3. Implementation – Easier Said than Done • Evidence-based interventions show the highest probability of success o With clients/problems for which it was designed o Demonstrate clinically relevant outcomes – In both scientific (clinical trials) and practical (community effectiveness) domains • Although there are numerous “proven” treatments for a variety of presenting problems, very few are being transferred into actual practice (Hayes, 2005) WHY?
  • 4. Implementation – Easier Said than Done • Significant “gap” between research and application WHY? • Lag time between research results and translating into practice • Practitioner perceived rigidity of treatment (e.g., manuals) and/or practitioners’ lack of knowledge of research results (e.g., attitude) • Cost – implementation is often not cheap • Organizational Factors
  • 5. Efficacy to Effectiveness • Efficacy – does the treatment work? o Treatment Efficacy (Best Practice [APA, 2000]) • Effectiveness – does the efficacious treatment work in real-world applications o Clinical Utility – “the applicability, feasibility, and usefulness of the intervention in the local or specific setting where it is to be offered” (Best Practice [APA, 2000, p.4])
  • 6. Organizational Readiness for Change (ORC) • There are many organizational factors that cannot be ignored when implementing ESTs (Lehman, Greener, & Simpson, 2002) o Motivational Readiness o Institutional Resources o Staff Attributes (Practitioner & Administrative) o Organizational Climate
  • 7. Implementation Case Example • A director of a community mental health agency wants to introduce an EST to the agency. There is increasing pressure to demonstrate client improvement and reduce cost. However, after discussing this idea with many of the staff and reviewing the agency’s resources the director has some significant concerns. There appears to be less than subtle resistance to providing services different from the status quo – e.g., “why change what already works?”, “I don’t want to lose my identity as a psychologist.” Furthermore, the current status of the agency does not appear to be well equipped with regard to technology and training resources. Finally, there has been concern about the overall organizational climate due to such factors as 2 consecutive years without staff raises and staff stress resulting from an increasing client load without corresponding increasing staff levels.
  • 8. Motivational Readiness • Includes perceptions by leadership and clinical staff of current status in regard to clinical (e.g., assessment & services) as well as organizational (e.g., clinical and financial record systems) functioning o Program need for improvement o Training needs o Pressure for change
  • 9. Institutional Resources • Offices • Staffing • Training Resources • Computer • E-communications
  • 10. Staff Attributes • Growth • Efficacy • Influence • Adaptability
  • 11. Organizational Climate • Psychological climate is an individual employee’s well-being based upon perception of the psychological impact resulting from the experienced work environment (Hemmelgarn, Glisson, & James, 2006) – when psychological climate perceptions are shared within employees it then becomes Organizational Climate o Clarity of mission goals o Staff cohesiveness o Staff autonomy o Openness of communication o Stress Measures o Openness to change
  • 12. Facilitating Implementation • Suggestions (partially adapted from Simpson [2002]): o Demonstrate there is empirical support for it o Have discussions about its relative advantages over existing practices o Include staff in planning and when it will be adopted • “felt ownership” o Show evidence of cost-effectiveness o Emphasize the art component through demonstration • practitioners will not be robots o Consider necessary changes in technology o Plan for additional funding options, if necessary o Have a mission/climate that includes ESTs as an expectation (over the long- term)
  • 13. Final Thoughts • Relying on what “feels right” is OUT • “What is right” – efficacy to effectiveness – with corresponding accountability is IN o Ethical considerations to provide quality care o Pragmatic considerations of managed care • Yes, implementing EST’s may require time, money, cognitive shifts, etc. o BUT the services we provide should be about providing the BEST quality of care possible to clients o AND not implementing EST’s may ultimately be the most costly proposition (literally and figuratively) in the long-run
  • 14. References • Hayes, R. A. (2005). Introduction to evidence-based practices. In C. E. Stout and R. A. Hayes (Eds.), The evidence-based practice: Methods, models, and tools for mental health professionals (pp. 1-9). Hoboken, NJ: Wiley. • Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and interventions research. Clinical Psychology: Science and Practice, 13, 73-89. • Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197-209. • Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 22, 171-182.