SlideShare ist ein Scribd-Unternehmen logo
1 von 45
Downloaden Sie, um offline zu lesen
INTEGRATING

ScienceandPractice
  Volume 2   number 2   noVember 2012




  10 Tools
  for Progress Monitoring
  in Psychotherapy

         CelestHealth                   ORS and SRS

         CORE-OM                        Polaris-MH

         BASIS-24                       PSYCHLOPS

         Integra/COMPASS                SOS-10

         OQ-45                          TOP
MISSION OF INTEGRATING SCIENCE AND PRACTICE

                                        Integrating Science and Practice is published twice yearly by the Ordre des psychologues du Québec.
                                        The goal of the journal is to provide syntheses of scientific knowledge in the area of psychology
                                        and to facilitate the transfer of scientific knowledge to the field of practice. The journal aims to
                                        give practitioners in psychology, from all areas and fields of practice, the tools they need
                                        by providing them with critical reviews of the literature and brief syntheses of knowledge on
                                        specific themes. The journal is further intended to inform the public and professionals who work
                                        in collaboration with psychologists about recent scientific and clinical developments in psy-
                                        chology and about the contribution of psychologists towards improving people’s quality of life.
                                                       The journal publishes articles by invitation only, following a call for proposals.
                                        Independent submissions are neither considered nor accepted. However, the editorial board
                                        may receive suggestions for themes. The choice of themes is made on the basis of their clinical
                                        relevance and their scientific, social and political relevance. Preference is given to articles that
                                        propose best practices in a specific field or context, or that question existing practices or poli-
                                        cies based on available research findings. In every instance, the value of an article is assessed on
                                        the basis of its scientific merit and its potential for improving practices. All articles undergo
                                        anonymous peer review before being accepted and published.
www.ordrepsy.qc.ca/scienceandpractice




                                        Integrating Science and Practice is published by the Communications Department of
 Vol. 2 no. 2 noVember 2012




                                        the Ordre des psychologues du Québec. The reproduction and distribution of texts are
                                        authorized for non-profit purposes with reference to the source.


                                        Editor: Martin Drapeau, Psychologist, Professor of Counselling Psychology and
                                            Psychiatry, McGill University
                                        Publication Coordinator: Diane Côté, Director of Communications,
                                            Ordre des psychologues du Québec                                                                   Legal deposit
                                        Editorial Board:                                                                                       Bibliothèque nationale du Québec
                                        Rose-Marie Charest, President, Ordre des psychologues du Québec                                        ISBN 978-2-923164-49-6
                                        Diane Côté, Director of Communications, Ordre des psychologues du Québec                               (Original version: 978-2-923164-48-9)
                                        Pierre Desjardins, Psychologist, Director of Quality and Development of                                ISSN 1923-189X
 Integrating Science and Practice




                                            Professional Practice, Ordre des psychologues du Québec
                                        Martin Drapeau, Psychologist, member of the Ordre des psychologues du Québec                           Ordre des psychologues du Québec
                                            board of directors and Professor at McGill University                                              1100 Beaumont avenue, suite 510
                                        Nathalie Girouard, Psychologist, Advisor on Quality and Development of                                 Mont-Royal, QC H3P 3H5
                                            Professional Practice, Ordre des psychologues du Québec                                            www.ordrepsy.qc.ca/en


                                        Special thanks to: Dr. Marilyn Fitzpatrick, Louise Overington, and Gabriela Ionita
                                        from McGill University, for their contribution to this issue.

2
TABLE OF CONTENTS                                            INTEGRATING SCIENCE AND PRACTICE   noVember 2012




The Value of Progress Tracking in Psychotherapy                                                            5
martin Drapeau


The CelestHealth System                                                                                     7
Craig J. bryan, Stephen mark Kopta, bryan D. lowes


The Core-om (Clinical outcomes in routine evaluation) and Its Derivatives                                 12
Chris evans


The bASIS-24 behavior and Symptom Identification Scale                                                    16
Thomaskutty b. Idiculla, Susan V. eisen




                                                                                                                www.ordrepsy.qc.ca/scienceandpractice
The Integra /ComPASS Tracking Assessment System                                                           20
robert J. lueger


The outcome Questionnaire-45                                                                              24
michael J. lambert


The outcome and Session rating Scales                                                                     28
Scott D. miller, Susanne bargmann




                                                                                                                 Vol. 2 no. 2 noVember 2012
The Polaris-mH                                                                                            32
Grant Grissom,Tina Harralson, Jesse nankin


The PSYCHloPS (Psychological outcome Profiles)                                                            36
mark Ashworth, maria Kordowicz, Peter Schofield
                                                                                                                 Integrating Science and Practice




The Schwartz outcome Scale - 10 (SoS-10)                                                                  40
mark A. blais


The Treatment outcome Package (ToP)                                                                       43
David r. Kraus

                                                                                                                  3
Every English and French issue of Integrating Science and Practice is available
                                        on the Ordre des psychologues du Québec website:
                                        www.ordrepsy.qc.ca/scienceandpratice

                                        Integrating Science and Practice     Cahier recherche et pratique
                                        _ Documenting the effectiveness       _ Documenter l’efficacité des
                                           of Psychotherapeutic Interventions interventions en psychothérapie

                                        _ Depression: Considerations            _ La dépression : considérations
                                          Surrounding Treatment Choices           autour des choix de traitements

                                        _ Addressing Childhood                  _ Reconnaître et traiter la
www.ordrepsy.qc.ca/scienceandpractice




                                          Suffering                                souffrance des enfants
 Vol. 2 no. 2 noVember 2012
 Integrating Science and Practice




4
EDITORIAL

The Value of Progress Tracking
                         in Psychotherapy

A previous issue of Science and Practice (March 2010) was                 expanded upon by the APA Council of Representatives in 20122.
dedicated to the assessment of one’s clinical practice, more specif-      Likewise, in 2012, the Canadian Psychological Association (CPA)
ically to the value of systematically documenting the effects of the      struck a Presidential Taskforce on Evidence Based Practice3 that
treatment one offers. The value of progress tracking is unquestion-       defined evidence-based practice as “the conscientious, explicit and
able, as it addresses the question that ultimately matters most: is       judicious use of the best available research evidence to inform each
this treatment, as I am delivering it now, helping this patient sitting   stage of clinical decision making and service delivery (… and the
in front of me?                                                           application of this knowledge…) in the context of specific client
                Asking this question at an individual level, for each     characteristics, cultural backgrounds, and treatment preferences”.
patient, and not only at a populational level, is certainly something     However, the Taskforce also innovated by adding to this that
that distinguishes psychologists from most policy makers. Indeed,         “following the initiation of treatment, data obtained from the on-
psychologists often move well beyond a patient’s diagnosis and            going monitoring of clients’ reactions, symptoms, and functioning
treatment recommendations that are based exclusively on this di-          should be used to modify or discontinue the selected treatment”.
agnosis to also take into consideration a number of other impor-          Hence, the very definition of evidence-based practice includes on-
tant factors that can affect treatment outcome. There are of course       going treatment monitoring and progress tracking. Good practice




                                                                                                                                                                www.ordrepsy.qc.ca/scienceandpractice
good reasons for this. First, the DSM does not aim to explicitly and      is not only evidence based; it is also practice based.
systematically account for extraneous and personal factors, such as                       This is an important step forward, which is perfectly
social support available, marital status, or other factors that may af-   congruent with what science has taught us to date. A decade of re-
fect a patient’s prognosis, which in and of itself does raise some        search has shown the value of progress tracking, and its added ben-
questions about psychotherapy recommendations that are based              efit to the practice of psychotherapy. It can help clinicians who do
solely on diagnosis. The need to move beyond diagnosis and diag-          not notice when a patient is deteriorating and even predict poor
nosis-based treatment recommendations is also supported by re-            outcome before it happens (e.g., see Hannan et al., 2005). Second,
search. A number of studies have shown that numerous patient              progress tracking can improve retention and adherence to treat-
characteristics account for variance in treatment outcome well be-        ment and even improve treatment outcome (e.g., Anker et al., 2009;



                                                                                                                                                                 Vol. 2 no. 2 noVember 2012
yond the effects related to fit between treatment type and diagno-        Bickman et al., 2011; Reese et al., 2010; Shimokawa et al., 2010;
sis (e.g., Beutler et al., 2011; Joyce et al., 2007).                     see also the special issue of Canadian Psychology on progress track-
                It is no surprise, then, that the conclusions of the      ing4). It can also help to direct the clinicians’ attention to areas and
American Psychological Association (APA) Presidential Task Force          domains where they may require additional training or supervision,
on Evidence Based Practice in Psychology (20061) emphasized the           or help them identify those patients with whom they are most
integration of patient, relational and treatment variables. Likewise,     effective. Unlike symptom measures, progress tracking methods in-
the APA and the Order of psychologists of Quebec statements               dicate areas that are problematic in the patient’s life (e.g. family,
                                                                                                                                                                 Integrating Science and Practice




on evidence based practice define evidence-based practice in              etc.), by such providing the clinician with clinically useful informa-
psychology as the integration of the best available research with         tion that can translate into specific techniques or lead to the dis-
clinical expertise in the context of patient characteristics, culture,    cussion of specific topics within therapy. Furthermore, patients
and preferences. This statement was reiterated and in many ways           respond favourably to progress tracking (e.g., Anker et al., 2011),

                                                                          1   See http://www.apa.org/practice/resources/evidence/evidence-based-statement.pdf
                                                                          2   See http://www.apa.org/about/governance/council/index.aspx
                                                                          3   See http://www.cpa.ca/researchers/sciencedirectorate/defebp/
                                                                          4   See Canadian Psychology (2012), vol. 53, issue 2.
                                                                                                                                                                  5
and, finally, a number of progress tracking methods provide tools                            measure and the technical considerations tied to using the meas-
                                        and advice to help the clinician adjust the treatment on an ongoing                          ure, and provides a brief overview of the settings and institutions
                                        basis.                                                                                       that have chosen that measure for their clinicians to use. Each
                                                        With this issue, our goal is to provide readers with an                      of these measures is short, both clinician and patient friendly, pan-
                                        easy to use introduction to the most popular progress tracking                               theoretical, and can be used in private practice as well as in other
                                        measures. Each paper presents one measure and is written by the                              clinical settings.
                                        author of, or important contributors to that measure. All authors                                            We had received very positive feedback about the
                                        kindly agreed to structure their paper in the same manner. Hence,                            previous issue of Science and Practice on progress tracking. Along
                                        each paper succinctly presents the measure, the populations it can                           with this feedback, readers also asked where they can find progress
                                        be used with, the languages it is available in, the domains it as-                           tracking measures and what they actually look like. This issue, which
                                        sesses, how it is used, and how it can be useful in treatment plan-                          presents 10 of the most widely used methods, is our response to
                                        ning. It also briefly presents the psychometric properties of the                            those questions.




                                                                                                                                                             martin Drapeau, Ph.D., Psychologist
                                                                                                                                                             editor,
                                                                                                                                                             Integrating Science and Practice
                                                                                                                                                             Professor of Counselling Psychology
                                                                                                                                                             and Psychiatry,
www.ordrepsy.qc.ca/scienceandpractice




                                                                                                                                                             mcGill university
 Vol. 2 no. 2 noVember 2012




                                           REFERENCES

                                        Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve        Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa,
                                          couple therapy outcomes: A randomized clinical trial in a naturalistic setting.              K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk
                                          Journal of Consulting and Clinical Psychology, 77, 693–704.                                  for treatment failure. Journal of Clinical Psychology, 61, 155–163.
                                        Anker, M., Sparks, J., Duncan, B., & Stapnes, A. (2011). Footprints of couple therapy:       Joyce, A. S., Piper, W. E., Ogrodniczuk, J. S., & Klein, R. H. (2007). Patient characteristics
                                          Client reflections at follow up using a mixed method design in routine care.                  and variations in termination processes and outcomes. In A. S. Joyce et coll. (éd.),
                                          Journal of Family Psychotherapy, 22, 22-45.                                                   Termination in psychotherapy: A psychodynamic model of processes and
                                                                                                                                        outcomes, pp. 109-131, Washington, DC: American Psychological Association.
 Integrating Science and Practice




                                        Beutler, L. E., Harwood, T. M., Kimpara, S., Verdirame, D., Blau, K. (2011). Coping style.
                                          Journal of Clinical Psychology, 67(2),176-183.                                             Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client
                                        Beutler, L. E., Harwood, T. M., Bertoni, M., & Thomann, J. (2006). Systematic treatment        feedback on couple psychotherapy outcomes. Psychotherapy, 47(4), 616-630.
                                          selection and prescriptive therapy. In G. Stricker et coll. (éd.), A casebook of           Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome
                                          psychotherapy integration, p. 29-41, Washington, DC: American Psychological                   of patients at risk of treatment failure: Meta-analytic and mega-analytic review of
                                          Association.                                                                                  a psychotherapy quality assurance system. Journal of Consulting and Clinical
                                        Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects          Psychology, 78, 298–311.
                                           of routine feedback to clinicians on mental health outcomes of youths: results
                                           of a randomized trial. Psychiatric Services, 62(12),1423-1429.
6
The                                                                The CelestHealth System (CHS-MH) is the evolved tool
                                                                   of over 30 years of mental health treatment outcomes assessment.
                                                                   In the early days, the belief was more items meant better assess-
CelestHealth                                                       ment. In the late 1970’s, paper and pencil questionnaires became
                                                                   popular with research studies investigating self-reported outcomes.
System                                                             In the early 1980‘s, clinical tracking began with paper and pencil
                                                                   questionnaires given at every session. This tracking approach was
                                                                   incorporated into studies investigating dose-effect relationships
                    Prof. Craig J. bryan, PsyD, AbPP               across sessions, where dose is the number of sessions and effect
                    The university of utah &                       was the probability of improvement (e.g., Howard, Kopta, Krause &
                    The national Center for Veterans Studies
                                                                   Orlinsky, 1986; Kopta, Howard, Lowry, and Beutler, 1994). Offered
                                                                   by Integra Incorporated, COMPASS (Howard, Brill, Lueger,
                    craig.bryan@utah.edu                           O’Mahoney & Grissom, 1995; Sperry, Brill, Howard & Grissom, 1996)
                                                                   arose in the 1990’s as the most comprehensive outcomes assess-
Prof. Stephen mark Kopta, Ph.D., H.S.P.P.,                         ment system featuring measures for mental health, psychothera-
university of evansville                                           peutic bond, patient satisfaction, treatment need/expectations,
bryan D. lowes, nSCI Group, Washington Crossing,                   and presenting problems. It totaled 123 items for the patient to
Pennsylvania                                                       complete and 7 life functioning items that the clinician completed.
                                                                   For a fee, COMPASS responses were faxed to an Integra office and
                                                                   a report was returned by fax to the clinician. At each session, the
                                                                   clinician reviewed the new clinical report with the patient. However,
                                                                   in the late 1990’s, the demand for briefer questionnaires and more




                                                                                                                                            www.ordrepsy.qc.ca/scienceandpractice
                                                                   immediately available outcomes increased.
                                                                                  To answer this demand, the CHS-MH was created in
                                                                   part from COMPASS, with updated technology using computerized
     The authors present the CelestHealth System, which can        systems to provide a quicker clinical report to the clinician. The
     be used to monitor patient progress during psychotherapy.     System features four instruments: (a) the 20-item Behavioral Health
     The System includes four instruments: the 43-item
     behavioral Health measure-43 (bHm-43), which assesses
                                                                   Measure-20 (BHM-20) assesses mental health and takes 90 seconds
     overall mental health functioning; the 20-item behavioral     to complete; (b) the 43-item Behavioral Health Measure-43 also as-
     Health measure-20 (bHm-20), a shorter version of the          sesses mental health with additional subscales, and takes 3 minutes
     bHm-43; the the 5-item Psychotherapy readiness Scale,
     which can be used to predict risks of poor treatment          to complete; (c) the 5-item Psychotherapy Readiness Scale predicts



                                                                                                                                             Vol. 2 no. 2 noVember 2012
     outcomes; and the 6-item Therapeutic bond Scale, which        risk to do poorly in psychotherapy and takes 30 seconds to com-
     evaluates the relationship between the psychotherapist        plete; and (d) the 6-item Therapeutic Bond Scale, evaluates the rela-
     and patient. Clinicians can select within the system which
     instruments to use and how frequently they are adminis-       tionship between the psychotherapist and patient in 30 seconds.
     tered. The system is appropriate for adults 18 years and      All four instruments are optional, with the clinician selecting within
     older of normal or greater intelligence, and can be used in
                                                                   the system which instruments to use and how frequently they are
     outpatient mental health settings, primary care medicine,
     and college counseling center settings. This paper presents   administered (e.g. every session, only pre-post treatment).The
     the system, reports on its psychometric properties, and       CHS-MH is appropriate for adults 18 years and older of normal or
     describes how the system can assist in treatment
                                                                                                                                             Integrating Science and Practice




     planning and delivery.
                                                                   greater intelligence. It has been used in outpatient mental health,
                                                                   primary care medicine, and college counseling center settings. It is
     Keywords: CelestHealth System; CHS-mH; behavioral
     Health measure; bHQ; Psychotherapy readiness Scale;           available in English, Spanish, and Vietnamese.
     Therapeutic bond Scale; treatment outcome; progress
     monitoring; psychotherapy




                                                                                                                                                  7
Domains Assessed                                 health, self-management, and sexual func-                        All client raw responses and
                                        The BHM-20 measures the most fre-                tioning concerns. The CHS-MH is compati-         the calculated scale scores are stored in
                                        quently endorsed symptoms in outpatient          ble with most clinical theories and              highly secure CHS-MH servers and can be
                                        psychotherapy consistent with the three          practices.                                       used for research (with approval from an
                                        phases of mental health change. This                                                              appropriate institutional review board)
                                        phase model proposes that improvement            Use and Procedures                               and administrative purposes. An impor-
                                        in behavioral health occurs in three pro-        The CHS-MH input and output informa-             tant new feature is the CelestHealth Treat-
                                        gressive, sequential stages across therapy       tion is securely communicated across com-        ment Outcomes Profile, which uses
                                        sessions, with improvement at each phase         puter networks to a centralized processing       collected data to provide an overview of
                                        being contingent upon improvement in             system. Before the session, the patient en-      the clinical status and progress for all
                                        the previous stage. First, the client obtains    ters his/her responses using a computer          clients within the center. This profile shows
                                        a greater sense of well-being with in-           (e.g., Netbook, iPad, or desktop computer)       a variety of outcome variables including
                                        creased optimism and hope. Next, specific        that is available in the waiting room. Using     percentage of patients recovered, im-
                                        symptoms such as panic attacks, depres-          simple and familiar browser-based inter-         proved, unchanged, and deteriorated for
                                        sive thinking, episodes of binge eating,         faces, patients respond to a maximum of          the most recent session, as well as distress
                                        and sleep disturbance diminish. Finally,         31 multiple choice items; the typical time       levels at intake and at most recent session.
                                         life functioning improves across areas such     for completion of the entire CHS-MH is 2.5       These variables are provided for all scales
                                        as work, as a parent and partner, and in life    minutes. The patient’s responses are ana-        and subscales of the BHM-20, and the sys-
                                        enjoyment. The phase model of psy-               lyzed and scored in secure CHS-MH                tem is updated frequently throughout the
                                        chotherapy has been validated in several         servers; a complete, formatted report is im-     day to provide a “real-time” snapshot of the
                                        research studies (e.g., Howard, Lueger,          mediately available to the clinician as soon     center’s client population. Date ranges can
                                        Maling & Martinovich, 1993; Leon, Kopta,         as the patient finishes the assessment. The      also be applied to look at the center’s sta-
www.ordrepsy.qc.ca/scienceandpractice




                                        Howard & Lutz, 1999; Lutz, Lowry, Kopta,         report produces several color-coded              tus over historical timeframes.
                                        Einstein & Howard, 2001; Stulz & Lutz,           graphs and tables. Dose-Outcome graphs                           The annual license fee for
                                        2007).                                           for the subscales show the patient’s             centers that do not charge for services (e,g,
                                                        Within the phase domains,        progress across sessions, the Behavioral         college counseling centers) is $US110 per
                                        the BHM-20 assesses several mental health        Health Profile displays color-coded sub-         full time equivalent clinician who uses in-
                                        problems: (a) well-being (distress, life         scale scores based on normative data, and        formation from the system, with a mini-
                                        satisfaction, motivation), (b) psychological     the Suicide Monitoring Scale helps clini-        mum cost of $US550. For a private practice
                                        symptoms (depression, anxiety, panic dis-        cians to consider current suicide risk level.    or center who charges for services, then
                                        order, mood swings associated with bipo-         The clinician discusses with the patient         the license fee is based on number of in-
 Vol. 2 no. 2 noVember 2012




                                        lar disorder, eating disorder, alcohol/drug      his/her distress levels (i.e., severe, moder-    takes because use of the system can be
                                        abuse, suicidality, risk of violence), and (c)   ate, mild, normal) and level of suicide risk     billed to insurance companies and
                                        life functioning (work/school performance,       (high, moderate, low, no risk) as indicated      Medicare/Medicaid. There are no set-up
                                        intimate relationships, social relationships,    by the Behavioral Health Profile. If chosen      costs; consulting with CelestHealth staff is
                                        life enjoyment). Within each phase do-           as an option, the clinician also discusses re-   free by phone or email.
                                        main, the longer BHM-43 has more sub-            sults from the Bond Scale and the Psy-
                                        scales comprised of less frequently              chotherapy Readiness Scale. With this            Assessment and Treatment
                                                                                                                                          Planning
 Integrating Science and Practice




                                        endorsed problems in outpatient psy-             method, both patient and clinician can see
                                        chotherapy. For example, the symptoms            which problems need to be targeted and           The CHS-MH streamlines the assessment
                                        scale measures hostility, sleep disorder,        followed as treatment moves forward in           of clients’ symptoms and functioning by
                                        obsessive-compulsive symptoms, and psy-          time. Based on this feedback, technical          helping clinicians to more rapidly identify
                                        chotic symptoms, and the life functioning        adjustments within therapy can be made           problem areas and symptom domains of
                                        scale additionally measures physical             to further reduce the patient’s psy-             interest. From a clinical perspective, clini-
                                                                                         chopathology and increase motivation.            cians and clients can quickly determine
8
current clinical severity and historical         outpatients). Internal consistency coeffi-     as a method for quickly and reliably as-
trends over the course of treatment be-          cients ranged from .89 to .90 for the Global   sessing clients’ “vital signs” of mental
cause of the CHS-MH’s ability to immedi-         Mental Health score. For the three phases,     health. Clients additionally report positive
ately calculate and display scores using a       the ranges were as follows: Well-Being,        feelings about the use of the CHS-MH
color-coded scheme. Clinicians can use the       .65 to .74; Symptoms, .85 to .86; and Life     when clinicians review and refer to the
CHS-MH’s output to ask more targeted as-         Functioning.72 to .77. Construct validity      clients’ responses during the appointment.
sessment questions and to focus conver-          analyses using the discriminant validity       Clinicians have reported that the system’s
sations on specific factors that are more        method showed significant differences          brevity and reliability/validity, as well as its
proximally related to treatment outcomes         (p < .001) between the samples for all four    separate measurement of life functioning
(e.g., interventions, life events). The color-   scales, with each scale distinguishing         from more generalized symptom clusters,
coded feedback system also can be used           clinical from nonclinical groups. Sensitiv-    are particularly attractive features. Primary
to facilitate interventions themselves. For      ity to change using college counseling and     care providers have similarly reported pos-
example, a client’s responses or scores can      the psychotherapy outpatient samples           itive feedback because of the CHS-MH’s
be used to disconfirm their beliefs that         showed improved outcomes when com-             separate measurement of daily function-
treatment is not working, or to reinforce        paring intake scores to session 3 scores for   ing. The separation of a functional domain
adherence and motivation for treatment           all scales. Concurrent validity is supported   is not common among outcomes meas-
(e.g., demonstrating improvement from            based on very high correlations of BHM-20      urement tools, and is especially useful for
one session to the next despite the pa-          scales with the other well-known meas-         clinicians’ case conceptualization, diag-
tient’s assertion that “things aren’t getting    ures of mental health functioning includ-      nostic impressions, and treatment plan-
any better”). The CHS-MH can therefore           ing the BASIS-32 (-.83), COMPASS (-.76),       ning.
enhance clinical accuracy and efficiency,        OQ-45 (-.81), and the SCL-R-90 (-.85). More
and can facilitate successful treatment          recently, the BHM-20’s psychometric prop-      Unique Features of the Measure




                                                                                                                                                   www.ordrepsy.qc.ca/scienceandpractice
outcomes.                                        erties were investigated across seven sep-     Perhaps the CHS-MH’s most distinguishing
                                                 arate samples (Blount et al., 2010): four      feature is its electronic, web-based format
Technical Support                                primary care samples, two clinical samples     and immediate feedback system that can
Support includes three electronic manu-          of deployed military personnel, and one        be implemented across computing plat-
als: (a) the CelestHealth Getting Started        nonclinical sample of deployed military        forms (e.g., PC, Apple, smart phone,
Manual describes the procedures for set-         personnel. Internal reliability estimates      tablets, etc.). This capability makes the
ting up administrators, clinicians, and          were consistent with Kopta and Lowry’s         CHS-MH system especially flexible and
clients on the CHS-MH; (b) the CelestHealth      (2002) findings. The four scales also          practical to use, and has contributed di-
Clinical Report Manual explains to the           demonstrated medium to large correla-          rectly to its easy implementation across a



                                                                                                                                                    Vol. 2 no. 2 noVember 2012
clinician how to understand the CHS-MH           tions in the expected directions with more     wide range of clinical settings. For general
output; and (c) the CelestHealth                 specific mood and symptom scales (e.g.,        clinical settings such as an outpatient psy-
Psychotherapist Manual instructs the psy-        happiness, fatigue, anxiety, depression,       chotherapy practice, primary care, or
chotherapist how to use the system with          PTSD). Further psychometric evaluation of      emergency departments, the CHS-MH’s
the client. Free online and telephone            the BHM-20 is ongoing.                         design for measuring generalized mental
support is also available.                                                                      health functioning, as opposed to diagno-
                                                 Patient /Client/Clinician Feedback             sis- or condition-specific symptoms, is es-
Psychometric Properties
                                                                                                                                                    Integrating Science and Practice




                                                 Positive feedback regarding the simplicity     pecially beneficial. Within primary care, for
The BHM-20 has demonstrated good reli-           and practicality of the CHS-MH has been        example, the BHM-20 can be a better indi-
ability and validity. An initial psychometric    received from both clients and clinicians,     cator of mental health functioning than
evaluation was conducted by Kopta and            especially regarding the color-coded feed-     more limited or restricted symptom meas-
Lowry (2002) using four samples (i.e., com-      back feature. Acceptability of the CHS-MH      ures of depression or anxiety given the
munity adults, college students, college         system is especially enhanced within med-      wide spectrum of clinical issues that
counseling clients, and psychotherapy            ical settings when presented or described      typically present in this setting (e.g.,
                                                                                                                                                    9
depression, anxiety, weight management,         Administered at intake, the client responds                   Within primary care, the
                                        diabetes management, insomnia, chronic          to five items in about 30 seconds that re-     CHS-MH has been used to track outcomes
                                        pain, etc).                                     late to the duration of presenting prob-       for both general patient populations
                                                       The BHM-20 additionally in-      lems, previous psychotherapy experience,       (Bryan, Morrow & Appolonio, 2009; Corso,
                                        cludes screening items for suicidal ideation    and motivation for treatment. Using            Bryan, Corso, Morrow & Kanzler, 2010;
                                        and impulses that have been shown to im-        Global Mental Health as the outcome vari-      Ray-Sannerud et al., 2011) and for specific
                                        prove the detection of suicidal patients six-   able, the scale has been shown to distin-      subpopulations (e.g., PTSD; Cigrang et al.,
                                        fold in primary care relative to standard       guish patients demonstrating poor              2011; Corso et al., 2009). The CHS-MH’s
                                        interviewing and assessment approaches          psychotherapy outcomes from those              BHM-20 has additionally been used to
                                        by primary care providers (Bryan et al.,        showing good psychotherapy outcomes            improve the detection of suicidal patients
                                        2008). The CHS-MH’s Suicide Monitoring          (Kopta, 2010).                                 in primary care clinics (Bryan, Corso,
                                        System (SMS) was additionally developed                                                        Rudd & Cordero, 2008), and is currently
                                        in collaboration with suicide experts to aid    Institutional Implementation                   undergoing pilot testing as a suicide as-
                                        clinicians in tracking and managing sui-        CHS-MH is used in college counseling set-      sessment aid in emergency departments.
                                        cide risk over the course of treatment in a     tings including Harvard University, Johns      The CHS-MH’s recent addition of an option
                                        more reliable manner (Kopta, Mond,              Hopkins University, University of Min-         for tracking psychotropic medication
                                        David, Potruzski & Doll, 2010), thereby         nesota, Indiana University, and the Univer-    along with clinical outcomes provides an
                                        helping clinicians to meet standards of         sity of Florida. Other settings include        especially useful tool for health care
                                        care for suicide risk assessment and man-       primary care medical clinics at several U.S.   providers of all disciplines, but most
                                        agement.                                        Air Force Bases and university medical cen-    notably psychiatrists and nonpsychiatric
                                                       The Psychotherapy Readi-         ters, as well as and private mental health     prescribers (e.g., primary care physicians).
                                        ness Scale of the CHS-MH is unique as a         clinics. The CHS-MH has been imple-
www.ordrepsy.qc.ca/scienceandpractice




                                        reliable, valid alert for distinguishing pa-    mented by mental health professionals
                                        tients who do poorly in psychotherapy.          deployed to Iraq to track clinical outcomes.
 Vol. 2 no. 2 noVember 2012
 Integrating Science and Practice




10
REFERENCES

Beck, A.T., Ward, C., & Mendelson, M. (1961). Beck Depression Inventory (BDI).                    Howard, K.I., Lueger, R.J., Maling, M.S., and Martinovich, Z. (1993). A phase model of
  Archives of General Psychiatry 4, 561–571.                                                        psychotherapy: Causal mediation of outcome. Journal of Consulting and Clinical
Blount, T.H., Bryan, C.J., Kanzler, K.E., Morrow, C.E., Corso, K.A., Corso, M.L. (2010,             Psychology, 38, 139-149.
   November). Psychometric properties of the BHM-20 in military samples. Poster                   Kopta, S.M. (2010, October). The future is here for college counseling centers: Counseling
   presented at the annual meeting of the Association for Behavioral and Cognitive                  works, preventing suicide, and improving outcomes. Workshop presented at the
   Therapy, San Francisco, CA.                                                                      Annual University and College Counseling Center Directors (AUCCCD) Conference,
Bryan, C.J., Corso, K.A., Rudd, M.D., & Cordero, L. (2008). Improving identification of             Portland, Oregon.
   suicidal patients in primary care through routine screening. Primary Care and                  Kopta, S.M., & Lowry, J.L. (2002). Psychometric evaluation of the Behavioral Health
   Community Psychiatry, 13, 143-147.                                                               Questionnaire-20: A brief instrument for assessing global mental health and the
Bryan, C.J., Morrow, C.E., & Appolonio, K.A.K. (2009). Impact of behavioral health                  three phases of psychotherapy outcome. Psychotherapy Research, 12, 413-426.
   consultant interventions on patient symptoms and functioning in an integrated                  Kopta, S.M., Howard, K.I., Lowry, J.L., & Beutler, L.E. (1994). Patterns of symptomatic
   family medicine clinic. Journal of Clinical Psychology, 65, 281-293.                             recovery in psychotherapy. Journal of Consulting and Clinical Psychology, 62,
Cigrang, J. A., Rauch, S. A. M., Avila, A. L., Bryan, C. J., Goodie, J. L., Hryshko-Mullen, A.,     1009-1016.
   Peterson, A. L., & the STRONG STAR Consortium. (2011). Treatment of active-duty                Kopta, S.M., Mond, M., David, L., Potruzski, N., & Doll, L. (2010, June). Assessing
   military with PTSD in primary care: early findings. Psychological Services, 8, 104-113.          suicidality: Validation of the Suicide Monitoring Scale of the Behavioral Health
Corso, K.A., Bryan, C.J., Morrow, C.E., Appolonio, K.K., Dodendorf, D.M., & Baker, M.T.             Measure-20 and implications for psychotherapeutic strategies. Paper presented at
  (2009). Managing posttraumatic stress disorder symptoms in active duty military                   the annual meeting of the International Society for Psychotherapy Research,
  personnel in primary care settings. Journal of Mental Health Counseling, 31,                      Monterey.
  119-136.                                                                                        Leon, S.C., Kopta, S.M., Howard, K.I., & Lutz, W. (1999). Predicting patients’ responses
Corso, M., Bryan, C.J., Corso, K.A., Morrow, C.E., & Kanzler, K.E. (2010, April). Mental            to psychotherapy: Are some more predictable than others? Journal of Consulting
  health functioning recovery curves associated with behavioral health consultant                   and Clinical Psychology, 67, 698-704.
  services in integrated primary care. Poster presented at the annual meeting of                  Lutz, W., Lowry, J.L., Kopta, S.M., Einstein, D., & Howard, K.I. (2001). Prediction of
  the Society of Behavioral Medicine, Seattle, WA.                                                   dose-response relations based patient characteristics. Journal of Clinical Psychology,
Derogatis, L.R. (1983). Administration, scoring, and procedures manual—II. Baltimore,                57, 889-900.
  MD: Clinical Psychometric Research.                                                             Ray-Sannerud, B., Bryan, C.J., Dolan, D., Morrow, C.E., Corso, K.A., Kanzler, K.E., &




                                                                                                                                                                                               www.ordrepsy.qc.ca/scienceandpractice
Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureño, G., & Villaseñor, V. S. (1988).              Corso, M.L. (April 2011). Preliminary evidence for long-term outcomes following brief
  The Inventory of Interpersonal Problems: Psychometric properties and clinical                     behavioral health intervention in primary care clinics. Poster presented at the annual
  applications. Journal of Consulting and Clinical Psychology, 56, 885-895.                         meeting of the Society of Behavioral Medicine, Washington, DC.
Howard, K.I., Brill, P.L., Lueger, R.J., O’Mahoney, M.T., & Grissom, G.R. (1995). Integra         Sperry, L., Brill, P.I., Howard, K.I., and Grissom, G.R. (1996). Treatment outcomes in
  outpatient tracking assessment. Philadelphia: Compass Information Services, Inc.                  psychotherapy and psychiatric interventions. New York: Brunner/Mazel.
Howard, K.I., Kopta, S.M., Krause, M.S., & Orlinsky, D.E. (1986). The dose-effect                 Stultz, N. & Lutz, W. (2007). Multidimensional patterns of change in outpatient
  relationship in psychotherapy. American Psychologist, 41, 159 164.                                 psychotherapy: The phase model revisited. Journal of Clinical Psychology, 63,
                                                                                                     817-833.




                                                                                                                                                                                                Vol. 2 no. 2 noVember 2012
                                                                                                                                                                                                Integrating Science and Practice




                                                                                                                                                                                               11
The CORE-OM                                                     The CORE-OM (Chris Evans et al., 2000) is a 34 item
                                                                                                        self-report questionnaire designed to measure change in mental
                                                                                                        health of adults, particularly change brought about by psycholog-
                                        (Clinical Outcomes                                              ical therapies. It was launched in 1998 as a central part of the “CORE
                                                                                                        system” complemented by a practitioner completed instrument
                                        in Routine                                                      (CORE-A) comprising the CORE-TAF (Therapy Assessment Form) and
                                                                                                        CORE-EoT (End of Therapy) and by two 18 item shortened forms for

                                        Evaluation)                                                     repeated use (CORE-SF/A and SF/B; Michael Barkham, Margison, et
                                                                                                        al., 2001). Subsequent work produced another shortened version
                                                                                                        for general population surveys (GP-CORE; Sinclair, Barkham, Evans,
                                        and its derivatives                                             Connell & Audin, 2005), and two more short forms for sessional and
                                                                                                        screening use: CORE-10 (in prep.) and CORE-5 (Wright, Bewick,
                                                                                                        Barkham, House & Hill, 2009). It has been translated into 22 lan-
                                                                                                        guages to date, including a French version currently in progress,
                                                                                                        and adaptations exist for adolescents (YP-CORE; Twigg et al., 2010),
                                                       Dr. Chris evans1, mrCPsych., m.Sc.,
                                                       Institute of Group Analysis,                     for people with learning difficulties (CORE-LD Brooks & Davies, 2008;
                                                       nottinghamshire Personality Disorder             and in prep.) and for description of families (SCORE-15; Stratton,
                                                       and Development network,
                                                                                                        Bland, Janes & Lask, 2010 and SCORE-28; Cahill, O’Reilly, Carr,
                                                       mandala Centre
                                                                                                        Dooley & Stratton, 2010). A health economic Quality of Life (QoL)
                                                       chris@psyctc.org                                 scoring is emerging (Mavranezouli, Brazier, Young & Barkham, 2010)
                                                                                                        as are algorithms or lookup tables to map CORE-OM scores to and
                                                                                                        from scores on other questionnaires such as the BDI-II (Leach et al.,
www.ordrepsy.qc.ca/scienceandpractice




                                                                                                        2006).
                                                                                                                        The CORE-OM assesses change in as wide a group of
                                                                                                        clients as possible, from those with no problems to those with very
                                                                                                        serious thoughts of suicide, self-harm or other severe distress. It was
                                         This paper presents the Clinical outcomes in routine
                                         evaluation (Core-om), a 34 item self-report questionnaire      not designed for forensic services nor for people with current para-
                                         designed to measure change in the mental health of             noid disorders who might mistrust its use, though it is as un-
                                         adults in the context of psychotherapy service delivery.
                                                                                                        provocative for such clients as possible. The measure was also not
                                         The questionnaire includes items with a primarily intra-
                                         personal focus and others with a primarily interpersonal       intended for use by adolescents and a 10 item YP-CORE (Young Per-
                                         focus. It assesses a number of different domains, including    son’s CORE) has been derived by selection and simplification from
 Vol. 2 no. 2 noVember 2012




                                         client well-being, problems and symptoms, functioning
                                         and risk. All Core-om derived measures can be scored
                                                                                                        the CORE-OM for ages 11-16 (Twigg et al., 2010). A 14 item related
                                         easily by hand with scoring boxes on the instruments.          measure, LD-CORE for use with adults with mild to moderate learn-
                                         Particular strengths of the Core-om include its broad          ing difficulties (LD) has also been developed though this includes
                                         domain coverage with risk "flag" items; the existence of
                                         well tested short forms; adaptations for families, young       items not in the CORE-OM as the problems faced by people with LD
                                         people and people with learning difficulties; the mapping      are not the same as those without LD.
                                         of some items to health economic valuation; and
                                         the availability of the system in 22 languages. The
                                         psychometric properties of the questionnaire are
 Integrating Science and Practice




                                         discussed along with its use in treatment planning and
                                         delivery and the procedures, costs and training it requires.

                                         Keywords: Clinical outcomes in routine evaluation;
                                         Core-om; treatment outcome; progress monitoring;
                                         psychotherapy
                                                                                                        1   Dr. Evans is a Trustee of CORE System Trust (CST), the not-for-profit company that holds the copyright
                                                                                                            on the CORE instruments. Like the other CST Trustees, Dr. Evans receives no income from the CORE-OM
                                                                                                            nor from CORE-IMS. This paper is a personal view, not the view of CST or CORE-IMS.

12
Domains Assessed                               only one company, CORE Informa-                               CORE-IMS have supported
The design ensured some items of prima-        tion Management Systems (CORE-IMS,             session-by-session presentation of indi-
rily intrapersonal focus and others prima-     www.coreims. co.uk) has permission to put      vidual client data since 1999 and two
rily interpersonal and to cover well-being,    CORE instruments into software for non-        shortened, 18 items forms (CORE-SF-A/B)
problems/symptoms, functioning and risk.       research use.                                  were provided from the CORE-OM launch.
                An early challenge was to                     CORE-IMS provide two com-       The SF-A and SF-B have four well-being
obtain a measure not too dominated by          puter solutions originally for CORE meas-      items in common and 14 other items that
psychiatric diagnosis hence few items map      ures alone but they now support over 30        are different, minimising memory effects.
to DSM or ICD though anxiety and depres-       other measures, though sometimes with          Over the last decade, expected length of
sion are well covered. No self-report meas-    additional licence costs, and could be ex-     routine measures has fallen and two other
ure can directly measure unconscious           tended to cover any typical measure. Their     short forms, the CORE-5 and CORE-10 are
functioning but many items fit with            systems are CORE-PC and CORE-Net, the          now available. In therapies appropriate to
Freud’s aims that a successful therapy re-     former a standalone PC system and the lat-     this, sessional use of the CORE-OM or
place neurotic misery with normal human        ter a networked client-server system.          shorter forms, supports score guided
unhappiness and his equally famous             CORE-Net uses a routine web browser to         adaptive therapy as championed by Lam-
aim that a good therapeutic outcome en-        access a server, usually a CORE-IMS inter-     bert (Lambert, 2010) and others.
hances the ability to love and to work.        net server, though dedicated local servers
Objections from CBT therapists were            can be used. Costs depend on usage with        Assessment and Treatment
mainly that they preferred measures spe-       CORE-PC available by annual license with       Planning
cific to presenting problems. For all modal-   a minimum license for 125 clients costing      As for sessional use, our “bottom up”
ities it has been important to explain that    £250 ($CA396) and additional clients           philosophy means that how the CORE-OM
no measure should replace normal clinical      charged from £2 ($CA3) downwards as vol-       relates to assessment must be determined




                                                                                                                                             www.ordrepsy.qc.ca/scienceandpractice
information channels and the CORE-OM           ume increases. CORE-Net is also provided       locally. Some services position it as an ap-
no more replaces specific measures in CBT      by annual license with license costs aver-     praisal of the service and not part of the
than it replaces counter-transference in an-   aging £3 ($CA4.75) per client. Neither CST     therapy, thus minimising the clients’ use of
alytic work. Counsellors and humanistic        nor CORE-IMS dictate what services do          the measure to communicate to their ther-
therapists surprisingly proved the most        with their data. The original CORE system      apists and removing it from assessment.
rapid adopters perhaps reflecting that         handbook from 1998 had a chapter on ap-        Others make it part of assessment and find
item wording which was kept in lay lan-        propriate informed consent to use identi-      that it provides a structure with broad
guage.                                         fiable data, congruent with European data      coverage that often leads smoothly into
                                               protection law. CORE system advice has al-     discussion of risk and of particular prob-



                                                                                                                                              Vol. 2 no. 2 noVember 2012
Use and Procedures                             ways been that data will be useful, and        lems.
All CORE-OM derived measures can be            sometimes only legal, if the service/thera-
scored easily by hand with scoring and         pist have thought clearly about planned        Technical Support
scoring boxes on the instruments. All          uses of the data so informed consent for       CORE-IMS provide high quality support
measures have been formatted to be             use can be obtained. All data held centrally   both for the software but more impor-
scanned for optical character reading          has always been scrupulously anonymised        tantly to help services choose how best to
(OCR) and most modern OCR systems              preventing central analysis from identify-     use CORE (or other) scores. This support is
                                                                                                                                              Integrating Science and Practice




should read scores without any illegal         ing services, therapists or clients. CORE-     widely used in the UK, the Netherlands,
modification of the forms. All the CORE        IMS and all the server companies used by       Norway and Denmark with CORE-IMS
instruments are free for use on paper          CORE-Net are accredited to ISO/IEC27001,       support appropriate to different needs in
(www.coreims.co.uk/copyright.pdf). We          an international standard for information      different countries developing as demand
have always given permission for the item      security.                                      emerges. Extensive information about
text to be used in software for research but                                                  the entire CORE system is available at
                                                                                              www.coreims.co.uk.
                                                                                                                                             13
Psychometric Properties                         Unique Features of the Measure                                               using the CORE-OM range from primary
                                         Psychometric properties are sometimes          The CORE-OM is not unique: a number of                                       care medical practitioners and psycholog-
                                        reported as if they were as fixed properties    good general measures exist, though few                                      ical therapists, through a plethora of sec-
                                        of measures but are, of course, statistical     are free to reproduce on paper as the CORE                                   ondary care psychological therapy services
                                        parameters, i.e. empirical findings from        measures are. The empirical literature on                                    including the Tavistock Clinic, to prisons
                                        samples generalised to populations. Trans-      general and specific measures shows them                                     and high secure hospitals. It is used in Clin-
                                        lations will not show exactly the same          all to have high covariance with only small                                  ical Psychology trainings in Norway and by
                                        psychometric properties as English UK           variance specific to diagnosis or problem                                    large provider organisations in the Nether-
                                        samples (e.g. Chris Evans et al., 2002).        area. In this convergent field, particular but                               lands and Norway and international use
                                        So far, reliability and validity in different   not unique strengths of the CORE-OM are:                                     is growing steadily. YP-CORE is one of
                                        samples using the English version and           its broad domain coverage with risk “flag”                                   the measures recommended by CORC
                                        translations have been good. Overall in-        items; the existence of well tested short                                    (www.corc.uk.net) and the SCORE meas-
                                        ternal reliability has been excellent, in the   forms, adaptations for families, young peo-                                  ures are being fostered by AFT
                                        range of .92 to .94. Internal reliability for   ple and people with learning difficulties;                                   (www.aft.org.uk).
                                        domain scores varies more across samples        the mapping of six items to health eco-                                                     Service comparison was a
                                        but is always acceptable. Test-retest relia-    nomic valuation; and the existence of a                                      primary driver; Michael Barkham, Margi-
                                        bility is good but not excessive, as appro-     standard translation protocol with 22                                        son, et al. (2001) and Evans, Connell,
                                        priate to a change measure: typical             good translations.                                                           Barkham, Marshall & Mellor-Clark (2003)
                                        values are from .64 (for the risk domain) to                                                                                 are early examples of such work. This work
                                        .91 (overall score). Discrimination between     Institutional Implementation                                                 has been extended to specific areas, e.g.
                                        clinical and non-clinical samples is always     As the measure is copyleft there is no sin-                                  university student counselling services
                                        strong and sensitivity to change good.          gle register of uptake. However, over 500                                    (Janice Connell, Barkham & Mellor-
www.ordrepsy.qc.ca/scienceandpractice




                                        Correlations with other instruments show        services and over 5000 practitioners use                                     Clark,2007, 2008). Further examples can be
                                        strong convergent validity and often slight     CORE-IMS software. In the UK, services                                       found in the list of CORE related publica-
                                        evidence of within-domain correlations                                                                                       tions (see next page).
                                        being higher than cross-domain correla-
                                        tions (Evans et al., 2002)2.

                                        Patient /Client/Clinician Feedback
                                        An excellent collection of accounts of
                                        using the CORE-OM and other compo-
 Vol. 2 no. 2 noVember 2012




                                        nents of the CORE system (Gray, Penny &
                                        Mellor-Clark, John, 2007) is freely available
                                        at http://www.coreims.co.uk/ site_
                                        downloads/CORE-A-Decade -of-
                                        Development.pdf. The CORE-OM emerged            2   The main criticisms of the psychometric properties of the CORE-OM come from our decision to facilitate reporting of domain scores.
                                        well from user feedback in the NHS com-             Publications and presentations by the CORE team have always recommended using domain scores only where there might be a specific
                                                                                            clinical or research interest in the domain and we never expected the domains to emerge as cross-sectional factors of variance. Initial analy-
                                        pendium of approved mental health                   ses (Evans et al., 2002) using principal component analysis showed a large first factor, a second mainly involving the positively keyed items
                                                                                            and a third involving mainly the risk items. Criticism that the domains do not fall out as neat factors recurs. We believed we had laid these
 Integrating Science and Practice




                                        outcome measures (National Institute for            issues to rest with a hierarchical factor analysis showing second-order general factor and first-order factors of the domains and positively
                                                                                            and negatively keying methods factors and we noted that scale quality was satisfactory where the non-risk items are treated as a single scale
                                        Mental Health England, 2008) and a recent           and risk items as a second is satisfactory (Lyne, Barrett, Evans & Barkham, 2006). However, the fantasy that a 34 item measure could show
                                        user-led review of measures (Crawford et            a neat four factor structure in which well-being, problems, functioning and risk were factorially simple and distinct persists (e.g. Bedford
                                                                                            et al., 2010). We are aware of no psychological theory, no psychotherapy theory nor any empirical data from any measure, that has ever
                                        al., 2011).                                         suggested that this is the case. A recent development may help though. This work extracts a small set of items from measures to provide
                                                                                            a direct translation of scores to QALY (Quality of Life Year) valuations used for health economic (HE) life valuation through time trading
                                                                                            tests widely used for HE scales. This work, (Mavranezouli et al., 2010) which the same team have applied to other problem specific meas-
                                                                                            ures with equal success, neatly inverts the usual complaint noting that the CORE-OM’s complex factor structure and broad domain cover-
                                                                                            age gives a good set of anchor items for HE evaluation. Exploration of the CORE-OM in clinical samples led to selection of six items,
                                                                                            five covering psychological state and one physical state, that provide HE evaluation. Perhaps this will finally dent the fantasy that domain
                                                                                            scores would or could show a clean factor structure.
14
REFERENCES

An extensive list, currently of 123 publications many with abstracts and some with full          Gray, Penny, & Mellor-Clark, John. (2007). CORE: a decade of development. Rugby,
text is at www.coreims.co.uk/Downloads_References.html and updated regularly.                      England: CORE IMS. Retrieved from
                                                                                                   http://www.coreims.co.uk/site_downloads/CORE-A-Decade-of-Development.pdf
Barkham, Michael, Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C.,              Lambert, M. (2010). Prevention of treatment failure : the use of measuring,
   Benson, L., et al. (2001). Service profiling and outcomes benchmarking using the                monitoring, and feedback in clinical practice (1st ed.). Washington D.C.: American
  CORE-OM: toward practice-based evidence in the psychological therapies.                          Psychological Association.
  Journal of Consulting and Clinical Psychology, 69, 184-196.
                                                                                                 Leach, C., Lucock, M., Barkham, M., Stiles, W. B., Noble, R., & Iveson, S. (2006).
Bedford, A., Watson, R., Lyne, J., Tibbles, J., Davies, F., & Deary, I. J. (2010). Mokken          Transforming between Beck Depression Inventory and CORE-OM scores in routine
  scaling and principal components analyses of the CORE-OM in a large clinical                     clinical practice. British journal of clinical psychology, 45, 153-166.
  sample. Clinical Psychology & Psychotherapy, 17, 51-62. doi:10.1002/cpp.649
                                                                                                 Lyne, K. D., Barrett, P., Evans, C., & Barkham, M. (2006). Dimensions of variation on the
Brooks, M., & Davies, S. (2008). Pathways to participatory research in developing a                CORE-OM. British journal of clinical psychology, 45, 185-203.
   tool to measure feelings. British Journal of Learning Disabilities, 36, 128-133.
   doi:10.1111/j.1468-3156.2007.00476.x                                                          Mavranezouli, I., Brazier, J. E., Young, T. A., & Barkham, M. (2010). Using Rasch analysis
                                                                                                   to form plausible health states amenable to valuation: the development of
Cahill, P., O’Reilly, K., Carr, A., Dooley, B., & Stratton, P. (2010). Validation of a 28-item     CORE-6D from a measure of common mental health problems (CORE-OM).
  version of the Systemic Clinical Outcome and Routine Evaluation in an Irish                      Quality of Life Research, 20, 321-333. doi:10.1007/s11136-010-9768-4
  context: the SCORE-28. Journal of Family Therapy, 32, 210-231. doi:10.1111/j.
  1467-6427.2010.00506.x                                                                         National Institute for Mental Health England. (2008). Mental Health Outcomes
                                                                                                   Compendium (p. 84). London: National Institute for Mental Health England.
Connell, Janice, Barkham, M., & Mellor-Clark, J. (2007). CORE-OM mental health norms               Retrieved from http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/
  of students attending university counselling services benchmarked against an                     documents/digitalasset/dh_093677.pdf
  age-matched primary care sample. British Journal of Guidance and Counselling,
  35(1), 41-57. doi:10.1080/03069880601106781                                                    Sinclair, A., Barkham, M., Evans, C., Connell, J., & Audin, K. (2005). Rationale and
                                                                                                    development of a general population well-being measure: Psychometric status
Connell, Janice, Barkham, M., & Mellor-Clark, J. (2008). The effectiveness of UK student            of the GP-CORE in a student sample. British journal of guidance and counselling, 33,
  counselling services: an analysis using the CORE System. British Journal of                       153-173.
  Guidance & Counselling, 36, 1-18. doi:10.1080/03069880701715655
                                                                                                 Stratton, P., Bland, J., Janes, E., & Lask, J. (2010). Developing an indicator of family
Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., Wykes, T.,         function and a practicable outcome measure for systemic family and couple
   et al. (2011). Selecting outcome measures in mental health: the views of service




                                                                                                                                                                                                www.ordrepsy.qc.ca/scienceandpractice
                                                                                                    therapy: The SCORE. Journal of Family Therapy, 32(3), 232-258.
   users. Journal of Mental Health, 20, 336-346. doi:10.3109/09638237.2011.577114
                                                                                                 Twigg, E., Barkham, M., Bewick, B. M., Mulhern, B., Connell, J., & Cooper, M. (2010).
Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor-Clark, J. (2003). Practice-based       The Young Person’s CORE: Development of a brief outcome measure for young
  evidence: Benchmarking NHS primary care counselling services at national and                     people. Counselling and Psychotherapy Research: Linking research with practice, 9,
  local levels. Clinical Psychology and Psychotherapy, 10(6), 374-388.                             160 - 168.
Evans, Chris, Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., &
  Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric                   Wright, F., Bewick, B. M., Barkham, M., House, A. O., & Hill, A. J. (2009). Co-occurrence of
  properties and utility of the CORE-OM. British Journal of Psychiatry, 180(JAN.), 51-60.          self-reported disordered eating and self-harm in UK university students. British
Evans, Chris, Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., &               Journal of Clinical Psychology, 48, 397-410. doi:10.1348/014466509X410343
  McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of
  Mental Health, 9, 247-255.




                                                                                                                                                                                                 Vol. 2 no. 2 noVember 2012
                                                                                                                                                                                                 Integrating Science and Practice




                                                                                                                                                                                                15
The BASIS-24                                                        The Behavior and Symptom Identification Scale
                                                                                                            24 (BASIS-24), copyrighted by McLean Hospital, is a 24 item
                                                                                                            patient self-report questionnaire designed to assess treatment out-
                                        Behavior and                                                        comes by measuring symptoms and functional difficulties experi-
                                                                                                            enced by individuals seeking mental health services. The original
                                        Symptom                                                             tool, Behavior and Symptom Identification Scale 32 (BASIS–32) was
                                                                                                            developed in the early 1980s to meet the need for a brief but com-

                                        Identification Scale                                                prehensive mental health status measure that would be useful in
                                                                                                            assessing the outcomes of mental health treatment from the
                                                                                                            consumer’s point of view. It is a measure of self-reported difficulty
                                                           Thomaskutty b. Idiculla, Ph.D.,                  in the major symptom and functioning domains that lead to the
                                                           mclean Hospital,
                                                           Harvard medical School                           need for mental health services (Eisen, Dill & Grob, 1994).
                                                                                                                            BASIS-24 sought to improve upon BASIS-32 by in-
                                                                                                            creasing applicability across diverse populations and improving the
                                                           tidiculla@mclean.harvard.edu                     reliability and validity of the instrument. Revision of the instrument
                                                                                                            included (a) review of literature; (b) input from 75 researchers,
                                        Susan V. eisen, Ph.D., Center for Health Quality, outcomes &        administrators, clinical providers, and consumers; (c) readability
                                        economic research (CHQoer), bedford, mA, VA Hospital,               analysis; (d) review of survey question design principles and meth-
                                        boston university School of Public Health
                                                                                                            ods; (e) meeting of the research team to review progress and make
                                                                                                            suggestions for the revision; (f) drafting of a revised instrument;
                                                                                                            (g) cognitive testing of the revised instrument; (h) analysis of cog-
                                                                                                            nitive test data; (i) further revisions of the instrument; (j) a second
www.ordrepsy.qc.ca/scienceandpractice




                                                                                                            round of cognitive testing; (k) analysis of the second round of cog-
                                                                                                            nitive testing; and (l) further revisions and construction of the in-
                                                                                                            strument for field-testing. The revised instrument was then tested
                                             The behavior and Symptom Identification Scale 24               on over 6,000 individuals who were receiving inpatient or outpa-
                                             (bASIS-24) is a 24 item patient self-report questionnaire
                                             designed to assess treatment outcomes by measuring
                                                                                                            tient treatment for mental health or substance abuse (Eisen et al.,
                                             symptoms and functional difficulties experienced by            2004a).
                                             individuals seeking mental health services. The survey is                      BASIS-24 is intended for adults, ages 18 and older,
                                             intended for adults of ages 18 and older who present a
                                             broad range of symptoms and problems at all levels of          and is appropriate for individuals who present a broad spectrum of
                                             care including in inpatient, residential, partial and          symptoms and problems at all levels of care including inpatient, res-
 Vol. 2 no. 2 noVember 2012




                                             outpatient settings. The bASIS-24, which has been              idential, partial and outpatient. Furthermore, the instrument can be
                                             translated into five languages, can be used across a wide
                                             range of therapeutic treatment models. Scores are              used across a wide range of therapeutic treatment models. It was
                                             computed for the overall scale, as well as for six subscales   designed to assess improvement over time regardless of type of
                                             that assess depression and functioning; interpersonal
                                                                                                            mental health treatment. A BASIS-24 Adolescent Pilot version is also
                                             relationships; psychosis, substance abuse; emotional
                                             lability, and self-harm. Studies using the questionnaire       available. Both instruments can be used with multiple administra-
                                             have shown that its use is associated with an increase         tions throughout treatment and post-treatment follow-up (Eisen et
                                             in patient satisfaction with care after the domain scores
                                             were discussed with the patient as part of developing
                                                                                                            al., 2004b). The adult version of BASIS-24 is available in English,
 Integrating Science and Practice




                                             a treatment plan. In this paper, the authors describe the      Spanish, Portuguese, French, and Russian.
                                             measure, the procedures related to its use, its psychomet-
                                             ric properties and the contexts in which it can be used.
                                                                                                            Domains Assessed
                                             Keywords: behavior and Symptom Identification Scale;
                                                                                                            The BASIS-24 survey cuts across diagnoses, recognizing the wide
                                             bASIS-24; treatment outcome; progress monitoring;
                                             psychotherapy                                                  range of symptoms and problems that occur across the diagnostic
                                                                                                            spectrum. BASIS-24 is designed to measure outcomes for a broad
                                                                                                            range of treatments and services encompassing many theoretical
16
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)
Integrating Science and Practice (Mller & Bargmann)

Weitere ähnliche Inhalte

Andere mochten auch

The Group Session Rating Scale
The Group Session Rating ScaleThe Group Session Rating Scale
The Group Session Rating ScaleScott Miller
 
Solution-focused Counseling for Depression
Solution-focused Counseling for Depression Solution-focused Counseling for Depression
Solution-focused Counseling for Depression Jeffrey Guterman
 
What Works (Question Version) Bergen
What Works (Question Version) BergenWhat Works (Question Version) Bergen
What Works (Question Version) BergenScott Miller
 
Delrapport ii slutversion
Delrapport ii slutversionDelrapport ii slutversion
Delrapport ii slutversionScott Miller
 
Measures and feedback 2013 [compatibility mode]
Measures and feedback 2013 [compatibility mode]Measures and feedback 2013 [compatibility mode]
Measures and feedback 2013 [compatibility mode]Scott Miller
 
Behavior Therapist (April 2009)
Behavior Therapist (April 2009)Behavior Therapist (April 2009)
Behavior Therapist (April 2009)Scott Miller
 
Dissemination of EST's (November 2009)
Dissemination of EST's (November 2009)Dissemination of EST's (November 2009)
Dissemination of EST's (November 2009)Scott Miller
 
Exposing the Mythmakers
Exposing the MythmakersExposing the Mythmakers
Exposing the MythmakersScott Miller
 
The joy of failure (philpott)
The joy of failure (philpott)The joy of failure (philpott)
The joy of failure (philpott)Scott Miller
 
Feedback informed treatment (german)
Feedback informed treatment (german)Feedback informed treatment (german)
Feedback informed treatment (german)Scott Miller
 
Expanding the Lens of EBP: A Common Factors in Agreement
Expanding the Lens of EBP: A Common Factors in AgreementExpanding the Lens of EBP: A Common Factors in Agreement
Expanding the Lens of EBP: A Common Factors in AgreementScott Miller
 
FIT: Evidence-based Practice meets Social Construction
FIT: Evidence-based Practice meets Social ConstructionFIT: Evidence-based Practice meets Social Construction
FIT: Evidence-based Practice meets Social ConstructionScott Miller
 
Seven Qualities Most Desired in a Therapist
Seven Qualities Most Desired in a TherapistSeven Qualities Most Desired in a Therapist
Seven Qualities Most Desired in a TherapistAnnual Conference
 
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)Scott Miller
 
Classifying happiness as a psychiatric disorder (richard bentall, 1992)
Classifying happiness as a psychiatric disorder (richard bentall, 1992)Classifying happiness as a psychiatric disorder (richard bentall, 1992)
Classifying happiness as a psychiatric disorder (richard bentall, 1992)Scott Miller
 
Individual expertise versus domain expertise (2014)
Individual expertise versus domain expertise (2014)Individual expertise versus domain expertise (2014)
Individual expertise versus domain expertise (2014)Scott Miller
 
The study of supershrinks (Chow, 2014)
The study of supershrinks (Chow, 2014)The study of supershrinks (Chow, 2014)
The study of supershrinks (Chow, 2014)Scott Miller
 
Practice based evidence history, methods and evaluation of the applicability ...
Practice based evidence history, methods and evaluation of the applicability ...Practice based evidence history, methods and evaluation of the applicability ...
Practice based evidence history, methods and evaluation of the applicability ...Scott Miller
 

Andere mochten auch (20)

The Group Session Rating Scale
The Group Session Rating ScaleThe Group Session Rating Scale
The Group Session Rating Scale
 
Solution-focused Counseling for Depression
Solution-focused Counseling for Depression Solution-focused Counseling for Depression
Solution-focused Counseling for Depression
 
What Works (Question Version) Bergen
What Works (Question Version) BergenWhat Works (Question Version) Bergen
What Works (Question Version) Bergen
 
Delrapport ii slutversion
Delrapport ii slutversionDelrapport ii slutversion
Delrapport ii slutversion
 
Measures and feedback 2013 [compatibility mode]
Measures and feedback 2013 [compatibility mode]Measures and feedback 2013 [compatibility mode]
Measures and feedback 2013 [compatibility mode]
 
Behavior Therapist (April 2009)
Behavior Therapist (April 2009)Behavior Therapist (April 2009)
Behavior Therapist (April 2009)
 
Dissemination of EST's (November 2009)
Dissemination of EST's (November 2009)Dissemination of EST's (November 2009)
Dissemination of EST's (November 2009)
 
Exposing the Mythmakers
Exposing the MythmakersExposing the Mythmakers
Exposing the Mythmakers
 
The joy of failure (philpott)
The joy of failure (philpott)The joy of failure (philpott)
The joy of failure (philpott)
 
Feedback informed treatment (german)
Feedback informed treatment (german)Feedback informed treatment (german)
Feedback informed treatment (german)
 
Expanding the Lens of EBP: A Common Factors in Agreement
Expanding the Lens of EBP: A Common Factors in AgreementExpanding the Lens of EBP: A Common Factors in Agreement
Expanding the Lens of EBP: A Common Factors in Agreement
 
FIT: Evidence-based Practice meets Social Construction
FIT: Evidence-based Practice meets Social ConstructionFIT: Evidence-based Practice meets Social Construction
FIT: Evidence-based Practice meets Social Construction
 
Seven Qualities Most Desired in a Therapist
Seven Qualities Most Desired in a TherapistSeven Qualities Most Desired in a Therapist
Seven Qualities Most Desired in a Therapist
 
Chaste Living
Chaste LivingChaste Living
Chaste Living
 
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
The Carlat Psychiatry Report (Interview with Scott Miller, April 2015)
 
Classifying happiness as a psychiatric disorder (richard bentall, 1992)
Classifying happiness as a psychiatric disorder (richard bentall, 1992)Classifying happiness as a psychiatric disorder (richard bentall, 1992)
Classifying happiness as a psychiatric disorder (richard bentall, 1992)
 
Robinson
RobinsonRobinson
Robinson
 
Individual expertise versus domain expertise (2014)
Individual expertise versus domain expertise (2014)Individual expertise versus domain expertise (2014)
Individual expertise versus domain expertise (2014)
 
The study of supershrinks (Chow, 2014)
The study of supershrinks (Chow, 2014)The study of supershrinks (Chow, 2014)
The study of supershrinks (Chow, 2014)
 
Practice based evidence history, methods and evaluation of the applicability ...
Practice based evidence history, methods and evaluation of the applicability ...Practice based evidence history, methods and evaluation of the applicability ...
Practice based evidence history, methods and evaluation of the applicability ...
 

Ähnlich wie Integrating Science and Practice (Mller & Bargmann)

The DSM-5: Overview of Main Themes and Diagnostic Revisions
The DSM-5: Overview of Main Themes and Diagnostic RevisionsThe DSM-5: Overview of Main Themes and Diagnostic Revisions
The DSM-5: Overview of Main Themes and Diagnostic RevisionsJames Tobin, Ph.D.
 
Structure Activity Relationship between the Emerging Psychedelic Industry and...
Structure Activity Relationship between the Emerging Psychedelic Industry and...Structure Activity Relationship between the Emerging Psychedelic Industry and...
Structure Activity Relationship between the Emerging Psychedelic Industry and...Markus Roggen
 
Cuthbert SRF Forum May 2014
Cuthbert SRF Forum May 2014Cuthbert SRF Forum May 2014
Cuthbert SRF Forum May 2014wef
 
Psychedelic Treatment Planning: Opportunities in Integrated Care
Psychedelic Treatment Planning: Opportunities in Integrated CarePsychedelic Treatment Planning: Opportunities in Integrated Care
Psychedelic Treatment Planning: Opportunities in Integrated CareBrian Peacock
 
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2T
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2TDunn & HalonenThe PsychologyMajor’s CompanionChapter 2T
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2TAlyciaGold776
 
Pacitane nanoparticles drug release for brain disorder
Pacitane nanoparticles drug release for brain disorderPacitane nanoparticles drug release for brain disorder
Pacitane nanoparticles drug release for brain disorderIJSRED
 
The new changes in Psychiatric Diagnosis in DSM 5
The new changes in Psychiatric Diagnosis in DSM 5The new changes in Psychiatric Diagnosis in DSM 5
The new changes in Psychiatric Diagnosis in DSM 5Scott Eaton
 
lyonsmPSY86899-24 masters thesis final copy edit (1)
lyonsmPSY86899-24 masters thesis final copy edit (1)lyonsmPSY86899-24 masters thesis final copy edit (1)
lyonsmPSY86899-24 masters thesis final copy edit (1)Marla Sarratori-Lyons
 
Journal Club 27 Jan2017
 Journal Club   27 Jan2017 Journal Club   27 Jan2017
Journal Club 27 Jan2017Frank Meissner
 
Borderline Personality Disorder Ontogeny Of A Diagnosis
Borderline Personality Disorder Ontogeny Of A DiagnosisBorderline Personality Disorder Ontogeny Of A Diagnosis
Borderline Personality Disorder Ontogeny Of A DiagnosisDemona Demona
 
Finished Presentation
Finished PresentationFinished Presentation
Finished PresentationMichael Kugel
 
Behavioral Neuroscience Diploma - Edukite
Behavioral Neuroscience Diploma - EdukiteBehavioral Neuroscience Diploma - Edukite
Behavioral Neuroscience Diploma - EdukiteEduKite
 
Publish Your Papers In The Top Scientific Journals
Publish Your Papers In The Top Scientific JournalsPublish Your Papers In The Top Scientific Journals
Publish Your Papers In The Top Scientific Journalsguestd02fab
 
Introduction to behavorial science
Introduction to  behavorial scienceIntroduction to  behavorial science
Introduction to behavorial scienceTexilaedu
 
Introduction to clinical psychology
Introduction to  clinical psychologyIntroduction to  clinical psychology
Introduction to clinical psychologytexila123
 
Introduction to clinical psychology
Introduction to  clinical psychologyIntroduction to  clinical psychology
Introduction to clinical psychologyTexilaedu
 

Ähnlich wie Integrating Science and Practice (Mller & Bargmann) (20)

Acute Psychiatric Management
Acute Psychiatric ManagementAcute Psychiatric Management
Acute Psychiatric Management
 
The DSM-5: Overview of Main Themes and Diagnostic Revisions
The DSM-5: Overview of Main Themes and Diagnostic RevisionsThe DSM-5: Overview of Main Themes and Diagnostic Revisions
The DSM-5: Overview of Main Themes and Diagnostic Revisions
 
Structure Activity Relationship between the Emerging Psychedelic Industry and...
Structure Activity Relationship between the Emerging Psychedelic Industry and...Structure Activity Relationship between the Emerging Psychedelic Industry and...
Structure Activity Relationship between the Emerging Psychedelic Industry and...
 
Cuthbert SRF Forum May 2014
Cuthbert SRF Forum May 2014Cuthbert SRF Forum May 2014
Cuthbert SRF Forum May 2014
 
Psychedelic Treatment Planning: Opportunities in Integrated Care
Psychedelic Treatment Planning: Opportunities in Integrated CarePsychedelic Treatment Planning: Opportunities in Integrated Care
Psychedelic Treatment Planning: Opportunities in Integrated Care
 
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2T
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2TDunn & HalonenThe PsychologyMajor’s CompanionChapter 2T
Dunn & HalonenThe PsychologyMajor’s CompanionChapter 2T
 
Quality poster
Quality posterQuality poster
Quality poster
 
Pacitane nanoparticles drug release for brain disorder
Pacitane nanoparticles drug release for brain disorderPacitane nanoparticles drug release for brain disorder
Pacitane nanoparticles drug release for brain disorder
 
The new changes in Psychiatric Diagnosis in DSM 5
The new changes in Psychiatric Diagnosis in DSM 5The new changes in Psychiatric Diagnosis in DSM 5
The new changes in Psychiatric Diagnosis in DSM 5
 
lyonsmPSY86899-24 masters thesis final copy edit (1)
lyonsmPSY86899-24 masters thesis final copy edit (1)lyonsmPSY86899-24 masters thesis final copy edit (1)
lyonsmPSY86899-24 masters thesis final copy edit (1)
 
Journal Club 27 Jan2017
 Journal Club   27 Jan2017 Journal Club   27 Jan2017
Journal Club 27 Jan2017
 
Clinical assessment
Clinical assessmentClinical assessment
Clinical assessment
 
Borderline Personality Disorder Ontogeny Of A Diagnosis
Borderline Personality Disorder Ontogeny Of A DiagnosisBorderline Personality Disorder Ontogeny Of A Diagnosis
Borderline Personality Disorder Ontogeny Of A Diagnosis
 
Finished Presentation
Finished PresentationFinished Presentation
Finished Presentation
 
Behavioral Neuroscience Diploma - Edukite
Behavioral Neuroscience Diploma - EdukiteBehavioral Neuroscience Diploma - Edukite
Behavioral Neuroscience Diploma - Edukite
 
Publish Your Papers In The Top Scientific Journals
Publish Your Papers In The Top Scientific JournalsPublish Your Papers In The Top Scientific Journals
Publish Your Papers In The Top Scientific Journals
 
Nursing Thesis Proposal Format
Nursing Thesis Proposal FormatNursing Thesis Proposal Format
Nursing Thesis Proposal Format
 
Introduction to behavorial science
Introduction to  behavorial scienceIntroduction to  behavorial science
Introduction to behavorial science
 
Introduction to clinical psychology
Introduction to  clinical psychologyIntroduction to  clinical psychology
Introduction to clinical psychology
 
Introduction to clinical psychology
Introduction to  clinical psychologyIntroduction to  clinical psychology
Introduction to clinical psychology
 

Mehr von Scott Miller

Deterioration in Psychotherapy: A Summary of Research by Jorgen Flor
Deterioration in Psychotherapy: A Summary of Research by Jorgen FlorDeterioration in Psychotherapy: A Summary of Research by Jorgen Flor
Deterioration in Psychotherapy: A Summary of Research by Jorgen FlorScott Miller
 
Trajectories of Change (Clinicians Research Digest version) 2015
Trajectories of Change (Clinicians Research Digest version) 2015Trajectories of Change (Clinicians Research Digest version) 2015
Trajectories of Change (Clinicians Research Digest version) 2015Scott Miller
 
Measures and feedback 2016
Measures and feedback 2016Measures and feedback 2016
Measures and feedback 2016Scott Miller
 
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...Scott Miller
 
Deliberate Practice at Stangehjelp
Deliberate Practice at StangehjelpDeliberate Practice at Stangehjelp
Deliberate Practice at StangehjelpScott Miller
 
Final Rational Empirical Model for Identifying and Addressing Alliance Ruptures
Final Rational Empirical Model for Identifying and Addressing Alliance RupturesFinal Rational Empirical Model for Identifying and Addressing Alliance Ruptures
Final Rational Empirical Model for Identifying and Addressing Alliance RupturesScott Miller
 
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...Scott Miller
 
The Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
The Therapeutic Alliance, Ruptures, and Session-by-Session FeedbackThe Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
The Therapeutic Alliance, Ruptures, and Session-by-Session FeedbackScott Miller
 
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift MitchellScott Miller
 
Effect size of common versus specific factors
Effect size of common versus specific factorsEffect size of common versus specific factors
Effect size of common versus specific factorsScott Miller
 
Beyond measures and monitoring
Beyond measures and monitoringBeyond measures and monitoring
Beyond measures and monitoringScott Miller
 
Rehab Guarantee Official Report 2015
Rehab Guarantee Official Report 2015Rehab Guarantee Official Report 2015
Rehab Guarantee Official Report 2015Scott Miller
 
Do therapists improve (preprint)
Do therapists improve (preprint)Do therapists improve (preprint)
Do therapists improve (preprint)Scott Miller
 
Medipex innovation awards 2015 press release
Medipex innovation awards 2015 press releaseMedipex innovation awards 2015 press release
Medipex innovation awards 2015 press releaseScott Miller
 
Duration of Psychological Therapy
Duration of Psychological TherapyDuration of Psychological Therapy
Duration of Psychological TherapyScott Miller
 
Does publication bias inflate the apparent efficacy of psychological treatmen...
Does publication bias inflate the apparent efficacy of psychological treatmen...Does publication bias inflate the apparent efficacy of psychological treatmen...
Does publication bias inflate the apparent efficacy of psychological treatmen...Scott Miller
 
Burnout Reconsidered: What Supershrinks Can Teach Us
Burnout Reconsidered: What Supershrinks Can Teach UsBurnout Reconsidered: What Supershrinks Can Teach Us
Burnout Reconsidered: What Supershrinks Can Teach UsScott Miller
 
Why most therapists are average (german, 2014)
Why most therapists are average (german, 2014)Why most therapists are average (german, 2014)
Why most therapists are average (german, 2014)Scott Miller
 
Resolving our Identity Crisis
Resolving our Identity CrisisResolving our Identity Crisis
Resolving our Identity CrisisScott Miller
 
ORS and SRS in Penelope
ORS and SRS in PenelopeORS and SRS in Penelope
ORS and SRS in PenelopeScott Miller
 

Mehr von Scott Miller (20)

Deterioration in Psychotherapy: A Summary of Research by Jorgen Flor
Deterioration in Psychotherapy: A Summary of Research by Jorgen FlorDeterioration in Psychotherapy: A Summary of Research by Jorgen Flor
Deterioration in Psychotherapy: A Summary of Research by Jorgen Flor
 
Trajectories of Change (Clinicians Research Digest version) 2015
Trajectories of Change (Clinicians Research Digest version) 2015Trajectories of Change (Clinicians Research Digest version) 2015
Trajectories of Change (Clinicians Research Digest version) 2015
 
Measures and feedback 2016
Measures and feedback 2016Measures and feedback 2016
Measures and feedback 2016
 
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...
Feedback informed treatment (fit) achieving(apa ip miller hubble seidel chow ...
 
Deliberate Practice at Stangehjelp
Deliberate Practice at StangehjelpDeliberate Practice at Stangehjelp
Deliberate Practice at Stangehjelp
 
Final Rational Empirical Model for Identifying and Addressing Alliance Ruptures
Final Rational Empirical Model for Identifying and Addressing Alliance RupturesFinal Rational Empirical Model for Identifying and Addressing Alliance Ruptures
Final Rational Empirical Model for Identifying and Addressing Alliance Ruptures
 
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
Model for Dealing with Ruptures in the Therapeutic Alliance via Session by Se...
 
The Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
The Therapeutic Alliance, Ruptures, and Session-by-Session FeedbackThe Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
The Therapeutic Alliance, Ruptures, and Session-by-Session Feedback
 
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell
"I Don't Know--The Three Most Common Words in Psychotherapy" Clift Mitchell
 
Effect size of common versus specific factors
Effect size of common versus specific factorsEffect size of common versus specific factors
Effect size of common versus specific factors
 
Beyond measures and monitoring
Beyond measures and monitoringBeyond measures and monitoring
Beyond measures and monitoring
 
Rehab Guarantee Official Report 2015
Rehab Guarantee Official Report 2015Rehab Guarantee Official Report 2015
Rehab Guarantee Official Report 2015
 
Do therapists improve (preprint)
Do therapists improve (preprint)Do therapists improve (preprint)
Do therapists improve (preprint)
 
Medipex innovation awards 2015 press release
Medipex innovation awards 2015 press releaseMedipex innovation awards 2015 press release
Medipex innovation awards 2015 press release
 
Duration of Psychological Therapy
Duration of Psychological TherapyDuration of Psychological Therapy
Duration of Psychological Therapy
 
Does publication bias inflate the apparent efficacy of psychological treatmen...
Does publication bias inflate the apparent efficacy of psychological treatmen...Does publication bias inflate the apparent efficacy of psychological treatmen...
Does publication bias inflate the apparent efficacy of psychological treatmen...
 
Burnout Reconsidered: What Supershrinks Can Teach Us
Burnout Reconsidered: What Supershrinks Can Teach UsBurnout Reconsidered: What Supershrinks Can Teach Us
Burnout Reconsidered: What Supershrinks Can Teach Us
 
Why most therapists are average (german, 2014)
Why most therapists are average (german, 2014)Why most therapists are average (german, 2014)
Why most therapists are average (german, 2014)
 
Resolving our Identity Crisis
Resolving our Identity CrisisResolving our Identity Crisis
Resolving our Identity Crisis
 
ORS and SRS in Penelope
ORS and SRS in PenelopeORS and SRS in Penelope
ORS and SRS in Penelope
 

Integrating Science and Practice (Mller & Bargmann)

  • 1. INTEGRATING ScienceandPractice Volume 2 number 2 noVember 2012 10 Tools for Progress Monitoring in Psychotherapy CelestHealth ORS and SRS CORE-OM Polaris-MH BASIS-24 PSYCHLOPS Integra/COMPASS SOS-10 OQ-45 TOP
  • 2. MISSION OF INTEGRATING SCIENCE AND PRACTICE Integrating Science and Practice is published twice yearly by the Ordre des psychologues du Québec. The goal of the journal is to provide syntheses of scientific knowledge in the area of psychology and to facilitate the transfer of scientific knowledge to the field of practice. The journal aims to give practitioners in psychology, from all areas and fields of practice, the tools they need by providing them with critical reviews of the literature and brief syntheses of knowledge on specific themes. The journal is further intended to inform the public and professionals who work in collaboration with psychologists about recent scientific and clinical developments in psy- chology and about the contribution of psychologists towards improving people’s quality of life. The journal publishes articles by invitation only, following a call for proposals. Independent submissions are neither considered nor accepted. However, the editorial board may receive suggestions for themes. The choice of themes is made on the basis of their clinical relevance and their scientific, social and political relevance. Preference is given to articles that propose best practices in a specific field or context, or that question existing practices or poli- cies based on available research findings. In every instance, the value of an article is assessed on the basis of its scientific merit and its potential for improving practices. All articles undergo anonymous peer review before being accepted and published. www.ordrepsy.qc.ca/scienceandpractice Integrating Science and Practice is published by the Communications Department of Vol. 2 no. 2 noVember 2012 the Ordre des psychologues du Québec. The reproduction and distribution of texts are authorized for non-profit purposes with reference to the source. Editor: Martin Drapeau, Psychologist, Professor of Counselling Psychology and Psychiatry, McGill University Publication Coordinator: Diane Côté, Director of Communications, Ordre des psychologues du Québec Legal deposit Editorial Board: Bibliothèque nationale du Québec Rose-Marie Charest, President, Ordre des psychologues du Québec ISBN 978-2-923164-49-6 Diane Côté, Director of Communications, Ordre des psychologues du Québec (Original version: 978-2-923164-48-9) Pierre Desjardins, Psychologist, Director of Quality and Development of ISSN 1923-189X Integrating Science and Practice Professional Practice, Ordre des psychologues du Québec Martin Drapeau, Psychologist, member of the Ordre des psychologues du Québec Ordre des psychologues du Québec board of directors and Professor at McGill University 1100 Beaumont avenue, suite 510 Nathalie Girouard, Psychologist, Advisor on Quality and Development of Mont-Royal, QC H3P 3H5 Professional Practice, Ordre des psychologues du Québec www.ordrepsy.qc.ca/en Special thanks to: Dr. Marilyn Fitzpatrick, Louise Overington, and Gabriela Ionita from McGill University, for their contribution to this issue. 2
  • 3. TABLE OF CONTENTS INTEGRATING SCIENCE AND PRACTICE noVember 2012 The Value of Progress Tracking in Psychotherapy 5 martin Drapeau The CelestHealth System 7 Craig J. bryan, Stephen mark Kopta, bryan D. lowes The Core-om (Clinical outcomes in routine evaluation) and Its Derivatives 12 Chris evans The bASIS-24 behavior and Symptom Identification Scale 16 Thomaskutty b. Idiculla, Susan V. eisen www.ordrepsy.qc.ca/scienceandpractice The Integra /ComPASS Tracking Assessment System 20 robert J. lueger The outcome Questionnaire-45 24 michael J. lambert The outcome and Session rating Scales 28 Scott D. miller, Susanne bargmann Vol. 2 no. 2 noVember 2012 The Polaris-mH 32 Grant Grissom,Tina Harralson, Jesse nankin The PSYCHloPS (Psychological outcome Profiles) 36 mark Ashworth, maria Kordowicz, Peter Schofield Integrating Science and Practice The Schwartz outcome Scale - 10 (SoS-10) 40 mark A. blais The Treatment outcome Package (ToP) 43 David r. Kraus 3
  • 4. Every English and French issue of Integrating Science and Practice is available on the Ordre des psychologues du Québec website: www.ordrepsy.qc.ca/scienceandpratice Integrating Science and Practice Cahier recherche et pratique _ Documenting the effectiveness _ Documenter l’efficacité des of Psychotherapeutic Interventions interventions en psychothérapie _ Depression: Considerations _ La dépression : considérations Surrounding Treatment Choices autour des choix de traitements _ Addressing Childhood _ Reconnaître et traiter la www.ordrepsy.qc.ca/scienceandpractice Suffering souffrance des enfants Vol. 2 no. 2 noVember 2012 Integrating Science and Practice 4
  • 5. EDITORIAL The Value of Progress Tracking in Psychotherapy A previous issue of Science and Practice (March 2010) was expanded upon by the APA Council of Representatives in 20122. dedicated to the assessment of one’s clinical practice, more specif- Likewise, in 2012, the Canadian Psychological Association (CPA) ically to the value of systematically documenting the effects of the struck a Presidential Taskforce on Evidence Based Practice3 that treatment one offers. The value of progress tracking is unquestion- defined evidence-based practice as “the conscientious, explicit and able, as it addresses the question that ultimately matters most: is judicious use of the best available research evidence to inform each this treatment, as I am delivering it now, helping this patient sitting stage of clinical decision making and service delivery (… and the in front of me? application of this knowledge…) in the context of specific client Asking this question at an individual level, for each characteristics, cultural backgrounds, and treatment preferences”. patient, and not only at a populational level, is certainly something However, the Taskforce also innovated by adding to this that that distinguishes psychologists from most policy makers. Indeed, “following the initiation of treatment, data obtained from the on- psychologists often move well beyond a patient’s diagnosis and going monitoring of clients’ reactions, symptoms, and functioning treatment recommendations that are based exclusively on this di- should be used to modify or discontinue the selected treatment”. agnosis to also take into consideration a number of other impor- Hence, the very definition of evidence-based practice includes on- tant factors that can affect treatment outcome. There are of course going treatment monitoring and progress tracking. Good practice www.ordrepsy.qc.ca/scienceandpractice good reasons for this. First, the DSM does not aim to explicitly and is not only evidence based; it is also practice based. systematically account for extraneous and personal factors, such as This is an important step forward, which is perfectly social support available, marital status, or other factors that may af- congruent with what science has taught us to date. A decade of re- fect a patient’s prognosis, which in and of itself does raise some search has shown the value of progress tracking, and its added ben- questions about psychotherapy recommendations that are based efit to the practice of psychotherapy. It can help clinicians who do solely on diagnosis. The need to move beyond diagnosis and diag- not notice when a patient is deteriorating and even predict poor nosis-based treatment recommendations is also supported by re- outcome before it happens (e.g., see Hannan et al., 2005). Second, search. A number of studies have shown that numerous patient progress tracking can improve retention and adherence to treat- characteristics account for variance in treatment outcome well be- ment and even improve treatment outcome (e.g., Anker et al., 2009; Vol. 2 no. 2 noVember 2012 yond the effects related to fit between treatment type and diagno- Bickman et al., 2011; Reese et al., 2010; Shimokawa et al., 2010; sis (e.g., Beutler et al., 2011; Joyce et al., 2007). see also the special issue of Canadian Psychology on progress track- It is no surprise, then, that the conclusions of the ing4). It can also help to direct the clinicians’ attention to areas and American Psychological Association (APA) Presidential Task Force domains where they may require additional training or supervision, on Evidence Based Practice in Psychology (20061) emphasized the or help them identify those patients with whom they are most integration of patient, relational and treatment variables. Likewise, effective. Unlike symptom measures, progress tracking methods in- the APA and the Order of psychologists of Quebec statements dicate areas that are problematic in the patient’s life (e.g. family, Integrating Science and Practice on evidence based practice define evidence-based practice in etc.), by such providing the clinician with clinically useful informa- psychology as the integration of the best available research with tion that can translate into specific techniques or lead to the dis- clinical expertise in the context of patient characteristics, culture, cussion of specific topics within therapy. Furthermore, patients and preferences. This statement was reiterated and in many ways respond favourably to progress tracking (e.g., Anker et al., 2011), 1 See http://www.apa.org/practice/resources/evidence/evidence-based-statement.pdf 2 See http://www.apa.org/about/governance/council/index.aspx 3 See http://www.cpa.ca/researchers/sciencedirectorate/defebp/ 4 See Canadian Psychology (2012), vol. 53, issue 2. 5
  • 6. and, finally, a number of progress tracking methods provide tools measure and the technical considerations tied to using the meas- and advice to help the clinician adjust the treatment on an ongoing ure, and provides a brief overview of the settings and institutions basis. that have chosen that measure for their clinicians to use. Each With this issue, our goal is to provide readers with an of these measures is short, both clinician and patient friendly, pan- easy to use introduction to the most popular progress tracking theoretical, and can be used in private practice as well as in other measures. Each paper presents one measure and is written by the clinical settings. author of, or important contributors to that measure. All authors We had received very positive feedback about the kindly agreed to structure their paper in the same manner. Hence, previous issue of Science and Practice on progress tracking. Along each paper succinctly presents the measure, the populations it can with this feedback, readers also asked where they can find progress be used with, the languages it is available in, the domains it as- tracking measures and what they actually look like. This issue, which sesses, how it is used, and how it can be useful in treatment plan- presents 10 of the most widely used methods, is our response to ning. It also briefly presents the psychometric properties of the those questions. martin Drapeau, Ph.D., Psychologist editor, Integrating Science and Practice Professor of Counselling Psychology and Psychiatry, www.ordrepsy.qc.ca/scienceandpractice mcGill university Vol. 2 no. 2 noVember 2012 REFERENCES Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, couple therapy outcomes: A randomized clinical trial in a naturalistic setting. K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk Journal of Consulting and Clinical Psychology, 77, 693–704. for treatment failure. Journal of Clinical Psychology, 61, 155–163. Anker, M., Sparks, J., Duncan, B., & Stapnes, A. (2011). Footprints of couple therapy: Joyce, A. S., Piper, W. E., Ogrodniczuk, J. S., & Klein, R. H. (2007). Patient characteristics Client reflections at follow up using a mixed method design in routine care. and variations in termination processes and outcomes. In A. S. Joyce et coll. (éd.), Journal of Family Psychotherapy, 22, 22-45. Termination in psychotherapy: A psychodynamic model of processes and outcomes, pp. 109-131, Washington, DC: American Psychological Association. Integrating Science and Practice Beutler, L. E., Harwood, T. M., Kimpara, S., Verdirame, D., Blau, K. (2011). Coping style. Journal of Clinical Psychology, 67(2),176-183. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client Beutler, L. E., Harwood, T. M., Bertoni, M., & Thomann, J. (2006). Systematic treatment feedback on couple psychotherapy outcomes. Psychotherapy, 47(4), 616-630. selection and prescriptive therapy. In G. Stricker et coll. (éd.), A casebook of Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome psychotherapy integration, p. 29-41, Washington, DC: American Psychological of patients at risk of treatment failure: Meta-analytic and mega-analytic review of Association. a psychotherapy quality assurance system. Journal of Consulting and Clinical Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects Psychology, 78, 298–311. of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiatric Services, 62(12),1423-1429. 6
  • 7. The The CelestHealth System (CHS-MH) is the evolved tool of over 30 years of mental health treatment outcomes assessment. In the early days, the belief was more items meant better assess- CelestHealth ment. In the late 1970’s, paper and pencil questionnaires became popular with research studies investigating self-reported outcomes. System In the early 1980‘s, clinical tracking began with paper and pencil questionnaires given at every session. This tracking approach was incorporated into studies investigating dose-effect relationships Prof. Craig J. bryan, PsyD, AbPP across sessions, where dose is the number of sessions and effect The university of utah & was the probability of improvement (e.g., Howard, Kopta, Krause & The national Center for Veterans Studies Orlinsky, 1986; Kopta, Howard, Lowry, and Beutler, 1994). Offered by Integra Incorporated, COMPASS (Howard, Brill, Lueger, craig.bryan@utah.edu O’Mahoney & Grissom, 1995; Sperry, Brill, Howard & Grissom, 1996) arose in the 1990’s as the most comprehensive outcomes assess- Prof. Stephen mark Kopta, Ph.D., H.S.P.P., ment system featuring measures for mental health, psychothera- university of evansville peutic bond, patient satisfaction, treatment need/expectations, bryan D. lowes, nSCI Group, Washington Crossing, and presenting problems. It totaled 123 items for the patient to Pennsylvania complete and 7 life functioning items that the clinician completed. For a fee, COMPASS responses were faxed to an Integra office and a report was returned by fax to the clinician. At each session, the clinician reviewed the new clinical report with the patient. However, in the late 1990’s, the demand for briefer questionnaires and more www.ordrepsy.qc.ca/scienceandpractice immediately available outcomes increased. To answer this demand, the CHS-MH was created in part from COMPASS, with updated technology using computerized The authors present the CelestHealth System, which can systems to provide a quicker clinical report to the clinician. The be used to monitor patient progress during psychotherapy. System features four instruments: (a) the 20-item Behavioral Health The System includes four instruments: the 43-item behavioral Health measure-43 (bHm-43), which assesses Measure-20 (BHM-20) assesses mental health and takes 90 seconds overall mental health functioning; the 20-item behavioral to complete; (b) the 43-item Behavioral Health Measure-43 also as- Health measure-20 (bHm-20), a shorter version of the sesses mental health with additional subscales, and takes 3 minutes bHm-43; the the 5-item Psychotherapy readiness Scale, which can be used to predict risks of poor treatment to complete; (c) the 5-item Psychotherapy Readiness Scale predicts Vol. 2 no. 2 noVember 2012 outcomes; and the 6-item Therapeutic bond Scale, which risk to do poorly in psychotherapy and takes 30 seconds to com- evaluates the relationship between the psychotherapist plete; and (d) the 6-item Therapeutic Bond Scale, evaluates the rela- and patient. Clinicians can select within the system which instruments to use and how frequently they are adminis- tionship between the psychotherapist and patient in 30 seconds. tered. The system is appropriate for adults 18 years and All four instruments are optional, with the clinician selecting within older of normal or greater intelligence, and can be used in the system which instruments to use and how frequently they are outpatient mental health settings, primary care medicine, and college counseling center settings. This paper presents administered (e.g. every session, only pre-post treatment).The the system, reports on its psychometric properties, and CHS-MH is appropriate for adults 18 years and older of normal or describes how the system can assist in treatment Integrating Science and Practice planning and delivery. greater intelligence. It has been used in outpatient mental health, primary care medicine, and college counseling center settings. It is Keywords: CelestHealth System; CHS-mH; behavioral Health measure; bHQ; Psychotherapy readiness Scale; available in English, Spanish, and Vietnamese. Therapeutic bond Scale; treatment outcome; progress monitoring; psychotherapy 7
  • 8. Domains Assessed health, self-management, and sexual func- All client raw responses and The BHM-20 measures the most fre- tioning concerns. The CHS-MH is compati- the calculated scale scores are stored in quently endorsed symptoms in outpatient ble with most clinical theories and highly secure CHS-MH servers and can be psychotherapy consistent with the three practices. used for research (with approval from an phases of mental health change. This appropriate institutional review board) phase model proposes that improvement Use and Procedures and administrative purposes. An impor- in behavioral health occurs in three pro- The CHS-MH input and output informa- tant new feature is the CelestHealth Treat- gressive, sequential stages across therapy tion is securely communicated across com- ment Outcomes Profile, which uses sessions, with improvement at each phase puter networks to a centralized processing collected data to provide an overview of being contingent upon improvement in system. Before the session, the patient en- the clinical status and progress for all the previous stage. First, the client obtains ters his/her responses using a computer clients within the center. This profile shows a greater sense of well-being with in- (e.g., Netbook, iPad, or desktop computer) a variety of outcome variables including creased optimism and hope. Next, specific that is available in the waiting room. Using percentage of patients recovered, im- symptoms such as panic attacks, depres- simple and familiar browser-based inter- proved, unchanged, and deteriorated for sive thinking, episodes of binge eating, faces, patients respond to a maximum of the most recent session, as well as distress and sleep disturbance diminish. Finally, 31 multiple choice items; the typical time levels at intake and at most recent session. life functioning improves across areas such for completion of the entire CHS-MH is 2.5 These variables are provided for all scales as work, as a parent and partner, and in life minutes. The patient’s responses are ana- and subscales of the BHM-20, and the sys- enjoyment. The phase model of psy- lyzed and scored in secure CHS-MH tem is updated frequently throughout the chotherapy has been validated in several servers; a complete, formatted report is im- day to provide a “real-time” snapshot of the research studies (e.g., Howard, Lueger, mediately available to the clinician as soon center’s client population. Date ranges can Maling & Martinovich, 1993; Leon, Kopta, as the patient finishes the assessment. The also be applied to look at the center’s sta- www.ordrepsy.qc.ca/scienceandpractice Howard & Lutz, 1999; Lutz, Lowry, Kopta, report produces several color-coded tus over historical timeframes. Einstein & Howard, 2001; Stulz & Lutz, graphs and tables. Dose-Outcome graphs The annual license fee for 2007). for the subscales show the patient’s centers that do not charge for services (e,g, Within the phase domains, progress across sessions, the Behavioral college counseling centers) is $US110 per the BHM-20 assesses several mental health Health Profile displays color-coded sub- full time equivalent clinician who uses in- problems: (a) well-being (distress, life scale scores based on normative data, and formation from the system, with a mini- satisfaction, motivation), (b) psychological the Suicide Monitoring Scale helps clini- mum cost of $US550. For a private practice symptoms (depression, anxiety, panic dis- cians to consider current suicide risk level. or center who charges for services, then order, mood swings associated with bipo- The clinician discusses with the patient the license fee is based on number of in- Vol. 2 no. 2 noVember 2012 lar disorder, eating disorder, alcohol/drug his/her distress levels (i.e., severe, moder- takes because use of the system can be abuse, suicidality, risk of violence), and (c) ate, mild, normal) and level of suicide risk billed to insurance companies and life functioning (work/school performance, (high, moderate, low, no risk) as indicated Medicare/Medicaid. There are no set-up intimate relationships, social relationships, by the Behavioral Health Profile. If chosen costs; consulting with CelestHealth staff is life enjoyment). Within each phase do- as an option, the clinician also discusses re- free by phone or email. main, the longer BHM-43 has more sub- sults from the Bond Scale and the Psy- scales comprised of less frequently chotherapy Readiness Scale. With this Assessment and Treatment Planning Integrating Science and Practice endorsed problems in outpatient psy- method, both patient and clinician can see chotherapy. For example, the symptoms which problems need to be targeted and The CHS-MH streamlines the assessment scale measures hostility, sleep disorder, followed as treatment moves forward in of clients’ symptoms and functioning by obsessive-compulsive symptoms, and psy- time. Based on this feedback, technical helping clinicians to more rapidly identify chotic symptoms, and the life functioning adjustments within therapy can be made problem areas and symptom domains of scale additionally measures physical to further reduce the patient’s psy- interest. From a clinical perspective, clini- chopathology and increase motivation. cians and clients can quickly determine 8
  • 9. current clinical severity and historical outpatients). Internal consistency coeffi- as a method for quickly and reliably as- trends over the course of treatment be- cients ranged from .89 to .90 for the Global sessing clients’ “vital signs” of mental cause of the CHS-MH’s ability to immedi- Mental Health score. For the three phases, health. Clients additionally report positive ately calculate and display scores using a the ranges were as follows: Well-Being, feelings about the use of the CHS-MH color-coded scheme. Clinicians can use the .65 to .74; Symptoms, .85 to .86; and Life when clinicians review and refer to the CHS-MH’s output to ask more targeted as- Functioning.72 to .77. Construct validity clients’ responses during the appointment. sessment questions and to focus conver- analyses using the discriminant validity Clinicians have reported that the system’s sations on specific factors that are more method showed significant differences brevity and reliability/validity, as well as its proximally related to treatment outcomes (p < .001) between the samples for all four separate measurement of life functioning (e.g., interventions, life events). The color- scales, with each scale distinguishing from more generalized symptom clusters, coded feedback system also can be used clinical from nonclinical groups. Sensitiv- are particularly attractive features. Primary to facilitate interventions themselves. For ity to change using college counseling and care providers have similarly reported pos- example, a client’s responses or scores can the psychotherapy outpatient samples itive feedback because of the CHS-MH’s be used to disconfirm their beliefs that showed improved outcomes when com- separate measurement of daily function- treatment is not working, or to reinforce paring intake scores to session 3 scores for ing. The separation of a functional domain adherence and motivation for treatment all scales. Concurrent validity is supported is not common among outcomes meas- (e.g., demonstrating improvement from based on very high correlations of BHM-20 urement tools, and is especially useful for one session to the next despite the pa- scales with the other well-known meas- clinicians’ case conceptualization, diag- tient’s assertion that “things aren’t getting ures of mental health functioning includ- nostic impressions, and treatment plan- any better”). The CHS-MH can therefore ing the BASIS-32 (-.83), COMPASS (-.76), ning. enhance clinical accuracy and efficiency, OQ-45 (-.81), and the SCL-R-90 (-.85). More and can facilitate successful treatment recently, the BHM-20’s psychometric prop- Unique Features of the Measure www.ordrepsy.qc.ca/scienceandpractice outcomes. erties were investigated across seven sep- Perhaps the CHS-MH’s most distinguishing arate samples (Blount et al., 2010): four feature is its electronic, web-based format Technical Support primary care samples, two clinical samples and immediate feedback system that can Support includes three electronic manu- of deployed military personnel, and one be implemented across computing plat- als: (a) the CelestHealth Getting Started nonclinical sample of deployed military forms (e.g., PC, Apple, smart phone, Manual describes the procedures for set- personnel. Internal reliability estimates tablets, etc.). This capability makes the ting up administrators, clinicians, and were consistent with Kopta and Lowry’s CHS-MH system especially flexible and clients on the CHS-MH; (b) the CelestHealth (2002) findings. The four scales also practical to use, and has contributed di- Clinical Report Manual explains to the demonstrated medium to large correla- rectly to its easy implementation across a Vol. 2 no. 2 noVember 2012 clinician how to understand the CHS-MH tions in the expected directions with more wide range of clinical settings. For general output; and (c) the CelestHealth specific mood and symptom scales (e.g., clinical settings such as an outpatient psy- Psychotherapist Manual instructs the psy- happiness, fatigue, anxiety, depression, chotherapy practice, primary care, or chotherapist how to use the system with PTSD). Further psychometric evaluation of emergency departments, the CHS-MH’s the client. Free online and telephone the BHM-20 is ongoing. design for measuring generalized mental support is also available. health functioning, as opposed to diagno- Patient /Client/Clinician Feedback sis- or condition-specific symptoms, is es- Psychometric Properties Integrating Science and Practice Positive feedback regarding the simplicity pecially beneficial. Within primary care, for The BHM-20 has demonstrated good reli- and practicality of the CHS-MH has been example, the BHM-20 can be a better indi- ability and validity. An initial psychometric received from both clients and clinicians, cator of mental health functioning than evaluation was conducted by Kopta and especially regarding the color-coded feed- more limited or restricted symptom meas- Lowry (2002) using four samples (i.e., com- back feature. Acceptability of the CHS-MH ures of depression or anxiety given the munity adults, college students, college system is especially enhanced within med- wide spectrum of clinical issues that counseling clients, and psychotherapy ical settings when presented or described typically present in this setting (e.g., 9
  • 10. depression, anxiety, weight management, Administered at intake, the client responds Within primary care, the diabetes management, insomnia, chronic to five items in about 30 seconds that re- CHS-MH has been used to track outcomes pain, etc). late to the duration of presenting prob- for both general patient populations The BHM-20 additionally in- lems, previous psychotherapy experience, (Bryan, Morrow & Appolonio, 2009; Corso, cludes screening items for suicidal ideation and motivation for treatment. Using Bryan, Corso, Morrow & Kanzler, 2010; and impulses that have been shown to im- Global Mental Health as the outcome vari- Ray-Sannerud et al., 2011) and for specific prove the detection of suicidal patients six- able, the scale has been shown to distin- subpopulations (e.g., PTSD; Cigrang et al., fold in primary care relative to standard guish patients demonstrating poor 2011; Corso et al., 2009). The CHS-MH’s interviewing and assessment approaches psychotherapy outcomes from those BHM-20 has additionally been used to by primary care providers (Bryan et al., showing good psychotherapy outcomes improve the detection of suicidal patients 2008). The CHS-MH’s Suicide Monitoring (Kopta, 2010). in primary care clinics (Bryan, Corso, System (SMS) was additionally developed Rudd & Cordero, 2008), and is currently in collaboration with suicide experts to aid Institutional Implementation undergoing pilot testing as a suicide as- clinicians in tracking and managing sui- CHS-MH is used in college counseling set- sessment aid in emergency departments. cide risk over the course of treatment in a tings including Harvard University, Johns The CHS-MH’s recent addition of an option more reliable manner (Kopta, Mond, Hopkins University, University of Min- for tracking psychotropic medication David, Potruzski & Doll, 2010), thereby nesota, Indiana University, and the Univer- along with clinical outcomes provides an helping clinicians to meet standards of sity of Florida. Other settings include especially useful tool for health care care for suicide risk assessment and man- primary care medical clinics at several U.S. providers of all disciplines, but most agement. Air Force Bases and university medical cen- notably psychiatrists and nonpsychiatric The Psychotherapy Readi- ters, as well as and private mental health prescribers (e.g., primary care physicians). ness Scale of the CHS-MH is unique as a clinics. The CHS-MH has been imple- www.ordrepsy.qc.ca/scienceandpractice reliable, valid alert for distinguishing pa- mented by mental health professionals tients who do poorly in psychotherapy. deployed to Iraq to track clinical outcomes. Vol. 2 no. 2 noVember 2012 Integrating Science and Practice 10
  • 11. REFERENCES Beck, A.T., Ward, C., & Mendelson, M. (1961). Beck Depression Inventory (BDI). Howard, K.I., Lueger, R.J., Maling, M.S., and Martinovich, Z. (1993). A phase model of Archives of General Psychiatry 4, 561–571. psychotherapy: Causal mediation of outcome. Journal of Consulting and Clinical Blount, T.H., Bryan, C.J., Kanzler, K.E., Morrow, C.E., Corso, K.A., Corso, M.L. (2010, Psychology, 38, 139-149. November). Psychometric properties of the BHM-20 in military samples. Poster Kopta, S.M. (2010, October). The future is here for college counseling centers: Counseling presented at the annual meeting of the Association for Behavioral and Cognitive works, preventing suicide, and improving outcomes. Workshop presented at the Therapy, San Francisco, CA. Annual University and College Counseling Center Directors (AUCCCD) Conference, Bryan, C.J., Corso, K.A., Rudd, M.D., & Cordero, L. (2008). Improving identification of Portland, Oregon. suicidal patients in primary care through routine screening. Primary Care and Kopta, S.M., & Lowry, J.L. (2002). Psychometric evaluation of the Behavioral Health Community Psychiatry, 13, 143-147. Questionnaire-20: A brief instrument for assessing global mental health and the Bryan, C.J., Morrow, C.E., & Appolonio, K.A.K. (2009). Impact of behavioral health three phases of psychotherapy outcome. Psychotherapy Research, 12, 413-426. consultant interventions on patient symptoms and functioning in an integrated Kopta, S.M., Howard, K.I., Lowry, J.L., & Beutler, L.E. (1994). Patterns of symptomatic family medicine clinic. Journal of Clinical Psychology, 65, 281-293. recovery in psychotherapy. Journal of Consulting and Clinical Psychology, 62, Cigrang, J. A., Rauch, S. A. M., Avila, A. L., Bryan, C. J., Goodie, J. L., Hryshko-Mullen, A., 1009-1016. Peterson, A. L., & the STRONG STAR Consortium. (2011). Treatment of active-duty Kopta, S.M., Mond, M., David, L., Potruzski, N., & Doll, L. (2010, June). Assessing military with PTSD in primary care: early findings. Psychological Services, 8, 104-113. suicidality: Validation of the Suicide Monitoring Scale of the Behavioral Health Corso, K.A., Bryan, C.J., Morrow, C.E., Appolonio, K.K., Dodendorf, D.M., & Baker, M.T. Measure-20 and implications for psychotherapeutic strategies. Paper presented at (2009). Managing posttraumatic stress disorder symptoms in active duty military the annual meeting of the International Society for Psychotherapy Research, personnel in primary care settings. Journal of Mental Health Counseling, 31, Monterey. 119-136. Leon, S.C., Kopta, S.M., Howard, K.I., & Lutz, W. (1999). Predicting patients’ responses Corso, M., Bryan, C.J., Corso, K.A., Morrow, C.E., & Kanzler, K.E. (2010, April). Mental to psychotherapy: Are some more predictable than others? Journal of Consulting health functioning recovery curves associated with behavioral health consultant and Clinical Psychology, 67, 698-704. services in integrated primary care. Poster presented at the annual meeting of Lutz, W., Lowry, J.L., Kopta, S.M., Einstein, D., & Howard, K.I. (2001). Prediction of the Society of Behavioral Medicine, Seattle, WA. dose-response relations based patient characteristics. Journal of Clinical Psychology, Derogatis, L.R. (1983). Administration, scoring, and procedures manual—II. Baltimore, 57, 889-900. MD: Clinical Psychometric Research. Ray-Sannerud, B., Bryan, C.J., Dolan, D., Morrow, C.E., Corso, K.A., Kanzler, K.E., & www.ordrepsy.qc.ca/scienceandpractice Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureño, G., & Villaseñor, V. S. (1988). Corso, M.L. (April 2011). Preliminary evidence for long-term outcomes following brief The Inventory of Interpersonal Problems: Psychometric properties and clinical behavioral health intervention in primary care clinics. Poster presented at the annual applications. Journal of Consulting and Clinical Psychology, 56, 885-895. meeting of the Society of Behavioral Medicine, Washington, DC. Howard, K.I., Brill, P.L., Lueger, R.J., O’Mahoney, M.T., & Grissom, G.R. (1995). Integra Sperry, L., Brill, P.I., Howard, K.I., and Grissom, G.R. (1996). Treatment outcomes in outpatient tracking assessment. Philadelphia: Compass Information Services, Inc. psychotherapy and psychiatric interventions. New York: Brunner/Mazel. Howard, K.I., Kopta, S.M., Krause, M.S., & Orlinsky, D.E. (1986). The dose-effect Stultz, N. & Lutz, W. (2007). Multidimensional patterns of change in outpatient relationship in psychotherapy. American Psychologist, 41, 159 164. psychotherapy: The phase model revisited. Journal of Clinical Psychology, 63, 817-833. Vol. 2 no. 2 noVember 2012 Integrating Science and Practice 11
  • 12. The CORE-OM The CORE-OM (Chris Evans et al., 2000) is a 34 item self-report questionnaire designed to measure change in mental health of adults, particularly change brought about by psycholog- (Clinical Outcomes ical therapies. It was launched in 1998 as a central part of the “CORE system” complemented by a practitioner completed instrument in Routine (CORE-A) comprising the CORE-TAF (Therapy Assessment Form) and CORE-EoT (End of Therapy) and by two 18 item shortened forms for Evaluation) repeated use (CORE-SF/A and SF/B; Michael Barkham, Margison, et al., 2001). Subsequent work produced another shortened version for general population surveys (GP-CORE; Sinclair, Barkham, Evans, and its derivatives Connell & Audin, 2005), and two more short forms for sessional and screening use: CORE-10 (in prep.) and CORE-5 (Wright, Bewick, Barkham, House & Hill, 2009). It has been translated into 22 lan- guages to date, including a French version currently in progress, and adaptations exist for adolescents (YP-CORE; Twigg et al., 2010), Dr. Chris evans1, mrCPsych., m.Sc., Institute of Group Analysis, for people with learning difficulties (CORE-LD Brooks & Davies, 2008; nottinghamshire Personality Disorder and in prep.) and for description of families (SCORE-15; Stratton, and Development network, Bland, Janes & Lask, 2010 and SCORE-28; Cahill, O’Reilly, Carr, mandala Centre Dooley & Stratton, 2010). A health economic Quality of Life (QoL) chris@psyctc.org scoring is emerging (Mavranezouli, Brazier, Young & Barkham, 2010) as are algorithms or lookup tables to map CORE-OM scores to and from scores on other questionnaires such as the BDI-II (Leach et al., www.ordrepsy.qc.ca/scienceandpractice 2006). The CORE-OM assesses change in as wide a group of clients as possible, from those with no problems to those with very serious thoughts of suicide, self-harm or other severe distress. It was This paper presents the Clinical outcomes in routine evaluation (Core-om), a 34 item self-report questionnaire not designed for forensic services nor for people with current para- designed to measure change in the mental health of noid disorders who might mistrust its use, though it is as un- adults in the context of psychotherapy service delivery. provocative for such clients as possible. The measure was also not The questionnaire includes items with a primarily intra- personal focus and others with a primarily interpersonal intended for use by adolescents and a 10 item YP-CORE (Young Per- focus. It assesses a number of different domains, including son’s CORE) has been derived by selection and simplification from Vol. 2 no. 2 noVember 2012 client well-being, problems and symptoms, functioning and risk. All Core-om derived measures can be scored the CORE-OM for ages 11-16 (Twigg et al., 2010). A 14 item related easily by hand with scoring boxes on the instruments. measure, LD-CORE for use with adults with mild to moderate learn- Particular strengths of the Core-om include its broad ing difficulties (LD) has also been developed though this includes domain coverage with risk "flag" items; the existence of well tested short forms; adaptations for families, young items not in the CORE-OM as the problems faced by people with LD people and people with learning difficulties; the mapping are not the same as those without LD. of some items to health economic valuation; and the availability of the system in 22 languages. The psychometric properties of the questionnaire are Integrating Science and Practice discussed along with its use in treatment planning and delivery and the procedures, costs and training it requires. Keywords: Clinical outcomes in routine evaluation; Core-om; treatment outcome; progress monitoring; psychotherapy 1 Dr. Evans is a Trustee of CORE System Trust (CST), the not-for-profit company that holds the copyright on the CORE instruments. Like the other CST Trustees, Dr. Evans receives no income from the CORE-OM nor from CORE-IMS. This paper is a personal view, not the view of CST or CORE-IMS. 12
  • 13. Domains Assessed only one company, CORE Informa- CORE-IMS have supported The design ensured some items of prima- tion Management Systems (CORE-IMS, session-by-session presentation of indi- rily intrapersonal focus and others prima- www.coreims. co.uk) has permission to put vidual client data since 1999 and two rily interpersonal and to cover well-being, CORE instruments into software for non- shortened, 18 items forms (CORE-SF-A/B) problems/symptoms, functioning and risk. research use. were provided from the CORE-OM launch. An early challenge was to CORE-IMS provide two com- The SF-A and SF-B have four well-being obtain a measure not too dominated by puter solutions originally for CORE meas- items in common and 14 other items that psychiatric diagnosis hence few items map ures alone but they now support over 30 are different, minimising memory effects. to DSM or ICD though anxiety and depres- other measures, though sometimes with Over the last decade, expected length of sion are well covered. No self-report meas- additional licence costs, and could be ex- routine measures has fallen and two other ure can directly measure unconscious tended to cover any typical measure. Their short forms, the CORE-5 and CORE-10 are functioning but many items fit with systems are CORE-PC and CORE-Net, the now available. In therapies appropriate to Freud’s aims that a successful therapy re- former a standalone PC system and the lat- this, sessional use of the CORE-OM or place neurotic misery with normal human ter a networked client-server system. shorter forms, supports score guided unhappiness and his equally famous CORE-Net uses a routine web browser to adaptive therapy as championed by Lam- aim that a good therapeutic outcome en- access a server, usually a CORE-IMS inter- bert (Lambert, 2010) and others. hances the ability to love and to work. net server, though dedicated local servers Objections from CBT therapists were can be used. Costs depend on usage with Assessment and Treatment mainly that they preferred measures spe- CORE-PC available by annual license with Planning cific to presenting problems. For all modal- a minimum license for 125 clients costing As for sessional use, our “bottom up” ities it has been important to explain that £250 ($CA396) and additional clients philosophy means that how the CORE-OM no measure should replace normal clinical charged from £2 ($CA3) downwards as vol- relates to assessment must be determined www.ordrepsy.qc.ca/scienceandpractice information channels and the CORE-OM ume increases. CORE-Net is also provided locally. Some services position it as an ap- no more replaces specific measures in CBT by annual license with license costs aver- praisal of the service and not part of the than it replaces counter-transference in an- aging £3 ($CA4.75) per client. Neither CST therapy, thus minimising the clients’ use of alytic work. Counsellors and humanistic nor CORE-IMS dictate what services do the measure to communicate to their ther- therapists surprisingly proved the most with their data. The original CORE system apists and removing it from assessment. rapid adopters perhaps reflecting that handbook from 1998 had a chapter on ap- Others make it part of assessment and find item wording which was kept in lay lan- propriate informed consent to use identi- that it provides a structure with broad guage. fiable data, congruent with European data coverage that often leads smoothly into protection law. CORE system advice has al- discussion of risk and of particular prob- Vol. 2 no. 2 noVember 2012 Use and Procedures ways been that data will be useful, and lems. All CORE-OM derived measures can be sometimes only legal, if the service/thera- scored easily by hand with scoring and pist have thought clearly about planned Technical Support scoring boxes on the instruments. All uses of the data so informed consent for CORE-IMS provide high quality support measures have been formatted to be use can be obtained. All data held centrally both for the software but more impor- scanned for optical character reading has always been scrupulously anonymised tantly to help services choose how best to (OCR) and most modern OCR systems preventing central analysis from identify- use CORE (or other) scores. This support is Integrating Science and Practice should read scores without any illegal ing services, therapists or clients. CORE- widely used in the UK, the Netherlands, modification of the forms. All the CORE IMS and all the server companies used by Norway and Denmark with CORE-IMS instruments are free for use on paper CORE-Net are accredited to ISO/IEC27001, support appropriate to different needs in (www.coreims.co.uk/copyright.pdf). We an international standard for information different countries developing as demand have always given permission for the item security. emerges. Extensive information about text to be used in software for research but the entire CORE system is available at www.coreims.co.uk. 13
  • 14. Psychometric Properties Unique Features of the Measure using the CORE-OM range from primary Psychometric properties are sometimes The CORE-OM is not unique: a number of care medical practitioners and psycholog- reported as if they were as fixed properties good general measures exist, though few ical therapists, through a plethora of sec- of measures but are, of course, statistical are free to reproduce on paper as the CORE ondary care psychological therapy services parameters, i.e. empirical findings from measures are. The empirical literature on including the Tavistock Clinic, to prisons samples generalised to populations. Trans- general and specific measures shows them and high secure hospitals. It is used in Clin- lations will not show exactly the same all to have high covariance with only small ical Psychology trainings in Norway and by psychometric properties as English UK variance specific to diagnosis or problem large provider organisations in the Nether- samples (e.g. Chris Evans et al., 2002). area. In this convergent field, particular but lands and Norway and international use So far, reliability and validity in different not unique strengths of the CORE-OM are: is growing steadily. YP-CORE is one of samples using the English version and its broad domain coverage with risk “flag” the measures recommended by CORC translations have been good. Overall in- items; the existence of well tested short (www.corc.uk.net) and the SCORE meas- ternal reliability has been excellent, in the forms, adaptations for families, young peo- ures are being fostered by AFT range of .92 to .94. Internal reliability for ple and people with learning difficulties; (www.aft.org.uk). domain scores varies more across samples the mapping of six items to health eco- Service comparison was a but is always acceptable. Test-retest relia- nomic valuation; and the existence of a primary driver; Michael Barkham, Margi- bility is good but not excessive, as appro- standard translation protocol with 22 son, et al. (2001) and Evans, Connell, priate to a change measure: typical good translations. Barkham, Marshall & Mellor-Clark (2003) values are from .64 (for the risk domain) to are early examples of such work. This work .91 (overall score). Discrimination between Institutional Implementation has been extended to specific areas, e.g. clinical and non-clinical samples is always As the measure is copyleft there is no sin- university student counselling services strong and sensitivity to change good. gle register of uptake. However, over 500 (Janice Connell, Barkham & Mellor- www.ordrepsy.qc.ca/scienceandpractice Correlations with other instruments show services and over 5000 practitioners use Clark,2007, 2008). Further examples can be strong convergent validity and often slight CORE-IMS software. In the UK, services found in the list of CORE related publica- evidence of within-domain correlations tions (see next page). being higher than cross-domain correla- tions (Evans et al., 2002)2. Patient /Client/Clinician Feedback An excellent collection of accounts of using the CORE-OM and other compo- Vol. 2 no. 2 noVember 2012 nents of the CORE system (Gray, Penny & Mellor-Clark, John, 2007) is freely available at http://www.coreims.co.uk/ site_ downloads/CORE-A-Decade -of- Development.pdf. The CORE-OM emerged 2 The main criticisms of the psychometric properties of the CORE-OM come from our decision to facilitate reporting of domain scores. well from user feedback in the NHS com- Publications and presentations by the CORE team have always recommended using domain scores only where there might be a specific clinical or research interest in the domain and we never expected the domains to emerge as cross-sectional factors of variance. Initial analy- pendium of approved mental health ses (Evans et al., 2002) using principal component analysis showed a large first factor, a second mainly involving the positively keyed items and a third involving mainly the risk items. Criticism that the domains do not fall out as neat factors recurs. We believed we had laid these Integrating Science and Practice outcome measures (National Institute for issues to rest with a hierarchical factor analysis showing second-order general factor and first-order factors of the domains and positively and negatively keying methods factors and we noted that scale quality was satisfactory where the non-risk items are treated as a single scale Mental Health England, 2008) and a recent and risk items as a second is satisfactory (Lyne, Barrett, Evans & Barkham, 2006). However, the fantasy that a 34 item measure could show user-led review of measures (Crawford et a neat four factor structure in which well-being, problems, functioning and risk were factorially simple and distinct persists (e.g. Bedford et al., 2010). We are aware of no psychological theory, no psychotherapy theory nor any empirical data from any measure, that has ever al., 2011). suggested that this is the case. A recent development may help though. This work extracts a small set of items from measures to provide a direct translation of scores to QALY (Quality of Life Year) valuations used for health economic (HE) life valuation through time trading tests widely used for HE scales. This work, (Mavranezouli et al., 2010) which the same team have applied to other problem specific meas- ures with equal success, neatly inverts the usual complaint noting that the CORE-OM’s complex factor structure and broad domain cover- age gives a good set of anchor items for HE evaluation. Exploration of the CORE-OM in clinical samples led to selection of six items, five covering psychological state and one physical state, that provide HE evaluation. Perhaps this will finally dent the fantasy that domain scores would or could show a clean factor structure. 14
  • 15. REFERENCES An extensive list, currently of 123 publications many with abstracts and some with full Gray, Penny, & Mellor-Clark, John. (2007). CORE: a decade of development. Rugby, text is at www.coreims.co.uk/Downloads_References.html and updated regularly. England: CORE IMS. Retrieved from http://www.coreims.co.uk/site_downloads/CORE-A-Decade-of-Development.pdf Barkham, Michael, Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., Lambert, M. (2010). Prevention of treatment failure : the use of measuring, Benson, L., et al. (2001). Service profiling and outcomes benchmarking using the monitoring, and feedback in clinical practice (1st ed.). Washington D.C.: American CORE-OM: toward practice-based evidence in the psychological therapies. Psychological Association. Journal of Consulting and Clinical Psychology, 69, 184-196. Leach, C., Lucock, M., Barkham, M., Stiles, W. B., Noble, R., & Iveson, S. (2006). Bedford, A., Watson, R., Lyne, J., Tibbles, J., Davies, F., & Deary, I. J. (2010). Mokken Transforming between Beck Depression Inventory and CORE-OM scores in routine scaling and principal components analyses of the CORE-OM in a large clinical clinical practice. British journal of clinical psychology, 45, 153-166. sample. Clinical Psychology & Psychotherapy, 17, 51-62. doi:10.1002/cpp.649 Lyne, K. D., Barrett, P., Evans, C., & Barkham, M. (2006). Dimensions of variation on the Brooks, M., & Davies, S. (2008). Pathways to participatory research in developing a CORE-OM. British journal of clinical psychology, 45, 185-203. tool to measure feelings. British Journal of Learning Disabilities, 36, 128-133. doi:10.1111/j.1468-3156.2007.00476.x Mavranezouli, I., Brazier, J. E., Young, T. A., & Barkham, M. (2010). Using Rasch analysis to form plausible health states amenable to valuation: the development of Cahill, P., O’Reilly, K., Carr, A., Dooley, B., & Stratton, P. (2010). Validation of a 28-item CORE-6D from a measure of common mental health problems (CORE-OM). version of the Systemic Clinical Outcome and Routine Evaluation in an Irish Quality of Life Research, 20, 321-333. doi:10.1007/s11136-010-9768-4 context: the SCORE-28. Journal of Family Therapy, 32, 210-231. doi:10.1111/j. 1467-6427.2010.00506.x National Institute for Mental Health England. (2008). Mental Health Outcomes Compendium (p. 84). London: National Institute for Mental Health England. Connell, Janice, Barkham, M., & Mellor-Clark, J. (2007). CORE-OM mental health norms Retrieved from http://www.dh.gov.uk/prod_consum_dh/groups/dh_digitalassets/ of students attending university counselling services benchmarked against an documents/digitalasset/dh_093677.pdf age-matched primary care sample. British Journal of Guidance and Counselling, 35(1), 41-57. doi:10.1080/03069880601106781 Sinclair, A., Barkham, M., Evans, C., Connell, J., & Audin, K. (2005). Rationale and development of a general population well-being measure: Psychometric status Connell, Janice, Barkham, M., & Mellor-Clark, J. (2008). The effectiveness of UK student of the GP-CORE in a student sample. British journal of guidance and counselling, 33, counselling services: an analysis using the CORE System. British Journal of 153-173. Guidance & Counselling, 36, 1-18. doi:10.1080/03069880701715655 Stratton, P., Bland, J., Janes, E., & Lask, J. (2010). Developing an indicator of family Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., Wykes, T., function and a practicable outcome measure for systemic family and couple et al. (2011). Selecting outcome measures in mental health: the views of service www.ordrepsy.qc.ca/scienceandpractice therapy: The SCORE. Journal of Family Therapy, 32(3), 232-258. users. Journal of Mental Health, 20, 336-346. doi:10.3109/09638237.2011.577114 Twigg, E., Barkham, M., Bewick, B. M., Mulhern, B., Connell, J., & Cooper, M. (2010). Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor-Clark, J. (2003). Practice-based The Young Person’s CORE: Development of a brief outcome measure for young evidence: Benchmarking NHS primary care counselling services at national and people. Counselling and Psychotherapy Research: Linking research with practice, 9, local levels. Clinical Psychology and Psychotherapy, 10(6), 374-388. 160 - 168. Evans, Chris, Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric Wright, F., Bewick, B. M., Barkham, M., House, A. O., & Hill, A. J. (2009). Co-occurrence of properties and utility of the CORE-OM. British Journal of Psychiatry, 180(JAN.), 51-60. self-reported disordered eating and self-harm in UK university students. British Evans, Chris, Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & Journal of Clinical Psychology, 48, 397-410. doi:10.1348/014466509X410343 McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of Mental Health, 9, 247-255. Vol. 2 no. 2 noVember 2012 Integrating Science and Practice 15
  • 16. The BASIS-24 The Behavior and Symptom Identification Scale 24 (BASIS-24), copyrighted by McLean Hospital, is a 24 item patient self-report questionnaire designed to assess treatment out- Behavior and comes by measuring symptoms and functional difficulties experi- enced by individuals seeking mental health services. The original Symptom tool, Behavior and Symptom Identification Scale 32 (BASIS–32) was developed in the early 1980s to meet the need for a brief but com- Identification Scale prehensive mental health status measure that would be useful in assessing the outcomes of mental health treatment from the consumer’s point of view. It is a measure of self-reported difficulty Thomaskutty b. Idiculla, Ph.D., in the major symptom and functioning domains that lead to the mclean Hospital, Harvard medical School need for mental health services (Eisen, Dill & Grob, 1994). BASIS-24 sought to improve upon BASIS-32 by in- creasing applicability across diverse populations and improving the tidiculla@mclean.harvard.edu reliability and validity of the instrument. Revision of the instrument included (a) review of literature; (b) input from 75 researchers, Susan V. eisen, Ph.D., Center for Health Quality, outcomes & administrators, clinical providers, and consumers; (c) readability economic research (CHQoer), bedford, mA, VA Hospital, analysis; (d) review of survey question design principles and meth- boston university School of Public Health ods; (e) meeting of the research team to review progress and make suggestions for the revision; (f) drafting of a revised instrument; (g) cognitive testing of the revised instrument; (h) analysis of cog- nitive test data; (i) further revisions of the instrument; (j) a second www.ordrepsy.qc.ca/scienceandpractice round of cognitive testing; (k) analysis of the second round of cog- nitive testing; and (l) further revisions and construction of the in- strument for field-testing. The revised instrument was then tested The behavior and Symptom Identification Scale 24 on over 6,000 individuals who were receiving inpatient or outpa- (bASIS-24) is a 24 item patient self-report questionnaire designed to assess treatment outcomes by measuring tient treatment for mental health or substance abuse (Eisen et al., symptoms and functional difficulties experienced by 2004a). individuals seeking mental health services. The survey is BASIS-24 is intended for adults, ages 18 and older, intended for adults of ages 18 and older who present a broad range of symptoms and problems at all levels of and is appropriate for individuals who present a broad spectrum of care including in inpatient, residential, partial and symptoms and problems at all levels of care including inpatient, res- Vol. 2 no. 2 noVember 2012 outpatient settings. The bASIS-24, which has been idential, partial and outpatient. Furthermore, the instrument can be translated into five languages, can be used across a wide range of therapeutic treatment models. Scores are used across a wide range of therapeutic treatment models. It was computed for the overall scale, as well as for six subscales designed to assess improvement over time regardless of type of that assess depression and functioning; interpersonal mental health treatment. A BASIS-24 Adolescent Pilot version is also relationships; psychosis, substance abuse; emotional lability, and self-harm. Studies using the questionnaire available. Both instruments can be used with multiple administra- have shown that its use is associated with an increase tions throughout treatment and post-treatment follow-up (Eisen et in patient satisfaction with care after the domain scores were discussed with the patient as part of developing al., 2004b). The adult version of BASIS-24 is available in English, Integrating Science and Practice a treatment plan. In this paper, the authors describe the Spanish, Portuguese, French, and Russian. measure, the procedures related to its use, its psychomet- ric properties and the contexts in which it can be used. Domains Assessed Keywords: behavior and Symptom Identification Scale; The BASIS-24 survey cuts across diagnoses, recognizing the wide bASIS-24; treatment outcome; progress monitoring; psychotherapy range of symptoms and problems that occur across the diagnostic spectrum. BASIS-24 is designed to measure outcomes for a broad range of treatments and services encompassing many theoretical 16