SlideShare ist ein Scribd-Unternehmen logo
1 von 9
Predicting The Risk of Clostridium difficile
    Infections Following an Outpatient Visit:
    Development And External Validation of a
    Pragmatic, Prognostic Risk Score

                       Jennifer L. Kuntz, PhD
                       Kaiser Permanente Northwest
                       Center for Health Research

                       May 2, 2012

© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Research question

     How accurately can routinely collected, patient
     characteristics predict the one-year risk of C. difficile
     infection (CDI) among patients having a routine outpatient
     healthcare visit?




© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Methods
  Retrospective cohort study of KPNW patients with an index outpatient
   visit between 2005 and 2008
          Outcome: Time to first occurrence of CDI during the one year after
           an index outpatient visit
  We modeled the occurrence of CDI using Cox regression and translated
   regression coefficients into risk score points.
  We calculated and plotted the observed one-year CDI risk for each decile
   of predicted risk.
  The risk score was validated and recalibrated using a KPCO cohort and
   the same patient characteristics.

© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Results: Development of the risk score

                                                       The failure curves show
                                                       the incidence of CDI
                                                       during the first year
                                                       after an outpatient visit
                                                       among KPNW cohort
                                                       members.
                                                       The curves show the
                                                       observed risk (solid
                                                       lines) and the predicted
                                                       risk (dotted lines) of CDI
                                                       according to deciles of
                                                       predicted risk.



© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Assigning risk score points to patients:
   Translating the tool into practice at KPNW

    A 65-year-old male patient in our cohort who was recently
    hospitalized for 8 days. This patient has diabetes and has
    recently used a fluoroquinolone.


    Age 65 (51 pts) + Hospitalization of 8 days (47 pts) + Diabetes (8 pts) +
                                     Fluoroquinolone use (27 pts)
                                                       = 133 points



© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Results: Validation of the risk score

                                                                       The failure curves show
                               0.020




                                                                       the incidence of CDI
                                                                       during the first year after
                                                                       an outpatient visit
                               0.015




                                                                       among KPCO cohort
Cumulative Risk of Infection




                                                                       members.
                               0.010




                                                                       The curves show the
                                                                       observed risk (solid
                                                                       lines) and the predicted
                               0.005




                                                                       risk (dotted lines) of CDI
                                                                       according to deciles of
                                                                       predicted risk.
                               0.000




                                       0   2   4   6     8   10   12
© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
                                                Months
Results: Validation of the risk score


                                                       Each point indicates the
                                                       predicted risk plotted against
                                                       the observed risk among
                                                       patients in each decile of
                                                       predicted risk.




© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Conclusions

      We developed a pragmatic risk score which:
              Successfully discriminated between patients at the highest and
               lowest one-year risk for CDI.
              Provided predictions which agreed closely with the observed
               risk for CDI.
              Provided important information about the risk for CDI among
               patients who would likely benefit the most from clinician
               recognition of this risk.



© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
Acknowledgements
    Kaiser Permanente Northwest                        Funding source
          Eric S. Johnson, PhD
          Amanda F. Petrik, MS                           Sanofi pasteur
          David H. Smith, PhD
          Micah L. Thorp, DO, MPH
          Xiuhai Yang, MS

    Kaiser Permanente Colorado
          Marsha A. Raebel, PharmD
          Karen A. Glenn

    Decision Research
          Nancy Neil, PhD
© 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH

Weitere ähnliche Inhalte

Mehr von HMO Research Network

A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGER
A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGERA Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGER
A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGERHMO Research Network
 
The Use of Administrative Data and Natural Language Processing to Estimate th...
The Use of Administrative Data and Natural Language Processing to Estimate th...The Use of Administrative Data and Natural Language Processing to Estimate th...
The Use of Administrative Data and Natural Language Processing to Estimate th...HMO Research Network
 
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...HMO Research Network
 
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...HMO Research Network
 
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...HMO Research Network
 
An Application of Doubly Robust Estimation JOHNSON
An Application of Doubly Robust Estimation JOHNSONAn Application of Doubly Robust Estimation JOHNSON
An Application of Doubly Robust Estimation JOHNSONHMO Research Network
 
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...HMO Research Network
 
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOK
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOKExpanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOK
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOKHMO Research Network
 
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...Drug Characteristics Associated with Medication Adherence Across Eight Diseas...
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...HMO Research Network
 
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...Feasibility of Implementing Screening Brief Intervention and Referral to Trea...
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...HMO Research Network
 
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...HMO Research Network
 
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...A Telephone Based Diabetes Prevention Program and Social Support for Weight L...
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...HMO Research Network
 
Technological Resources & Personnel Costs Required to Implement an Automated ...
Technological Resources & Personnel Costs Required to Implement an Automated ...Technological Resources & Personnel Costs Required to Implement an Automated ...
Technological Resources & Personnel Costs Required to Implement an Automated ...HMO Research Network
 
Online Patient Access to their Medical Record and Health Providers is Associa...
Online Patient Access to their Medical Record and Health Providers is Associa...Online Patient Access to their Medical Record and Health Providers is Associa...
Online Patient Access to their Medical Record and Health Providers is Associa...HMO Research Network
 
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALE
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALEDocumentations of Advanced Heath Care Directives Where Are They TAI_SEALE
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALEHMO Research Network
 
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...HMO Research Network
 
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...HMO Research Network
 
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...HMO Research Network
 
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...HMO Research Network
 
Psychology in Primary Care An Evaluation of Best Practices BASU
Psychology in Primary Care An Evaluation of Best Practices BASUPsychology in Primary Care An Evaluation of Best Practices BASU
Psychology in Primary Care An Evaluation of Best Practices BASUHMO Research Network
 

Mehr von HMO Research Network (20)

A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGER
A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGERA Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGER
A Descriptive Study of Vaccinations Occuring During Pregnancy HENNINGER
 
The Use of Administrative Data and Natural Language Processing to Estimate th...
The Use of Administrative Data and Natural Language Processing to Estimate th...The Use of Administrative Data and Natural Language Processing to Estimate th...
The Use of Administrative Data and Natural Language Processing to Estimate th...
 
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...
Patient Views of KRAS Testing for Treatment of Metastatic Colorectal Cancer L...
 
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...
Comparative Effectiveness of Chemotherapy Regimens for Advanced Lung Cancer C...
 
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...
CER HUB An Informatics Platform for Conducting Compartive Effectiveness with ...
 
An Application of Doubly Robust Estimation JOHNSON
An Application of Doubly Robust Estimation JOHNSONAn Application of Doubly Robust Estimation JOHNSON
An Application of Doubly Robust Estimation JOHNSON
 
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...
Risk Factors for Short Term Virologic Outcomes Among HIV Infected Patients Un...
 
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOK
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOKExpanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOK
Expanding SEER Reporting with Comorbidity Data Colorectal Cancer HORNBROOK
 
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...Drug Characteristics Associated with Medication Adherence Across Eight Diseas...
Drug Characteristics Associated with Medication Adherence Across Eight Diseas...
 
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...Feasibility of Implementing Screening Brief Intervention and Referral to Trea...
Feasibility of Implementing Screening Brief Intervention and Referral to Trea...
 
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...
eCare for Heart Wellness A Trial to Test the Feasibility of Web Based Dietici...
 
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...A Telephone Based Diabetes Prevention Program and Social Support for Weight L...
A Telephone Based Diabetes Prevention Program and Social Support for Weight L...
 
Technological Resources & Personnel Costs Required to Implement an Automated ...
Technological Resources & Personnel Costs Required to Implement an Automated ...Technological Resources & Personnel Costs Required to Implement an Automated ...
Technological Resources & Personnel Costs Required to Implement an Automated ...
 
Online Patient Access to their Medical Record and Health Providers is Associa...
Online Patient Access to their Medical Record and Health Providers is Associa...Online Patient Access to their Medical Record and Health Providers is Associa...
Online Patient Access to their Medical Record and Health Providers is Associa...
 
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALE
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALEDocumentations of Advanced Heath Care Directives Where Are They TAI_SEALE
Documentations of Advanced Heath Care Directives Where Are They TAI_SEALE
 
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...
A Simulated Diabetes Learning Intervention Improves Provider Knowledge and Co...
 
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...
Prevalence of Elevated Blood Pressure and BMI in US Children and Adolescents ...
 
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...
Models of Integrated Care for Adolescent Alcohol and Drug Use in Pediatrics P...
 
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...
I Got Mine Have you Gotten Yours Email to Promote Colorectal Cancer Screening...
 
Psychology in Primary Care An Evaluation of Best Practices BASU
Psychology in Primary Care An Evaluation of Best Practices BASUPsychology in Primary Care An Evaluation of Best Practices BASU
Psychology in Primary Care An Evaluation of Best Practices BASU
 

Predicting the Risk of Clostridium Difficile Infections Following an Outpatient Visit KUNTZ

  • 1. Predicting The Risk of Clostridium difficile Infections Following an Outpatient Visit: Development And External Validation of a Pragmatic, Prognostic Risk Score Jennifer L. Kuntz, PhD Kaiser Permanente Northwest Center for Health Research May 2, 2012 © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 2. Research question How accurately can routinely collected, patient characteristics predict the one-year risk of C. difficile infection (CDI) among patients having a routine outpatient healthcare visit? © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 3. Methods  Retrospective cohort study of KPNW patients with an index outpatient visit between 2005 and 2008  Outcome: Time to first occurrence of CDI during the one year after an index outpatient visit  We modeled the occurrence of CDI using Cox regression and translated regression coefficients into risk score points.  We calculated and plotted the observed one-year CDI risk for each decile of predicted risk.  The risk score was validated and recalibrated using a KPCO cohort and the same patient characteristics. © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 4. Results: Development of the risk score The failure curves show the incidence of CDI during the first year after an outpatient visit among KPNW cohort members. The curves show the observed risk (solid lines) and the predicted risk (dotted lines) of CDI according to deciles of predicted risk. © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 5. Assigning risk score points to patients: Translating the tool into practice at KPNW A 65-year-old male patient in our cohort who was recently hospitalized for 8 days. This patient has diabetes and has recently used a fluoroquinolone. Age 65 (51 pts) + Hospitalization of 8 days (47 pts) + Diabetes (8 pts) + Fluoroquinolone use (27 pts) = 133 points © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 6. Results: Validation of the risk score The failure curves show 0.020 the incidence of CDI during the first year after an outpatient visit 0.015 among KPCO cohort Cumulative Risk of Infection members. 0.010 The curves show the observed risk (solid lines) and the predicted 0.005 risk (dotted lines) of CDI according to deciles of predicted risk. 0.000 0 2 4 6 8 10 12 © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH Months
  • 7. Results: Validation of the risk score Each point indicates the predicted risk plotted against the observed risk among patients in each decile of predicted risk. © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 8. Conclusions  We developed a pragmatic risk score which:  Successfully discriminated between patients at the highest and lowest one-year risk for CDI.  Provided predictions which agreed closely with the observed risk for CDI.  Provided important information about the risk for CDI among patients who would likely benefit the most from clinician recognition of this risk. © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH
  • 9. Acknowledgements  Kaiser Permanente Northwest  Funding source Eric S. Johnson, PhD Amanda F. Petrik, MS Sanofi pasteur David H. Smith, PhD Micah L. Thorp, DO, MPH Xiuhai Yang, MS  Kaiser Permanente Colorado Marsha A. Raebel, PharmD Karen A. Glenn  Decision Research Nancy Neil, PhD © 2012, KAISER PERMANENTE CENTER FOR HEALTH RESEARCH

Hinweis der Redaktion

  1. As background, Clostridium difficile infection is a gastrointestinal infection associated with significant morbidity in the United States. C diff is traditionally considered to be a healthcare associated infection although it is becoming more common in ambulatory populations. The primary risk factors for CDI are advanced age, underlying comorbidity, and antimicrobial use. First, you are likely wondering who will benefit from being able to accurately predict a patient’s risk for CDI.1) Vaccine developers – to determine clinical trial eligibility2) In turn, if or when a C. difficile vaccine is developed, healthcare providers could determine which patients would benefit from vaccination. 3) Finally, physicians might use the risk score to identify patients for more judicious utilization of antimicrobials or risk management for CDI.
  2. To develop the risk score, we conducted a retrospective cohort study among KPNW patients who had an index outpatient visit for any reason between July 2005 and September 2008. We then followed these patients for one year--until the end of follow-up or the first occurrence of CDI. C. difficile was identified through toxin tests in combination with treatment for CDI or through ICD-9 codes. We then identified potential predictors for CDI based on the current scientific literature and input from clinicians. As we were designing the risk score to be pragmatic and useful in clinical practice, we also tried to select predictors which can be easily obtained during patient care, through electronic health records. Predictors included: healthcare utilization—hospitalization, stay in a nursing home; medication use, specifically antimicrobials and gastric acid suppressants; and history of immunosuppression, renal dialysis, and chemotherapeutic procedures or therapies. These were measured during the 60-day baseline period before the index outpatient visit. The presence or absence of comorbid conditions were measured in the one year prior to the index visit.We used Cox regression to evaluate baseline patient characteristics that might predict CDI in the one year following an outpatient visit. The risk score results from the translation of the coefficients from the Cox regression into a points-based system, in which a higher number of points indicates a higher risk of CDI. First, the linear predictor in the Cox model was mapped to the corresponding one-year risk for CDI. Following this, the components of the linear predictor were rescaled to an arbitrary axis in which a score of zero points was assigned to the lowest-risk category for each variable, with increasing points counted for proportionate increases in the linear predictor. These risk score points approximate the exact hazard ratio for CDI. We calculated the observed risk of CDI for each decile of patients’ predicted risks of CDI to measure discrimination and calibration. The observed and predicted risks were then plotted using failure curves.Following development of the risk score at KPNW, we validated and recalibrated the risk score using a retrospective cohort of KPCO members with an index outpatient visit during the same time period. We used the same patient characteristics for the development and validation risk scores.