The document proposes a knowledge-based framework called HAIKU that uses ontologies, web services, and rules to improve surveillance of healthcare-associated infections. The framework focuses on consistently classifying infections like surgical site infections according to standards and guidelines. It uses the HAI ontology to group thousands of codes into a hierarchy of infection concepts and relationships. Statistical analysis and heuristics are used to define rules to improve detection of surgical site infection cases. The framework aims to use "e-triggers" identified through the ontology to better assess risk of postoperative infections for certain surgeries.
Disha NEET Physics Guide for classes 11 and 12.pdf
SYSTEMS-LEVEL QUALITY IMPROVEMENTFrom Cues to Nudge A Kno.docx
1. SYSTEMS-LEVEL QUALITY IMPROVEMENT
From Cues to Nudge: A Knowledge-Based Framework
for Surveillance of Healthcare-Associated Infections
Arash Shaban-Nejad1,2 & Hiroshi Mamiya2 & Alexandre
Riazanov3 & Alan J. Forster4 &
Christopher J. O. Baker2,5 & Robyn Tamblyn2 & David L.
Buckeridge2
Received: 3 June 2015 /Accepted: 30 September 2015
/Published online: 4 November 2015
# Springer Science+Business Media New York 2015
Abstract We propose an integrated semantic web framework
consisting of formal ontologies, web services, a reasoner and a
rule engine that together recommend appropriate level of
patient-care based on the defined semantic rules and guide-
lines. The classification of healthcare-associated infections
within the HAIKU (Hospital Acquired Infections – Knowl-
edge in Use) framework enables hospitals to consistently fol-
low the standards along with their routine clinical practice and
diagnosis coding to improve quality of care and patient safety.
The HAI ontology (HAIO) groups over thousands of codes
into a consistent hierarchy of concepts, along with relation-
ships and axioms to capture knowledge on hospital-associated
infections and complications with focus on the big four types,
surgical site infections (SSIs), catheter-associated urinary tract
infection (CAUTI); hospital-acquired pneumonia, and blood
stream infection. By employing statistical inferencing in our
study we use a set of heuristics to define the rule axioms to
improve the SSI case detection. We also demonstrate how the
2. occurrence of an SSI is identified using semantic e-triggers.
The e-triggers will be used to improve our risk assessment of
post-operative surgical site infections (SSIs) for patients un-
dergoing certain type of surgeries (e.g., coronary artery bypass
graft surgery (CABG)).
Keywords Ontologies . Knowledge modeling .
Healthcare-associated infections . Surveillance . Semantic
framework . Surgical site infections
Introduction
Healthcare-associated Infections (HAIs) affect millions of
patients around the world, killing hundreds of thousands
and imposing, directly or indirectly, a significant socio-
economic burden on healthcare systems [1]. According
to the Centers for Disease Control (CDC) [2], hospital-
acquired infections in the U.S., where the point preva-
lence of HAIs among hospitalized patients is 4 %, result
in an estimated 1.7 million infections, which lead to as
many as 99,000 deaths and cost up to $45 billion annually
[3, 4]. Similar or higher rates of HAI occur in other coun-
tries as well with an estimated 10.5 % of patients in Ca-
nadian hospitals having an HAI [5]. Clinical assessment
and laboratory testing are generally used to detect and
confirm an infection, identify its origin, and determine
appropriate infection control methods to stop the infection
from spreading within a healthcare institution. Failure to
monitor, and detect HAI in timely manner can delay di-
agnosis, leading to complications (e.g., sepsis), and
allowing an epidemic to spread.
To ensure the quality of care given to the patients in
healthcare settings, it is crucial to have systems that mon-
3. itor for cases of HAI [6]. Our knowledge-based surveil-
lance infrastructure enables monitoring for HAIs and
This article is part of the Topical Collection on Systems-Level
Quality
Improvement
* Arash Shaban-Nejad
[email protected]
1 School of Public Health, University of California at Berkeley,
50
University Hall, 94720-7360 Berkeley, CA, USA
2 Department of Epidemiology and Biostatistics, McGill
University,
Montreal, QC, Canada
3 IPSNP Computing Inc, Suite 1000, 44 Chipman Hill, Station
A, PO
Box 7289, Saint John, NB E2L 4S6, Canada
4 Faculty of Medicine, University of Ottawa, Ottawa, ON,
Canada
5 Department of Computer Science, University of New
Brunswick,
Saint John, NB, Canada
J Med Syst (2016) 40: 23
DOI 10.1007/s10916-015-0364-6
http://crossmark.crossref.org/dialog/?doi=10.1007/s10916-015-
0364-6&domain=pdf
generates an alert when a suspect, probable, or confirmed
4. cases of HAI is detected. In this paper we focus on sur-
gical site infections (SSIs), one of the most common
healthcare associated infections, accounting for about
31 % of all HAIs among hospitalized patients in 2010 in
U.S [7]. Diagnosis of an SSI relies mainly on direct ob-
servation of physical signs and symptoms of infection in
an incisional wound and a case cannot usually be con-
firmed solely by analyzing data given in laboratory re-
ports. Given the diversity, complexity and heterogeneity
of HAI data, availability of a reference vocabulary is a
prerequisite of creating an integrated knowledge-based
system. Despite several modifications and improvements
to existing terminologies made by the Centers for Disease
Control and Prevention (CDC) in the last decade, e.g.,
specifying the location of infections related to surgical
operations and clarifying the criteria to identify the exact
anatomic location of deep infections [8], inconsistencies,
discrepancies, and confusion in the application of the
criteria in different medical/clinical practices still exist,
and there is a need for further improvement and clarifica-
tion of the current nomenclature [9].
While the Centers for Disease Control and Prevention
(CDC) has provided a certain criteria as a guideline [8] to
prevent, control and reduce HAIs, in the HAIKU project
[10] we have brought together expertise in artificial intel-
ligence, knowledge modeling, epidemiology, medicine,
and infection control to explore how advances in semantic
technology can improve the analysis and detection of
HAIs. To develop a common understanding about the do-
main of infection control and to achieve data interopera-
bility in the area of healthcare-associated infections, we
present the HAI Ontology as part of the HAIKU (Hospital
Acquired Infections – Knowledge in Use) project. The
formal HAI ontology assists researchers and health pro-
fessionals in analyzing medical records to identify and
5. flag potential cases of HAIs among patients who could
be at risk of acquiring an SSI.
In this paper we discuss the role and importance of the
HAIKU semantic infrastructure to improve the detection of
HAI using semantic web technologies. The paper is organized
as follows: BExisting methods for detecting HAI^ section pre-
sents an overview of existing tools and systems for managing
nosocomial infections. The HAIKU ontology design and im-
plementation along with the related semantic rules and axioms
designed for intelligent alerting are presented in BThe HAI
ontology: an overview^ and BThe HAIKU framework for case
detection and reporting^ section, respectively.
BAxiomatization using semantic and statistical analysis^ sec-
tion presents our axiomatization process informed by statisti-
cal analysis of existing datasets. The paper concludes in
BConclusion^ section with a general discussion, a summary
of findings, and anticipated future work.
Existing methods for detecting HAI
Healthcare-associated Infections have been considered an im-
portant healthcare quality outcome since Florence Nightingale
reduced mortality rates through the application of septic tech-
niques in field hospitals during the Crimean war [11]. HAIs
continue to be costly to individual patients and to the health
system. Although there are several different types of HAIs,
five of them account for nearly all cases. These HAI types are:
pneumonia, surgical site infections, urinary tract infections,
bloodstream infections, and gastrointestinal infections [3, 5].
The recognition that specific syndromes represent the majority
of infections was an important advancement in efforts to re-
duce the incidence and impact of HAIs. While general ap-
proaches to reduce infections have been employed since the
1800s – including encouraging hand hygiene [12, 13] and
environment cleaning [14, 15] – evidence-based preventive
6. measures specifically designed for each of the five HAI syn-
dromes now exist [16–20].
A cornerstone of HAI prevention and control is disease
surveillance. The Centers for Disease Control and Prevention
has specified explicit criteria and cohort definitions to support
the surveillance of various HAI syndromes [6]. Their efforts in
this domain began in the 1970s and led to the conduct of the
SENIC Project [6], which evaluated the impact of infection
surveillance on HAI incidence [21]. This study demonstrated
that systematic tracking of HAIs coupled with physician-level
feedback significantly reduces infection risk [21]. Other re-
searchers [22, 23] have also described the use of electronic
systems for the surveillance of hospital acquired infections,
mainly through monitoring microbiology lab reports. As a
result of the SENIC Project, hospital based infection control
programs have become a standard practice; and surveillance is
a primary function of these programs. The task of surveil-
lance, however, is not trivial. It is instructive to consider sur-
veillance for surgical site infections as an example. Each day,
patients undergoing surgery must be identified, baseline infor-
mation recorded, and a method of follow-up identified. Then,
practitioners must follow patients for 30 days following the
surgery to identify specific criteria indicative of infection [24].
This monitoring requires extensive review of medical records
and possibly a telephone interview with the patient. This man-
ual process is time consuming and is expensive, requiring
highly skilled personnel. Due to the expense, hospitals may
forego surveillance or focus only on a subset of patients. Nei-
ther of these alternatives is optimal and in spite of many years
of experience and research, the detection and control of HAIs
remains as a challenge.
However, many of the steps in the surveillance of HAI
could, in theory, be automated. The cohort identification could
be simplified by taking advantage of information contained in
7. information systems used to manage operating rooms. Most of
the criteria specifying increased risk of infection are contained
23 Page 2 of 12 J Med Syst (2016) 40: 23
in other systems, such as laboratory, pharmacy, or administra-
tive information systems. If this information could be com-
bined in a consistent manner across disparate information sys-
tems, then it might be possible to reduce the costs of infection
control programs or to increase the number of patients covered
by them. The goal of our project is to create a logical frame-
work using clear semantics to enable the consistent integration
of different data sources necessary for HAI surveillance, with
an initial focus on SSI.
The HAI ontology: An overview
Many factors [25], including environmental, organizational,
procedural, and personal factors, contribute to the occurrence
and severity of HAIs. The effectiveness of any detection meth-
od is highly dependent on the quality of the integrated infor-
mation derived from different data sources in various settings
including microbiological, clinical, and epidemiological data.
We use ontologies along with other semantic technologies to
align these different data sources with one another and with
knowledge-bases, regulations, and processes. An ontology, or
a formal explicit specification of shared conceptualization
[26], provides a semantic framework for knowledge dissemi-
nation, exchange, and discovery via reasoning and
inferencing. Ontologies capture the knowledge in a domain
of interest through concepts, instances and relationships (tax-
onomic and associative). The taxonomic relationships orga-
nize concepts into sub/super (narrower/broader) concept tree
structure, while associative relationships relate instances of
8. defined concepts across taxonomies.
Methodology and data sources
The HAI Ontology has been implemented following an inte-
grated and iterative V- model [27] methodology consisting of
the following steps: i) scope definition; ii) data and knowledge
acquisition; iii) conceptualization through defining the main
concepts, their attributes and the relationships within the do-
main of interest; iv) integration; v) encoding using a formal
ontology language; vi) documentation and vii) evaluation.
In the conceptualization stage we have defined the onto-
logical elements (concepts, relationships/attributes and logical
axioms) based on expert interview, the results from a statistical
analysis over our available datasets along with the CDC SSI
case definition criteria [6, 24] and a case–control study per-
formed over a systematic review of 156 studies on SSIs and
their associated factors and attributes [28]. In this study, we
used the Ottawa Hospital (TOH) research data warehouse,
[28] which contains data from 1996 to the present time. ware-
house is a relational database that draws together data from
multiple source systems including the most important opera-
tional information systems, such as laboratory (microbiology
and clinical chemistry), pharmacy, operating room, clinical
notes, encounters and diagnoses (classified using ICD codes)
patient registration system, patient demographics and move-
ment, and patient abstracts (e.g., discharge abstract database
(DAD), and the national ambulatory care reporting system
(NACRS)).
Moreover to develop and validate detection methods we
have used clinical data along with the information extracted
through exhaustive chart review to identify patients that have
experienced surgical site infections. For surveillance of SSIs,
9. the infection-control staff routinely collect demographic and
operational data about selected patients undergoing one or
more operative procedures during a specific observation time
period.
At the integration phase several databases (e.g., those con-
taining information on hospital morbidity and discharge ab-
stracts), existing bio-ontologies (e.g., SNOMED-CT [29],
ICD-9,1 HL7-RIM,2 FMA,3 CheBI,4 Infectious Disease On-
tology (IDO)), and textual resources have been used to design
and implement the integrated HAI Ontology. The databases
and ontologies has been identified and selected based on our
requirements and their compatibility with existing data ware-
house schema architecture. The integration [10] has been done
at two structural and semantic levels. The structural integra-
tion has been done by creating a homogeneous dataset in a
standard ontology language. Semantic integration, which is
more challenging, has been performed partly manually and
partly (semi) automatically through using the
SemanticScience Integrated Ontology (SIO) framework [30].
Ontological conceptualization
We use description logics and OWL 2.0 Web Ontology Lan-
guage [31] to encode the ontological model. Figures 1 and 2
demonstrate, respectively, a segment of the HAI Ontology
class hierarchy representing different types of hospital ac-
quired infections and different types of processes and opera-
tions defined in the HAI Ontology, integrated within the
SemanticScience Integrated Ontology (SIO) framework [30],
created using Protégé5 ontology editor.
Figure 3 demonstrates a partial view of the HAI On-
tology in Protégé with axiom definitions for Surgical
Site Infections.
10. An extra-simple-time-ontology has been created to manage
temporal aspects of HAIKU. We also use the SADI
1 International Classification of Diseases, Version 9
2 HL7 Reference Information Model:
www.hl7.org/implement/standards/
rim.cfm
3 T h e F o u n d a t i o n a l M o d e l o f A n a t o m y O n t o l
o g y :
sig.biostr.washington.edu/projects/fm/AboutFM.html
4 Chemical Entities of Biological Interest (ChEBI):
https://www.ebi.ac.
uk/chebi/
5 http://protege.stanford.edu/
J Med Syst (2016) 40: 23 Page 3 of 12 23
http://www.hl7.org/implement/standards/rim.cfm
http://www.hl7.org/implement/standards/rim.cfm
https://www.ebi.ac.uk/chebi/
https://www.ebi.ac.uk/chebi/
http://protege.stanford.edu/
framework [32], which is a set of conventions for creating
HTTP-based Semantic Web services. It consume RDF6 doc-
uments as input and produce RDF documents as output,
which solves the syntactic interoperability problem as all ser-
vices communicate in one language. We evaluate the HAI
Ontology by assessing its competency to answer the intended
queries. Also to examine consistency of the ontology we use
logical reasoners. We have already formulated [10, 33] a
broad range of semantic queries to improve HAI case identi-
fication and enumeration, evaluation of HAI risk factors or
causative factors, identification or evaluation of diagnostic
factors.
11. Below is an example [33] of captured knowledge in
the HAI ontology represented in in N3 format [34],
which is a variation of RDF with improved human-read-
ability. It demonstrates an event such as BDiagnosis^ Bis
performed for^ a Bpatient^ within an specific time
Bdiagnosis time^ and Bidentifies^ an Bincident^, which
could be a Bsurgical site infection^ as Bconsequence of^
a Bsurgery ,̂ in this case Bcoronary artery bypass graft^
has been performed in a specific time (Bevent has
time^) Bsurgery time^. Looking at the Bblood culture
result^ for Bblood culture test^ that Bhas time^ Btest
time^, Bspecifies finding^, which here is Bpositive blood
culture finding^ that ‘identifies microorganism^
Fig. 1 Different types of
Healthcare-associated infections
defined in HAIKU
Fig. 2 Different types of processes defined in the HAI
Ontology, integrated
within the Semanticscience Integrated Ontology (SIO)
framework 6 The Resource Description Framework (RDF):
www.w3.org/RDF/
23 Page 4 of 12 J Med Syst (2016) 40: 23
http://www.w3.org/RDF/
BSerratia Proteamaculans^ and its NCBI’s taxonomy
number: 28151. Then, a Bpharmacy service^, which is
Ba service for^ the Bpatient^ has been performed at
Bpharmacy service time^ to Bmanage^ a Bdrug product^,
in this case BA-Hydrocort Inj^ with a specific drug
12. identification number (DIN) record.
The HAIKU framework for case detection
and reporting
As shown in Fig. 4, the HAIKU semantic web framework
consists of formal ontologies, web services, a reasoner and a
rule engine that together recommend appropriate level of ac-
tions based on the defined semantic rules and guidelines. The
HAIKU semantic rules are modeled throughout a set of
iterative processes that consists of domain and context speci-
fication, consensus knowledge acquisition from unstructured
texts and literature, statistical/epidemiological analysis over
existing structured data available from the TOH data ware-
house, interviewing with domain experts and end-users, eval-
uation and conflicts resolution.
The semantic backbone, powered by the HAI ontology,
assists us in reviewing medical records by identifying specific
J Med Syst (2016) 40: 23 Page 5 of 12 23
Fig. 4 The HAIKU framework for automatic case detection
Fig. 3 Part of the HAI Ontology in Protégé representing axiom
definitions for SSIs
23 Page 6 of 12 J Med Syst (2016) 40: 23
terms and the association between them to generate patterns
that indicate at-risk patients. By linking relevant pieces of data
13. and information (e.g., signs and symptoms, type of medical
procedures, length of hospitalization, drugs prescribed, names
of infectious agents), an e-trigger can be fired when the se-
mantics imply a possible risk of SSI, allowing preventative
measures can be taken.
In the knowledge engineering phase, as demonstrated
in Fig. 4, after implementing the integrated HAI ontol-
ogy [33] we used PSOA RuleML [35], to map the con-
cepts in the ontology to instances of data in TOH
datawarehouse. For example, the population of
haio:is_performed for and haio:identifies is captured by
the following rules:
Axiomatization using semantic and statistical
analysis
We have defined a set of rule axioms to trigger specific actions
under certain conditions. By using the ontology and a logical
reasoner together the system can issue alerts to support infec-
tion control actions. We start our semantic analysis by
converting the existing knowledge, based on the CDC guide-
line and our statistical analysis, into rule axioms. We specify
the rule axioms through multiple criteria such as type and
duration of surgery, patients’ age and specifications,
comorbidities/existing conditions, etc.
In our model we analyzed TOH data related to 732
operative episodes among 729 patients (3 patients had 2
Table 1 Logistic regression coefficients in odds ratio indicating
the predictive power of the trigger factors
Trigger Factors Odds Ratio lower 95 % CIb Upper 95 % CI
14. Systemic antibiotics likely for SSI started on or after post-
operative day 2 7.59 4.29 13.50
Duration of the antibiotics usage abovea 1.06 1.03 1.09
Any CT (Computed Tomography) scan report with mention of
specific SSI termsa 1.14 0.34 4.17
Readmission with presumed diagnosis of SSIa 15.44 6.78 38.18
Readmission to emergency room/reference center, or coded as
urgenta 1.34 0.76 2.32
Any likely significant pathogens on wound culturea 1.38 0.69
2.70
a For specific conditions, refer to Table 2
b CI - Confidence Interval
J Med Syst (2016) 40: 23 Page 7 of 12 23
episodes each) who received a coronary artery bypass
graft (CABG) between July 1 2004 and June 30 2007.
To define the indicators and trigger factors, we used
existing knowledge in guidelines, biomedical literature,
and insights obtained through the statistical analysis of
data in TOH data warehouse. Based on the semantic
and statistical analysis and also following the guideline
presented in [28] we generate the following three rules
for issuing alerts for suspect, probable and confirmed
cases of SSIs.
The semantic alerts are issued upon presentation of
15. one or more indicators for probable, suspect or con-
firmed cases. The results from the statistical analysis
are used to:
1. Power the knowledge acquisition phase by improving (or
revising our) conceptualization of the domain
2. Assess the result obtained in response to queries from our
knowledge-based system
23 Page 8 of 12 J Med Syst (2016) 40: 23
The triggers most frequently associated with cardiac
surgical site infection in the literature have been sum-
marized [28]. We used multivariable logistic regression
with data in the TOH data warehouse to generate con-
ditional predicted probabilities of SSI, based on these
trigger factors (Table 1) [28].
Area Under the Receiver Operating Caharacteristic (AUC-
ROC) curve: 0.91 (10-fold cross-validated estimate was 0.90)
95 % CI: 0.88-0.94
As mentioned, the case identification rule has been defind
in the HAIKU ontology as suspected (cutlure positive from
would or blood specimen) and probable (IV antibiotics or
thoracic CT order). The graphs below display the distribution
of predicted probabilities among, probable cases, suspected
cases and the data including non-SSI instances (individuals).
Figure 5a represents the density of predicted probability
among probable cases (lab result indicative of infection).
The detailed search terms for this analysis have been shown
Table 2 Search terms for trigger factors used in the model
16. (adapted from [28])
Trigger factor definitions Search terms or codes used
Microbiology Reports (Free text entry)
‘Any likely significant pathogens on wound
culture’
‘obacter’; ‘staphylococcus aureus’; ‘escherischia’;
‘streptococcus’; pseudomonas’; ‘morganella’;
‘serratia’; ‘stenotrophomonas’; ‘klebsiella’; ‘proteus’;
providencia’; ‘coagulase negative’ (IF
moderate polymorphs or greater on gram); ‘multiple gram
negative’ (IF heavy growth, AND
moderate polymorphs or greater on gram); ‘enterococcus (IF
heavy growth, AND moderate
polymorphs or greater on gram)
‘Any likely significant pathogens on blood
culture’
‘obacter’; ‘staphylococcus aureus’; ‘escherischia’;
‘streptococcus’; ‘pseudomonas’; ‘morganella’;
‘serratia’; ‘stenotrophomonas’; ‘klebsiella’; ‘proteus’;
‘providencia’; ‘enterococcus’;
‘haemophilus’; ‘propionibacterium’; ‘coagulase negative’ (IF
had non-human derived material
implanted in index operative episode)
Radiology Reports (Free text entry)
‘Any CT report with mention of specific SSI
terms’
‘osteomyelitis’; ‘sternal infection’; ‘wound infection’;
17. ‘mediastinitis’; ‘abscess’; ‘retrosternal fluid’;
‘endocariditis’; ‘phlegmon’
Admitting Diagnoses (Free text entry)
‘Readmission with presumed diagnosis of SSI’ ‘endocarditis’;
‘infect’; ‘cellulitis’; ‘incision’; ‘wound’; ‘osteomyelitis’;
‘sepsis’; ‘I + D’; ‘abscess’;
‘mediastinit’; ‘debride’; ‘sternal’
Pharmacy Records (Generic and Trade names, Drug
Identification Numbers, Anatomic Therapeutic Chemical
Classification codes, and American
Hospital Formulary Service pharmacologic-therapeutic
classifications for listed agents)
‘Systemic antibiotics likely for SSI started on or
after post-operative day 2’
cefazolin; cephalexin; clindamycin; cloxacillin; ertapenem;
imipenem; linezolid; meropenem;
nafcillin; penicillin; piperacillin; rifampin; rifampicin;
ticarcillin; vancomycin
Fig. 5 a Density of predicted probability among probable cases
(lab
indicative of infection, both gram positive and culture positive);
b
Density of predicted probability among probable cases (culture
positive
only); c Density of predicted probability among probable cases
(postoperative systemic antibiotics); d Density of predicted
probability
among probable cases (chest CT with mentions of SSI specific
terms)
18. J Med Syst (2016) 40: 23 Page 9 of 12 23
at Table 2. The peak around predicted probability of 0.1 is
probably due to the gram stain test being non-specific for
infection.
The distribution represented in Fig. 5b is also based on lab
results, but selected from positive culture results only which is
expected to be more specific to the presence of pathogen.
However, overall accuracy of prediction in terms of AUC-
ROC did not change significantly whether we use this criteria
or the non-specific one above, potentially due to the small
number of individuals that had culture alone (n=44) in our
data resulting in the loss of precision in statistical quantity.
Distribution of predicted probability among suspected cases
(selected systemic antibiotics 2 days after index operation–
see the list of antibiotics in Table 2) shown in Fig. 5c suggests
that certain antibiotics orders are less predictive of SSI than
other as seen in the large peak at low value of predictive
probability. Highly right-skewed distribution of predicted
probability density is observed among suspected case (thorac-
ic CT result with suggestive terms of SSI) (Fig. 5d) implying
the usefulness of the CTscan for the detection of SSI, although
the number of the individuals receiving the scan is small
(n=38) and thus its statistical significance is inconclusive as
seen in its confidence interval crossing the null effect (i.e.,
1.0).
The weak predictive power of culture diagnosis seen in our
model does not preclude the importance of this test as it is
already established indicator of the infection (Ref-CDC); rath-
er, this could be caused by the low yield of culture diagnosis
when specimens were drawn after the initiation of antibiotics
19. treatment (ref – I will find it today if necessary) or other factors
that is not measured in this study. In contrast, extremely strong
effect of the presumed diagnosis of SSI at readmission seen in
our model potentially reflects a high accuracy of readmission
diagnosis in TOH. Thus, although existing knowledge such as
the CDC guideline will play a central role in developing the
detection rule, the predictive power of trigger factors may
differ from one target population to another due to biological
and non-biological variations reflecting local practice, such as
the accuracy of laboratory tests, patterns of medication use,
and clinical diagnosis. Although the accuracy and precision of
statistical algorithm is limited to the quality of data (e.g., sam-
ple size and selection bias) and analytic methodology (e.g.,
model selection), it can be highly useful to quantify the im-
portance of trigger factors for a target population of interest
and thus assist to achieve best detection performance at spe-
cific context. Therefore, the importance of combining existing
knowledge and statistical analysis will be highly critical once
the evaluation of the detection systems is extended to other
settings, especially when strong heterogeneity across
healthcare or target population is expected.
E-triggers can be issued in response to queries retrieving
confirmed, suspect and probable SSI cases using logical rea-
soners and rule engines. The logical reasoner controls the
consistency and satisfiability of the results and reveals redun-
dancies and hidden dependencies.
Conclusion
In behavioral economics, nudges are used for positive rein-
forcement and indirect suggestions to try to achieve non-
forced compliance to improve the decision making of groups
and individuals. Using the same analogy, we define a semantic
infrastructure to issue semantic nudges to assist healthcare
20. professionals and infection control practitioners in their
decision-making process to effectively monitor healthcare-
associated infections (HAIs), with a particular focus on surgi-
cal site infections (SSIs). Since the rate of HAIs is a major
quality and performance indicator, healthcare settings are con-
stantly under pressure to control, and minimize the incidence
of HAIs.
SSIs impose a huge burden on patients, hospitals, and
healthcare organizations. For the CABG procedure, post-
surgery SSIs can substantially increase the length-of-stay in
hospital [36]. Several known risk factors (e.g., obesity, old
age, and diabetes, duration of surgery) have been associated
with incidence of SSIs. Multiples lists of cautionary steps,
guidelines and strategies have been provided by different in-
fection control agencies to improve the SSIs surveillance and
prevention, to reduce the incidents of SSI.
In this study, we presented the HAIKU semantic web plat-
form. This platform captures and integrates knowledge from
existing guidelines, standards, and databases and generates
triggers to detect cases based on the HAI ontology (available
for download from: http://surveillance.mcgill.ca/projects/
haiku/HAI.owl), and the logical rules created through
semantic and statistical analysis. The HAIKU framework
enables health professionals and researchers to analyze
retrospective data on health-care associated infections and
generate predictive models using the existing knowledge
(i.e., literature findings, guidelines, statistical models) to issue
alerts on potential cases of HAIs. It also assists them in mak-
ing informed decisions regarding different procedures and
policies about healthcare associated infections. While in this
paper we focused more on SSIs, the detection of other adverse
events due to infection could possibly benefit from the HAI-
KU semantic framework as well, such as sepsis, C-difficile
associated diarrhea, and urinary tract infection.
21. One strength of this study is the use of statistical methods
along with semantic technology to define e-triggers, which
provides a coherent, efficient and consistent view of the data
extracted from various resources. Our research demonstrates
that a combination of parameters indicating infections, e.g.,
antibiotic use and positive blood culture, along with the risk
factors, e.g., having old age, duration of a surgical procedure
23 Page 10 of 12 J Med Syst (2016) 40: 23
http://surveillance.mcgill.ca/projects/haiku/HAI.owl
http://surveillance.mcgill.ca/projects/haiku/HAI.owl
leads to more accurate triggers to issue alerts for early detec-
tion of HAIs.
The semantic rules can be used to recommend a certain
course of actions given a specific situation occurring in a
healthcare setting. Issuing timely alerts and warnings can in-
crease the efficiency of the healthcare system, and improve the
quality of care in healthcare settings. We plan to implement
the HAIKU framework in multiple clinical sites so that we can
evaluate the transferability of our approach. One limitation of
our work is related to the temporal reasoning. Since we are
using description logics to encode the HAI Ontology, tempo-
ral reasoning can easily lead to undecidability. So, we are
currently working on alternative approached to overcome this
problem. In addition we are planning on enriching the onto-
logical structure to extend our analysis for different types of
HAIs, as well as other adverse events such as sepsis and
bleeding.
Acknowledgments The Canadian Foundation for Innovation
(CFI),
22. the Canadian Institutes of Health Research (CIHR), the Natural
Sciences
& Engineering Council of Canada (NSERC), and Canadian
Network for
the Advancement of Research, Industry and Education
(CANARIE) pro-
vide funding for this research.
References
1. Douglas Scott II, R., The Direct Medical costs of Healthcare-
Associated Infections in U.S. Hospitals and the Benefits of
Prevention. 2009 CDC Report: www.cdc.gov/hai/pdfs/hai/scott_
costpaper.pdf.
2. Klevens, R. M., Edwards, J. R., Richards, C. L., Jr., Horan,
T. C.,
Gaynes, R. P., Pollock, D. A., and Cardo, D. M., Estimating
health
care-associated infections and deaths in U.S. hospitals, 2002.
Public Health Rep 122(2):160–6, 2007.
3. Magill, S. S., Edwards, J. R., Bamberg, W., Beldavs, Z. G.,
Dumyati, G., Kainer, M. A., et al., Multistate point-prevalence
sur-
vey of health care-associated infections. New England Journal
of
Medicine 370(13):1198–208, 2014.
4. Scott, R. D., The direct medical costs of healthcare-
associated in-
fections in US hospitals and the benefits of prevention. Division
of
Healthcare Quality Promotion National Center for Preparedness,
Detection, and Control of Infectious Diseases, Centers for
Disease
23. Control and Prevention; 2009.
5. Gravel, D., Taylor, G., Ofner, M., Johnston, L., Loeb, M.,
Roth, V.
R., et al., Point prevalence survey for healthcare-associated
infec-
tions within Canadian adult acute-care hospitals. Journal of
Hospital Infection 66(3):243–8, 2007.
6. Horan, T. C., Andrus, M., and Dudeck, M. A., CDC/NHSN
sur-
veillance definition of health care-associated infection and
criteria
for specific types of infections in the acute care setting.
American
journal of infection control 36(5):309–32, 2008.
7. Magill, S. S., et al., Prevalence of healthcare-associated
infections
in acute care hospitals in Jacksonville. Florida. Infect Control
Hosp
Epidemiol 33(3):283–91, 2012.
8. Mangram, A. J., Horan, T. C., Pearson, M. L., Silver, L. C.,
and
Jarvis, W. R., Guideline for prevention of surgical site
infection,
1999. Hospital Infection Control Practices Advisory Committee.
Infect Control Hosp Epidemiol. 20(4):250–78, 1999. quiz 279–
80.
9. Lee, J. T., Precision, accuracy, clarity, meaning. Surg Infect
(Larchmt) 8(1):1–4, 2007.
10. Shaban-Nejad, A., Rose, G. W., Okhmatovskaia, A.,
Riazanov, A.,
24. Baker, C. J. O., Tamblyn, T., Forster, A. J., and Buckeridge, D.
L.,
Knowledge-based Surveillance for Preventing Postoperative
Surgical Site Infection. In proc. of MIE 2011, Studies in Health
Technology and Informatics, IOS Press, 145–149.11, 2011.
11. Gill, C. J., and Gill, G. C., Nightingale in Scutari: Her
legacy
reexamined. Clinical infectious diseases 40(12):1799–805,
2005.
12. Boyce, J. M., and Pittet, D., Guideline for hand hygiene in
health-
care settings: recommendations of the Healthcare Infection
Control
Practices Advisory Committee and the HICPAC/SHEA/APIC/
IDSA Hand Hygiene Task Force. American journal of infection
control 30(8):S1–S46, 2002.
13. Centre for Communicable Diseases and Infection Control,
Public
Health Agency of Canada. Hand hygiene practices in healthcare
settings. Ottawa, Ontario: Canadian Electronic Library, Centre
for
Communicable Diseases and Infection Control, Public Health
Agency of Canada, 2012; 2012.
14. Rutala, W. A., Weber, D. J., Centers for Disease Control.,
Guideline
for disinfection and sterilization in healthcare facilities, 2008.
Centers for Disease Control (US), 2008.
15. Centre for Communicable Diseases and Infection Control
(Canada), Public Health Agency of Canada, Routine practices
and additional precautions for preventing the transmission of in-
fection in healthcare settings. Ottawa, Ontario: Canadian
25. Electronic Library, Centre for Communicable Diseases and
Infection Control, Public Health Agency of Canada, 2012, 2012.
16. Mangram, A. J., Horan, T. C., Pearson, M. L., Silver, L. C.,
and
Jarvis, W. R., Guideline for prevention of surgical site
infection,
1999. American journal of infection control 27(2):97–134,
1999.
17. Healthcare Infection Control Practices Advisory Committee,
Centers for Disease Control and Prevention, Guidelines for
preventing health-care-associated pneumonia, 2003
recommenda-
tions of the CDC and the Healthcare Infection Control Practices
Advisory Committee. Respiratory care 49(8):926, 2004.
18. O’Grady, N. P., Alexander, M., Burns, L. A., Dellinger, E.
P.,
Garland, J., Heard, S. O., et al., Guidelines for the prevention of
intravascular catheter-related infections. Clinical infectious
diseases 52(9):e162–e193, 2011.
19. Public Health Agency of Canada, Centre for Communicable
Diseases and Infection Control, Canadian Electronic Library,
Clostridium Difficile Infection - Infection Prevention and
Control
Guidance for Management in Acute Care Settings. Public Health
Agency of Canada. Canadian Electronic Library. Canadian
Health
Research Collection, 2012.
20. Gould, C., Umscheid, C., Agarwal, R., Kuntz, G., Pegues,
D., and
Healthcare Infection Control Practices Advisory Committee,
Guideline for prevention of catheter-associated urinary tract
26. infec-
tions 2009. Infect Control Hosp Epidemiol 31(4):319–26, 2010.
21. Haley, R. W., Culver, D. H., White, J. W., Morgan, W. M.,
Emori, T.
G., Munn, V. P., et al., The efficacy of infection surveillance
and
control progams in preventing nosocomial infections in US
Hospitals. American Journal of Epidemiology 121(2):182–205,
1985.
22. Leth, R. A., and Møller, J. K., Surveillance of hospital-
acquired
infections based on electronic hospital registries. J. of Hospital
Infection 62:71–79, 2006.
23. Sands, K., Vineyard, G., Livingston, J., Christiansen, C.,
and Platt,
R., Efficient identification of postdischarge surgical site
infections:
Use of automated pharmacy dispensing information,
administrative
data, and medical record information. J Infect Dis 179(2):434–
441,
1999.
24. Surgical Site Infection (SSI) Event, Procedure-Associated
Module,
Centers for Disease Control and Prevention, Office of Infectious
Diseases, National Center for Emerging and Zoonotic Infectious
J Med Syst (2016) 40: 23 Page 11 of 12 23
http://www.cdc.gov/hai/pdfs/hai/scott_costpaper.pdf
http://www.cdc.gov/hai/pdfs/hai/scott_costpaper.pdf
27. Diseases (NCEZID), Division of Healthcare Quality Promotion
(DHQP). Accessed on October 20, 2014. Available from: http://
www.cdc.gov/nhsn/CPTcodes/ssi-cpt.html, 2014.
25. Ducel, G., Fabry, J., Nicolle, L. (eds.) Prevention of
hospital-
acquired infections: A practical guide. 2nd edition, World
Health
Organization (WHO), 2002. http://www.who.int/csr/resources/
publications/whocdscsreph200212.pdf.
26. Gruber, T. R., A translation approach to portable ontology
specifi-
cations. Knowl. Acquis. 5:199–220, 1993.
27. Stevens, R., Goble, C. A., and Bechhofer, S., Ontology-
based
knowledge representation for bioinformatics. Brief Bioinform
1(4):398–414, 2000.
28. Rose G. W. Use of an Electronic Data Warehouse to
Enhance
Cardiac Surgical Site Infection Surveillance at a Large
Canadian
Centre. MSc Thesis, University of Ottawa, 2009.
29. Donnelly, K., SNOMED-CT: The advanced terminology and
cod-
ing system for eHealth. Stud. Health Technol. Inform. 121:279–
290, 2006.
30. Dumontier, M., Baker, C. J., Baran, J., Callahan, A.,
Chepelev, L.,
Cruz-Toledo, J., Del Rio, N. R., Duck, G., Furlong, L. I., Keath,
N.,
28. Klassen, D., McCusker, J. P., Queralt-Rosinach, N., Samwald,
M.,
Villanueva-Rosales, N., Wilkinson, M. D., and Hoehndorf, R.,
The
Semanticscience Integrated Ontology (SIO) for biomedical
research
and knowledge discovery. J Biomed Semantics 5(1):14, 2014.
31. W3C OWL Working Group, OWL 2 Web Ontology
Language.
Available online: www.w3.org/TR/owl2-overview/ (accessed on
30 May 2015).
32. Wilkinson, M., McCarthy, L., Vandervalk, B., Withers, D.,
Kawas,
E., and Samadian, S., SADI, SHARE, and the in silico scientific
method. BMC Bioinformatics 11(Suppl 12):S7, 2010.
33. Riazanov, A., Klein, A., Shaban-Nejad, A., Rose, G. W.,
Forster, A.
J., Buckeridge, D. L., and Baker, C. J., Semantic querying of
rela-
tional data for clinical intelligence: A semantic web services-
based
approach. J Biomed Semantics 4(1):9, 2013.
34. Berners-Lee, T., Connolly, D., Kagal, L., Scharf, Y., and
Hendler, J.,
N3Logic: A logical framework for the World Wide Web. Theory
and Practice of Logic Programming 8(3):249–269, 2008.
35. Boley, H., A RIF-Style semantics for RuleML-integrated
position-
al-slotted, object-applicative rules. In Proc. RuleML 2011, Vol.
6826 of LNCS. Springer; pp. 194–211, 2011.
29. 36. Cristofolini, M., Worlitzsch, D., Wienke, A., Silber, R. E.,
and
Borneff-Lipp, M., Surgical site infections after coronary artery
by-
pass graft surgery: Incidence, perioperative hospital stay,
readmissions, and revision surgeries. Infection 40:397–404,
2012.
23 Page 12 of 12 J Med Syst (2016) 40: 23
http://www.cdc.gov/nhsn/CPTcodes/ssi-cpt.html
http://www.cdc.gov/nhsn/CPTcodes/ssi-cpt.html
http://www.who.int/csr/resources/publications/whocdscsreph200
212.pdf
http://www.who.int/csr/resources/publications/whocdscsreph200
212.pdf
http://www.w3.org/TR/owl2-overview/
Journal of Medical Systems is a copyright of Springer, 2016.
All Rights Reserved.
From Cues to Nudge: A Knowledge-Based Framework for
Surveillance of Healthcare-Associated
InfectionsAbstractIntroductionExisting methods for detecting
HAIThe HAI ontology: An overviewMethodology and data
sourcesOntological conceptualizationThe HAIKU framework for
case detection and reportingAxiomatization using semantic and
statistical analysisConclusionReferences
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1913
30. www.internationaljournalofcaringsciences.org
Original Article
Incidence Rate of Device-Associated, Hospital Acquired
Infections in ICUs:
A Systematic Review Developed Versus Developing Economies
Yiorgos Pettemerides, BSc
Limassol General Hospital, Cyprus
Savvoula Ghobrial PhDc
University of Nicosia, Nursing program Leader, Cyprus
Raftopoulos Vasilios, PhD
Cyprus University of Technology, Nursing Department, Cyprus
Iordanou Stelios, PhDc
Limassol General Hospital, Cyprus University of Technology,
Nursing Department, Cyprus
Correspondence: Iordanou Stelios, Agias Elenis 9B, 4186
Ipsonas, Limassol – Cyprus e-mail:
[email protected]
Abstract
Background: Device-associated hospital-acquired infections
(DA-HAIs) are a major threat to patient safety; as
well as a contributing factor for increased morbidity, mortality,
increased cost and length of ICU stay. Rates of
occurrence of DA-HAIs can be associated with the economic
31. status of the countries where they occur.
Aims: To assess all available DA-HAI incidence rates from
studies published between 2007 and 2017, and
compare them according to the economic status of the country
of origin.
Methodology: Systematic review of the published literature
between 2007 and 2017.
Results: 40 articles were included in this study. Central line-
associated blood stream infection (CLABSI),
ventilator-associated pneumonia (VAP) and catheter-associated
urinary tract infection (CAUTI) incidence rates
from various countries, together with data on the countries
economic status (developed vs developing), were
included and correlated accordingly. The highest reported
CLABSI, VAP and CAUTI rate was 72.56, 73.4 and
34.2 respectively per 1000 device days, and these all originated
from developing economies. The highest
incidence rates for VAP and CLABSI in developed economies
are demonstrably lower than those in developing
economies, demonstrating a statistical significant correlation.
Lower economic statuses tend to predominate
higher rates of Ventilator-Associated Pneumonia and Central
Line-associated Blood-stream Infections in a
statistically significant correlation, whilst for CAUTI there was
no statistical difference.
Conclusions: DA-HAI are affected directly in a positive or
negative way according to the economic status of
the originating country..
Keywords: Device Associated Infections, Central Line
Associated Blood Stream Infection, Ventilator
Associated Pneumonia, Catheter Associated Urinary Tract
Infection, ICU.
32. International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1914
www.internationaljournalofcaringsciences.org
Introduction
Infections acquired in the intensive care unit
(ICU) are a major healthcare related problem as
they contribute to length of stay (LOS)
prolongation, elevated costs of care as well as
increased morbidity and mortality
(Apostolopoulou et al., 2013; Tigen et al., 2014).
Furthermore, health-care associated infections
(HAIs), with specific reference to invasive
devices utilization in healthcare settings, when
considered in the far more prevalent context of
ICU patients are usually referenced as device-
associated HAIs (DA-HAIs) and are a
complicating factor with regard to positive
patient’s outcomes. Most of the infection
surveillance reports comparing the outcomes of
DA-HAIs with those of other countries do not
consider that the economic status of the country
in question can directly affect, positively or
negatively. According to the WHO(World health
Organization, 2015), low economic country
status (developing) may be an additional factor
that influences the incidence of DA-HAIs with
greater prevalence than is reported in developed
areas.
33. Aim
The aim of the study was to investigate the DA-
HAI rates published in public literature between
the years 2007 and 2017 and compare rates
between developed and developing countries.
Materials & Methods
This systematic review was guided by the
preferred reporting items for systematic reviews
and meta-analyses (PRISMA) statement.
PRISMA is a 27-item checklist that is used to
improve the reporting of systematic reviews and
meta-analyses and has been endorsed by major
biomedical journals for the publication of
systematic reviews(Liberati et al., 2009).
A comprehensive search of the available
literature was conducted by the authors, using
Medline, PubMed and Cumulative Index to
Nursing and Allied Health Literature [CINAHL],
for articles dated from 2007 until late 2017, using
these search terms: “ventilator associated
pneumonia”, “VAP”, “central line associated
blood stream infection”, “CLABSI”, “catheter
associated urinary tract infection”, “CAUTI”,
“device associated infection” and various
combinations of these terms plus “Intensive Care
Unit”.
Inclusion criteria
The inclusion criteria used during the search
were:
34. Publication dates ranging from 01/01/2007 to
31/12/2017,
Data must have been obtained from adult ICU
patients,
Publications written and published in the English
language,
DA-HAIs rates to be reported as incidence per
1000 device days (DD).
Publications which studied only one of the DA-
HAIs rates were not excluded if they met the
remainder of the inclusion criteria. The primary
outcome measures for this review were:
Infection rates per device per 1000 device days,
The number of patients,
The country and place of study,
Purpose and methodology of study.
Study Selection
A Medline search yielded 377 articles, PubMed
yielded 1074 articles, and CINAHL yielded 289
articles. After duplicated results and articles with
access to the abstract or the title only were
removed, a total of 562 articles were left for
screening. Of these, 367 were related to pediatric
and neonatal ICUs, 106 were not related to ICU
patients (hospital wards or home ventilated
35. patients), 22 were not research studies, 17 had
very small sample sizes and/or durations and 10
studies were dismissed for other reasons not
meeting the study design, leaving a total of 40
articles. The flow chart below summarizes the
article selection (Figure 1).
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1915
www.internationaljournalofcaringsciences.org
Table 1: Developing countries and DA-HAIs rates
Name, Country, Year CLABSI VAP CAUTI
Talaat, Egypt, 2016 (after intervention) 2.6 4.3 1.9
Empaire, Venezuela, 2017 5.1 7.2 3.9
Mehta, India(INICC), 2016 5.1 9.4 2.1
Kanj, Lebanon(INICC), 2012 5.2 8.1 4.1
Mehta, India(INICC), 2007 7.92 10.46 1.41
Jahani-Sherafat, Iran, 2015 5.84 7.88 8.99
El-Kholy, Egypt, 2012 2.9 17 3.4
39. International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1917
www.internationaljournalofcaringsciences.org
Table 3: Developing vs developed economies DA-HAI incidence
rates
Ventilator Associated Pneumonia - VAP
Developed economies Developing economies
Cyprus 8.25† Mongolia 43.7
France 20.6 Venezuela 7.2
Greece 16.3† Brazil 20.9
Italy 11† China 20.18†
Japan 1.14 Ecuador 44.3
Holland 3.3 Egypt 31.56†
Belgium 2.3 India 24.85†
Iran 7.88
Lebanon 8.1
Mexico 21.8
Morocco 43.2
Turkey 17.85†
P value
Mean (SD) 10.09(6.82) 24.29 (13.1) 0.016
Median (IQR) 9.62(2.76-17.37) 21.35 (10.5-40.29) 0.020
Central Line-Associated Bloodstream Infection - CLABSI
Developed economies Developing economies
40. Belgium 2.3 Mongolia 19.7
Cyprus 17.25† Venezuela 5.1
Greece 11.95† Brazil 9.1
Italy 4.25† China 2.9†
Japan 2.38 Ecuador 6.5
Holland 1.7 Egypt 9.33†
Australia 1.34 India 14.15†
Iran 5.84
Lebanon 5.2
Mexico 23.1
Morocco 15.7
Turkey 8.75†
P value
Mean (SD) 5.88(5.75) 10.44 (6.07) 0.011
Median (IQR) 2.38(1.7-11.95) 8.92 (5.36-15.31) 0,025
Catheter-Associated Urinary Tract Infection - CAUTI
Developed economies Developing economies
Belgium 5.5 Mongolia 15.7
Cyprus 2.75† Venezuela 3.9
Greece 4.5 Brazil 9.6
Italy 5.45 China 6†
Japan 2.4 Ecuador 5.7
Poland 4.8 Egypt 34.1†
India 7.31†
Iran 8.99
Lebanon 4.1
Mexico 13.4
Morocco 11.7
Turkey 5.9†
P value
Mean (SD) 5.31 (3.18) 9.02 (3.66) 0,13
Median (IQR) 4.65 (2.6-7) 8.94 (5.75-12.75) 0,066
41. Abbreviation: † mean (more than one study)
Table 4: Summary of reviewed articles
1 Leblebicioglu et al., -Turkey -Frequency Documentation -
Prospective -94498 -CLABSI: 11.1
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1918
www.internationaljournalofcaringsciences.org
2014 (Turkey) - 63 ICUs.
from 29
hospitals in 19
cities
of Device Associated
Hospital Acquired
Infections
observational
cohort study
ICU
Patients
-VAP: 21.4
-CAUTI: 7.5
2 Kaiser et al., 2014
(The Netherlands)
43. -Evaluation of infection
frequency and risk factors
from invasive devices in
the ICU
-Prospective
clinical
observation study
-679
ICU
Patients
-CLABSI: 13.86/1000
-VAP: 6.04/1000
-CAUTI: 9.08/1000
4 Kanj et al., 2012
(INICC Lebanon)
-University
hospital ICU
in Lebanon
-Evaluation of device
related infection frequency
in the ICU
-Prospective
observational study
-666
ICU
Patients
44. -CLABSI: 5.2/1000
-VAP: 8.1/1000
-CAUTI: 4.1/1000
5 Madani et al., 2009
(Morocco)
-12-bed icu of
the university
hospital of
Morocco
-Evaluation of device
related infection frequency
in the ICU. microbiological
profile. resistance. length of
stay and increase in
mortality
-Prospective
surveillance study
-1731 ICU
Patients
-CLABSI: 15.7/1000
-VAP: 43.2/1000
-CAUTI: 11.7/1000
6 Chen et al., 2012
(Taiwan)
-42-bed ICU
45. of a university
hospital in
Taiwan
-Evaluation of device
related infection frequency
in the ICU
-Retrospective and
prospective
observational study
-14734
ICU
Patients
-CLABSI: 3.48/1000
-VAP: 3.8/1000
-CAUTI: 3.7/1000
7 Singh et al., 2013
(India)
-10-bed ICU in
a tertiary care
hospital in
India
-Evaluation of the total
frequency of DA-HAI
incidence
-Prospective
observational study
- 293
46. ICU
Patients
-CLABSI: 16/1000
-VAP: 32/1000
-CAUTI: 9/1000
8 Watanabe et al.,
2011 (Japan)
-20 ICUs from
university
hospitals in
Japan
-Evaluation of the
frequency of invasive
device related infections
using a data collection
system to aggregate
information in a national
database and enhance
quality improvement
activities
-Prospective
observational study
-1989
ICU
Patients
-CLABSI: 2.38/1000
-VAP: 1.14/1000
-CAUTI: 2.4/1000
47. 9 Ranjan et al., 2014
(India)
-12-bed ICU in
a tertiary care
hospital in
India
-Evaluation of VAP
incidence rate. risk factors
and mortality
-Prospective
observational study
-105
ICU
Patients
-CLABSI: Not measured
-VAP: 31.7/1000
-CAUTI: Not measured
10 Velasquez et al.,
2016 (Italy)
-21 ICUs in
Italy
- Evaluation of VAP
incidence rate and risk
factors
-Prospective
observational study
48. -772
ICU
Patients
-CLABSI: Not measured
-VAP: 13.2/1000
-CAUTI: Not measured
11 Vanhems et al., 2011
(France)
-11 ICUs in
France
-Evaluation of incidence
rate of early onset VAP
-Prospective
observational study
-3387
ICU
Patients
-CLABSI: Not measured
-VAP: 20.6/1000
-CAUTI: Not measured
12 Mehta et al., 2007
(INICC India)
-12 ICUs from
7 tertiary care
49. hospitals in
India
-Evaluation of DA-HAI s
incidence rate. their
microbiological profile.
drug resistance. mortality
and length of stay
-Prospective
observational study
-10835
ICU
Patients
-CLABSI: 7.92/1000
-VAP: 10.46/1000
-CAUTI: 1.41/1000
13 Patil et al., 2011
(India)
-1 ICU of a
public
University
hospital in
India
-Define incidence rate of
BSIs related with CVCs
-Prospective
50. observational study
-54
ICU
Patients
-CLABSI: 47.31/1000
-VAP: Not measured
-CAUTI: Not measured
14 Apostolopoulou et
al., 2013 (Greece)
-3 ICUs from
3 hospitals in
Greece
-Evaluation of DA-HAI
incidence rate.
microbiological profile.
drug resistance and
morbidity
-Prospective
observational study
-294
ICU
Patients
-CLABSI: 11.8/1000
-VAP: 20/1000
-CAUTI: 4.2/1000
51. International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1919
www.internationaljournalofcaringsciences.org
15 Bammigatti et al.,
2017 (India)
-1 ICU in a
university
hospital in
India
-Evaluation of risk factors
and microbial resistance in
DA-HAIs
-Prospective
observational study
-341
ICU
Patients
-CLABSI: 72.56/1000
-VAP: 3.98/1000
-CAUTI: 12.4/1000
16 Boncagni et al., 2015
(Italy)
52. -12 bed ICU of
a tertiary care
hospital in
Italy
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-1382
ICU
Patients
-CLABSI: 6.6/1000
-VAP: 23.1/1000
-CAUTI: 5.45/1000
17 Gikas et al., 2010
(Cyprus)
-4 ICUs in 4
major
hospitals of
Cyprus
-Evaluation of DA-HAI
incidence rate and
identification of areas of
improvement
-Prospective
observational study
53. -2692 ICU
Patients
-CLABSI: 18.6/1000
-VAP: 6.4/1000
-CAUTI: Not measured
18 Dima et al., 2007
(Greece)
-8 ICUs in
Greece
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-1739 ICU
Patients
-CLABSI: 12.1/1000
-VAP: 12.5/1000
-CAUTI: Not measured
19 Iordanou et al., 2017
(Cyprus)
-8 bed ICU in
a major
general
hospital in
54. Cyprus
-Evaluation of DA-HAI
incidence rate for one year
-Prospective cohort
and active
surveillance study
-198
ICU
Patients
-CLABSI: 15.9/1000
-VAP: 10.1/1000
-CAUTI: 2.7/1000
20 Jahani-Sherafat et al.,
2015 (Iran)
-6 ICUs of
university
hospitals in
Tehran-Iran
-Evaluation of DA-HAI
incidence rate
-Prospective cohort
and active
surveillance study
-2584
ICU
55. Patients
-CLABSI: 5.84/1000
-VAP: 7.88/1000
-CAUTI: 8.99/1000
21 Rasslan et al., 2012
(Egypt)
-3 ICUs of 3
hospitals in 2
towns in Egypt
-Evaluation of DA-HAI
incidence rate
-Prospective cohort
and active
surveillance study
-473
ICU
Patients
-CLABSI: 22.5/1000
-VAP: 73.4/1000
-CAUTI: 34.2/1000
22 Salgado Yepez et al.,
2017 (Ecuador)
-2 ICUs of 3
hospitals in
Ecuador
56. -Evaluation of DA-HAI
incidence rate
-Prospective cohort
and active
surveillance study
-776
ICU
Patients
-CLABSI: 6.5/1000
-VAP: 44.3/1000
-CAUTI: 5.7/1000
23 Tigen. et al., 2014
(Turkey)
-16 bed ICU of
a university
hospital in
Turkey
-Evaluation of DA-HAI
incidence rate
-Prospective cohort
and active
surveillance study
-1798
ICU
Patients
-CLABSI: 6.4/1000
-VAP: 14.3/1000
57. -CAUTI: 4.3/1000
24 Medeiros et al., 2015
(Brazil)
- 4 ICUs of 3
hospitals in 3
towns in Brazil
-Evaluation of DA-HAI
incidence rate
-Prospective cohort
and active
surveillance study
-1031
ICU
Patients
-CLABSI: 9.1/1000
-VAP: 20.9/1000
-CAUTI: 9.6/1000
25 Ramirez et al., 2007
(Mexico)
-5 ICUs of 4
hospitals in
Mexico
-Evaluation of DA-HAI
incidence rate
58. -Prospective cohort
study
-1055
ICU
Patients
-CLABSI: 23.1/1000
-VAP: 21.8/1000
-CAUTI: 13.4/1000
26 El-Kholy et al., 2012
(Egypt)
-3 ICUs of 3
hospitals in
Egypt
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-1101
ICU
Patients
-CLABSI 2.9/1.000
-VAP 17/1.000
-CAUTI 3.4/1.000
27 Tao et al., 2011
(China)
59. -398 ICUs of
70 hospitals in
China
-Evaluation of DA-HAI
incidence rate
-Multicentered
prospective cohort
study
-391527
ICU
Patients
-CLABSI 3.1/1.000
-VAP 20.8/1.000
-CAUTI 6.4/1000
28 Empaire et al., 2017
(Venezuela)
-2 ICUs of 2
hospitals in
Venezuela
-Evaluation of DA-HAI
incidence rate
microbiological resistance
of identified
microorganisms
61. 30 Rosenthal et al.,
2016
-703 ICUs of
50 countries
from Latin
America.
Eastern
Mediterranean.
Southeast Asia
and the West
Pacific
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-861284
ICU
Patients
-CLABSI 4.1/1.000
-VAP 13.1/1.000
-CAUTI 5.7/1000
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1920
62. www.internationaljournalofcaringsciences.org
31 Talaat et al., 2016
(Egypt)
-91 ICUs of 28
hospitals in
Egypt
-Evaluation of DA-HAI
incidence rate and the
effectiveness of a reduction
program
-Prospective
observational study
before and after
intervention
-59318
ICU
Patients
Results following
intervention
-CLABSI 2.6/1.000
-VAP 4.3/1.000
-CAUTI 1.9/1000
32 Ider et al., 2016
(Mongolia)
63. -3 ICUs of 3
hospitals in
Mongolia
-Evaluation of DA-HAI
incidence rate
-Prospective
observational/surv
eillance study
-467
ICU
Patients
-CLABSI 19.7/1.000
-VAP 43.7/1.000
-CAUTI 15.7/1000
33 Mehta et al., 2016
(INICC India)
-Hospitals
from 20 cities
in India
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-236.700
ICU
Patients
64. -CLABSI 5.1/1.000
-VAP 9.4/1.000
-CAUTI 2.1/1000
34 Hui-Peng et al., 2015
(INICC China)
-26 bed ICU of
a tertiary care
hospital in
China
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-4013
ICU
Patients
-CLABSI 2.7/1.000
-VAP 19.561/1.000
-CAUTI 1.5/1000
35 Worth et al., 2015
(Australia)
-ICUs of 29
hospitals in
Australia
-Describe time-trends in
CLABSI rates. Infections
by ICU peer-groups.
65. Etiology. and antimicrobial
susceptibility of pathogens
-Prospective
observational study
-No Data -CLABSI 1.34/1.000
-VAP Not measured
-CAUTI Not measured
36 Rosenthal et al.,
2014 (International
Nosocomial Infectio
n Control
Consortium (INICC)
report. data summary
of 43 countries for
2007-2012. Device-
associated module.)
-503 ICUs
from 43
countries in
Latin America.
Asia. Europe
and Africa
-Evaluation of DA-HAI
incidence rate
-Prospective
observational study
-605310
ICU
Patients
66. -CLABSI 4.9/1.000
-VAP 16.8/1.000
-CAUTI 5.5/1000
37 Mertens et al., 2013
(Belgium)
-ICUs of 18
hospitals in
Belgium
-Evaluation of DA-HAI
incidence rate (VAP &
CLABSI) and the
surveillance procedure
-Prospective
observational study
-6478
ICU
Patients
-CLABSI 2.3/1.000
-VAP 12/1.000
-CAUTI 5.5/1000
38 Rosenthal et al.,
2012 (International
Nosocomial Infectio
n Control
Consortium (INICC)
report. data summary
of 36 countries. for
67. 2004-2009)
-422 ICUs
from 36
countries in
Latin America.
Asia and
Europe
-Evaluation of DA-HAI
incidence rate
-Prospective cohort
study
-313008
ICU
Patients
-CLABSI 6.8/1.000
-VAP 15.8/1.000
-CAUTI 6.3/1000
39 Kübler et al., 2012
(Poland)
-15 bed ICU of
a university
hospital in
Poland
- Evaluation of DA-HAI
incidence rate
-Prospective
surveillance study
68. -847
ICU
Patients
-CLABSI 4.01/1.000
-VAP 18.2/1.000
-CAUTI 4.8/1000
40 Malacarne et al.,
2010 (Italy)
-125 ICUs in
Italy
- Evaluation of DA-HAI
incidence rate
-Prospective
epidimiological
study
-34472
ICU
Patients
-CLABSI 1.9/1.000
-VAP 8.9/1.000
-CAUTI 4.8/1000
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1921
70. n=522
Full Text
n=40
Medline articles
n=377
Figure 1: Flow diagram for article selection, as per Preferred
Reporting Items for Systematic Reviews
and Meta-Analyses (PRISMA) and CINAHL recommendations
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1922
www.internationaljournalofcaringsciences.org
Figure 2: Number of studies per country
Characteristics of Studies
Table 4 summarizes the characteristics of the 40
studies used in this review. Although highly
developed countries are pioneers in infection
surveillance, in this review no studies were
included from the USA, UK, Canada or
71. Scandinavia. A search for older articles yielded
numerous texts from these countries but they were
not relevant to this study nor did they meet the
study inclusion criteria (spicifically age<10 years),
so their results were not included but their content
supported the conclusion that DAI rates were a
popular research topic for advanced health
provision countries in the past decades, but are no
longer as relevant. Despite the absence of
appropriate articles from the aforementioned
countries, many other countries have studies that
were conducted during the last decade and were
relevant to the subject. Most of the articles
(92.68%) came from 22 countries (Figure 2),
whilst the remaining 7.32% articles came from
multinational studies conducted on behalf of the
International Nosocomial Infection Control
Consortium (INICC) and were included in this
review as their multinational nature was not a
restriction in article selection.
Developed & developing countries
The International Monetary Fund (IMF) (IMF,
2017) classifies national economies by their degree
of development and publishes this list yearly. Of
the participating countries in this review, the
economies of Brazil, China, Ecuador, Egypt, India,
Iran, Lebanon, Mexico, Mongolia, Morocco,
Poland, Turkey and Venezuela are listed as
developing (table 1) while the economies of
Australia, Belgium, Cyprus, France, Greece,
Holland, Italy, Japan and Taiwan are listed as
advanced (table 2). Poland however, is listed by
the United Nations (UN)(United Nations
72. Development Programme, 2016) among the list of
countries with a high human development index
(HDI), along with all of the countries on the
advanced economies list and is the only country in
this review that does not appear in the developed
economy list.
Overall, the most represented country in terms of
reviewed articles was India with eight
2
1
8
1
1
1
1
3
1
2
1
2
2
3
1
1
1
2
1
1
73. 1
1
0 1 2 3 4 5 6 7 8 9
Turkey
India
Morocco
Japan
France
Poland
Iran
Equador
Mexio
Venezuela
Australia
Study No
Number of studies found per country (n=37)
*multinational studies excluded
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1923
74. www.internationaljournalofcaringsciences.org
articles(Mehta et al., 2007, 2016; H. Patil et al.,
2011; Singh et al., 2013; Datta et al., 2014; Ranjan
et al., 2014; Bammigatti et al., 2017; Kumar et al.,
2017) (20%), followed by Egypt(El-Kholy et al.,
2012; Rasslan et al., 2012; Talaat et al., 2016) and
Italy (Malacarne et al., 2010a; Boncagni et al.,
2015; Velasquez et al., 2016) with 3 studies each
(7.5% each or 15% of the total), whilst China(Tao
et al., 2011; Peng et al., 2015), Greece(Dima et al.,
2007; Apostolopoulou et al., 2013), Cyprus(Gikas,
M. Roumbelaki, et al., 2010; Iordanou et al., 2017)
and Turkey(Leblebicioglu et al., 2014; Tigen et al.,
2014) are represented with 2 studies each (5% each
or 20% of the total). Australia (Worth et al., 2015),
Belgium(Mertens, Morales and Catry, 2013),
Brazil(Medeiros et al., 2015), Ecuador(Salgado
Yepez et al., 2017), France(Vanhems et al., 2011),
Holland(Kaiser et al., 2014), Iran(Jahani-Sherafat
et al., 2015), Japan(Watanabe et al., 2011),
Lebanon(Ss Kanj et al., 2012), Mexico(Ramirez
Barba et al., 2007), Mongolia(Ider et al., 2016),
Morocco(Madani et al., 2009), Poland(Kübler et
al., 2012), Taiwan(Chen et al., 2012) and
Venezuela(Empaire et al., 2017) were represented
by one study each (2.5% each or 37.5%
combined). 80% of studies (32/40) studied all three
DAIs (CLABSI, VAP and CAUTI) while a smaller
number (3/40 or 7.5%) studied two out of the three
DA-HAIs, specifically CLABSI and VAP. The
remaining five articles looked at only one of the
three DA-HAIs (5/40, 12.5%). Interestingly, no
75. researchers chose to study CAUTI with either
CLABSI or VAP and none of the researchers that
chose to study a single type of DA-HAI in the ICU
chose to focus on CAUTI, unlike VAP with 3/40
(7.5%) articles or CLABSI with 2/40 (5%) articles.
On the other hand, CAUTI is highly researched
with regard to non-ICU patients and many of the
rejected articles focussed on CAUTI outside the
ICU. Urinary catheter care in the ICU differs very
little from urinary catheter care elsewhere in
healthcare setting and since subject is heavily
studied outside the ICU, this may explain the
apparent lack of interest among ICU researchers.
Less than a third of the articles (12/40, 30%) were
conducted in a single ICU, while the remaining
70% (28/40) of articles study data gathered from
more than one ICU. Furthermore, three articles,
published by the INICC combine data from ICUs
in different countries and even different continents;
more specifically 422 ICUs from 36 countries in
Latin America, Asia and Europe(Rosenthal et al.,
2012), 503 ICUs from 43 countries in Latin
America, Asia, Europe and Africa(Rosenthal et al.,
2014) and 703 ICUs from 50 countries from Latin
America, Eastern Mediterranean, Southeast Asia
and the West Pacific(Rosenthal et al., 2016).
The sample sizes among studies vary greatly. The
largest sample of ICU patients is seen in the INICC
studies, and more specifically in Rosenthal’s et al
report from 703 ICUs in 50 countries(Rosenthal et
al., 2016), with 861,284 ICU patents, followed by
another INICC report, in 503 ICUs from 43
countries with a sample of 605,310 ICU patients
76. (Rosenthal et al., 2014) and the third largest study
is the Chinese(Tao et al., 2011) one with a sample
size of 391,527 patients, from 398 ICUs of 70
hospitals. On the other hand, the smallest sample is
found in one of the studies from India (H. Patil et
al., 2011) with 54 ICU patients, followed by
another study from the same country (Ranjan et al.,
2014) with 105 patients, whilst the third smallest
sample is found in one of the studies from the
republic of Cyprus(Iordanou et al., 2017) with 198
ICU patients.
Statistical analysis
For statistical analysis, median and interquartile
range (IQR) values, the mean and standard
deviation (SD) values of the DA-HAIs were used
to describe the constant variables. T-test was used
to examine the means between developed and
developing countries and the Wilcoxon rank-sum
test was used for comparing the medians.
Methodological Quality
Of the 40 reviewed articles, 32.5% (13/40) were
conducted in single ICUs. The remaining 27
articles are multicentered, while the three of the 27
INICC articles were not only multicentered but
conducted in multiple countries on multiple
continents. Also, a great variation in sample size is
noted. The results cannot be used to extract
conclusions about all the ICUs of a country and,
even though there may be many studies in a
country, the results are not necessarily indicative of
all the ICUs in that country as these individual
units may vary greatly from the infection
77. standpoint norm. India is the most represented
among the 40 studies. While results may not
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1924
www.internationaljournalofcaringsciences.org
considered necessarily representative for an entire
country, this does not mean they are not useful.
Potentially, comparison among ICUs can help
researchers and infection control staff to develop
better infection prevention practices.
DA-HAI Incidence rates
Both the first and second highest identified
CLABSIs rates were found in India(H. Patil et al.,
2011; Bammigatti et al., 2017) with a frequency of
72.56 and 47.31 incidents per 1000 device days
respectively. The third highest infection rate was
found in the Mexican study (23.1)(Ramirez Barba
et al., 2007). The lowest rates were found in the
Australian study(Worth et al., 2015) with a
reported incidence rate of 1.34 infections per 1000
device days. The Australian study reports only
CLABSI rates, so there is no data available for
VAP and CAUTI. The study with the second
lowest CLABSI rate was from the Netherlands
(Kaiser et al., 2014) with 1.7 cases per 1000 device
days and the third best result was from
Italy(Malacarne et al., 2010).
78. The highest VAP rates are reported in an Egyptian
study (73.4/1000DD)(Rasslan et al., 2012), second
highest in an Ecuadorian study
(44.3/1000DD)(Salgado Yepez et al., 2017) and
the third in a Mongolian study (43.7/1000DD)(Ider
et al., 2016). The lowest reported VAP rates come
from a Japanese study (1.14/1000DD)(Watanabe et
al., 2011), with the second lowest being reported in
the Netherlands (3.3/1000DD)(Kaiser et al., 2014)
and the third in Taiwan (3.8/1000DD)(Chen et al.,
2012). Ventilator associated pneumonia was
researched in 38 of the 40 reviewed studies and the
total sum of the 38 studies is 672161 instances of
VAP.
CAUTIs appear to be the third and least
encountered type of all DA-HAI, where rates of
infection are much lower than VAP and CLABSIs
in most studies. Higher CAUTI rates were found in
an Egyptian study (34.2/1000DD)(Rasslan et al.,
2012), second highest in a Mongolian study
(15.7/1000DD)(Ider et al., 2016) and third in a
Mexican and Mongolian study
(13.4/1000DD)(Ramirez Barba et al., 2007; Ider et
al., 2016) with exactly the same incidence rate per
1000 DD. The lowest CAUTI incidence rates
comes from India (1.41/1000DD)(Mehta et al.,
2007), the second lowest from China
(1.5/1000DD)(Peng et al., 2015) and third from
Egypt (1.9/1000DD)(Talaat et al., 2016).
The results of this particular Egyptian study(Talaat
et al., 2016) are reportedly after intervention,
noting that the results prior the intervention are not
79. disclosed.
Overall, the highest reported DA-HAI rate was
reported by Rasslan(Rasslan et al., 2012) whose
VAP infection rate was at 73.4 per 1000 ventilator
days, followed closely behind by Bammigatti et
al.’s(Bammigatti et al., 2017) who reported 72.56
CLABSI incidents per 1000 central line
days(Bammigatti et al., 2017). The lowest reported
DAI rate was 1.14(Watanabe et al., 2011)
pneumonias associated with mechanical ventilation
per 1000 device days.
Developing economies DA-HAI Incidence rates
In developing economies, VAP incidence rates per
1000 device days are reported by several studies
included in the present review. These reports
originate from twelve geographical locations,
specifically Mongolia (43.7/1000), Venezuela
(7.2/1000), Brazil (20.9/1000), China (20.18
[mean]), Ecuador (44.3/1000), Egypt (31.56/1000
[mean]), India (24.85/1000[mean]), Iran
(7.88/1000), Lebanon (8.1/1000), Mexico
(21.8/1000), Morocco (43.2/1000) and Turkey
(17.85/1000 [mean]). Mean and median values
computed using data from all developing
economies gives VAP rates of 24.29 (SD, 13.1)
and 21.35 (IQR, 10.5-40.29) respectively. Also,
CLABSI rates were found for 12 developing
economies, specifically Mongolia (19.7/1000),
Venezuela (5.1/1000), Brazil (9.1/1000), China
(2.9/1000[mean]), Ecuador (6.5/1000), Egypt
(9.33/1000[mean]), India (14.15/1000[mean]), Iran
(5.84), Lebanon (5.2/1000), Mexico (23.1/1000),
Morocco (15.7/1000) and Turkey (8.75/1000).
80. Mean developing economies CLABSI rate is
10.44/1000 (SD, 6.07) and median 8.92 (IQR,
5.36-15.31).
CAUTI rates are reported in public literature for 12
developing economies, Mongolia (15.7/1000),
Venezuela (3.9/1000), Brazil (9.6/1000), China
(6/1000[mean]), Ecuador (5.7/1000), Egypt
(34.1/1000[mean]), India (7.31/1000[mean]), Iran
(8.99/1000), Lebanon (4.1/1000), Mexico
(13.4/1000), Morocco (11.7/1000) and Turkey
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1925
www.internationaljournalofcaringsciences.org
(5.9/1000). Developing economies mean and
median value is 9.2 (SD: 3.66) and 8.94 (IQR;
5.75-12.75) (Table 3).
Developed Economies DA-HAI Incidence
Examining DA-HAIs found in publicly available
literature over the last ten years (2007-2017). VAP
incidence rates for developed economies include
data from for Cyprus (8.25/1000[mean]), France
(20.6/1000), Greece (16.3/1000[mean]), Italy
(11/1000[mean]), Japan (1.14/1000), Holland
(13.3/1000) and Belgium (2.3/1000). Mean and
median values for VAP rates in developed
economies were found to be 10.09 (SD, 6.82) and
81. 9.62 (IQR, 2.76-17.37) respectively.
CLABSI rates are mentioned in several reports
from eight countries, Belgium (2.3/1000), Cyprus
(17.25/1000[mean]), Greece (11.95/1000[mean]),
Italy (4.25/1000[mean]), Japan (2.38/1000),
Holland (1.7/1000) and Australia (1.34/1000).
Mean and median values for CLABSI rates in
developed economies were found to be 5.88 (SD,
5.75) and 2.38 (IQR, 1.7 – 11.95) respectively.
CAUTI is mentioned in seven studies reporting
incidence rates from six countries. Belgium reports
12 instances of CAUTI per 1000 device days
(5.5/1000), Cyprus 2.75/1000 (mean), Greece
4.5/1000, Italy 5.45/1000, Japan 2.4/1000 and
Poland 4.8/1000. Developed countries’ mean and
median values per 1000 device days is 5.31 (SD,
3.18) and 4.65 (IQR, 2.6-7.08) (Table 3).
Overall, the highest reported infection rate was
described by Rasslan(Rasslan et al., 2012) whose
VAP infection rate was 73.4 per 1000 ventilator
days, followed closely behind by Bammigatti’s
72.56 CLABSI incidents per 1000 central line
days(Bammigatti et al., 2017).
Aggregated Results
In total, 40 articles were found and reviewed in this
project, coming from 22 countries over the last 10
years and published in international literature. The
majority of these articles came from developing
economies (24/41) while the sample from
economies classified as developed, according to
the IMF(IMF, 2017) classification, was limited to
82. 14 articles (14/41). The remaining three articles
(3/41) came from the INICC and were based on
research conducted in multiple ICUs from
36(Rosenthal et al., 2012), 43(Rosenthal et al.,
2014) and 50(Rosenthal et al., 2016) countries
respectively, so these studies cannot be classified
based on the economic status of a specific
originating country.
The highest DAI rates come from Egypt (Rasslan
et al., 2012), India (Bammigatti et al., 2017) and
Mongolia (Ider et al., 2016) while the lowest come
from Japan (Watanabe et al., 2011) and the
Netherlands (Kaiser et al., 2014). The most
frequently reported DAI among the reviewed
articles was VAP with 73.4 lung infections per
1000 ventilator days (Rasslan et al., 2012), the
second highest reported DAI was CLABSI with
72.56 BSIs per 1000 central line days (Bammigatti
et al., 2017) and the least frequently encountered
DAI was CAUTI with a highest reported rate of
34.2 UTIs per 1000 urinary catheter days (Rasslan
et al., 2012). The overall mean and median values
for all articles were 10.83 and 6.45 respectively for
BSIs, 17.28 and 13.2 for pneumonia and for UTIs
6.89 and 5.5.
In general, the incidence rate of infections related
to invasive device use is higher in developing
economies than in those considered developed.
The mean and median values of all DAI rates in
developing economies are from 40% to 60%
higher than those of developed economies,
confirming the World Health Organization’s
findings(World health Organization, 2015).
83. DA-HAI rate comparison between developed
and developing countries
Mean and median VAP value for developed
economies are 10.09 (SD. 6.82) and 9.62 (IQR.
2.76-17.37) respectively, while in developing
countries, mean was 24.29 (SD.13.1) and median
21.35 (IQR.10.5-40.29). P Values between means
and medians for developed vs developing
economies were found in both correlations to have
statistical significance (mean correlation
[p=0.016], median correlation [p=0.02])(table 3).
Furthermore, CLABSI mean and median
comparisons between developed and developing
economies resulted in a significant statistical
correlation (mean correlation [p=0.011], median
correlation [p=0.025]). Mean and median for
developed and developing economies was
5.88(SD. 5.75) vs 10.44 (SD. 6.07) and 2.38(IQR.
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1926
www.internationaljournalofcaringsciences.org
1.7-11.95) vs 21.35 (IQR. 10.5-40.29) respectively
(table 3).
Comparing CAUTI mean and median figures, no
statistical correlation was found since the p value
84. was, in both cases, more than 0.05 (p>0.05). Mean
and median for developed and developing
economies was found to be 5.31 (SD. 3.18) vs 9.02
(SD. 3.66) and 4.65 (IQR. 2.6-7) vs 8.94
(IQR.5.75-12.75) (table 3).
Discussion
Systematic surveillance, recording and analysis of
local DA-HAI events in comparison to published
DA-HAI literature is highly significant in the ICU
setting. A single ICU’s results may be lost in a
countrywide multicentered study, but comparison
of local results with better results from a wider
source(es) and identification of possible areas for
improvement can directly affect ICU patient’s
hospitalization and outcomes by reducing the risk
of DA-HAIs and so impacting the negative
consequences of ICU hospitalization.
The aim of the current review was to gather
articles published since the 01/01/2007 to
determine DAI infection rates per 1000 device
days per article and per country and then use this
data to extract conclusions. Following an extensive
search in the scientific databases PubMed, Medline
and CINAHL and subsequent evaluation; 40
articles were found (table 4) from 22 countries and
reviewed.
In an attempt to improve analysis of the articles
and extract more conclusive results, the articles
were grouped for analysis in various ways. By
examining the articles based on their total number
of infections, the worst results come from
Egypt(Rasslan et al., 2012), India(Bammigatti et
85. al., 2017) and Mongolia(Ider et al., 2016). The
best results come from Japan(Watanabe et al.,
2011) and Egypt(Talaat et al., 2016). It was noted
that Australia(Worth et al., 2015) and the
Netherlands(Kaiser et al., 2014) have very low
results for CLABSI and CLABSI and VAP
respectively but do not have collective results for
all DAIs. First and third results were obtained
following intervention, making them of greater
interest as they demonstrate the effectiveness of
studying research backed literature and applying
the conclusions reached to daily practice in order
to identify and eliminate unsafe practices.
According to the WHO(World health
Organization, 2015), developing economies have
more DA-HAIs per 1000 device days than
developed ones. In order to avoid bias, the
reviewed articles were grouped based on their
geographical location and their economic status
(developed or developing). According to the
IMF(IMF, 2017), of the countries participating in
this review, the economies of Australia, Belgium,
Cyprus, France, Greece, Holland, Italy, Japan and
Taiwan are listed as developed, while the
economies of Brazil, China, Ecuador, Egypt, India,
Iran, Lebanon, Mexico, Mongolia, Morocco,
Poland, Turkey and Venezuela are listed as
developing. Three of the reviewed articles,
published on behalf of the INICC were conducted
in multiple countries and cannot be used in a
comparison by means of economic status of their
source country(Rosenthal et al., 2012, 2014, 2016).
Of the remaining 37 articles, 13 referred to ICUs in
developed economies (Dima et al., 2007; Gikas, Á.
86. M. Roumbelaki, et al., 2010; Malacarne et al.,
2010b; Watanabe et al., 2011; Vanhems et al.,
2011; Chen et al., 2012; Apostolopoulou et al.,
2013; Mertens, Morales and Catry, 2013; Kaiser et
al., 2014; Boncagni et al., 2015; Worth et al.,
2015; Velasquez et al., 2016; Iordanou et al.,
2017), while 24 of the reviewed articles were in
developing economies (Boyce et al., 2002; Mehta
et al., 2007; Ramirez Barba et al., 2007; Madani et
al., 2009; Tao et al., 2011; H. V Patil et al., 2011;
Rasslan et al., 2012; SS Kanj et al., 2012; El-
Kholy et al., 2012; Kübler et al., 2012; Singh et
al., 2013; Leblebicioglu et al., 2014; Ranjan et al.,
2014; Datta et al., 2014; Tigen et al., 2014;
Medeiros et al., 2015; Peng et al., 2015; Jahani-
Sherafat et al., 2015; Rosenthal et al., 2016; Talaat
et al., 2016; Ider et al., 2016; Bammigatti et al.,
2017; Salgado Yepez et al., 2017; Empaire et al.,
2017; Kumar et al., 2017).
Among developed economies, the highest reported
DAI rate was 23.1/1000 DD, specifically VAP in
Italy(Boncagni et al., 2015), and the second
highest was again VAP with an incidence rate of
20.6/1000 DD in France(Vanhems et al., 2011). Of
the 13 articles, 12 reviewed the incidence of VAP
with the highest reported incidence being 23.1
infections to the lowest 1.14(Watanabe et al.,
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1927
87. www.internationaljournalofcaringsciences.org
2011) per 1000 DD. In comparison, the highest
VAP incidence rate for developing economies was
in Egypt with 73.4(Rasslan et al., 2012) per 1000
ventilator days and the best result came from
India(Bammigatti et al., 2017) with 3.98 VAP
incidents per 1000 ventilator days. For developing
economies, 23 researchers studied VAP rates as
opposed to 12 researchers for developed
economies. The mean value of the samples was
24.29 vs 10.09 (p=0.016) for developed
economies. The median value is 21.35 against 9.62
(p=0.02) for developed economies.
The same statistically significant correlation was
found in the comparison of mean and median
values for CLABSI. The mean value for CLABSI
rates among developing economies is 10.44 versus
5.88 (p=0.011) for advanced economies and
median value is 8.92 against 2.38 (p=0.025), where
the highest advanced economies rate was found in
Cyprus(Gikas, M. Roumbelaki, et al., 2010)
(18.6/1000DD) and the lowest in Australia(Worth
et al., 2015) (1.34/1000DD). The highest rate for
developing economies comes from
India(Bammigatti et al., 2017) (72.56/1000DD)
and the lowest from Egypt(Talaat et al., 2016)
(2.6/1000DD).
Despite the fact that mean and median values for
developed economies are higher than is described
in the NHSN ICUs report(Dudeck et al., 2011) (for
VAP, 4/1000DD and for CLABSI, 3/1000DD),
these values still appear to be much lower than the
figures for developing economies in a statistically
88. significant correlation. Accordingly, VAP and
CLABSI is directly associated and affected by the
economic status of the country under study.
Indwelling urinary catheters are common in
healthcare settings outside the ICU and are far
more researched, so CAUTI prevention steps are
better known and better followed by healthcare
professionals. Also, there is limited interest among
ICU researchers to investigate this subject and then
to employ scientific literature recommendations as
the current relatively low infection rates are judged
acceptable. This is reflected in the fact that only
seven out of the 14 articles reviewed studied
CAUTI rates, and the low infection rates reported
in both developed and developing economies. The
highest reported CAUTI rate comes from
Belgium(Mertens, Morales and Catry, 2013) at
5.5/1000DD and the best result is reported from
Japan(Watanabe et al., 2011) (2.4/1000DD). The
mean CAUTI rate among developed economies is
5.31(SD. 3.18) while the median is 2.38(IQR. 1.7-
11.95).
In developing economies, there is significantly
greater interest among researchers with regard to
CAUTI rates. Of the 24 reviewed articles from
developing economies, 22 measured CAUTI
incidence rates in their hospitals. The highest
reported CAUTI rate came from Egypt(Rasslan et
al., 2012) (34.2/1000DD) and the lowest result was
reported from India(Mehta et al., 2016)
(2.1/1000DD). Mean and median were found to be
9.02(SD. 3.66) and 8.94(IQR. 5.75-12.75)
respectively. There was no statistically significant
89. correlation in the comparison of the mean and
median values although much higher rates of
incidence were found in developing economies.
Accordingly, country of origin may associated
with high or low CAUTIs rates, but it cannot be
considered as the only cause of positive or negative
results.
In general, the incidence rate of infections related
with invasive devices usage is higher in developing
than in developed economies. In comparison, the
mean and median values of all DA-HAI rates in
developing economies are 50% - 60% higher than
those of developed economies, verifying the World
Health Organization’s findings(World health
Organization, 2015).
Conclusions
There are many gaps in bibliography when it
comes to aggregating results per ICU and per
country as most studies are multicentered, and
sometimes even from multiple countries so
conclusive results cannot be extracted on a per
country or per ICU basis.
When it comes to correlations between developed
and developing economies DA-HAI rates, we
concluded that the economic status of countries
tend to be associated with marked variations in
DA-HAI rates.
The most practical way to separate DA-HAIs rates
for comparison is by considering the economic
status of the article’s originating country (as per
the International Monetary Fund classification), as
90. it is more likely for limited resource ICUs from
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1928
www.internationaljournalofcaringsciences.org
developing economies to have higher DA-HAIs
rates as compared with ICUs from countries with
developed economies and therefore resources.
Limitations
Grey literature was not included in the study.
References
Apostolopoulou, E., Raftopoulos, V., Filntisis, G.,
Kithreotis, P., Stefanidis, E., Galanis, P., Veldekis,
D., (2013). Surveillance of device-associated
infection rates and mortality in 3 greek intensive
care units. Am. J. Crit. Care 22, e12-20.
Bammigatti, C., Doradla, S., Belgode, H.N., Kumar, H.,
Swaminathan, R.P., (2017). Healthcare associated
infections in a resource limited setting. J. Clin.
Diagnostic Res. 11, OC01-OC04.
Boncagni, F., Francolini, R., Nataloni, S., Skrami, E.,
Gesuita, R., Donati, A., Pelaia, P., (2015).
Epidemiology and clinical outcome of healthcare-
associated Infections: A 4-year experience of an
91. Italian ICU. Minerva Anestesiol. 81, 765–775.
Boyce, J.M., Pittet, D., Committee, H.I.C.P.A., Force,
H.H.H.T., Healthcare Infection Control Practices
Advisory Committee, HICPAC/SHEA/APIC/IDSA
Hand Hygiene Task Force, (2002). Guideline for
Hand Hygiene in Health-Care Settings.
Recommendations of the Healthcare Infection
Control Practices Advisory Committee and the
HICPAC/SHEA/APIC/IDSA Hand Hygiene Task
Force. Society for Healthcare Epidemiology of
America/Association for Prof.
MMWR.Recommendations reports Morb. Mortal.
Wkly. report.Recommendations reports / Centers
Dis. Control 51, 1–45, quiz CE1-4.
Chen, Y.-Y., Chen, L.-Y., Lin, S.-Y., Chou, P., Liao, S.-
Y., Wang, F.-D., (2012). Surveillance on secular
trends of incidence and mortality for device-
associated infection in the intensive care unit setting
at a tertiary medical center in Taiwan, 2000-2008: a
retrospective observational study. BMC Infect. Dis.
12, 209.
Datta, P., Rani, H., Chauhan, R., Gombar, S., Chander,
J., (2014). Health-care-associated infections: Risk
factors and epidemiology from an intensive care unit
in Northern India. Indian J. Anaesth. 58, 30–35.
Dima, S., Kritsotakis, E.I., Roumbelaki, M., Metalidis,
S., Karabinis, A., Maguina, N., Klouva, F.,
Levidiotou, S., Zakynthinos, E., Kioumis, J., Gikas,
A., (2007). Device-associated nosocomial infection
rates in intensive care units in Greece. Infect.
Control Hosp. Epidemiol. 28, 602–605.
92. Dudeck, M.A., Horan, T.C., Peterson, K.D., Allen-
Bridson, K., Morrell, G., Pollock, D.A., Edwards,
J.R., (2011). National Healthcare Safety Network
(NHSN) Report, data summary for 2010, device-
associated module. Am. J. Infect. Control 39, 798–
816.
El-Kholy, A., Saied, T., Gaber, M., Younan, M.A.,
Haleim, M.M.A., El-Sayed, H., El-Karaksy, H.,
Bazara’a, H., Talaat, M., (2012). Device-associated
nosocomial infection rates in intensive care units at
Cairo University hospitals: first step toward
initiating surveillance programs in a resource-limited
country. Am. J. Infect. Control 40, e216-20.
Empaire, G.D., Guzman Siritt, M.E., Rosenthal, V.D.,
Pérez, F., Ruiz, Y., Díaz, C., Di Silvestre, G.,
Salinas, E., Orozco, N., (2017). Multicenter
prospective study on device-associated infection
rates and bacterial resistance in intensive care units
of Venezuela: International Nosocomial Infection
Control Consortium (INICC) findings. Int. Health 9,
44–49.
Gikas, A., Roumbelaki, Á.M., Bagatzouni-Pieridou, D.,
Alexandrou, M., Zinieri, V., Kritsotakis, E.I.,
Roumbelaki, M., Bagatzouni-Pieridou, D.,
Alexandrou, M., Zinieri, V., Dimitriadis, I.,
Kritsotakis, E.I., (2010a). Device-associated
infections in the intensive care units of Cyprus:
results of the first national incidence study. Infection
38, 165–171.
Gikas, A., Roumbelaki, M., Bagatzouni-Pieridou, D.,
Alexandrou, M., Zinieri, V., Dimitriadis, I.,
93. Kritsotakis, E.I., (2010b). Device-associated
infections in the intensive care units of Cyprus:
results of the first national incidence study. Infection
38, 165–171.
Ider, B.-E., Baatar, O., Rosenthal, V.D.,
Khuderchuluun, C., Baasanjav, B., Donkhim, C.,
Batsuur, B., Jambiimolom, M., Purevdorj, S.-E.,
Tsogtbaatar, U., Sodnomdarjaa, B., Gendaram, B.,
Mendsaikhan, N., Begzjav, T., Narankhuu, B.,
Ariungerel, B.-E., Tumendemberel, B., Orellano,
P.W., (2016). Multicenter study of device-associated
infection rates in hospitals of Mongolia: Findings of
the International Nosocomial Infection Control
Consortium (INICC). Am. J. Infect. Control 44,
327–331.
IMF, (2017). World Advanced Economies [WWW
Document]. URL
https://en.wikipedia.org/wiki/Developed_country#I
MF_advanced_economies
Iordanou, S., Middleton, N., Papathanassoglou, E.,
Raftopoulos, V., (2017). Surveillance of device
associated infections and mortality in a major
intensive care unit in the Republic of Cyprus. BMC
Infect. Dis. 17, 607.
Jahani-Sherafat, S., Razaghi, M., Rosenthal, V.D.,
Tajeddin, E., Seyedjavadi, S., Rashidan, M.,
Alebouyeh, M., Rostampour, M., Haghi, A.,
Sayarbayat, M., Farazmandian, S., Yarmohammadi,
International Journal of Caring Sciences September-
94. December 2018 Volume 11 | Issue 3| Page1929
www.internationaljournalofcaringsciences.org
T., Arshadi, F.K., Mansouri, N., Sarbazi, M.R.,
Vilar, M., Zali, M.R., (2015). Device-associated
infection rates and bacterial resistance in six
academic teaching hospitals of Iran: Findings from
the International Nocosomial Infection Control
Consortium (INICC). J. Infect. Public Health 8,
553–561.
Kaiser, A.M., de Jong, E., Evelein-Brugman, S.F.,
Peppink, J.M., Vandenbroucke-Grauls, C.M.,
Girbes, A.R., (2014). Development of trigger-based
semi-automated surveillance of ventilator-associated
pneumonia and central line-associated bloodstream
infections in a Dutch intensive care. Ann. Intensive
Care 4, 40.
Kanj, S., Kanafani, Z., Sidani, N., Alamuddin, L.,
Zahreddine, N., Rosenthal, V., (2012). International
nosocomial infection control consortium findings of
device-associated infections rate in an intensive care
unit of a lebanese university hospital. J. Glob. Infect.
Dis. 4, 15–21.
Kanj, S., Kanafani, Z., Sidani, N., Alamuddin, L.,
Zahreddine, N., Rosenthal, V., (2012). International
nosocomial infection control consortium findings of
device-associated infections rate in an intensive care
unit of a Lebanese university hospital. J. Glob.
Infect. Dis. 4, 15.
95. Kübler, A., Duszynska, W., Rosenthal, V.D., Fleischer,
M., Kaiser, T., Szewczyk, E., Barteczko-Grajek, B.,
(2012). Device-associated infection rates and extra
length of stay in an intensive care unit of a
university hospital in Wroclaw, Poland:
International Nosocomial Infection Control
Consortium’s (INICC) findings. J. Crit. Care 27,
105.e5-105.e10.
Kumar, S., Sen, P., Gaind, R., Verma, P.K., Gupta, P.,
Suri, P.R., Nagpal, S., Rai, A.K., (2012). Prospective
surveillance of device-associated health care–
associated infection in an intensive care unit of a
tertiary care hospital in New Delhi, India. Am. J.
Infect. Control.
https://doi.org/10.1016/j.ajic.2017.08.037
Leblebicioglu, H., Erben, N., Rosenthal, V.D., Atasay,
B., Erbay, A., Unal, S., Senol, G., Willke, A.,
Özgültekin, A., Altin, N., Bakir, M., Oncul, O.,
Ersöz, G., Ozdemir, D., Yalcin, A.N., Özdemir, H.,
Yıldızdaş, D., Koksal, I., Aygun, C., Sirmatel, F.,
Sener, A., Tuna, N., Akan, Ö.A., Turgut, H.,
Demiroz, A.P., Kendirli, T., Alp, E., Uzun, C.,
Ulusoy, S., Arman, D., 2014. International
Nosocomial Infection Control Consortium (INICC)
national report on device-associated infection rates
in 19 cities of Turkey, data summary for 2003-2012.
Ann. Clin. Microbiol. Antimicrob. 13, 51.
Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C.,
Gøtzsche, P.C., Ioannidis, J.P.A., Clarke, M.,
Devereaux, P.J., Kleijnen, J., Moher, D., (20097).
The PRISMA statement for reporting systematic
reviews and meta-analyses of studies that evaluate
96. health care interventions: Explanation and
elaboration. PLoS Med.
https://doi.org/10.1371/journal.pmed.1000100
Madani, N., Rosenthal, V.D., Dendane, T., Abidi, K.,
Zeggwagh, A.A., Abouqal, R., (2009). Health-care
associated infections rates, length of stay, and
bacterial resistance in an intensive care unit of
Morocco: findings of the International Nosocomial
Infection Control Consortium (INICC). Int. Arch.
Med. 2, 29. https://doi.org/10.1186/1755-7682-2-29
Malacarne, P., Boccalatte, D., Acquarolo, A., Agostini,
F., Anghileri, A., Giardino, M., Giudici, D., Langer,
M., Livigni, S., Nascimben, E., Rossi, C., Bertolini,
G., (2010a). Epidemiology of nosocomial infection
in 125 Italian intensive care units. Minerva
Anestesiol. 76, 13–23.
Malacarne, P., Boccalatte, D., Acquarolo, A., Agostini,
F., Anghileri, A., Giardino, M., Giudici, D., Langer,
M., Livigni, S., Nascimben, E., Rossi, C., Bertolini,
G., (2010b). Epidemiology of Nosocomial infection
in 125 Italian Intensive Care units. Minerva
Anestesiol. 76, 13–23.
Medeiros, E.A., Grinberg, G., Rosenthal, V.D., Bicudo
Angelieri, D., Buchner Ferreira, I., Bauer Cechinel,
R., Zanandrea, B.B., Rohnkohl, C., Regalin, M.,
Spessatto, J.L., Scopel Pasini, R., Ferla, S., (2015).
Impact of the International Nosocomial Infection
Control Consortium (INICC) multidimensional hand
hygiene approach in 3 cities in Brazil. Am. J. Infect.
Control 43, 10–15.
Mehta, A., Rosenthal, V.D., Mehta, Y., Chakravarthy,
97. M., Todi, S.K., Sen, N., Sahu, S., Gopinath, R.,
Rodrigues, C., Kapoor, P., Jawali, V., Chakraborty,
P., Raj, J.P., Bindhani, D., Ravindra, N., Hegde, A.,
Pawar, M., Venkatachalam, N., Chatterjee, S.,
Trehan, N., Singhal, T., Damani, N., (2007). Device-
associated nosocomial infection rates in intensive
care units of seven Indian cities. Findings of the
International Nosocomial Infection Control
Consortium (INICC). J. Hosp. Infect. 67, 168–174.
Mehta, Y., Jaggi, N., Rosenthal, V.D., Kavathekar, M.,
Sakle, A., Munshi, N., Chakravarthy, M., Todi, S.K.,
Saini, N., Rodrigues, C., Varma, K., Dubey, R.,
Kazi, M.M., Udwadia, F.E., Myatra, S.N., Shah, S.,
Dwivedy, A., Karlekar, A., Singh, S.P.S., Sen, N.,
Limaye-Joshi, K., Ramachandran, B., Sahu, S.S.,
Pandya, N., Mathur, P., Sahu, S.S., Singh, S.P.S.,
Bilolikar, A.K., Kumar, S., Mehta, P., Padbidri, V.,
Gita, N., Patnaik, S.K., Francis, T., Warrier, A.R.,
Muralidharan, S., Nair, P.K., Subhedar, V.R.,
Gopinath, R., Azim, A., Sood, S., (2016). Device-
Associated Infection Rates in 20 Cities of India,
Data Summary for 2004–2013: Findings of the
International Nosocomial Infection Control
International Journal of Caring Sciences September-
December 2018 Volume 11 | Issue 3| Page1930
www.internationaljournalofcaringsciences.org
Consortium. Infect. Control Hosp. Epidemiol. 37,
172–181.