2. The HCPC standard
By the end of your training you will be
able to...
... be able to identify, review and
critically appraise a substantial body of
research evidence relevant to clinical
psychology practice
3. Learning Outcomes
• To be able to clarify a suitable question for a
literature search and to operationalize the
question in an appropriate search strategy
• To be able to systematically search relevant
databases and keep accurate records of those
searches
• To be able to identify, review, and clearly describe
a substantial body of empirical evidence relevant
to clinical psychology practice
• To be able to report the findings of a detailed and
systematic survey of a literature in a clear,
methodical and professional way
6. The Literature Survey:
• 4000 word limit
• Title
• Abstract (structured)
• Introduction
• Method
• Results
• Discussion
7.
8.
9. What is the effect of therapy
on Mental Illness?
10. Focused questions
To generate a specific question – identify the
key components - PICO.
• Population/participants/patients
• Intervention/exposure
• Comparison group
• Outcomes of interest
11. Exercise
Identify the key components of the following
review questions:
1. Stage-based interventions for smoking
cessation among adolescents
2. Psychosocial interventions for prevention
and treatment of childhood obesity
3. Determinants of mammography screening
uptake.
13. Comprehensive searching
• Why does your research need to be
comprehensive?
• What kinds of bias might we introduce?
• Publication type (need to include journals,
conference, dissertations, grey, ongoing)
• Search media (electronic, manual, personal)
• Languages, countries
14. Search strategy
Break the question down into its component
parts
• Patient group
• Intervention
• Comparison
• Outcome
Think about limits (date of introduction of
drug? Study design?)
15. Developing search terms from your
question.
• Identify and record synonyms, abbreviations,
related terms.
• Remember transatlantic differences (e.g.
learning disability/mental retardation)
16. Decide upon the limits of your review
• Publication
– Peer reviewed articles? English language?
Published after 2000?
• Study
– E.g. sample size, follow-up time, type of outcome
measure used.
• Quality of evidence
– Hierarchy of evidence in terms of study design.
32. Study Participants Intervention Results Conclusion / Comment
Study,
003
N Randomised:
290 (I=150,
C=140)
Age: m=43.
Gender: 30%
female
Type: UK
Community
(Patient)
Recruitment:
Non-smoking
related attendance
at GP surgery
I: 3 x 30 min weekly
stage-based, group
MI with take-home
intervention pack.
C: GP advice
Provider: Practice
Nurse
Setting: GP Surgery
Follow-up: 2 months
Outcome:
Abstinence (3 wks),
self-report
questionnaire
Author:
Dropout:
82 (I=53, C=29)
N Analysed:
208 (I=97, C=111)
Abstinence:
31 (I=19, C=12)
(p<0.05)
Reviewer analysis
ITT OR=1.54
(95% CI, 0.63 to
4.29)
Author:
Brief, stage-based MI
with take-home material
is an effective smoking
cessation intervention.
Reviewer:
High attrition (I, OR =
2.09) and ns difference
with ITT analysis.
Participant inclusion
criteria and method of
randomisation unknown.
Tailoring unclear, re:
group-level MI.
Authors’ conclusions are
inconsistent with data.
36. PRISMA – Be methodical
• PRISMA stands for Preferred Reporting Items
for Systematic Reviews and Meta-Analyses. It
is an evidence-based minimum set of items
for reporting in systematic reviews and meta-
analyses.
• The aim of the PRISMA Statement is to help
authors improve the reporting of systematic
reviews and meta-analyses.
• The PRISMA Statement consists of a 27-
item checklist and a four-phase flow diagram.
The first step towards establishing a useful research question involves a thorough examination of the literature. Before deciding upon a research question, it is important to establish that the proposed research is both necessary and useful by ensuring that other research already conducted leaves a question unasked, or findings that are inconclusive or unsound. It is crucial to ensure that the proposed study has not already been undertaken or that, if it has, there is a sound justification for repeating the study. It is also important to ensure that the literature is considered in sufficient depth so that new research findings can be integrated with existing knowledge so that others will be able to make full use of it.
The Literature Survey is a first step towards a critical review of the literature relevant to the MRP Empirical Paper. The purpose of the Literature Survey is to construct a preliminary overview of the relevant literature to enable the development of the MRP Proposal. The trainee will receive clear feedback on the Literature Survey before going on to work it up into the MRP Literature Review.
The trainee is not expected to have a fully developed a critique of the literature at the point when they submit the Literature Survey to their Principal Supervisor. However, before enabling the trainee to proceed with the next stage of the MRP, the Principal Supervisor will expect to see evidence that the trainee has a good understanding of the relevant territory for their research. This will include being able to define the relevant literature, characterize it, talk about the dominant models, theories and explanations in use, and key methodological approaches. The assessment and critique of these may not be as sophisticated or as fully developed as in the MRP Literature Review, but must be sufficiently well developed to provide a sound rationale for undertaking a research project. A more descriptive account of the literature will be acceptable for the Literature Survey.
It is important that the aims and/or specific research question for the Literature Survey are made clear so that the relevance of the literature that is outlined and discussed is apparent. The survey should also include a clear and concise statement about why these particular literatures or areas of literature are brought together to underpin the plans for further research.
To help refine and define your area of interest
To succinctly describe the works of relevance in this area
To highlight the known known's and the known unknowns
To suggest future research (which you may or may not be about to engage in)
The process
Formulating a question/clarifying the review topic
Indentify resources
Literature searching
Data extraction
Critical evaluation of the literature
Synthesis
Conclusions
Start by identifying what you will need to know to inform your research:
What research has already been done on this topic?
What are the sub-areas of the topic you need to explore?
What other research (perhaps not directly on the topic) might be relevant to your investigation?
How do these sub-topics and other research overlap with your investigation?
You need to be able to develop a good question.
How useful is this question?
How easy would it be to answer?
Is it sufficiently focused?
How meaningful would the answers be?
Allow up to 10/15 minutes
Group work.
Before beginning your review, check to see if there are any other literature reviews or systematic reviews available.
DARE at CRD - DARE is data base for Centre for Reviews and Dissemination York University
Cochrane Library
TRIP index - a clinical search tool for latest evidence from Centre for Evidence Based Medicine
NRR (includes ongoing reviews database) - National Research Register for the NIHR – projects database
The Library
The internet
UoS Library has dedicated staff to help you :
http://www.surrey.ac.uk/library/subjects/psychology/index.htm
Access to a variety of specialist databases as well as IT resources and study areas.
You need be on a UoS machine, OR log in via Athens or UoS
We’ll try to do a live demonstration – or use the next few slides as an example.
My personal preference is to use the Web of Science gateway.
Many other alternatives are available eg PubMed
You should keep a record of what databases you used, what the search terms were, and how many ‘hits’ you got. This can be sumarised in a table that can be part of the appendix.
Record everything !!!
Search history
Search strategy
Search results
Each and every time you add to it.
Plan ahead to cope with the thousands of references you might identify – It’s a data tsunami
Keep precise records
Reference Management Software
Allows you to keep track of large numbers of references
Can contain bibliographic data and abstracts
Integrates with word processing software to facilitate standardised referencing
How do you decide what to include in the survey?
Look at the title and abstract to assess the extent to which the description fits your inclusion/exclusion criteria
Look at the full text versions of the papers you identify against your criteria
These are the ones that you will include in your review
Panic!!! Do I need to read every word?
Organise the information you extract
Participants/demographic/diagnosis for intervention and controls
Intervention and control conditions
Methods of analysis. ITT
Results (relevant to review)
Authors conclusions (verbatim if possible)
Your comments
All designs have flaws – potential for bias
To establish the status of research findings you have to apply the appropriate frameworks and criteria for the type of study
Are the findings attributable to factors other than those that the authors identify?
For RCT’s:
Adequate randomisation
N, power
Blinding
Baseline comparability
Adequate follow-up
Intention-to-treat analysis
Quality of research
Quality assessment determines:
Whether you include the study in your review
The strength with which conclusions can be drawn about current knowledge
Recommendations for filling gaps in knowledge and improving research quality
Quantitative: Statistically combine results of several studies into a single numerical estimate of effect (e.g. meta-analysis)
Qualitative : Narrative summary and synthesis of primary studies
Narrative Synthesis:
Characterise the literature
Group the studies in a meaningful way and discuss them
Include enough of your evaluation of the study to show the status of the findings from your point of view
In the end, the goal of the Literature Survey is to identify the gaps in the wider body of research so as to provide justification for your research question upon which your MRP will be based. You need to get specific in your conclusions, so that we are left in no doubt that the topic is relevant and evidence based.