This document discusses the need for mixed methods approaches in research and policy appraisal to counter pressures for closure. It notes that institutions often privilege narrow scopes and incumbent interests over opening up discussion. The document calls for independent innovation research and policy appraisal to deliberately counter these pressures for closure. It proposes that building repertoires of mixed methods can provide both practical project methods and a systematic methodology to achieve more open and reflexive discussions.
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
Steps methods #5 Towards repertoires of mixed methods
1. STEPS Pathways Methods
PART 5
Towards repertoires of mixed methods
Professor Andy Stirling
Co-director, STEPS Centre
www.steps-centre.org
www.sussex.ac.uk/spru
www.multicriteria-mapping.org
2. INPUTS
(aspects taken into
account within
practice of research
or appraisal)
problems,
options,
pros / cons,
issues,
uncertainties,
perspectives
INPUTS
(things that are
taken into account)
Pro
blems, options, pros
/ cons, issues,
uncertainties,
perspectives
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
OUTPUTS
(aspects that are conveyed
outwards into wider discourse)
’Plural conditional’ conclusions…
… if X then A … if Y then B …
3. narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
decision
analysis
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
4. narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
5. narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
participatory
rural appraisal
q-method
deliberative
mapping
scientometric
mapping
open
space
multi-criteria
mapping
extended
foresight
citizen’s juries
decision
analysis
stakeholder
negotiation
sensitivity
analysis
cost-benefit
analysis
risk
assessment
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
spot-the-
narrative
6. spot-the-
narrative
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
decision
analysis
participatory
rural appraisal
stakeholder
negotiation
q-method
sensitivity
analysis
deliberative
mapping
scientometric
mapping
open
space
cost-benefit
analysis
risk
assessmen
t
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
multi-criteria
mapping
extended
foresight
Power Closes Down Research and Appraisal
Institutions privilege blinkered scope, marginal analysis, incumbent interests
… evidence-basing, liability, insurance, agency remits, fiduciary responsibility
stakeholder
negotiation
cost-benefit
analysis
risk
assessment
7. narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
decision
analysis
participatory
rural appraisal
stakeholder
negotiation
q-method
sensitivity
analysis
deliberative
mapping
scientometric
mapping
open
space
cost-benefit
analysis
risk
assessmen
t
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
multi-criteria
mapping
extended
foresight
Power Closes Down Research and Appraisal
A responsibility for neutrality means independent innovation research and
policy appraisal should deliberately counter pressures for closure
spot-the-
narrative
8. narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
Building Methods Repertoires
Basis both for practical project methods – and systematic STEPS methodology
‘visions
workshops’
‘dynamic
MCM’
‘particip.
epidem.’
‘top-bottom
comparison’
‘network
analysis’
‘insider
ontologies’