SlideShare a Scribd company logo
1 of 8
Download to read offline
STEPS Pathways Methods
PART 5
Towards repertoires of mixed methods
Professor Andy Stirling
Co-director, STEPS Centre
www.steps-centre.org
www.sussex.ac.uk/spru
www.multicriteria-mapping.org
INPUTS
(aspects taken into
account within
practice of research
or appraisal)
problems,
options,
pros / cons,
issues,
uncertainties,
perspectives
INPUTS
(things that are
taken into account)
Pro
blems, options, pros
/ cons, issues,
uncertainties,
perspectives
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
OUTPUTS
(aspects that are conveyed
outwards into wider discourse)
’Plural conditional’ conclusions…
… if X then A … if Y then B …
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
decision
analysis
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
participatory
rural appraisal
q-method
deliberative
mapping
scientometric
mapping
open
space
multi-criteria
mapping
extended
foresight
citizen’s juries
decision
analysis
stakeholder
negotiation
sensitivity
analysis
cost-benefit
analysis
risk
assessment
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
Challenges for Research and Appraisal
How more reflexively to inform policy and wider innovation governance?
spot-the-
narrative
spot-the-
narrative
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
decision
analysis
participatory
rural appraisal
stakeholder
negotiation
q-method
sensitivity
analysis
deliberative
mapping
scientometric
mapping
open
space
cost-benefit
analysis
risk
assessmen
t
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
multi-criteria
mapping
extended
foresight
Power Closes Down Research and Appraisal
Institutions privilege blinkered scope, marginal analysis, incumbent interests
… evidence-basing, liability, insurance, agency remits, fiduciary responsibility
stakeholder
negotiation
cost-benefit
analysis
risk
assessment
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
citizen’s juries
decision
analysis
participatory
rural appraisal
stakeholder
negotiation
q-method
sensitivity
analysis
deliberative
mapping
scientometric
mapping
open
space
cost-benefit
analysis
risk
assessmen
t
interactive
modelling
structured
interviews
narrative-based
participant
observation
multi-site
ethnographic-
methods
citizen’s juries
consensus
conference
open
hearings
dissenting
opinions
multi-criteria
mapping
extended
foresight
Power Closes Down Research and Appraisal
A responsibility for neutrality means independent innovation research and
policy appraisal should deliberately counter pressures for closure
spot-the-
narrative
narrow
broad
closing down opening up
expert /
analytic
participatory /
deliberative
Building Methods Repertoires
Basis both for practical project methods – and systematic STEPS methodology
‘visions
workshops’
‘dynamic
MCM’
‘particip.
epidem.’
‘top-bottom
comparison’
‘network
analysis’
‘insider
ontologies’

More Related Content

What's hot

Case study approach as a pedagogy in management
Case study approach as a pedagogy in managementCase study approach as a pedagogy in management
Case study approach as a pedagogy in management
smitaj
 
Factors influencing choice of methods
Factors influencing choice of methodsFactors influencing choice of methods
Factors influencing choice of methods
lucylee79
 

What's hot (20)

An introduction to qualitative research method
An introduction to qualitative research methodAn introduction to qualitative research method
An introduction to qualitative research method
 
Qualitative v,s Quantitative Research
Qualitative v,s Quantitative ResearchQualitative v,s Quantitative Research
Qualitative v,s Quantitative Research
 
Designing impactful research in social sciences
Designing impactful research in social sciencesDesigning impactful research in social sciences
Designing impactful research in social sciences
 
Qualitative research
Qualitative researchQualitative research
Qualitative research
 
Research in language and literature, karpagam university, conference ppt
Research in language and literature, karpagam university, conference pptResearch in language and literature, karpagam university, conference ppt
Research in language and literature, karpagam university, conference ppt
 
Introduction to Research Methods in the Social Services 02
Introduction to Research Methods in the Social Services 02Introduction to Research Methods in the Social Services 02
Introduction to Research Methods in the Social Services 02
 
SRA Poster: Qualitative Interviews about Communication Training
SRA Poster: Qualitative Interviews about Communication TrainingSRA Poster: Qualitative Interviews about Communication Training
SRA Poster: Qualitative Interviews about Communication Training
 
Case study approach as a pedagogy in management
Case study approach as a pedagogy in managementCase study approach as a pedagogy in management
Case study approach as a pedagogy in management
 
Introduction to Research Methods in the Social Services 03
Introduction to Research Methods in the Social Services 03Introduction to Research Methods in the Social Services 03
Introduction to Research Methods in the Social Services 03
 
Jean-Christophe Belisle Pipon, "Patients in Multiple Roles: Does it Lead to E...
Jean-Christophe Belisle Pipon, "Patients in Multiple Roles: Does it Lead to E...Jean-Christophe Belisle Pipon, "Patients in Multiple Roles: Does it Lead to E...
Jean-Christophe Belisle Pipon, "Patients in Multiple Roles: Does it Lead to E...
 
Quality Qualitative Research
Quality Qualitative ResearchQuality Qualitative Research
Quality Qualitative Research
 
Systematic literature review in social sciences
Systematic literature review in social sciencesSystematic literature review in social sciences
Systematic literature review in social sciences
 
Research ethics
Research ethicsResearch ethics
Research ethics
 
Share 'workshop 2019.pptx'
Share 'workshop 2019.pptx'Share 'workshop 2019.pptx'
Share 'workshop 2019.pptx'
 
PICO in systematic literature review
PICO in systematic literature reviewPICO in systematic literature review
PICO in systematic literature review
 
Methods and Data Collection
Methods and Data CollectionMethods and Data Collection
Methods and Data Collection
 
ETHICS IN RESEARCH
ETHICS IN RESEARCHETHICS IN RESEARCH
ETHICS IN RESEARCH
 
Introduction to Research Methods in the Social Services 05
Introduction to Research Methods in the Social Services 05Introduction to Research Methods in the Social Services 05
Introduction to Research Methods in the Social Services 05
 
Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research Gedu 6170 Mixed Methods Research
Gedu 6170 Mixed Methods Research
 
Factors influencing choice of methods
Factors influencing choice of methodsFactors influencing choice of methods
Factors influencing choice of methods
 

Similar to Steps methods #5 Towards repertoires of mixed methods

Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
Conceptualising a Research and Writing a Proposal. How to evolve a budget for...Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
essadmin
 
E D 203, Month #1, Sept 12, 09, Updated
E D 203,  Month #1,  Sept 12, 09,  UpdatedE D 203,  Month #1,  Sept 12, 09,  Updated
E D 203, Month #1, Sept 12, 09, Updated
juliemn
 

Similar to Steps methods #5 Towards repertoires of mixed methods (20)

Research day 2011
Research day 2011Research day 2011
Research day 2011
 
James Wilsdon - Evidence informed policy making - 27 June 2017
James Wilsdon - Evidence informed policy making - 27 June 2017James Wilsdon - Evidence informed policy making - 27 June 2017
James Wilsdon - Evidence informed policy making - 27 June 2017
 
How to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposalHow to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposal
 
Sir Peter Gluckman - Evidence informed policy making - 27 June 2017
Sir Peter Gluckman - Evidence informed policy making - 27 June 2017Sir Peter Gluckman - Evidence informed policy making - 27 June 2017
Sir Peter Gluckman - Evidence informed policy making - 27 June 2017
 
Power Of In Between M&E Session
Power Of In Between M&E SessionPower Of In Between M&E Session
Power Of In Between M&E Session
 
Ethical design of pedagogical research
Ethical design of pedagogical researchEthical design of pedagogical research
Ethical design of pedagogical research
 
V1 researchSEND, University of Wolverhampton, 23 June 2018
V1 researchSEND, University of Wolverhampton, 23 June 2018V1 researchSEND, University of Wolverhampton, 23 June 2018
V1 researchSEND, University of Wolverhampton, 23 June 2018
 
Rafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicatorsRafols - Towards more inclusive STI indicators
Rafols - Towards more inclusive STI indicators
 
Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
Conceptualising a Research and Writing a Proposal. How to evolve a budget for...Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
Conceptualising a Research and Writing a Proposal. How to evolve a budget for...
 
Gender dimension in research Research Funders
Gender dimension in research Research FundersGender dimension in research Research Funders
Gender dimension in research Research Funders
 
John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...John Lavis | Making research work for decision makers: international perspect...
John Lavis | Making research work for decision makers: international perspect...
 
Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17
 
Samra Article Cm Principles For Consideration During Research Projects
Samra Article   Cm Principles For Consideration During Research ProjectsSamra Article   Cm Principles For Consideration During Research Projects
Samra Article Cm Principles For Consideration During Research Projects
 
Towards indicators for 'opening up' science and technology policy
Towards indicators for 'opening up' science and technology policyTowards indicators for 'opening up' science and technology policy
Towards indicators for 'opening up' science and technology policy
 
Influencing policy and practice
Influencing policy and practiceInfluencing policy and practice
Influencing policy and practice
 
E D 203, Month #1, Sept 12, 09, Updated
E D 203,  Month #1,  Sept 12, 09,  UpdatedE D 203,  Month #1,  Sept 12, 09,  Updated
E D 203, Month #1, Sept 12, 09, Updated
 
V2 canons park aggregating november 2016
V2 canons park aggregating november 2016V2 canons park aggregating november 2016
V2 canons park aggregating november 2016
 
Towards a catalogue of good practices
Towards a catalogue of good practicesTowards a catalogue of good practices
Towards a catalogue of good practices
 
Research question sb_faculty
Research question sb_facultyResearch question sb_faculty
Research question sb_faculty
 
Ruth Murray APM RISK MANAGEMENT SIG CONFERENCE
 Ruth Murray APM RISK MANAGEMENT SIG CONFERENCE Ruth Murray APM RISK MANAGEMENT SIG CONFERENCE
Ruth Murray APM RISK MANAGEMENT SIG CONFERENCE
 

More from STEPS Centre

More from STEPS Centre (20)

TRANSFORMING IMAGINATIONS? Multiple dimensionalities and temporalities in tra...
TRANSFORMING IMAGINATIONS? Multiple dimensionalities and temporalities in tra...TRANSFORMING IMAGINATIONS? Multiple dimensionalities and temporalities in tra...
TRANSFORMING IMAGINATIONS? Multiple dimensionalities and temporalities in tra...
 
Coloniality in Transformation: decolonising methods for activist scholarship ...
Coloniality in Transformation: decolonising methods for activist scholarship ...Coloniality in Transformation: decolonising methods for activist scholarship ...
Coloniality in Transformation: decolonising methods for activist scholarship ...
 
Opening up the politics of justification in maths for policy: power and uncer...
Opening up the politics of justification in maths for policy: power and uncer...Opening up the politics of justification in maths for policy: power and uncer...
Opening up the politics of justification in maths for policy: power and uncer...
 
Discussion: The Future of the World is Mobile - Giorgia Giovannetti
Discussion: The Future of the World is Mobile - Giorgia GiovannettiDiscussion: The Future of the World is Mobile - Giorgia Giovannetti
Discussion: The Future of the World is Mobile - Giorgia Giovannetti
 
Interfacing pastoral movements and modern mobilities
Interfacing pastoral movements and modern mobilitiesInterfacing pastoral movements and modern mobilities
Interfacing pastoral movements and modern mobilities
 
Reconceiving migration through the study of pastoral mobility
Reconceiving migration through the study of pastoral mobilityReconceiving migration through the study of pastoral mobility
Reconceiving migration through the study of pastoral mobility
 
Bringing moral economy into the study of land deals: reflections from Madagascar
Bringing moral economy into the study of land deals: reflections from MadagascarBringing moral economy into the study of land deals: reflections from Madagascar
Bringing moral economy into the study of land deals: reflections from Madagascar
 
Agency and social-ecological system (SES) pathways: the Transformation Lab in...
Agency and social-ecological system (SES) pathways: the Transformation Lab in...Agency and social-ecological system (SES) pathways: the Transformation Lab in...
Agency and social-ecological system (SES) pathways: the Transformation Lab in...
 
From controlled transition to caring transformations - Stirling
From controlled transition to caring transformations - StirlingFrom controlled transition to caring transformations - Stirling
From controlled transition to caring transformations - Stirling
 
Systems, change and growth - Huff and Brock
Systems, change and growth - Huff and BrockSystems, change and growth - Huff and Brock
Systems, change and growth - Huff and Brock
 
Brighton and Hove's Downland Estate - potentials to contribute to more sustai...
Brighton and Hove's Downland Estate - potentials to contribute to more sustai...Brighton and Hove's Downland Estate - potentials to contribute to more sustai...
Brighton and Hove's Downland Estate - potentials to contribute to more sustai...
 
STEPS Annual Lecture 2017: Achim Steiner - Doomed to fail or bound to succeed...
STEPS Annual Lecture 2017: Achim Steiner - Doomed to fail or bound to succeed...STEPS Annual Lecture 2017: Achim Steiner - Doomed to fail or bound to succeed...
STEPS Annual Lecture 2017: Achim Steiner - Doomed to fail or bound to succeed...
 
Andy Stirling - nexus methods (RGS 2016)
Andy Stirling - nexus methods (RGS 2016)Andy Stirling - nexus methods (RGS 2016)
Andy Stirling - nexus methods (RGS 2016)
 
Andy Stirling - STEPS Centre 'Pathways Methods'
Andy Stirling - STEPS Centre 'Pathways Methods'Andy Stirling - STEPS Centre 'Pathways Methods'
Andy Stirling - STEPS Centre 'Pathways Methods'
 
Andy Stirling - nexus methods
Andy Stirling - nexus methods Andy Stirling - nexus methods
Andy Stirling - nexus methods
 
Suresh Rohilla - Climate change and sanitation, water resources
Suresh Rohilla - Climate change and sanitation, water resourcesSuresh Rohilla - Climate change and sanitation, water resources
Suresh Rohilla - Climate change and sanitation, water resources
 
Suraje Dessai - Uncertainty from above and encounters in the middle
Suraje Dessai - Uncertainty from above and encounters in the middleSuraje Dessai - Uncertainty from above and encounters in the middle
Suraje Dessai - Uncertainty from above and encounters in the middle
 
Sumetee Pahwa Gajjar - Uncertainty from within
Sumetee Pahwa Gajjar - Uncertainty from withinSumetee Pahwa Gajjar - Uncertainty from within
Sumetee Pahwa Gajjar - Uncertainty from within
 
Shibaji Bose - Voices from below - a Photo Voice exploration in Indian sundar...
Shibaji Bose - Voices from below - a Photo Voice exploration in Indian sundar...Shibaji Bose - Voices from below - a Photo Voice exploration in Indian sundar...
Shibaji Bose - Voices from below - a Photo Voice exploration in Indian sundar...
 
Ian Scoones - Enabling plural pathways - uncertainty and responses to climate...
Ian Scoones - Enabling plural pathways - uncertainty and responses to climate...Ian Scoones - Enabling plural pathways - uncertainty and responses to climate...
Ian Scoones - Enabling plural pathways - uncertainty and responses to climate...
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 

Steps methods #5 Towards repertoires of mixed methods

  • 1. STEPS Pathways Methods PART 5 Towards repertoires of mixed methods Professor Andy Stirling Co-director, STEPS Centre www.steps-centre.org www.sussex.ac.uk/spru www.multicriteria-mapping.org
  • 2. INPUTS (aspects taken into account within practice of research or appraisal) problems, options, pros / cons, issues, uncertainties, perspectives INPUTS (things that are taken into account) Pro blems, options, pros / cons, issues, uncertainties, perspectives narrow broad closing down opening up expert / analytic participatory / deliberative Challenges for Research and Appraisal How more reflexively to inform policy and wider innovation governance? OUTPUTS (aspects that are conveyed outwards into wider discourse) ’Plural conditional’ conclusions… … if X then A … if Y then B …
  • 3. narrow broad closing down opening up expert / analytic participatory / deliberative decision analysis Challenges for Research and Appraisal How more reflexively to inform policy and wider innovation governance?
  • 4. narrow broad closing down opening up expert / analytic participatory / deliberative citizen’s juries Challenges for Research and Appraisal How more reflexively to inform policy and wider innovation governance?
  • 5. narrow broad closing down opening up expert / analytic participatory / deliberative citizen’s juries participatory rural appraisal q-method deliberative mapping scientometric mapping open space multi-criteria mapping extended foresight citizen’s juries decision analysis stakeholder negotiation sensitivity analysis cost-benefit analysis risk assessment interactive modelling structured interviews narrative-based participant observation multi-site ethnographic- methods citizen’s juries consensus conference open hearings dissenting opinions Challenges for Research and Appraisal How more reflexively to inform policy and wider innovation governance? spot-the- narrative
  • 6. spot-the- narrative narrow broad closing down opening up expert / analytic participatory / deliberative citizen’s juries decision analysis participatory rural appraisal stakeholder negotiation q-method sensitivity analysis deliberative mapping scientometric mapping open space cost-benefit analysis risk assessmen t interactive modelling structured interviews narrative-based participant observation multi-site ethnographic- methods citizen’s juries consensus conference open hearings dissenting opinions multi-criteria mapping extended foresight Power Closes Down Research and Appraisal Institutions privilege blinkered scope, marginal analysis, incumbent interests … evidence-basing, liability, insurance, agency remits, fiduciary responsibility stakeholder negotiation cost-benefit analysis risk assessment
  • 7. narrow broad closing down opening up expert / analytic participatory / deliberative citizen’s juries decision analysis participatory rural appraisal stakeholder negotiation q-method sensitivity analysis deliberative mapping scientometric mapping open space cost-benefit analysis risk assessmen t interactive modelling structured interviews narrative-based participant observation multi-site ethnographic- methods citizen’s juries consensus conference open hearings dissenting opinions multi-criteria mapping extended foresight Power Closes Down Research and Appraisal A responsibility for neutrality means independent innovation research and policy appraisal should deliberately counter pressures for closure spot-the- narrative
  • 8. narrow broad closing down opening up expert / analytic participatory / deliberative Building Methods Repertoires Basis both for practical project methods – and systematic STEPS methodology ‘visions workshops’ ‘dynamic MCM’ ‘particip. epidem.’ ‘top-bottom comparison’ ‘network analysis’ ‘insider ontologies’