SlideShare ist ein Scribd-Unternehmen logo
1 von 13
Downloaden Sie, um offline zu lesen
Question Design and
Methodological
Considerations
ADLT 673 – Teaching
as Scholarship in
Medical Education
Class Session 4
Agenda for February 24
Feedback on
Your Research
Questions

Formation of
Project
Discussion
Groups
Any changes
needed?

Team-Based
Learning
Exercise

3 TBLs for
remainder of
course

Grades
counted on two
(5 points each)
To move from opinionbased curricula to
evidence-based as a
result of research
findings

What do you perceive as
the goal of SoTL in Medical
Education?
Create a
clear
question

Disseminatio
n of results

Reporting

Medical
Education
research is a
highly
structured
process

Data
analysis

Choice of
methodolog
y and design

Subject
recruitment
What is a conceptual framework?
A model that organizes different
parts of a study into a coherent
whole
System of
concepts, assumptions, expectatio
ns, beliefs, and theories that
support and inform your research
(Miles and Huberman, 1994)
A visual or written product that
explains the main things to be
studied: key factors, concepts, or
variables
4 common conceptual frameworks
Kirkpatrick model (modified by Barr et al., 2005)
• Learner satisfaction, Change in attitudes, Change in
knowledge/skill
• Change in behavior, Change in professional practice
• Change in patient condition , Cost Effectiveness
Translational Science Model
• Medical knowledge translates to practice – 3 levels
3-P Model: Presage-Process-Product
Cook classification – hierarchical, based on purpose of
study (description, justification, clarification)
Research Questions
Quantitative methods
• Does? Is (are)? Can? Should?

Qualitative methods
• What?
• Why?

Quantitative, qualitative, or mixed methods
• How?
Quantitative Approaches
Post-course
designs

Longitudinal
studies

Randomized
controlled
trials (RCTs)

Before and
after studies

Controlled
before and
after studies
Qualitative Approaches
Ethnography

Action
Research

Case Studies

Phenomenology

Grounded
Theory
Terminology in Qualitative
Methodology
Inductive Approach
Iterative Approach
Thematic Analysis / Emergent Design
Reflexivity
Representativeness
Saturation

Triangulation
Resonance or member checks
Rigor and Quality in Research
Methods
Quantitative


Internal Validity

Qualitative


Credibility (truth value)



Transferability
(applicability)



External Validity



Reliability



Dependability
(consistency)



Objectivity



Confirmability
(neutrality)
Models for Mixed Methods
Research in Medical Education
Instrument Development
(questionnaires, checklists)
Explanatory Model (to complement or clarify)*
Triangulation Model (data collected
simultaneously)*
Longitudinal transformation (multiple data
points, often more than one population)
Issues for Consideration
Availability of resources to conduct the research
(time, money, and personnel with requisite strengths)

Access to tools and programs (software, data security and
storage)
Challenges in publishing mixed methods studies
• Need to have expertise in both qualitative and quantitative
• Need to be able to address alternative (pragmatic) paradigm

Decide on prominence of each data type; formulate questions
appropriate for each aspect of study
Decisions on how and when data are collected, analyzed and
integrated

Weitere ähnliche Inhalte

Was ist angesagt?

Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...healthlibaust2012
 
Systematic Reviews in Social Work
Systematic Reviews in Social WorkSystematic Reviews in Social Work
Systematic Reviews in Social WorkLorie Kloda
 
Evidence based practice in hand surgery
Evidence based practice in hand surgeryEvidence based practice in hand surgery
Evidence based practice in hand surgeryVaikunthan Rajaratnam
 
Intro to research methodology 2
Intro to research methodology 2Intro to research methodology 2
Intro to research methodology 2Zhiqz Dee
 
Systematic literature review: An introduction
Systematic literature review: An introductionSystematic literature review: An introduction
Systematic literature review: An introductionKhalid Mahmood
 
Systematic Reviews Overview
Systematic Reviews OverviewSystematic Reviews Overview
Systematic Reviews Overviewralloyd79
 
Introduction to Systematic Reviews
Introduction to Systematic ReviewsIntroduction to Systematic Reviews
Introduction to Systematic ReviewsLaura Koltutsky
 
Systematic Review
Systematic ReviewSystematic Review
Systematic Review2015UPM
 
Research vs research methodology - Research Methodology - Manu Melwin Joy
Research vs research methodology - Research Methodology - Manu Melwin JoyResearch vs research methodology - Research Methodology - Manu Melwin Joy
Research vs research methodology - Research Methodology - Manu Melwin Joymanumelwin
 
Levels of evidence, systematic review and guidelines
Levels of evidence, systematic review and  guidelinesLevels of evidence, systematic review and  guidelines
Levels of evidence, systematic review and guidelinesAboubakr Elnashar
 
searching for evidence
searching for evidencesearching for evidence
searching for evidenceIAU Dent
 

Was ist angesagt? (19)

Systematic Reviews: Context & Methodology for Librarians
Systematic Reviews: Context & Methodology for LibrariansSystematic Reviews: Context & Methodology for Librarians
Systematic Reviews: Context & Methodology for Librarians
 
Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...Systematic Reviews: the researcher's perspective and the research question. E...
Systematic Reviews: the researcher's perspective and the research question. E...
 
Ch05 instrumentation
Ch05 instrumentationCh05 instrumentation
Ch05 instrumentation
 
Systematic Reviews in Social Work
Systematic Reviews in Social WorkSystematic Reviews in Social Work
Systematic Reviews in Social Work
 
Evidence based practice in hand surgery
Evidence based practice in hand surgeryEvidence based practice in hand surgery
Evidence based practice in hand surgery
 
Intro
IntroIntro
Intro
 
Research in healthcare
Research in healthcareResearch in healthcare
Research in healthcare
 
Intro to research methodology 2
Intro to research methodology 2Intro to research methodology 2
Intro to research methodology 2
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
Systematic literature review: An introduction
Systematic literature review: An introductionSystematic literature review: An introduction
Systematic literature review: An introduction
 
Systematic Reviews Overview
Systematic Reviews OverviewSystematic Reviews Overview
Systematic Reviews Overview
 
Introduction to Systematic Reviews
Introduction to Systematic ReviewsIntroduction to Systematic Reviews
Introduction to Systematic Reviews
 
How to select , read & review an article
How to select , read & review an article  How to select , read & review an article
How to select , read & review an article
 
Systematic review
Systematic reviewSystematic review
Systematic review
 
Systematic Review
Systematic ReviewSystematic Review
Systematic Review
 
Research vs research methodology - Research Methodology - Manu Melwin Joy
Research vs research methodology - Research Methodology - Manu Melwin JoyResearch vs research methodology - Research Methodology - Manu Melwin Joy
Research vs research methodology - Research Methodology - Manu Melwin Joy
 
Levels of evidence, systematic review and guidelines
Levels of evidence, systematic review and  guidelinesLevels of evidence, systematic review and  guidelines
Levels of evidence, systematic review and guidelines
 
searching for evidence
searching for evidencesearching for evidence
searching for evidence
 
Clinical literature evaluation
Clinical literature evaluationClinical literature evaluation
Clinical literature evaluation
 

Ähnlich wie Class session 4 question design and methodological choices

Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17tjcarter
 
Critical Appraisal of a Quantitative Study Assignment Guideline.docx
Critical Appraisal of a Quantitative Study Assignment Guideline.docxCritical Appraisal of a Quantitative Study Assignment Guideline.docx
Critical Appraisal of a Quantitative Study Assignment Guideline.docxstudywriters
 
setting used in the study typical of clinical settings.docx
setting used in the study typical of clinical settings.docxsetting used in the study typical of clinical settings.docx
setting used in the study typical of clinical settings.docxwrite5
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docxwrite22
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docxstirlingvwriters
 
Qualitative data
Qualitative dataQualitative data
Qualitative dataIlli Elas
 
Selecting research topic
Selecting research topicSelecting research topic
Selecting research topicAmna Khairy
 
How to write a research proposal
How to write a research proposalHow to write a research proposal
How to write a research proposalDrHebatalla Mohamed
 
SI2016JoslinPannHowToReadResearch.pdf
SI2016JoslinPannHowToReadResearch.pdfSI2016JoslinPannHowToReadResearch.pdf
SI2016JoslinPannHowToReadResearch.pdfShairaAgulan1
 
Computer based assessment of clinical reasoning (Heidelberg 2012)
Computer based assessment of clinical reasoning (Heidelberg 2012)Computer based assessment of clinical reasoning (Heidelberg 2012)
Computer based assessment of clinical reasoning (Heidelberg 2012)Mathijs Doets
 
Research Overview
Research OverviewResearch Overview
Research OverviewS A Tabish
 
Research Critique.pptx
Research Critique.pptxResearch Critique.pptx
Research Critique.pptxneeti70
 
Qualitative Research Methods
Qualitative Research MethodsQualitative Research Methods
Qualitative Research MethodsAnil Sharma
 
Babitha's Note on Unit 01: Introduction to Research & Research Process
Babitha's Note on Unit 01: Introduction to Research & Research ProcessBabitha's Note on Unit 01: Introduction to Research & Research Process
Babitha's Note on Unit 01: Introduction to Research & Research ProcessBabitha Devu
 
Research protocol writting
Research protocol writtingResearch protocol writting
Research protocol writtingDawal Salve
 

Ähnlich wie Class session 4 question design and methodological choices (20)

Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17
 
Critical Appraisal of a Quantitative Study Assignment Guideline.docx
Critical Appraisal of a Quantitative Study Assignment Guideline.docxCritical Appraisal of a Quantitative Study Assignment Guideline.docx
Critical Appraisal of a Quantitative Study Assignment Guideline.docx
 
setting used in the study typical of clinical settings.docx
setting used in the study typical of clinical settings.docxsetting used in the study typical of clinical settings.docx
setting used in the study typical of clinical settings.docx
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
 
Qualitative data
Qualitative dataQualitative data
Qualitative data
 
Selecting research topic
Selecting research topicSelecting research topic
Selecting research topic
 
Lecture - 2 PhD.pptx
Lecture - 2 PhD.pptxLecture - 2 PhD.pptx
Lecture - 2 PhD.pptx
 
How to write a research proposal
How to write a research proposalHow to write a research proposal
How to write a research proposal
 
SI2016JoslinPannHowToReadResearch.pdf
SI2016JoslinPannHowToReadResearch.pdfSI2016JoslinPannHowToReadResearch.pdf
SI2016JoslinPannHowToReadResearch.pdf
 
Class2
Class2Class2
Class2
 
Computer based assessment of clinical reasoning (Heidelberg 2012)
Computer based assessment of clinical reasoning (Heidelberg 2012)Computer based assessment of clinical reasoning (Heidelberg 2012)
Computer based assessment of clinical reasoning (Heidelberg 2012)
 
Research Overview
Research OverviewResearch Overview
Research Overview
 
Research Critique.pptx
Research Critique.pptxResearch Critique.pptx
Research Critique.pptx
 
Research critique
Research critiqueResearch critique
Research critique
 
Qualitative Research Methods
Qualitative Research MethodsQualitative Research Methods
Qualitative Research Methods
 
Babitha's Note on Unit 01: Introduction to Research & Research Process
Babitha's Note on Unit 01: Introduction to Research & Research ProcessBabitha's Note on Unit 01: Introduction to Research & Research Process
Babitha's Note on Unit 01: Introduction to Research & Research Process
 
Action research
Action researchAction research
Action research
 
Critique
CritiqueCritique
Critique
 
Research protocol writting
Research protocol writtingResearch protocol writting
Research protocol writting
 

Mehr von tjcarter

Class sessions 8 motivation and learning 3 28-19
Class sessions 8 motivation and learning 3 28-19Class sessions 8 motivation and learning 3 28-19
Class sessions 8 motivation and learning 3 28-19tjcarter
 
Class 7 mind, body, and spirit
Class 7 mind, body, and spiritClass 7 mind, body, and spirit
Class 7 mind, body, and spirittjcarter
 
Class session 6 march 14, 2019
Class session 6 march 14, 2019Class session 6 march 14, 2019
Class session 6 march 14, 2019tjcarter
 
Class 5 mezirow's tl theory adlt 671
Class 5   mezirow's tl theory adlt 671Class 5   mezirow's tl theory adlt 671
Class 5 mezirow's tl theory adlt 671tjcarter
 
Class session 4 sdl
Class session 4  sdlClass session 4  sdl
Class session 4 sdltjcarter
 
Class 4 knowles principles of andragogy rev
Class 4    knowles principles of andragogy revClass 4    knowles principles of andragogy rev
Class 4 knowles principles of andragogy revtjcarter
 
Class session 2 lindeman's era in the u.s.
Class session 2   lindeman's era in the u.s.Class session 2   lindeman's era in the u.s.
Class session 2 lindeman's era in the u.s.tjcarter
 
Class session 2 theoretical orientations a framework for the course
Class session 2 theoretical orientations   a framework for the courseClass session 2 theoretical orientations   a framework for the course
Class session 2 theoretical orientations a framework for the coursetjcarter
 
Class 2 or 3 houle's inquiring mind
Class 2 or 3 houle's inquiring mindClass 2 or 3 houle's inquiring mind
Class 2 or 3 houle's inquiring mindtjcarter
 
Class session 2 lindeman's era in the u.s.
Class session 2   lindeman's era in the u.s.Class session 2   lindeman's era in the u.s.
Class session 2 lindeman's era in the u.s.tjcarter
 
Class session 1 jan 31, 2019
Class session 1   jan 31, 2019Class session 1   jan 31, 2019
Class session 1 jan 31, 2019tjcarter
 
Class session 11 putting it all together
Class session 11   putting it all togetherClass session 11   putting it all together
Class session 11 putting it all togethertjcarter
 
Class session 11 putting it all together
Class session 11   putting it all togetherClass session 11   putting it all together
Class session 11 putting it all togethertjcarter
 
Developing an effective case study march 2018
Developing an effective case study march 2018Developing an effective case study march 2018
Developing an effective case study march 2018tjcarter
 
Class 5 planning a pogil
Class 5   planning a pogilClass 5   planning a pogil
Class 5 planning a pogiltjcarter
 
Class 1 intro spring 2018
Class 1 intro spring 2018Class 1 intro spring 2018
Class 1 intro spring 2018tjcarter
 
Session 11 significant learning
Session 11   significant learningSession 11   significant learning
Session 11 significant learningtjcarter
 
Writing mc qs for for tbls and pogils nov 5, 2017 class 8
Writing mc qs for  for tbls and pogils nov 5, 2017 class 8Writing mc qs for  for tbls and pogils nov 5, 2017 class 8
Writing mc qs for for tbls and pogils nov 5, 2017 class 8tjcarter
 
Kirkpatrick's evaluation model revised 2017
Kirkpatrick's evaluation model revised 2017Kirkpatrick's evaluation model revised 2017
Kirkpatrick's evaluation model revised 2017tjcarter
 
Class 7 intro to assessment rev for 2017
Class 7   intro to assessment rev for 2017Class 7   intro to assessment rev for 2017
Class 7 intro to assessment rev for 2017tjcarter
 

Mehr von tjcarter (20)

Class sessions 8 motivation and learning 3 28-19
Class sessions 8 motivation and learning 3 28-19Class sessions 8 motivation and learning 3 28-19
Class sessions 8 motivation and learning 3 28-19
 
Class 7 mind, body, and spirit
Class 7 mind, body, and spiritClass 7 mind, body, and spirit
Class 7 mind, body, and spirit
 
Class session 6 march 14, 2019
Class session 6 march 14, 2019Class session 6 march 14, 2019
Class session 6 march 14, 2019
 
Class 5 mezirow's tl theory adlt 671
Class 5   mezirow's tl theory adlt 671Class 5   mezirow's tl theory adlt 671
Class 5 mezirow's tl theory adlt 671
 
Class session 4 sdl
Class session 4  sdlClass session 4  sdl
Class session 4 sdl
 
Class 4 knowles principles of andragogy rev
Class 4    knowles principles of andragogy revClass 4    knowles principles of andragogy rev
Class 4 knowles principles of andragogy rev
 
Class session 2 lindeman's era in the u.s.
Class session 2   lindeman's era in the u.s.Class session 2   lindeman's era in the u.s.
Class session 2 lindeman's era in the u.s.
 
Class session 2 theoretical orientations a framework for the course
Class session 2 theoretical orientations   a framework for the courseClass session 2 theoretical orientations   a framework for the course
Class session 2 theoretical orientations a framework for the course
 
Class 2 or 3 houle's inquiring mind
Class 2 or 3 houle's inquiring mindClass 2 or 3 houle's inquiring mind
Class 2 or 3 houle's inquiring mind
 
Class session 2 lindeman's era in the u.s.
Class session 2   lindeman's era in the u.s.Class session 2   lindeman's era in the u.s.
Class session 2 lindeman's era in the u.s.
 
Class session 1 jan 31, 2019
Class session 1   jan 31, 2019Class session 1   jan 31, 2019
Class session 1 jan 31, 2019
 
Class session 11 putting it all together
Class session 11   putting it all togetherClass session 11   putting it all together
Class session 11 putting it all together
 
Class session 11 putting it all together
Class session 11   putting it all togetherClass session 11   putting it all together
Class session 11 putting it all together
 
Developing an effective case study march 2018
Developing an effective case study march 2018Developing an effective case study march 2018
Developing an effective case study march 2018
 
Class 5 planning a pogil
Class 5   planning a pogilClass 5   planning a pogil
Class 5 planning a pogil
 
Class 1 intro spring 2018
Class 1 intro spring 2018Class 1 intro spring 2018
Class 1 intro spring 2018
 
Session 11 significant learning
Session 11   significant learningSession 11   significant learning
Session 11 significant learning
 
Writing mc qs for for tbls and pogils nov 5, 2017 class 8
Writing mc qs for  for tbls and pogils nov 5, 2017 class 8Writing mc qs for  for tbls and pogils nov 5, 2017 class 8
Writing mc qs for for tbls and pogils nov 5, 2017 class 8
 
Kirkpatrick's evaluation model revised 2017
Kirkpatrick's evaluation model revised 2017Kirkpatrick's evaluation model revised 2017
Kirkpatrick's evaluation model revised 2017
 
Class 7 intro to assessment rev for 2017
Class 7   intro to assessment rev for 2017Class 7   intro to assessment rev for 2017
Class 7 intro to assessment rev for 2017
 

Class session 4 question design and methodological choices

  • 1. Question Design and Methodological Considerations ADLT 673 – Teaching as Scholarship in Medical Education Class Session 4
  • 2. Agenda for February 24 Feedback on Your Research Questions Formation of Project Discussion Groups Any changes needed? Team-Based Learning Exercise 3 TBLs for remainder of course Grades counted on two (5 points each)
  • 3. To move from opinionbased curricula to evidence-based as a result of research findings What do you perceive as the goal of SoTL in Medical Education?
  • 4. Create a clear question Disseminatio n of results Reporting Medical Education research is a highly structured process Data analysis Choice of methodolog y and design Subject recruitment
  • 5. What is a conceptual framework? A model that organizes different parts of a study into a coherent whole System of concepts, assumptions, expectatio ns, beliefs, and theories that support and inform your research (Miles and Huberman, 1994) A visual or written product that explains the main things to be studied: key factors, concepts, or variables
  • 6. 4 common conceptual frameworks Kirkpatrick model (modified by Barr et al., 2005) • Learner satisfaction, Change in attitudes, Change in knowledge/skill • Change in behavior, Change in professional practice • Change in patient condition , Cost Effectiveness Translational Science Model • Medical knowledge translates to practice – 3 levels 3-P Model: Presage-Process-Product Cook classification – hierarchical, based on purpose of study (description, justification, clarification)
  • 7. Research Questions Quantitative methods • Does? Is (are)? Can? Should? Qualitative methods • What? • Why? Quantitative, qualitative, or mixed methods • How?
  • 10. Terminology in Qualitative Methodology Inductive Approach Iterative Approach Thematic Analysis / Emergent Design Reflexivity Representativeness Saturation Triangulation Resonance or member checks
  • 11. Rigor and Quality in Research Methods Quantitative  Internal Validity Qualitative  Credibility (truth value)  Transferability (applicability)  External Validity  Reliability  Dependability (consistency)  Objectivity  Confirmability (neutrality)
  • 12. Models for Mixed Methods Research in Medical Education Instrument Development (questionnaires, checklists) Explanatory Model (to complement or clarify)* Triangulation Model (data collected simultaneously)* Longitudinal transformation (multiple data points, often more than one population)
  • 13. Issues for Consideration Availability of resources to conduct the research (time, money, and personnel with requisite strengths) Access to tools and programs (software, data security and storage) Challenges in publishing mixed methods studies • Need to have expertise in both qualitative and quantitative • Need to be able to address alternative (pragmatic) paradigm Decide on prominence of each data type; formulate questions appropriate for each aspect of study Decisions on how and when data are collected, analyzed and integrated