SlideShare ist ein Scribd-Unternehmen logo
1 von 9
Su-Tuan Lulee
September 1st, 2013
Assessing Critical Thinking in Massive
Open Online Courses(MOOCs):
The Relationship Between Content Analysis &
Social Network Analysis
• MOOC is an emerging form of education and has
been placed in wide context of open education
recently. However, the nature of emergent,
fragmented, diffuse, and diverse nature of
MOOCs make educators question about “To what
extent students of MOOCs have demonstrated
critical thinking skills?”
• How can content analysis and social network help
with answering the question? Do the results of
these two methods highly related to each other?
Problem
• Setting: Adult open online learning
Context
• To investigate whether or not the analysis
results from two research methods – content
analysis and social analysis highly related to
each other.
Purpose
• Critical thinking is important for knowledge
construction in education.
• The interaction in group discussions is the visual
evidence of critical thinking. More interaction
leads to higher levels of knowledge construction.
• Content analysis and social network analysis are
both effective tools for investigating student
critical thinking. Levels of critical thinking in
MOOCs should highly relate to the centrality
measures of social networks.
Assumption
• Research tools: content analysis (Atlas.ti),
social network analysis (NodeX/SNAPP), and
Spearman’s correlations.
• Samples:
– participants > 300 per MOOC
– main discussions took place in an LMS (Canvas)
• Procedure: collect discussion data → Excel →
Content analysis/SNA → Correlation analysis
Methodology
• To what extent students of MOOCs have
demonstrated critical thinking skills?
• How can content analysis and social network
help with answering the question?
• Do the results of these two methods highly
related to each other?
Research Questions
• MOOC have been adopted widely in higher
education however academic research on MOOCs
is limited currently.
• Due to the massive learners of MOOCs, the
educators will rely heavily on learning analysis
technique to support their decisions on next-step
instructional intervention, and the curriculum
design in the near future. It is necessary to
validate the various existing measurements.
Significance of the Study
• Generalizability:
– Focus on discussions on LMS only
– convenience sampling
– small sample size (only 2-3 MOOCs will be
analyzed)
Limitation

Weitere ähnliche Inhalte

Was ist angesagt?

Conole tel methodologies
Conole tel methodologiesConole tel methodologies
Conole tel methodologies
Grainne Conole
 
Is what's 'trending' what¹s worth purchasing?
Is what's 'trending' what¹s worth purchasing?Is what's 'trending' what¹s worth purchasing?
Is what's 'trending' what¹s worth purchasing?
NASIG
 
Global Futures Intelligence System talk at WFSF 2013
Global Futures Intelligence System talk at WFSF 2013Global Futures Intelligence System talk at WFSF 2013
Global Futures Intelligence System talk at WFSF 2013
Jerome Glenn
 
Teaching Information Literacy: A Performance Based Cycle
Teaching Information Literacy: A Performance Based CycleTeaching Information Literacy: A Performance Based Cycle
Teaching Information Literacy: A Performance Based Cycle
annielibrarian
 
Evaluate! Evaluation of school libraries
Evaluate!  Evaluation of school librariesEvaluate!  Evaluation of school libraries
Evaluate! Evaluation of school libraries
Johan Koren
 

Was ist angesagt? (19)

Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
Let's Chat: The Art of Delivering Information Literacy Instruction in a Virtu...
 
Conole tel methodologies
Conole tel methodologiesConole tel methodologies
Conole tel methodologies
 
Is what's 'trending' what¹s worth purchasing?
Is what's 'trending' what¹s worth purchasing?Is what's 'trending' what¹s worth purchasing?
Is what's 'trending' what¹s worth purchasing?
 
Global Futures Intelligence System talk at WFSF 2013
Global Futures Intelligence System talk at WFSF 2013Global Futures Intelligence System talk at WFSF 2013
Global Futures Intelligence System talk at WFSF 2013
 
Are we there yet? Peter Hickey
Are we there yet? Peter HickeyAre we there yet? Peter Hickey
Are we there yet? Peter Hickey
 
Using Social Network Analysis to Assess Organizational Development Initiatives
Using Social Network Analysis to Assess Organizational Development InitiativesUsing Social Network Analysis to Assess Organizational Development Initiatives
Using Social Network Analysis to Assess Organizational Development Initiatives
 
NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...
NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...
NISO/BISG 7th Annual Changing Standards Landscape Forum: ALA Chicago User Pra...
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational research
 
Library Instruction that Improves Self-Efficacy & Academic Achievement
Library Instruction that Improves Self-Efficacy & Academic AchievementLibrary Instruction that Improves Self-Efficacy & Academic Achievement
Library Instruction that Improves Self-Efficacy & Academic Achievement
 
Learning Analytics - An Overview of a Research Community
Learning Analytics - An Overview of a Research CommunityLearning Analytics - An Overview of a Research Community
Learning Analytics - An Overview of a Research Community
 
Empirical Investigations that Supported the Development of OpenEssayist: A To...
Empirical Investigations that Supported the Development of OpenEssayist: A To...Empirical Investigations that Supported the Development of OpenEssayist: A To...
Empirical Investigations that Supported the Development of OpenEssayist: A To...
 
What's the Point of New Media?
What's the Point of New Media?What's the Point of New Media?
What's the Point of New Media?
 
Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...
Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...
Comtella: Adaptive Rewards Mechanism to Incentivize Participation in Online C...
 
Sherif presentation richard nurse new template
Sherif presentation richard nurse new templateSherif presentation richard nurse new template
Sherif presentation richard nurse new template
 
Teaching Information Literacy: A Performance Based Cycle
Teaching Information Literacy: A Performance Based CycleTeaching Information Literacy: A Performance Based Cycle
Teaching Information Literacy: A Performance Based Cycle
 
Sandy Presentation Student Achievement
Sandy Presentation Student AchievementSandy Presentation Student Achievement
Sandy Presentation Student Achievement
 
Evaluate! Evaluation of school libraries
Evaluate!  Evaluation of school librariesEvaluate!  Evaluation of school libraries
Evaluate! Evaluation of school libraries
 
Resume hasan
Resume hasanResume hasan
Resume hasan
 
Does it matter how much open? Impact in learning and degrees of openness
Does it matter how much open? Impact in learning and degrees of opennessDoes it matter how much open? Impact in learning and degrees of openness
Does it matter how much open? Impact in learning and degrees of openness
 

Ähnlich wie Assessing critical thinking in moo cs preliminary proposal 201309

Anatomy of a ph d terry final
Anatomy of a ph d terry finalAnatomy of a ph d terry final
Anatomy of a ph d terry final
Patricia Fidalgo
 
Rebecca eynon learning & interaction in moo cs
Rebecca eynon learning & interaction in moo csRebecca eynon learning & interaction in moo cs
Rebecca eynon learning & interaction in moo cs
oiisdp
 
A MOOL in a MOOC: Librarians in massive open online courses
A MOOL in a MOOC: Librarians in massive open online coursesA MOOL in a MOOC: Librarians in massive open online courses
A MOOL in a MOOC: Librarians in massive open online courses
Laureen Cantwell
 
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
M I Santally
 
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
Bieke Schreurs
 

Ähnlich wie Assessing critical thinking in moo cs preliminary proposal 201309 (20)

Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...
Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...
Elizabeth Koh - WESST - Leveraging Learning Analytics to Formatively Assess T...
 
Anatomy of a ph d terry final
Anatomy of a ph d terry finalAnatomy of a ph d terry final
Anatomy of a ph d terry final
 
Icmet 21 bali 3 generations & covid
Icmet 21 bali   3 generations & covidIcmet 21 bali   3 generations & covid
Icmet 21 bali 3 generations & covid
 
Rebecca eynon learning & interaction in moo cs
Rebecca eynon learning & interaction in moo csRebecca eynon learning & interaction in moo cs
Rebecca eynon learning & interaction in moo cs
 
A MOOL in a MOOC: Librarians in massive open online courses
A MOOL in a MOOC: Librarians in massive open online coursesA MOOL in a MOOC: Librarians in massive open online courses
A MOOL in a MOOC: Librarians in massive open online courses
 
Exploring learners’ motivations on Assessment in a Massive Open Online Course...
Exploring learners’ motivations on Assessment in a Massive Open Online Course...Exploring learners’ motivations on Assessment in a Massive Open Online Course...
Exploring learners’ motivations on Assessment in a Massive Open Online Course...
 
Integrating MOOCs into University Modules
Integrating MOOCs into University ModulesIntegrating MOOCs into University Modules
Integrating MOOCs into University Modules
 
Integrating MOOCs into University Modules
Integrating MOOCs into University ModulesIntegrating MOOCs into University Modules
Integrating MOOCs into University Modules
 
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
Learning Analytics as a Method to Examine Students’ Learning Patterns in an O...
 
MOOCs for professional development TCEA Feb 2015
MOOCs for professional development TCEA Feb 2015MOOCs for professional development TCEA Feb 2015
MOOCs for professional development TCEA Feb 2015
 
MOOCs for professional development TCEA Feb 2015
MOOCs for professional development TCEA Feb 2015MOOCs for professional development TCEA Feb 2015
MOOCs for professional development TCEA Feb 2015
 
Integrating moocs into modules ICEM17 Naples
Integrating moocs into modules   ICEM17 NaplesIntegrating moocs into modules   ICEM17 Naples
Integrating moocs into modules ICEM17 Naples
 
Moo cs for professional development tcea feb 2015
Moo cs for professional development tcea feb 2015Moo cs for professional development tcea feb 2015
Moo cs for professional development tcea feb 2015
 
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
LAK13: Visualizing Social Learning Ties by Type and Topic: Rationale and Co...
 
The User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the UsersThe User Side of Personalization: How Personalization Affects the Users
The User Side of Personalization: How Personalization Affects the Users
 
Requirements for Learning Analytics
Requirements for Learning AnalyticsRequirements for Learning Analytics
Requirements for Learning Analytics
 
A Social Learning Space Grid for MOOCs, EMOOCs2017
A Social Learning Space Grid for MOOCs, EMOOCs2017A Social Learning Space Grid for MOOCs, EMOOCs2017
A Social Learning Space Grid for MOOCs, EMOOCs2017
 
Websci 2018
Websci 2018Websci 2018
Websci 2018
 
Learning Analytics for MOOCs: EMMA case
Learning Analytics for MOOCs: EMMA caseLearning Analytics for MOOCs: EMMA case
Learning Analytics for MOOCs: EMMA case
 
2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...
2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...
2014 04 03 (educon2014) emadrid uam towards a collaborative pedagogical model...
 

Mehr von Su-Tuan Lulee

Assessing Teaching Presence In Instructional Cmc Susan Lulee
Assessing Teaching Presence In Instructional Cmc Susan LuleeAssessing Teaching Presence In Instructional Cmc Susan Lulee
Assessing Teaching Presence In Instructional Cmc Susan Lulee
Su-Tuan Lulee
 
Assessing Teaching Presence In Instructional Cmc
Assessing Teaching Presence In Instructional CmcAssessing Teaching Presence In Instructional Cmc
Assessing Teaching Presence In Instructional Cmc
Su-Tuan Lulee
 

Mehr von Su-Tuan Lulee (19)

淺談網路多媒體在教學上的應用
淺談網路多媒體在教學上的應用淺談網路多媒體在教學上的應用
淺談網路多媒體在教學上的應用
 
淺談網路多媒體在教學上的應用
淺談網路多媒體在教學上的應用 淺談網路多媒體在教學上的應用
淺談網路多媒體在教學上的應用
 
Reflection on EDDE 804
Reflection on EDDE 804Reflection on EDDE 804
Reflection on EDDE 804
 
Open Learning and Costs of Education
Open Learning and Costs of EducationOpen Learning and Costs of Education
Open Learning and Costs of Education
 
Open Learning: Lowering the Cost of Education
Open Learning:  Lowering the Cost of EducationOpen Learning:  Lowering the Cost of Education
Open Learning: Lowering the Cost of Education
 
Transformational Leadership: Leadership for Education
Transformational Leadership: Leadership for EducationTransformational Leadership: Leadership for Education
Transformational Leadership: Leadership for Education
 
Teaching for Understanding Framework in Practice
Teaching for Understanding Framework in PracticeTeaching for Understanding Framework in Practice
Teaching for Understanding Framework in Practice
 
What History Teaches About the Impact of Educational Research on Practice? A ...
What History Teaches About the Impact of Educational Research on Practice? A ...What History Teaches About the Impact of Educational Research on Practice? A ...
What History Teaches About the Impact of Educational Research on Practice? A ...
 
Meta-Analysis of Interaction in Distance Education
Meta-Analysis of Interaction in Distance EducationMeta-Analysis of Interaction in Distance Education
Meta-Analysis of Interaction in Distance Education
 
Did we become a community - A Literature Review
Did we become a community - A Literature ReviewDid we become a community - A Literature Review
Did we become a community - A Literature Review
 
Basic principles of interaction for learning in web based environment
Basic principles of interaction for learning in web based environmentBasic principles of interaction for learning in web based environment
Basic principles of interaction for learning in web based environment
 
Complexity leadership in open learning
Complexity leadership in open learningComplexity leadership in open learning
Complexity leadership in open learning
 
Teaching for Understanding in Practice
Teaching for Understanding in PracticeTeaching for Understanding in Practice
Teaching for Understanding in Practice
 
Introduction to Transformative Learning
Introduction to Transformative LearningIntroduction to Transformative Learning
Introduction to Transformative Learning
 
如何利用社會軟體進行遠距教學和學習
如何利用社會軟體進行遠距教學和學習如何利用社會軟體進行遠距教學和學習
如何利用社會軟體進行遠距教學和學習
 
腳本軸線流程圖
腳本軸線流程圖腳本軸線流程圖
腳本軸線流程圖
 
Online Auditing Course Redesign Susan Lulee Slideshare
Online Auditing Course Redesign  Susan Lulee SlideshareOnline Auditing Course Redesign  Susan Lulee Slideshare
Online Auditing Course Redesign Susan Lulee Slideshare
 
Assessing Teaching Presence In Instructional Cmc Susan Lulee
Assessing Teaching Presence In Instructional Cmc Susan LuleeAssessing Teaching Presence In Instructional Cmc Susan Lulee
Assessing Teaching Presence In Instructional Cmc Susan Lulee
 
Assessing Teaching Presence In Instructional Cmc
Assessing Teaching Presence In Instructional CmcAssessing Teaching Presence In Instructional Cmc
Assessing Teaching Presence In Instructional Cmc
 

Kürzlich hochgeladen

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 

Kürzlich hochgeladen (20)

Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 

Assessing critical thinking in moo cs preliminary proposal 201309

  • 1. Su-Tuan Lulee September 1st, 2013 Assessing Critical Thinking in Massive Open Online Courses(MOOCs): The Relationship Between Content Analysis & Social Network Analysis
  • 2. • MOOC is an emerging form of education and has been placed in wide context of open education recently. However, the nature of emergent, fragmented, diffuse, and diverse nature of MOOCs make educators question about “To what extent students of MOOCs have demonstrated critical thinking skills?” • How can content analysis and social network help with answering the question? Do the results of these two methods highly related to each other? Problem
  • 3. • Setting: Adult open online learning Context
  • 4. • To investigate whether or not the analysis results from two research methods – content analysis and social analysis highly related to each other. Purpose
  • 5. • Critical thinking is important for knowledge construction in education. • The interaction in group discussions is the visual evidence of critical thinking. More interaction leads to higher levels of knowledge construction. • Content analysis and social network analysis are both effective tools for investigating student critical thinking. Levels of critical thinking in MOOCs should highly relate to the centrality measures of social networks. Assumption
  • 6. • Research tools: content analysis (Atlas.ti), social network analysis (NodeX/SNAPP), and Spearman’s correlations. • Samples: – participants > 300 per MOOC – main discussions took place in an LMS (Canvas) • Procedure: collect discussion data → Excel → Content analysis/SNA → Correlation analysis Methodology
  • 7. • To what extent students of MOOCs have demonstrated critical thinking skills? • How can content analysis and social network help with answering the question? • Do the results of these two methods highly related to each other? Research Questions
  • 8. • MOOC have been adopted widely in higher education however academic research on MOOCs is limited currently. • Due to the massive learners of MOOCs, the educators will rely heavily on learning analysis technique to support their decisions on next-step instructional intervention, and the curriculum design in the near future. It is necessary to validate the various existing measurements. Significance of the Study
  • 9. • Generalizability: – Focus on discussions on LMS only – convenience sampling – small sample size (only 2-3 MOOCs will be analyzed) Limitation