SlideShare a Scribd company logo
1 of 25
Download to read offline
Open Survival of the fittest
Open in the jungle of
Open Educational Resources
15th of August 2014
a Master Thesis by
Sander Latour
Open Educational Resources [1]
Learning objects that can freely be
reused, revised, remixed and redistributed.
[1] Daniel E Atkins, John S Brown and Allen L Hammond. Creative Common, 2007. A review of the
open educational resources (OER) movement: Achievements, challenges, and new opportunities.
Open Educational Resources
Learning objects that can freely be
reused, revised, remixed and redistributed.
Textual objects Video objects Interactive objects
You should not focus
on every detail. Stick
to the bigger picture
Example:
You are reading this.
Stick to the
bigger picture
OER Sequence
T1
T1
T2
T1
T2
T2
( )
T2
T1
=
Tmax
NLG
T1“impact”
( )NLGE
NLG1(
(
( )NLGE
NLG2(
( NLG3(
( NLG4(
(
NLG5(
( NLG6(
( NLG7(
( NLG8(
(
NLG1(
(
( )NLGE
NLG2(
( NLG3(
( NLG4(
(
NLG5(
( NLG6(
( NLG7(
( NLG8(
(
NLG1(
(
( )NLGE
NLG2(
( NLG3(
( NLG4(
(
NLG5(
( NLG6(
( NLG7(
( NLG8(
(
NLG1(
(
( )NLGE I regret
trying this
Exploration Exploitation
regretminimize online
“while learning”
( )NLGE
Survival of
the fittest
UCB +
a Genetic
Algorithm
[2] A.E. Eiben and J.E. Smith. Natural Computing,
2007. Introduction to Evolutionary Computing.
[2]
( )
2 ln(n)
n
NLG
average
total nr. of
evaluations
nr. of times
tried
UCB-1[3]
[3] P. Auer, N. Cesa-Bianchi and P. Fischer. Machine learning, 2002.
Finite-time analysis of the multiarmed bandit problem.
The impacts of these sequences are not independent
If these two
are effective
then it makes
sense to try this
Genetic Algorithms
Population containing a subset of candidates
Candidates have a “fitness” value, i.e. how good is it?
Higher fitness means higher chance of reproduction
Produced offspring is a combination of both parents
Inspired by Darwinian evolution
( ) 2 ln(n)
n
NLG
Current population
T1
T2
Selecting most
promising sequence
Evaluation of impact
NLG1
NLG3
NLG2
NLG4
NLG5
Roulette selection of parents
1
2
3
4
Crossover
& Mutation
Crossover
& Mutation
Offspring
Offspring
Generational replacement
with elite preservation
elite
offspring
Current
generation
Next
generation
Genes
chromosome
Permutation encoding
… with varying length
… with partial permutations
One-point crossover Append crossover
Swap mutation Addition mutation Deletion mutation
Evaluation
& Results
Experiment with
online “course”
Nim game
Curriculum
Low High
student groups
4lessons
4OER
T1
T2
7sequences in
1 generation
10evaluations in
1 generation
2elite members
5%mutation
237total usable
participants
Algorithm Participants
voluntary
participation
could stop at
any moment
diverse crowd
not just students
3MC 3MC
Does the system learn to pick sequences with
more learning impact over those with less impact?
Figure: Regret in Rules - Low Figure: Regret in Intuition - Low
Built-up
regret
students
The system worked for the “Low” student groups
In “High” groups there was either too little data or a technical issue
It’s unknown how good the apparently best sequences really are
Possible explanation
limited pre- and post-test
coarse division of students
independence assumption
Variance in the observed learning impact
learning
impact
students
Figure: Best sequence in “Rules” lesson for student group “Low”
In conclusion,
A possible approach for using learning
impact in the assessment of OER
has been presented and tested.
Many lessons can be drawn from the
results, but the principle works.
I recommend others to continue
on the path of using learning impact
in the assessment of OER.

More Related Content

Similar to Survival of the fittest in the jungle of OER

11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
novabroom
 
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
hyacinthshackley2629
 
From Silver Bullets to First Principles: Effectively Leveraging Technology in...
From Silver Bullets to First Principles: Effectively Leveraging Technology in...From Silver Bullets to First Principles: Effectively Leveraging Technology in...
From Silver Bullets to First Principles: Effectively Leveraging Technology in...
Peter Doolittle
 
Foundations of Delphi for Foresight and Group Communication
Foundations of Delphi for Foresight and Group CommunicationFoundations of Delphi for Foresight and Group Communication
Foundations of Delphi for Foresight and Group Communication
Tina Comes
 
Young Minds and Computer Coding
Young Minds and Computer CodingYoung Minds and Computer Coding
Young Minds and Computer Coding
Michael Newbold
 
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
Karthik Murugesan
 

Similar to Survival of the fittest in the jungle of OER (20)

Technology and Teaching: How Technology Can Improve Classroom Instruction
Technology and Teaching: How Technology Can Improve Classroom InstructionTechnology and Teaching: How Technology Can Improve Classroom Instruction
Technology and Teaching: How Technology Can Improve Classroom Instruction
 
A Review On Genetic Algorithm And Its Applications
A Review On Genetic Algorithm And Its ApplicationsA Review On Genetic Algorithm And Its Applications
A Review On Genetic Algorithm And Its Applications
 
Word Frequency Effects and Plurality in L2 Word Recognition—A Preliminary Study—
Word Frequency Effects and Plurality in L2 Word Recognition—A Preliminary Study—Word Frequency Effects and Plurality in L2 Word Recognition—A Preliminary Study—
Word Frequency Effects and Plurality in L2 Word Recognition—A Preliminary Study—
 
E-Learn 2004 - Learning Styles and Web-Based Design for Secondary Students
E-Learn 2004 - Learning Styles and Web-Based Design for Secondary StudentsE-Learn 2004 - Learning Styles and Web-Based Design for Secondary Students
E-Learn 2004 - Learning Styles and Web-Based Design for Secondary Students
 
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
 
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
An Improved Differential Evolution Algorithm for Real Parameter Optimization ...
 
IITSEC Presentation on Learning in Virtual Worlds
IITSEC Presentation on Learning in Virtual WorldsIITSEC Presentation on Learning in Virtual Worlds
IITSEC Presentation on Learning in Virtual Worlds
 
Translated learning
Translated learningTranslated learning
Translated learning
 
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
 
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
11 T(EA) FOR TWO TESTS BETWEEN THE MEANS OF DIFFERENT GROUPS11 .docx
 
GIGI 1229
GIGI 1229 GIGI 1229
GIGI 1229
 
deepnet-lourentzou.ppt
deepnet-lourentzou.pptdeepnet-lourentzou.ppt
deepnet-lourentzou.ppt
 
From Silver Bullets to First Principles: Effectively Leveraging Technology in...
From Silver Bullets to First Principles: Effectively Leveraging Technology in...From Silver Bullets to First Principles: Effectively Leveraging Technology in...
From Silver Bullets to First Principles: Effectively Leveraging Technology in...
 
Active learning
Active learningActive learning
Active learning
 
Unit1 revision
Unit1 revisionUnit1 revision
Unit1 revision
 
What every teacher should know about cognitive research
What every teacher should know about cognitive researchWhat every teacher should know about cognitive research
What every teacher should know about cognitive research
 
What every teacher should know about cognitive science
What every teacher should know about cognitive scienceWhat every teacher should know about cognitive science
What every teacher should know about cognitive science
 
Foundations of Delphi for Foresight and Group Communication
Foundations of Delphi for Foresight and Group CommunicationFoundations of Delphi for Foresight and Group Communication
Foundations of Delphi for Foresight and Group Communication
 
Young Minds and Computer Coding
Young Minds and Computer CodingYoung Minds and Computer Coding
Young Minds and Computer Coding
 
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
BIng NLP Expert - Dl summer-school-2017.-jianfeng-gao.v2
 

More from Sander Latour

Learning analytics : foundation of mass personalized education
Learning analytics : foundation of mass personalized educationLearning analytics : foundation of mass personalized education
Learning analytics : foundation of mass personalized education
Sander Latour
 

More from Sander Latour (9)

UvA BSc KI voorlichting - alumni praatje
UvA BSc KI voorlichting - alumni praatjeUvA BSc KI voorlichting - alumni praatje
UvA BSc KI voorlichting - alumni praatje
 
Starfish - Networked Knowledge Sharing
Starfish - Networked Knowledge SharingStarfish - Networked Knowledge Sharing
Starfish - Networked Knowledge Sharing
 
Some thoughts on the future of Learning Analytics
Some thoughts on the future of Learning AnalyticsSome thoughts on the future of Learning Analytics
Some thoughts on the future of Learning Analytics
 
De Haagse Onderwijsdag 2013 - Workshop Learning Analytics
De Haagse Onderwijsdag 2013 - Workshop Learning AnalyticsDe Haagse Onderwijsdag 2013 - Workshop Learning Analytics
De Haagse Onderwijsdag 2013 - Workshop Learning Analytics
 
Handout: Learning analytics, student perspective
Handout: Learning analytics, student perspectiveHandout: Learning analytics, student perspective
Handout: Learning analytics, student perspective
 
Learning analytics, student perspective
Learning analytics, student perspectiveLearning analytics, student perspective
Learning analytics, student perspective
 
Open learning analytics
Open learning analyticsOpen learning analytics
Open learning analytics
 
Learning analytics : foundation of mass personalized education
Learning analytics : foundation of mass personalized educationLearning analytics : foundation of mass personalized education
Learning analytics : foundation of mass personalized education
 
Reflecting on Learning Analytics Tools
Reflecting on Learning Analytics ToolsReflecting on Learning Analytics Tools
Reflecting on Learning Analytics Tools
 

Recently uploaded

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 

Recently uploaded (20)

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 

Survival of the fittest in the jungle of OER

  • 1. Open Survival of the fittest Open in the jungle of Open Educational Resources 15th of August 2014 a Master Thesis by Sander Latour
  • 2. Open Educational Resources [1] Learning objects that can freely be reused, revised, remixed and redistributed. [1] Daniel E Atkins, John S Brown and Allen L Hammond. Creative Common, 2007. A review of the open educational resources (OER) movement: Achievements, challenges, and new opportunities.
  • 3. Open Educational Resources Learning objects that can freely be reused, revised, remixed and redistributed. Textual objects Video objects Interactive objects You should not focus on every detail. Stick to the bigger picture Example: You are reading this. Stick to the bigger picture
  • 5.
  • 10. NLG2( ( NLG3( ( NLG4( ( NLG5( ( NLG6( ( NLG7( ( NLG8( ( NLG1( ( ( )NLGE
  • 11. NLG2( ( NLG3( ( NLG4( ( NLG5( ( NLG6( ( NLG7( ( NLG8( ( NLG1( ( ( )NLGE
  • 12. NLG2( ( NLG3( ( NLG4( ( NLG5( ( NLG6( ( NLG7( ( NLG8( ( NLG1( ( ( )NLGE I regret trying this
  • 14. Survival of the fittest UCB + a Genetic Algorithm [2] A.E. Eiben and J.E. Smith. Natural Computing, 2007. Introduction to Evolutionary Computing. [2]
  • 15. ( ) 2 ln(n) n NLG average total nr. of evaluations nr. of times tried UCB-1[3] [3] P. Auer, N. Cesa-Bianchi and P. Fischer. Machine learning, 2002. Finite-time analysis of the multiarmed bandit problem.
  • 16. The impacts of these sequences are not independent If these two are effective then it makes sense to try this
  • 17. Genetic Algorithms Population containing a subset of candidates Candidates have a “fitness” value, i.e. how good is it? Higher fitness means higher chance of reproduction Produced offspring is a combination of both parents Inspired by Darwinian evolution
  • 18. ( ) 2 ln(n) n NLG Current population T1 T2 Selecting most promising sequence Evaluation of impact
  • 19. NLG1 NLG3 NLG2 NLG4 NLG5 Roulette selection of parents 1 2 3 4 Crossover & Mutation Crossover & Mutation Offspring Offspring Generational replacement with elite preservation elite offspring Current generation Next generation
  • 20. Genes chromosome Permutation encoding … with varying length … with partial permutations One-point crossover Append crossover Swap mutation Addition mutation Deletion mutation
  • 22. Nim game Curriculum Low High student groups 4lessons 4OER T1 T2 7sequences in 1 generation 10evaluations in 1 generation 2elite members 5%mutation 237total usable participants Algorithm Participants voluntary participation could stop at any moment diverse crowd not just students 3MC 3MC
  • 23. Does the system learn to pick sequences with more learning impact over those with less impact? Figure: Regret in Rules - Low Figure: Regret in Intuition - Low Built-up regret students The system worked for the “Low” student groups In “High” groups there was either too little data or a technical issue It’s unknown how good the apparently best sequences really are
  • 24. Possible explanation limited pre- and post-test coarse division of students independence assumption Variance in the observed learning impact learning impact students Figure: Best sequence in “Rules” lesson for student group “Low”
  • 25. In conclusion, A possible approach for using learning impact in the assessment of OER has been presented and tested. Many lessons can be drawn from the results, but the principle works. I recommend others to continue on the path of using learning impact in the assessment of OER.
  • 27. Diversity of individuals in each population Diversity was low with few novelties Parameters were set to converge more quickly Exploration was often not possible by means of crossover