Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication

Educational  Technology
Educational TechnologyGraz University of Technology
Markov Chain and Classification
of Difficulty Levels Enhances
the Learning Path in
One Digit Multiplication
Behnam Taraghi, Anna Saranti, Martin Ebner, Martin Schön
Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication
What it is about ?
!
Learning Analytics is the use of
intelligent data, learner-produced data,
and analysis models to discover
information and social connections, and
to predict and advise on learning.
Learning Analytics
Georg Siemens (2010) http://www.elearnspace.org/blog/2010/08/25/what-are-learning-analytics/
!
Learning Analytics is about collecting
traces that learners leave behind and
using those traces to improve learning.	

Learning Analytics
Erik Duval (2012) http://www.slideshare.net/erik.duval/learning-analytics-13050389
http://www.flickr.com/photos/neeravbhatt/6995946039
http://schule.tugraz.at
http://einmaleins.tugraz.at/
http://mathe.tugraz.at
Schön, M., Ebner, M., Kothmeier, G. (2012) It's Just About
Learning the Multiplication Table, In Proceedings of the 2nd
International Conference on Learning Analytics and
Knowledge (LAK '12), Simon Buckingham Shum, Dragan
Gasevic, and Rebecca Ferguson (Eds.). ACM, New York, NY,
USA, 73-81	

Algorithm
What is done as next step ?
!
!
- ... collect data: more than 500,000 calculations
!
- ... pupils from different primary schools
!
-... analyze preprocessed data
!
- ... cluster arithmetic questions according to their difficulty
!
- ... identify influential structures in each user’s answers
!
- ... offer personalized recommendation for each pupil
One Digit Multiplication
Answer Type Preceding Answer Current Answer
R - R
W - W
RR R R
RW R W
WR W R
WW W W
Answer Types
!
Question Difficulty: R & W
Question Difficulty: RW, WR & WW
!
Question Difficulty: RW, WR & WW
! !
Question Difficulty Clusters
(8 - 22 - 60)
!
!
!
- states: answer types to each question
!
- transition links: probability to the answer type of the
subsequent same posed question in the sequence
!
- for each 90 questions the MC model is applied individually
!
!
Markov Chain Analysis
(per Question)
Markov Chain Analysis (per Question)
!
!
- states: answer types to each question
!
- transition links: probability to the answer type of the
subsequent posed question in the sequence
Markov Chain Analysis
(over all Questions)
Markov Chain Analysis
(over all Questions)
k = 1 k = 3k = 2 k = 5Answer types k = 4
RW
WR
46.0
25.30
70.69
61.02
76.88
84.77
77.20
86.92
78.79
92.52
not observable in the set of easy questions
Markov Chain Analysis
(over all Questions)
Answer types
k = 2k = 1 k = 3 k = 4 k = 5
R
W
69.66
30.44
RR
12.8
87.2
RW
53.29
46.71
WR
7.11
92.89
WW
10.15
89.85
Others
31.01
68.99
71.52
28.48
23.03
76.97
77.59
22.41
9.37
90.63
16.14
83.86
55.29
44.71
72.26
27.74
42.28
57.72
89.02
10.98
7.69
92.31
29.30
70.70
66.51
33.49
72.66
27.34
51.38
48.62
92.48
7.52
0
100
39.13
60.87
74.98
25.02
72.92
27.08
50.00
50.00
93.57
6.43
0
100
41.67
58.33
80.63
19.37
Which question to pose
as next ?
- Question q from cluster c is answered correctly
- take Q = q+1 out of cluster C = c or c+1
!
- Question q from cluster c is answered incorrectly
- take Q = q+1 out of cluster C = c or c-1
!
!
- adapt the algorithm used to pose a question according to
identified difficulty levels
- choose question Q from cluster C that owns the highest
proportion rate referring to answer type WR or RR
!
!
- 1x1 multiplications were classified into 6 optimal difficulty
clusters
!
- most difficult questions: 6*8, 7*8, 8*6, 8*7, 8*4, 8*8, 6*7, 4*8
!
- the multiplications where 1, 2, 5, 10 occur as operands can be
classified as easy to learn
!
- 3, 4, 6, 9, and especially 7, 8 operands build multiplications
that can be classified as difficult
!
- adapt the algorithm used to pose a question according to
identified difficulty levels
!
- use the detected patterns to let teachers intervene if required.
Conclusions
Graz University of Technology
SOCIAL LEARNING
Computer and Information Services
Graz University of Technology
Behnam Taraghi
Slides available at: http://elearningblog.tugraz.at
behi_at
1 von 26

Recomendados

cee6210_f16 von
cee6210_f16cee6210_f16
cee6210_f16Sadra Sharifi, Ph.D.
112 views5 Folien
SoftwareInformationTechnology von
SoftwareInformationTechnologySoftwareInformationTechnology
SoftwareInformationTechnologySalhi Fadhel
556 views17 Folien
Genetic Algorithm von
Genetic AlgorithmGenetic Algorithm
Genetic AlgorithmAnkit Chaudhary
88 views28 Folien
Multimodal Residual Networks for Visual QA von
Multimodal Residual Networks for Visual QAMultimodal Residual Networks for Visual QA
Multimodal Residual Networks for Visual QAJin-Hwa Kim
261 views25 Folien
Lect5_GSEA_Classify (1).ppt von
Lect5_GSEA_Classify (1).pptLect5_GSEA_Classify (1).ppt
Lect5_GSEA_Classify (1).pptSaiGanesh836443
2 views32 Folien

Más contenido relacionado

Similar a Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication

The Importance of Being Structured von
The Importance of Being StructuredThe Importance of Being Structured
The Importance of Being StructuredFabio Caraffini
106 views19 Folien
Research Poster (2015-16) von
Research Poster (2015-16)Research Poster (2015-16)
Research Poster (2015-16)Transpose Multiservices
44 views1 Folie
Matrix Factorization von
Matrix FactorizationMatrix Factorization
Matrix FactorizationYusuke Yamamoto
2.9K views34 Folien
Unsupervised learning with Spark von
Unsupervised learning with SparkUnsupervised learning with Spark
Unsupervised learning with SparkMarko Velic
702 views17 Folien
Methodological study of opinion mining and sentiment analysis techniques von
Methodological study of opinion mining and sentiment analysis techniquesMethodological study of opinion mining and sentiment analysis techniques
Methodological study of opinion mining and sentiment analysis techniquesijsc
667 views11 Folien
Role of technology to make teaching, learning & assessment convenient von
Role of technology to make teaching, learning & assessment convenientRole of technology to make teaching, learning & assessment convenient
Role of technology to make teaching, learning & assessment convenientAshish Jain
1.3K views13 Folien

Similar a Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication(20)

The Importance of Being Structured von Fabio Caraffini
The Importance of Being StructuredThe Importance of Being Structured
The Importance of Being Structured
Fabio Caraffini106 views
Unsupervised learning with Spark von Marko Velic
Unsupervised learning with SparkUnsupervised learning with Spark
Unsupervised learning with Spark
Marko Velic702 views
Methodological study of opinion mining and sentiment analysis techniques von ijsc
Methodological study of opinion mining and sentiment analysis techniquesMethodological study of opinion mining and sentiment analysis techniques
Methodological study of opinion mining and sentiment analysis techniques
ijsc667 views
Role of technology to make teaching, learning & assessment convenient von Ashish Jain
Role of technology to make teaching, learning & assessment convenientRole of technology to make teaching, learning & assessment convenient
Role of technology to make teaching, learning & assessment convenient
Ashish Jain1.3K views
Mobile App Recommendations Using Deep Learning and Big Data von Luís Pinto
Mobile App Recommendations Using Deep Learning and Big DataMobile App Recommendations Using Deep Learning and Big Data
Mobile App Recommendations Using Deep Learning and Big Data
Luís Pinto470 views
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS von Irene Pochinok
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSISFUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS
Irene Pochinok198 views
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ... von alywise
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...
alywise567 views
Introduction to Linear Discriminant Analysis von Jaclyn Kokx
Introduction to Linear Discriminant AnalysisIntroduction to Linear Discriminant Analysis
Introduction to Linear Discriminant Analysis
Jaclyn Kokx7.1K views
BASIC STATISTICS AND PROBABILITY.pptx von RanjuBijoy
BASIC STATISTICS AND PROBABILITY.pptxBASIC STATISTICS AND PROBABILITY.pptx
BASIC STATISTICS AND PROBABILITY.pptx
RanjuBijoy2 views
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla... von Mark Brown
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
Mark Brown793 views
Poster CELePro for the eScience Network Conference 06/2013 von Anja Lorenz
Poster CELePro for the eScience Network Conference 06/2013Poster CELePro for the eScience Network Conference 06/2013
Poster CELePro for the eScience Network Conference 06/2013
Anja Lorenz2K views
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese... von Vitomir Kovanovic
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Vitomir Kovanovic1.4K views
Work completion seminar defence von Mahdi Babaei
Work completion seminar defenceWork completion seminar defence
Work completion seminar defence
Mahdi Babaei338 views
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing... von ArchiLab 7
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
ArchiLab 7214 views

Más de Educational Technology

The use of programming tasks in interactive videos to increase learning effec... von
The use of programming tasks in interactive videos to increase learning effec...The use of programming tasks in interactive videos to increase learning effec...
The use of programming tasks in interactive videos to increase learning effec...Educational Technology
4 views39 Folien
Analysis of students' behavior watching iMooX courses with interactive elements von
Analysis of students' behavior watching iMooX courses with interactive elementsAnalysis of students' behavior watching iMooX courses with interactive elements
Analysis of students' behavior watching iMooX courses with interactive elementsEducational Technology
3 views15 Folien
Portability of Mobile Applications von
Portability of Mobile ApplicationsPortability of Mobile Applications
Portability of Mobile ApplicationsEducational Technology
11 views35 Folien
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen... von
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...Educational Technology
22 views23 Folien
Mixed Reality im Distance Learning in der Hochschullehre von
Mixed Reality im Distance Learning in der HochschullehreMixed Reality im Distance Learning in der Hochschullehre
Mixed Reality im Distance Learning in der HochschullehreEducational Technology
31 views26 Folien
Development of a WCAG theme for a learning management system von
Development of a WCAG theme for a learning management systemDevelopment of a WCAG theme for a learning management system
Development of a WCAG theme for a learning management systemEducational Technology
23 views25 Folien

Más de Educational Technology(20)

The use of programming tasks in interactive videos to increase learning effec... von Educational Technology
The use of programming tasks in interactive videos to increase learning effec...The use of programming tasks in interactive videos to increase learning effec...
The use of programming tasks in interactive videos to increase learning effec...
Analysis of students' behavior watching iMooX courses with interactive elements von Educational Technology
Analysis of students' behavior watching iMooX courses with interactive elementsAnalysis of students' behavior watching iMooX courses with interactive elements
Analysis of students' behavior watching iMooX courses with interactive elements
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen... von Educational Technology
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
Empirical Analysis of Automated Editing of Raw Learning Video Footage von Educational Technology
Empirical Analysis of Automated Editing of Raw Learning Video FootageEmpirical Analysis of Automated Editing of Raw Learning Video Footage
Empirical Analysis of Automated Editing of Raw Learning Video Footage
DENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien von Educational Technology
DENKEN UND TECHNIK Über manipulative Auswirkungen von InternettechnologienDENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien
DENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-... von Educational Technology
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:... von Educational Technology
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual... von Educational Technology
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...
Fächerintegrativer Unterricht am Beispiel des Lernroboters Thymio von Educational Technology
Fächerintegrativer Unterricht am Beispiel des Lernroboters ThymioFächerintegrativer Unterricht am Beispiel des Lernroboters Thymio
Fächerintegrativer Unterricht am Beispiel des Lernroboters Thymio
Chatbots for Brand Representation in Comparison with Traditional Websites von Educational Technology
Chatbots for Brand Representation in Comparison with Traditional WebsitesChatbots for Brand Representation in Comparison with Traditional Websites
Chatbots for Brand Representation in Comparison with Traditional Websites

Último

Computer Introduction-Lecture06 von
Computer Introduction-Lecture06Computer Introduction-Lecture06
Computer Introduction-Lecture06Dr. Mazin Mohamed alkathiri
105 views12 Folien
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively von
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyPECB
623 views18 Folien
CUNY IT Picciano.pptx von
CUNY IT Picciano.pptxCUNY IT Picciano.pptx
CUNY IT Picciano.pptxapicciano
54 views17 Folien
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant... von
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Ms. Pooja Bhandare
133 views45 Folien
Solar System and Galaxies.pptx von
Solar System and Galaxies.pptxSolar System and Galaxies.pptx
Solar System and Galaxies.pptxDrHafizKosar
106 views26 Folien
Gross Anatomy of the Liver von
Gross Anatomy of the LiverGross Anatomy of the Liver
Gross Anatomy of the Liverobaje godwin sunday
61 views12 Folien

Último(20)

ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively von PECB
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
PECB 623 views
CUNY IT Picciano.pptx von apicciano
CUNY IT Picciano.pptxCUNY IT Picciano.pptx
CUNY IT Picciano.pptx
apicciano54 views
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant... von Ms. Pooja Bhandare
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Pharmaceutical Inorganic Chemistry Unit IVMiscellaneous compounds Expectorant...
Ms. Pooja Bhandare133 views
Solar System and Galaxies.pptx von DrHafizKosar
Solar System and Galaxies.pptxSolar System and Galaxies.pptx
Solar System and Galaxies.pptx
DrHafizKosar106 views
Monthly Information Session for MV Asterix (November) von Esquimalt MFRC
Monthly Information Session for MV Asterix (November)Monthly Information Session for MV Asterix (November)
Monthly Information Session for MV Asterix (November)
Esquimalt MFRC72 views
Ch. 7 Political Participation and Elections.pptx von Rommel Regala
Ch. 7 Political Participation and Elections.pptxCh. 7 Political Participation and Elections.pptx
Ch. 7 Political Participation and Elections.pptx
Rommel Regala111 views
AUDIENCE - BANDURA.pptx von iammrhaywood
AUDIENCE - BANDURA.pptxAUDIENCE - BANDURA.pptx
AUDIENCE - BANDURA.pptx
iammrhaywood117 views
Narration lesson plan von TARIQ KHAN
Narration lesson planNarration lesson plan
Narration lesson plan
TARIQ KHAN61 views
Use of Probiotics in Aquaculture.pptx von AKSHAY MANDAL
Use of Probiotics in Aquaculture.pptxUse of Probiotics in Aquaculture.pptx
Use of Probiotics in Aquaculture.pptx
AKSHAY MANDAL119 views
Education and Diversity.pptx von DrHafizKosar
Education and Diversity.pptxEducation and Diversity.pptx
Education and Diversity.pptx
DrHafizKosar193 views

Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication

  • 1. Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication Behnam Taraghi, Anna Saranti, Martin Ebner, Martin Schön
  • 3. What it is about ?
  • 4. ! Learning Analytics is the use of intelligent data, learner-produced data, and analysis models to discover information and social connections, and to predict and advise on learning. Learning Analytics Georg Siemens (2010) http://www.elearnspace.org/blog/2010/08/25/what-are-learning-analytics/
  • 5. ! Learning Analytics is about collecting traces that learners leave behind and using those traces to improve learning. Learning Analytics Erik Duval (2012) http://www.slideshare.net/erik.duval/learning-analytics-13050389
  • 10. Schön, M., Ebner, M., Kothmeier, G. (2012) It's Just About Learning the Multiplication Table, In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK '12), Simon Buckingham Shum, Dragan Gasevic, and Rebecca Ferguson (Eds.). ACM, New York, NY, USA, 73-81 Algorithm
  • 11. What is done as next step ?
  • 12. ! ! - ... collect data: more than 500,000 calculations ! - ... pupils from different primary schools ! -... analyze preprocessed data ! - ... cluster arithmetic questions according to their difficulty ! - ... identify influential structures in each user’s answers ! - ... offer personalized recommendation for each pupil One Digit Multiplication
  • 13. Answer Type Preceding Answer Current Answer R - R W - W RR R R RW R W WR W R WW W W Answer Types
  • 18. ! ! - states: answer types to each question ! - transition links: probability to the answer type of the subsequent same posed question in the sequence ! - for each 90 questions the MC model is applied individually ! ! Markov Chain Analysis (per Question)
  • 19. Markov Chain Analysis (per Question)
  • 20. ! ! - states: answer types to each question ! - transition links: probability to the answer type of the subsequent posed question in the sequence Markov Chain Analysis (over all Questions)
  • 21. Markov Chain Analysis (over all Questions) k = 1 k = 3k = 2 k = 5Answer types k = 4 RW WR 46.0 25.30 70.69 61.02 76.88 84.77 77.20 86.92 78.79 92.52 not observable in the set of easy questions
  • 22. Markov Chain Analysis (over all Questions) Answer types k = 2k = 1 k = 3 k = 4 k = 5 R W 69.66 30.44 RR 12.8 87.2 RW 53.29 46.71 WR 7.11 92.89 WW 10.15 89.85 Others 31.01 68.99 71.52 28.48 23.03 76.97 77.59 22.41 9.37 90.63 16.14 83.86 55.29 44.71 72.26 27.74 42.28 57.72 89.02 10.98 7.69 92.31 29.30 70.70 66.51 33.49 72.66 27.34 51.38 48.62 92.48 7.52 0 100 39.13 60.87 74.98 25.02 72.92 27.08 50.00 50.00 93.57 6.43 0 100 41.67 58.33 80.63 19.37
  • 23. Which question to pose as next ?
  • 24. - Question q from cluster c is answered correctly - take Q = q+1 out of cluster C = c or c+1 ! - Question q from cluster c is answered incorrectly - take Q = q+1 out of cluster C = c or c-1 ! ! - adapt the algorithm used to pose a question according to identified difficulty levels - choose question Q from cluster C that owns the highest proportion rate referring to answer type WR or RR
  • 25. ! ! - 1x1 multiplications were classified into 6 optimal difficulty clusters ! - most difficult questions: 6*8, 7*8, 8*6, 8*7, 8*4, 8*8, 6*7, 4*8 ! - the multiplications where 1, 2, 5, 10 occur as operands can be classified as easy to learn ! - 3, 4, 6, 9, and especially 7, 8 operands build multiplications that can be classified as difficult ! - adapt the algorithm used to pose a question according to identified difficulty levels ! - use the detected patterns to let teachers intervene if required. Conclusions
  • 26. Graz University of Technology SOCIAL LEARNING Computer and Information Services Graz University of Technology Behnam Taraghi Slides available at: http://elearningblog.tugraz.at behi_at