SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Downloaden Sie, um offline zu lesen
Adding predictive elements to
student and instructor dashboards
Robert Bodily
Brigham Young University
Context
• Class
• First year chemistry course
• Blended – class 3x per week,
• Resources
• 150 videos (avg. 2 min long, supplemental resources)
• 15 weekly quizzes (unlimited question attempts)
• Participants
• 200 students (online interactions)
• 96 students took the self-report resource use survey
Nature of the data
• Quiz
• Confidence in answer (just a guess, pretty sure, very sure)
• Time spent on quiz
• Correct/incorrect
• Number of attempts per question
• Leave tab (still open, but inactive), come back to tab (active again)
• Video
• Play, pause, skip forward/backward, change play rate, change volume,
• Dashboard
• Number of times students follow recommendations given in dashboard
• Number of clicks within the dashboard
Student Dashboard
Instructor dashboard
Goals
Our dashboards are completely descriptive, so I want to add predictive
elements to both the student and instructor dashboards
1. Understand what course elements are predictive of student
achievement (grade on final exam)
2. Develop an early course prediction of student success
3. Determine what student profiles exist based on online behavior
4. Develop a model to classify future students into groups
What course elements are predictive of
student success?
Variable Beta P-value
Online homework score 0.366 0.000
In-class IClicker scores 0.154 0.024
# of attempts/question -0.411 0.000
Amount of question navigation -0.206 0.040
# of online activity sessions -0.195 0.020
Variable Beta P-value
Read the textbook 2.443 0.059
Ask professor questions in class 7.363 0.000
Watch Khan Academy -2.738 0.051
Use the internet -3.199 0.010
Skip recitation -4.820 0.041
Model 1 – regressing online interaction data
on final exam score.
Model 2 – regressing self-report resource use
on final exam score.
Develop an early course prediction of student
achievement
Online student interaction data Online student interaction data AND exam scores
There is significant improvement in both models until week 3 or 4, so that seems to be a good time to make
predictions for instructors and students.
Clustering to find student profiles
Cluster 1: Higher prior knowledge, good study skills, uses email, does not use office hours
Cluster 2: Efficient, game the system, ok losing some points, office hour students, does not use email
Cluster 3: Work hard but inefficiently, use tutor/friends, low self-regulation, bad study habits
3
Develop a classification model to classify
future students into groups
Classes AIC BIC SSA BIC
Log
Likelihood
2 8299 8460 8305 -4101
3 7870 8086 7877 -3869
4 7502 7774 7511 -3668
5 7139 7467 7150 -3470
6 6813 7196 6826 -3290
7 6612 7051 6626 -3172
8 6523 7017 6539 -3110
Group counts
3. 2
1. 20
2. 119
5. 24
6. 8
4. 22
Group 3: efficient smart learners
Group 1: low online activity, efficiency driven, just getting by
Group 2: average students, lower effort, low online activity
Group 5: average students, high effort, high online activity
Group 6: low learning skills, low knowledge awareness, high effort
Group 4: low learning skills, low knowledge awareness, but put forth less effort than group 6
Student dashboard suggestions
• Provide students with recommendations on the things that good
students do to succeed in the course, as well as the potential effect of
these things.
• Give students feedback on how they will do on the final based on
historical students similar to them. Give them something to click to
act on this information (e.g. meet with TA, meet with instructor, etc.).
• Show students some examples of their online behaviors to make
them more aware of their online activity. Provide recommendations
to help them improve.
Instructor dashboard suggestions
• Provide a list of things successful students do along with their effect
on student final exam grade so the instructor can encourage students
to do them to improve in the course
• Provide a predicted pass/fail score for each student at week 3 or 4 in
the course so the instructor or teaching assistants can intervene with
potentially struggling students
• Provide a student profile for each student so the instructor can better
personalize feedback to students

Weitere ähnliche Inhalte

Was ist angesagt?

Tips for Assessing Student Learning Using Blackboard
Tips for Assessing Student Learning Using BlackboardTips for Assessing Student Learning Using Blackboard
Tips for Assessing Student Learning Using BlackboardJason Rhode
 
Presentation10
Presentation10Presentation10
Presentation10Yum Studio
 
Supporting Faculty In The Angel Virtual Classroom
Supporting Faculty In The Angel Virtual ClassroomSupporting Faculty In The Angel Virtual Classroom
Supporting Faculty In The Angel Virtual ClassroomMelanie
 
Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...Alison Graham
 
NIU Blackboard Portfolio Pilot Information
NIU Blackboard Portfolio Pilot InformationNIU Blackboard Portfolio Pilot Information
NIU Blackboard Portfolio Pilot InformationJason Rhode
 
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...Blackboard APAC
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Blackboard APAC
 
Institutional roll out of submission and marking ss
Institutional roll out of submission and marking ssInstitutional roll out of submission and marking ss
Institutional roll out of submission and marking ssLTatUoN
 
Effective Teaching with Learn@UW
Effective Teaching with Learn@UWEffective Teaching with Learn@UW
Effective Teaching with Learn@UWjbohrer
 
Preparing Students
Preparing StudentsPreparing Students
Preparing StudentsKatie Turner
 
Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learning
Footholds and Foundations: Setting Freshmen on the Path to Lifelong LearningFootholds and Foundations: Setting Freshmen on the Path to Lifelong Learning
Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learningannielibrarian
 
iGeneration Conference
iGeneration ConferenceiGeneration Conference
iGeneration Conferencenix1
 
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...Blackboard APAC
 
Creating Effective CBT Training for Nursing Educators
Creating Effective CBT Training for Nursing EducatorsCreating Effective CBT Training for Nursing Educators
Creating Effective CBT Training for Nursing EducatorsExamSoft
 
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education EnvironmentBest Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education EnvironmentExamSoft
 
Calamity & Creativity in Chemistry
Calamity & Creativity in ChemistryCalamity & Creativity in Chemistry
Calamity & Creativity in ChemistryKatherine Haxton
 
Developing Conceptual Understanding Through Alternative Assessment
Developing Conceptual Understanding Through Alternative AssessmentDeveloping Conceptual Understanding Through Alternative Assessment
Developing Conceptual Understanding Through Alternative AssessmentKatherine Haxton
 
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopFacilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopSara Marsham
 
Extending Moodle - Moodlemoot Romania 2013
Extending Moodle - Moodlemoot Romania 2013Extending Moodle - Moodlemoot Romania 2013
Extending Moodle - Moodlemoot Romania 2013Gavin Henrick
 

Was ist angesagt? (20)

Tips for Assessing Student Learning Using Blackboard
Tips for Assessing Student Learning Using BlackboardTips for Assessing Student Learning Using Blackboard
Tips for Assessing Student Learning Using Blackboard
 
Presentation10
Presentation10Presentation10
Presentation10
 
Supporting Faculty In The Angel Virtual Classroom
Supporting Faculty In The Angel Virtual ClassroomSupporting Faculty In The Angel Virtual Classroom
Supporting Faculty In The Angel Virtual Classroom
 
Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...
 
NIU Blackboard Portfolio Pilot Information
NIU Blackboard Portfolio Pilot InformationNIU Blackboard Portfolio Pilot Information
NIU Blackboard Portfolio Pilot Information
 
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...
Efficiency in teaching using these 5 Moodlerooms tools and tips | Grant Beeve...
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...
 
Institutional roll out of submission and marking ss
Institutional roll out of submission and marking ssInstitutional roll out of submission and marking ss
Institutional roll out of submission and marking ss
 
Effective Teaching with Learn@UW
Effective Teaching with Learn@UWEffective Teaching with Learn@UW
Effective Teaching with Learn@UW
 
Preparing Students
Preparing StudentsPreparing Students
Preparing Students
 
Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learning
Footholds and Foundations: Setting Freshmen on the Path to Lifelong LearningFootholds and Foundations: Setting Freshmen on the Path to Lifelong Learning
Footholds and Foundations: Setting Freshmen on the Path to Lifelong Learning
 
iGeneration Conference
iGeneration ConferenceiGeneration Conference
iGeneration Conference
 
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...
Using Blackboard Learn alongside Microsoft OneNote: the overlaps, the complem...
 
Creating Effective CBT Training for Nursing Educators
Creating Effective CBT Training for Nursing EducatorsCreating Effective CBT Training for Nursing Educators
Creating Effective CBT Training for Nursing Educators
 
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education EnvironmentBest Practices for Implementation of ExamSoft in a Nursing Education Environment
Best Practices for Implementation of ExamSoft in a Nursing Education Environment
 
Session 1 e-Learning
Session 1 e-LearningSession 1 e-Learning
Session 1 e-Learning
 
Calamity & Creativity in Chemistry
Calamity & Creativity in ChemistryCalamity & Creativity in Chemistry
Calamity & Creativity in Chemistry
 
Developing Conceptual Understanding Through Alternative Assessment
Developing Conceptual Understanding Through Alternative AssessmentDeveloping Conceptual Understanding Through Alternative Assessment
Developing Conceptual Understanding Through Alternative Assessment
 
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopFacilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
 
Extending Moodle - Moodlemoot Romania 2013
Extending Moodle - Moodlemoot Romania 2013Extending Moodle - Moodlemoot Romania 2013
Extending Moodle - Moodlemoot Romania 2013
 

Ähnlich wie Predictive dashboard elements

3 Things to Know About Midterm Evaluation
3 Things to Know About Midterm Evaluation3 Things to Know About Midterm Evaluation
3 Things to Know About Midterm EvaluationLianaYeghiazaryan1
 
Online Learning and Student Success
Online Learning and Student Success Online Learning and Student Success
Online Learning and Student Success Pearson North America
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Evaluating the Quality of Online Teaching
Evaluating the Quality of Online Teaching Evaluating the Quality of Online Teaching
Evaluating the Quality of Online Teaching D2L Barry
 
Evaluating Quality of Online Teaching
Evaluating Quality of Online TeachingEvaluating Quality of Online Teaching
Evaluating Quality of Online TeachingD2L Barry
 
Unit 7 examination system in pakistan
Unit 7 examination system in pakistanUnit 7 examination system in pakistan
Unit 7 examination system in pakistanAsima shahzadi
 
Stus 101 001 2014 fall llabus
Stus 101 001 2014 fall llabusStus 101 001 2014 fall llabus
Stus 101 001 2014 fall llabusJenni Davis Lund
 
Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016JLynn Jen Smith
 
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...statisfactions
 
Online Testing: An Authentic Twist to Traditional Assessment - Bloomsburg Un...
Online Testing: An Authentic Twist to Traditional Assessment  - Bloomsburg Un...Online Testing: An Authentic Twist to Traditional Assessment  - Bloomsburg Un...
Online Testing: An Authentic Twist to Traditional Assessment - Bloomsburg Un...DCPS
 
GaETC 2004 - LTTS: Online Professional Development for Technology Integration
GaETC 2004 - LTTS: Online Professional Development for Technology IntegrationGaETC 2004 - LTTS: Online Professional Development for Technology Integration
GaETC 2004 - LTTS: Online Professional Development for Technology IntegrationMichael Barbour
 
CA12 Assessing Online Courses (Updated)
CA12 Assessing Online Courses (Updated)CA12 Assessing Online Courses (Updated)
CA12 Assessing Online Courses (Updated)CETLA
 
Stus101syllabusspring2016 jenlund
Stus101syllabusspring2016 jenlundStus101syllabusspring2016 jenlund
Stus101syllabusspring2016 jenlundJenni Davis Lund
 
Stus 101 syllabus fall 2015 jen lund
Stus 101 syllabus fall 2015 jen lundStus 101 syllabus fall 2015 jen lund
Stus 101 syllabus fall 2015 jen lundJenni Davis Lund
 
D2L Community Webinar - Online Student Expectations
D2L Community Webinar - Online Student ExpectationsD2L Community Webinar - Online Student Expectations
D2L Community Webinar - Online Student ExpectationsD2L Barry
 
Personalised Learning for Edtech.pdf
Personalised Learning for Edtech.pdfPersonalised Learning for Edtech.pdf
Personalised Learning for Edtech.pdfSubrat Kumar Dash
 
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...taruian
 

Ähnlich wie Predictive dashboard elements (20)

3 Things to Know About Midterm Evaluation
3 Things to Know About Midterm Evaluation3 Things to Know About Midterm Evaluation
3 Things to Know About Midterm Evaluation
 
Online Learning and Student Success
Online Learning and Student Success Online Learning and Student Success
Online Learning and Student Success
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Evaluating the Quality of Online Teaching
Evaluating the Quality of Online Teaching Evaluating the Quality of Online Teaching
Evaluating the Quality of Online Teaching
 
Evaluating Quality of Online Teaching
Evaluating Quality of Online TeachingEvaluating Quality of Online Teaching
Evaluating Quality of Online Teaching
 
Unit 7 examination system in pakistan
Unit 7 examination system in pakistanUnit 7 examination system in pakistan
Unit 7 examination system in pakistan
 
Stus 101 001 2014 fall llabus
Stus 101 001 2014 fall llabusStus 101 001 2014 fall llabus
Stus 101 001 2014 fall llabus
 
Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016
 
Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016Intro.to.course.hit2333 2016
Intro.to.course.hit2333 2016
 
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...
Top Ten Things Learned From Ten Years of Online Statistics Teaching (Michelle...
 
Online Testing: An Authentic Twist to Traditional Assessment - Bloomsburg Un...
Online Testing: An Authentic Twist to Traditional Assessment  - Bloomsburg Un...Online Testing: An Authentic Twist to Traditional Assessment  - Bloomsburg Un...
Online Testing: An Authentic Twist to Traditional Assessment - Bloomsburg Un...
 
GaETC 2004 - LTTS: Online Professional Development for Technology Integration
GaETC 2004 - LTTS: Online Professional Development for Technology IntegrationGaETC 2004 - LTTS: Online Professional Development for Technology Integration
GaETC 2004 - LTTS: Online Professional Development for Technology Integration
 
CA12 Assessing Online Courses (Updated)
CA12 Assessing Online Courses (Updated)CA12 Assessing Online Courses (Updated)
CA12 Assessing Online Courses (Updated)
 
Evaluation of training
Evaluation of trainingEvaluation of training
Evaluation of training
 
Stus101syllabusspring2016 jenlund
Stus101syllabusspring2016 jenlundStus101syllabusspring2016 jenlund
Stus101syllabusspring2016 jenlund
 
Stus 101 syllabus fall 2015 jen lund
Stus 101 syllabus fall 2015 jen lundStus 101 syllabus fall 2015 jen lund
Stus 101 syllabus fall 2015 jen lund
 
D2L Community Webinar - Online Student Expectations
D2L Community Webinar - Online Student ExpectationsD2L Community Webinar - Online Student Expectations
D2L Community Webinar - Online Student Expectations
 
Weac
WeacWeac
Weac
 
Personalised Learning for Edtech.pdf
Personalised Learning for Edtech.pdfPersonalised Learning for Edtech.pdf
Personalised Learning for Edtech.pdf
 
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...
Criteria-2-–-Teaching-Learning-and-Evaluation-NAAC-Perspectives-by-Prof.-Rajm...
 

Kürzlich hochgeladen

5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 

Kürzlich hochgeladen (17)

5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 

Predictive dashboard elements

  • 1. Adding predictive elements to student and instructor dashboards Robert Bodily Brigham Young University
  • 2. Context • Class • First year chemistry course • Blended – class 3x per week, • Resources • 150 videos (avg. 2 min long, supplemental resources) • 15 weekly quizzes (unlimited question attempts) • Participants • 200 students (online interactions) • 96 students took the self-report resource use survey
  • 3. Nature of the data • Quiz • Confidence in answer (just a guess, pretty sure, very sure) • Time spent on quiz • Correct/incorrect • Number of attempts per question • Leave tab (still open, but inactive), come back to tab (active again) • Video • Play, pause, skip forward/backward, change play rate, change volume, • Dashboard • Number of times students follow recommendations given in dashboard • Number of clicks within the dashboard
  • 6. Goals Our dashboards are completely descriptive, so I want to add predictive elements to both the student and instructor dashboards 1. Understand what course elements are predictive of student achievement (grade on final exam) 2. Develop an early course prediction of student success 3. Determine what student profiles exist based on online behavior 4. Develop a model to classify future students into groups
  • 7. What course elements are predictive of student success? Variable Beta P-value Online homework score 0.366 0.000 In-class IClicker scores 0.154 0.024 # of attempts/question -0.411 0.000 Amount of question navigation -0.206 0.040 # of online activity sessions -0.195 0.020 Variable Beta P-value Read the textbook 2.443 0.059 Ask professor questions in class 7.363 0.000 Watch Khan Academy -2.738 0.051 Use the internet -3.199 0.010 Skip recitation -4.820 0.041 Model 1 – regressing online interaction data on final exam score. Model 2 – regressing self-report resource use on final exam score.
  • 8. Develop an early course prediction of student achievement Online student interaction data Online student interaction data AND exam scores There is significant improvement in both models until week 3 or 4, so that seems to be a good time to make predictions for instructors and students.
  • 9. Clustering to find student profiles Cluster 1: Higher prior knowledge, good study skills, uses email, does not use office hours Cluster 2: Efficient, game the system, ok losing some points, office hour students, does not use email Cluster 3: Work hard but inefficiently, use tutor/friends, low self-regulation, bad study habits 3
  • 10. Develop a classification model to classify future students into groups Classes AIC BIC SSA BIC Log Likelihood 2 8299 8460 8305 -4101 3 7870 8086 7877 -3869 4 7502 7774 7511 -3668 5 7139 7467 7150 -3470 6 6813 7196 6826 -3290 7 6612 7051 6626 -3172 8 6523 7017 6539 -3110 Group counts 3. 2 1. 20 2. 119 5. 24 6. 8 4. 22 Group 3: efficient smart learners Group 1: low online activity, efficiency driven, just getting by Group 2: average students, lower effort, low online activity Group 5: average students, high effort, high online activity Group 6: low learning skills, low knowledge awareness, high effort Group 4: low learning skills, low knowledge awareness, but put forth less effort than group 6
  • 11. Student dashboard suggestions • Provide students with recommendations on the things that good students do to succeed in the course, as well as the potential effect of these things. • Give students feedback on how they will do on the final based on historical students similar to them. Give them something to click to act on this information (e.g. meet with TA, meet with instructor, etc.). • Show students some examples of their online behaviors to make them more aware of their online activity. Provide recommendations to help them improve.
  • 12. Instructor dashboard suggestions • Provide a list of things successful students do along with their effect on student final exam grade so the instructor can encourage students to do them to improve in the course • Provide a predicted pass/fail score for each student at week 3 or 4 in the course so the instructor or teaching assistants can intervene with potentially struggling students • Provide a student profile for each student so the instructor can better personalize feedback to students