Learning assessments, such as quizzes, can be powerful tools for informing and reforming learning. The ability to analyze a variety of assessment data, and interpret the factors that can contribute to or influence learning has the potential to make it more effective and facilitate better decision-making for the investment and allocation of resources.
In this 30 minute Master Class, we will show you how to use Zoola Analytics to analyze quiz results, quiz question frequency, and quiz question pass/fail rates.
1. Erin Melvin - Moderator
Director of Client Engagement
Stewart Rogers - Presenter
VP, Products
Your Guide to Analyzing Moodle
Quizzes
2. Agenda
● Use overall quiz results to identify learning gaps and
increase learning effectiveness
● Understand how to identify problematic questions to
improve the learning experience
● Use data-based results to assess what other factors affect
the learning process so you can optimize for better results
2
3. Your Guide To Building Moodle Quizzes Recap
Students
● Assessment is a key component of learning
● Assessments help students learn
● Assessments help learners determine whether or not they understand the material
● Assessments can help motivate students
Instructors
● Improve student learning
● Providing teachers with data
● Data informs and guides better instruction and learning
3
4. Do you currently analyze any quiz or quiz question data?
● Yes
● No
● I don’t know
POLL
4
5. Quiz Data Analysis Plan
5
● The WHY - Demonstrate a continuous improvement in
assessment scores.
● The HOW - Lean Learning Analytics; optimize the One
Metric That Matters
● The WHAT - Quiz or Questions
6. Analyze Quiz Results To Look For Anomalies
6
● Analysis can give insight into whether pockets of Learners
are struggling more than others
● Analysis can give insight into whether Learners are
acquiring knowledge (pre- and post-assessment)
● Look at individual quizzes and compare different user
demographics
7. Analyze the Distribution
● Look at the question distribution segmented by
demographics to ensure a fair and expected balance
7
8. Analyze Distribution Question Results
● This data helps you recognize questions that might be
poor discriminators of student performance.
● Use this information to improve questions for future test
administrations or to adjust credit on current attempts.
● Segmented by demographics to identify questions where
the material may not be presented clearly or the question
is not effective.
8
9. You are interested in analyzing your quiz question results so
that you can (choose all that apply):
● Improve the quality of quiz questions
● Improve the quality of learning materials
● Improve the quality of instruction
● To identify particular students who require assistance
● To identify student demographics who require assistance
● Other
POLL
9
11. See you in the New Year
2019 Master Class
Designing your Learning to Motivate your Learners
https://www.lambdasolutions.net/resources/webinars
Tuesday, January 8, 10am PST
11
12. Resources
Webinar: Your Guide to Building Moodle Quizzes
https://go.lambdasolutions.net/your-guide-to-building-moodle-quizzes
DADA: Data > Analysis > Decision > Action
Webinar: 4 Emerging LMS Fundamentals You Need to Know
https://www.lambdasolutions.net/resources/webinars/4-lms-fundamentals
Lean Learning Analytics
Webinar: Using Analytics to Deliver Engaging Courses
https://www.lambdasolutions.net/resources/webinars/using-analytics-to-deliver-engaging-courses
12
13. Bonus Resources
Embracing Big Data in Complex Educational Systems: The Learning
Analytics Imperative and the Policy Challenge
by Leah P. Macfadyen, Shane Dawson, Abelardo Pardo, Dragan Gašević
https://files.eric.ed.gov/fulltext/EJ1062692.pdf
13
14. What’s your first action after this session (choose all that
apply)?
● Share this information with my colleagues
● Create a quiz question analysis plan
● Check out our quiz question report templates in Zoola
● Buy Stewart a Christmas present
POLL
14
15. Which data points would you like to learn more about:
● Forums
● Assignments
● Grades
● Time Spent
● Other
POLL
15