6+6 is more than 12: How Online Assessments add to Distance Learning

1. 6+6 is more than 12:
How Online Assessments add to
Distance Learning
John Kleeman and Eric Shepherd
www.questionmark.com
GUIDE INTERNATIONAL CONFERENCE, ROME, NOVEMBER 2011
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

2. Distance learning in higher education
crossing chasm?
TODAY
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 2
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

3. Internet / mobile growth
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 3
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

4. 6 key applications
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 4 Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

5. Assessment Through Learning Process
Learning
Collaborative
Mentoring Instructor & E-learning Work Place
Prepare For
Windows CD In/As Learning
Windows CD Of-Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

6. Pre-Learning Assessments
Purpose:
• Create intrigue Learning
• Route to course
• Inform instructors
• Establish benchmarks
Collaborative
Mentoring Instructor & E-learning Work Place
Prepare For
Windows CD In/As Learning
Windows CD Of Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

7. In-Learning Assessments
Purpose:
• Learning
Encourages focus on learning
• Provide instant feedback to instructor
• Stimulate and strengthen memory
• Correct misconceptions
Collaborative
Mentoring Instructor & E-learning Work Place
Prepare For
Windows CD In/As Learning
Windows CD Of Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

8. In a Perfect World…
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 8
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

9. In a Perfect World…
we would remember everything we learn!
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 9
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

10. In the Actual World…
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 10
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

11. In the Actual World…
we forget some of it!
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 11
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

12. Post-Learning Assessments
Purpose:
Learning • Was learning environment okay?
• Knowledge transfer occurred?
• Reduce Forgetting Curve
• Certifications
Collaborative
Mentoring Instructor & E-learning Work Place
Prepare For
Windows CD In/As Learning
Windows CD Of Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

13. Evidence quizzes slow forgetting curve
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 13
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

14. Distance learning: 6 key assessments
Course
Windows CD
Learning Evaluations
Collaborative Slow Forgetting
Windows CD
Mentoring Instructor & E-learning Work Place Curve
Windows CD Formative
Windows CD Windows CD Windows CD
Pretests Practice tests Exams
quizzes
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

15. 6 key improvements … start with embed assessments in
learning
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 15 Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

16. Embed in a Wiki
Embedded in a
Wiki
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 16
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

17. Embed in a website
Embedded in a
Web Page
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 17
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

18. Embed in a Blog
Embedded in a
Blog
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 18
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

19. Author once… deliver embedded
Author once SME Deliver to any
device in context
Windows based
Authoring Manager
Available Securely
Single results set
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 19
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

20. Mobile delivery of assessments
 6 billion mobile subscriptions
 Easy access to
 Practice tests
 Quiz of the day
 Course evaluations
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

21. Remote video monitoring
Reduce opportunity and
impact rationalization
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 21
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

22. Easy to use learning platforms
 Learning platforms
 Moodle
 Blackboard
 Sakai
 SharePoint
 Assessment systems
 Questionmark
 others
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 22
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

23. Easy to translate
 Manage translation online
 Multilingual assessments realistic
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 23
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

24. The Cloud eases
deployment
Author, manage item
banks via the cloud
Assessment Cloud
Deliver via the cloud
Deliver via the cloud
Reporting and Analytics
Reporting and Analytics
via the cloud
via the cloud
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

25. Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 25 Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

26. Online assessments solve 2 distance
learning barriers
 How do I fairly give certificates?
 Remote monitoring technology
 Frequent assessments rather than single exams
 Randomizing questions
 How do I engage and check engagement?
 What are the students are learning?
 Frequent online assessments
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

27. Frequent assessments - stay in touch
 Assess frequently
 Students know progress
 Instructors know progress
 Course correction
 Encourage spaced study (not just for exam)
 Aggregate results
 Complete story for each student
 Aid retention
Evidence Accumulated
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 27
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

28. 6 + 6 more than 12?
TODAY
WHEN
?
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 28
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.

29. What do you think?
 Email at john at questionmark.com or engage on
Twitter @johnkleeman
 For more information on Questionmark, see
www.questionmark.com
Copyright © 1995-2011 Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved.
Slide 29
Questionmark is a registered trademark of Questionmark Computing Limited. All other trademarks are acknowledged.