2. Twitter: @donnawells
Taking Measurement Mobile: Assessing mLearning
Analyzed results from nearly 250,000 courses delivered on Mindflash LMS in
past 6 weeks.
• Only courses with more than 100 completions or more
• Courses with completions both via Desktop and Mobile channels
Key is tying training results to key business metrics
Training Metrics analyzed
• Course Completion Rates
• Average Scores
• Time Required to Complete
• Likelihood to Reference
Business results used by our Customers
• Sales by trained/untrained employees, resellers, franchisees, etc.
• Cost savings from moving live training partly or fully online
• Speed or Scale achieved at same cost
3. 2
Mobile small but growing...especially over the weekend
Mobile
12%
0%
5%
10%
15%
20%
25%
Mon Tues Weds Thurs Fri Sat Sun
Course Views
Desktop Mobile
Desktop
88%
Twitter: @donnawells
4. Mobile Learners as likely to Complete and Comprehend
90%
84%
Desktop Mobile
Completion Rate
of those Starting Course
94% 94%
Desktop Mobile
Average Score
Twitter: @donnawells
5. But Mobile learners completing course in half the time ...
100
50
Desktop Mobile
Average Time to Complete
(Index)
100
120
Desktop Mobile
Reviewed Later
(Index)
... and 20% more likely to reference again
Twitter: @donnawells
6. Mobile Learners less active during “Office Hours”...
... more active from close of business to Midnight
0%
1%
2%
3%
4%
5%
6%
7%
8%
9%
6:00
AM
7 8 9 10 11 12:00
PM
1 2 3 4 5 6 7 8 9 10 11 12:00
AM
1 2 3 4 5
Desktop
Mobile
Twitter: @donnawells
7. Completion Rates can vary significantly with Mobile vs.
Desktop course-taking ... on SAME course
20%
30%
40%
50%
60%
70%
80%
90%
100%
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69
Courses
Completion Rate by Channel
Desktop Mobile
Rates differed 15% on average, but as much as 80%
Twitter: @donnawells
8. Primary Driver of Mobile Course Completion Rates is
Course Size/Length
75%
80%
85%
90%
95%
100%
1 to 10 11 to 20 21 to 30 31 to 40 41 to 50 >51
Course Completion Rates by Size of Course
Size = Number of “Slides”
Desktop
Mobile
Twitter: @donnawells
9. Completion Rates can also be influenced by the types of
Content formats used
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
PDF PPT Video YouTube
Video
Word Narration SCORM,
Other
Frequency of Content Type
Same Course, More Successful on Desktop vs. on Mobile
Desktop Completion Higher Mobile Completion Higher
Courses with more PowerPoint
got higher completion rates on
Desktop
Courses with more YouTube and
Word content got higher
completion rates on Mobile
Twitter: @donnawells
10. 9
Tying Course Outcomes to Business Results
More Case Studies: https://www.mindflash.com/customers/
Innovative, premium priced products
Training mobile, distributed sales
team
5,000+ online course completions
by remote sales staff
Daily sales up 4X since iPad–
delivered training introduced
Software company selling via resellers
Delivering in-person did not scale with
rapid company growth
Over 12,000 reseller course
completions
Resellers completing series of 3
courses selling 400% more
Twitter: @donnawells
11. 10
Five Best Practices Summary
1. Learners showing equal success on same course whether desktop or
mobile. Mobile learners achieving same outcomes in half the time.
2. Providing mobile course access likely to increase percent of
learners who reference course content after initial course completion
3. Shorter! Mobile learners much more sensitive to Course length vs.
Desktop. Break into a Series of shorter Courses, requiring sequential
passing.
4. Consider swapping PowerPoint for Word and increasing usage of Video to
improve experience and success among Mobile learners
5. Correlate Training outcomes with Business outcomes. Integrate LMS
data with CRM or Financial Systems data, ideally.
Caveat: Your results may vary. Analyze your learners’ results on Mobile
vs. Desktop... (e.g. Ask at time of course registration or via and end-of-course
survey. Or provided in reporting.)
Twitter: @donnawells
As expected, majority of courses still taken on desktop. And mobile stronger on weekend
Surprise was 95% use one mode only. 95% start and finish on same platform