4. Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
“speaking in the
language of business,
rather than trying to
sell learning “
"We know they've
been trained to do it,
but do they actually
do it?"
“When L&D professionals can
provide data and analysis
linked to strategy, they will be
a key influencer. “
7. Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
“As an instructional designer I've never had to
deal with analysis, statistics(?) or wrangling
datasets.
I feel a steep learning curve coming on.”
8. Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
It is a learning curve…
But it’s not that steep.
You can do a lot with xAPI…
Using the tools you already have
15. Unmeasured Learning’s Day Off| Janet Laane Effron
What Do You Want to Know?
Participation
Performance
16. Unmeasured Learning’s Day Off| Janet Laane Effron
Participation Related
• How are people using resources available?
• How much time are they spending?
• What elements/resources are proving useful?
• What aspects of participation affect results?
• What aspects of participation affect completions?
17. Unmeasured Learning’s Day Off| Janet Laane Effron
Performance Related
• Are we teaching the right things?
• How does course performance correspond to
job performance?
• Did X have the desired effect on Y?
19. Unmeasured Learning’s Day Off| Janet Laane Effron
Did anything change?
At first glance, not really, but…
• Reply rates increased by 12%
And then we looked a little further…
22. Unmeasured Learning’s Day Off| Janet Laane Effron
More than a popularity contest
Looking at what works and what resonates
• By Region
• By Functional role
• By Business Unit
Insights drive design improvements.
23. Unmeasured Learning’s Day Off| Janet Laane Effron
Did it work?
Retail Sales Course Data:
• Enrollments
• Completions
• Course Performance
• Regional data
CONTEXT is where we find the answers…
24. Unmeasured Learning’s Day Off| Janet Laane Effron
Did it work?
Outcomes
• Average Transaction Value is +32% for relevant
regions
• Country wide sales for product category are +19%
after product specific training.
26. Unmeasured Learning’s Day Off| Janet Laane Effron
Janet Laane Effron
Data Scientist, HT2
Janet@ht2.co.uk
@jleffron
UNMEASURED LEARNING’S
DAY OFF
DATA
RULES
Hinweis der Redaktion
Can get a lot of it very easily
xAPI gives us more. But why? What can we do with xAPI
“We can track people”
Can get a lot of it very easily
xAPI gives us more. But why? What can we do with xAPI
“We can track people”
Lesson – keep exploring – and – a little extra data goes a long way
When we saw the reply rates, I wondered if that translated to improved completion rates…not really, but we learned something new
IHG comment popularity – it wasn’t just what people were looking at, it’s what they were discussing QUALITATIVE
It’s not just counts – it’s what those counts mean
IHG – Business insights, regional concerns what content is meeting needs
DfD – Diff roles like diff types of content – and it didn’t fall out how we anticipated.
Power of Context– we saw that in IHG, we also see that here.
Power of Context– we saw that in IHG, we also see that here.
Everything in this preso was done with spreadsheets…