SlideShare ist ein Scribd-Unternehmen logo
1 von 26
Unmeasured Learning’s Day Off| Janet Laane Effron
UNMEASURED
LEARNING’S
DAY OFF
DATA
RULES
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
“speaking in the
language of business,
rather than trying to
sell learning “
"We know they've
been trained to do it,
but do they actually
do it?"
“When L&D professionals can
provide data and analysis
linked to strategy, they will be
a key influencer. “
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
“As an instructional designer I've never had to
deal with analysis, statistics(?) or wrangling
datasets.
I feel a steep learning curve coming on.”
Unmeasured Learning’s Day Off| Janet Laane Effron
Why use xAPI?
It is a learning curve…
But it’s not that steep.
You can do a lot with xAPI…
Using the tools you already have
Unmeasured Learning’s Day Off| Janet Laane Effron
Data is messy…
Unmeasured Learning’s Day Off| Janet Laane Effron
Data is messy…
Unmeasured Learning’s Day Off| Janet Laane Effron
Explore
Unmeasured Learning’s Day Off| Janet Laane Effron
Explore
Unmeasured Learning’s Day Off| Janet Laane Effron
Explore
Unmeasured Learning’s Day Off| Janet Laane Effron
Explore
Unmeasured Learning’s Day Off| Janet Laane Effron
What Do You Want to Know?
Participation
Performance
Unmeasured Learning’s Day Off| Janet Laane Effron
Participation Related
• How are people using resources available?
• How much time are they spending?
• What elements/resources are proving useful?
• What aspects of participation affect results?
• What aspects of participation affect completions?
Unmeasured Learning’s Day Off| Janet Laane Effron
Performance Related
• Are we teaching the right things?
• How does course performance correspond to
job performance?
• Did X have the desired effect on Y?
Unmeasured Learning’s Day Off| Janet Laane Effron
Did anything change?
Unmeasured Learning’s Day Off| Janet Laane Effron
Did anything change?
At first glance, not really, but…
• Reply rates increased by 12%
And then we looked a little further…
Unmeasured Learning’s Day Off| Janet Laane Effron
More Questions, More Insights
Unmeasured Learning’s Day Off| Janet Laane Effron
More than a popularity contest
Unmeasured Learning’s Day Off| Janet Laane Effron
More than a popularity contest
Looking at what works and what resonates
• By Region
• By Functional role
• By Business Unit
Insights drive design improvements.
Unmeasured Learning’s Day Off| Janet Laane Effron
Did it work?
Retail Sales Course Data:
• Enrollments
• Completions
• Course Performance
• Regional data
CONTEXT is where we find the answers…
Unmeasured Learning’s Day Off| Janet Laane Effron
Did it work?
Outcomes
• Average Transaction Value is +32% for relevant
regions
• Country wide sales for product category are +19%
after product specific training.
Unmeasured Learning’s Day Off| Janet Laane Effron
The Road Ahead
Unmeasured Learning’s Day Off| Janet Laane Effron
Janet Laane Effron
Data Scientist, HT2
Janet@ht2.co.uk
@jleffron
UNMEASURED LEARNING’S
DAY OFF
DATA
RULES

Weitere ähnliche Inhalte

Was ist angesagt?

[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart; Former Growth Lead at Pin...
[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart;  Former Growth Lead at Pin...[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart;  Former Growth Lead at Pin...
[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart; Former Growth Lead at Pin...
500 Startups
 

Was ist angesagt? (20)

How to Mentor Someone without Ruining their Career (Steve Hickey)
How to Mentor Someone without Ruining their Career (Steve Hickey)How to Mentor Someone without Ruining their Career (Steve Hickey)
How to Mentor Someone without Ruining their Career (Steve Hickey)
 
Action research
Action researchAction research
Action research
 
SaaSFest 2015: Accelerating Organic Growth Through High Tempo Testing
SaaSFest 2015: Accelerating Organic Growth Through High Tempo TestingSaaSFest 2015: Accelerating Organic Growth Through High Tempo Testing
SaaSFest 2015: Accelerating Organic Growth Through High Tempo Testing
 
Social Media Analytics
Social Media AnalyticsSocial Media Analytics
Social Media Analytics
 
Cat herding or collaborative learning?
Cat herding or collaborative learning?Cat herding or collaborative learning?
Cat herding or collaborative learning?
 
Product Meets Growth - How Product Teams Are Key To Driving Sustainable Growth
Product Meets Growth - How Product Teams Are Key To Driving Sustainable GrowthProduct Meets Growth - How Product Teams Are Key To Driving Sustainable Growth
Product Meets Growth - How Product Teams Are Key To Driving Sustainable Growth
 
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" StageStartupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
 
SaaSFest 2015 - "Increase New Feature Adoption, Decrease Churn" by Sonciary H...
SaaSFest 2015 - "Increase New Feature Adoption, Decrease Churn" by Sonciary H...SaaSFest 2015 - "Increase New Feature Adoption, Decrease Churn" by Sonciary H...
SaaSFest 2015 - "Increase New Feature Adoption, Decrease Churn" by Sonciary H...
 
[WMD2016] GrowthHackers >> Sean Ellis "Make your marketing team agile or die"
[WMD2016] GrowthHackers >> Sean Ellis "Make your marketing team agile or die" [WMD2016] GrowthHackers >> Sean Ellis "Make your marketing team agile or die"
[WMD2016] GrowthHackers >> Sean Ellis "Make your marketing team agile or die"
 
South shore meetup agile marketing jan 2012
South shore meetup agile marketing   jan 2012South shore meetup agile marketing   jan 2012
South shore meetup agile marketing jan 2012
 
Building a Company-Wide Growth Culture: SaaStr Annual 2016
Building a Company-Wide Growth Culture: SaaStr Annual 2016Building a Company-Wide Growth Culture: SaaStr Annual 2016
Building a Company-Wide Growth Culture: SaaStr Annual 2016
 
Nitin Paranjape - Toastmasters Reverberations 2010
Nitin Paranjape - Toastmasters Reverberations 2010Nitin Paranjape - Toastmasters Reverberations 2010
Nitin Paranjape - Toastmasters Reverberations 2010
 
Thinking outside the slide
Thinking outside the slideThinking outside the slide
Thinking outside the slide
 
Customer Development Startup 101 with Founder Institute Sydney
Customer Development Startup 101 with Founder Institute SydneyCustomer Development Startup 101 with Founder Institute Sydney
Customer Development Startup 101 with Founder Institute Sydney
 
SaaSFest 2015 - "Improve Your Retention with this One Change" by David Cancel...
SaaSFest 2015 - "Improve Your Retention with this One Change" by David Cancel...SaaSFest 2015 - "Improve Your Retention with this One Change" by David Cancel...
SaaSFest 2015 - "Improve Your Retention with this One Change" by David Cancel...
 
Product Management, Demystified
Product Management, DemystifiedProduct Management, Demystified
Product Management, Demystified
 
Leading From the Middle
Leading From the MiddleLeading From the Middle
Leading From the Middle
 
Agile Network India | Personal Agility - Resolving complexity in Personality ...
Agile Network India | Personal Agility - Resolving complexity in Personality ...Agile Network India | Personal Agility - Resolving complexity in Personality ...
Agile Network India | Personal Agility - Resolving complexity in Personality ...
 
[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart; Former Growth Lead at Pin...
[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart;  Former Growth Lead at Pin...[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart;  Former Growth Lead at Pin...
[WMD 2016] Advisor to Pocket, Airbnb, Darby Smart; Former Growth Lead at Pin...
 
Agile Scaling - 3 Factors For Success
Agile Scaling - 3 Factors For SuccessAgile Scaling - 3 Factors For Success
Agile Scaling - 3 Factors For Success
 

Ähnlich wie Data Rules: Unmeasured Learning's Day Off

Enterprise gaming updated
Enterprise gaming updatedEnterprise gaming updated
Enterprise gaming updated
Deepu S Nath
 
Career clarity and your next steps, 2 March 2022
Career clarity and your next steps, 2 March 2022Career clarity and your next steps, 2 March 2022
Career clarity and your next steps, 2 March 2022
Association for Project Management
 

Ähnlich wie Data Rules: Unmeasured Learning's Day Off (20)

Putting Data To Work - Janet Laane Effron
Putting Data To Work - Janet Laane Effron Putting Data To Work - Janet Laane Effron
Putting Data To Work - Janet Laane Effron
 
Why Most eLearning Fails: How to Create eLearning that Gets Results
Why Most eLearning Fails: How to Create eLearning that Gets ResultsWhy Most eLearning Fails: How to Create eLearning that Gets Results
Why Most eLearning Fails: How to Create eLearning that Gets Results
 
Enterprise gaming updated
Enterprise gaming updatedEnterprise gaming updated
Enterprise gaming updated
 
Successful attributes for making you a valuable IT asset.
Successful attributes for making you a valuable IT asset. Successful attributes for making you a valuable IT asset.
Successful attributes for making you a valuable IT asset.
 
eLearning for Sales Success: Fulfilling Today's (Changing) eLearning Needs
eLearning for Sales Success: Fulfilling Today's (Changing) eLearning NeedseLearning for Sales Success: Fulfilling Today's (Changing) eLearning Needs
eLearning for Sales Success: Fulfilling Today's (Changing) eLearning Needs
 
8 Ways to Evaluate Learning S106 Learning DevCamp 2019
8 Ways to Evaluate Learning S106 Learning DevCamp 20198 Ways to Evaluate Learning S106 Learning DevCamp 2019
8 Ways to Evaluate Learning S106 Learning DevCamp 2019
 
Megan Torrance - Day Hikes with xAPI #xapicamp
Megan Torrance - Day Hikes with xAPI #xapicampMegan Torrance - Day Hikes with xAPI #xapicamp
Megan Torrance - Day Hikes with xAPI #xapicamp
 
Improving Organizational Performance using the Experience API
Improving Organizational Performance using the Experience APIImproving Organizational Performance using the Experience API
Improving Organizational Performance using the Experience API
 
Day Hikes in the xAPI
Day Hikes in the xAPIDay Hikes in the xAPI
Day Hikes in the xAPI
 
Overcoming Resistance - How to Engage Developers in Agile Adoption
Overcoming Resistance - How to Engage Developers in Agile AdoptionOvercoming Resistance - How to Engage Developers in Agile Adoption
Overcoming Resistance - How to Engage Developers in Agile Adoption
 
LEAP Approach Book (Read-Only)
LEAP Approach Book (Read-Only)LEAP Approach Book (Read-Only)
LEAP Approach Book (Read-Only)
 
Unleash your potential
Unleash your potentialUnleash your potential
Unleash your potential
 
Follow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about AgileFollow the Money - How to Speak to Executives about Agile
Follow the Money - How to Speak to Executives about Agile
 
Putting the Pieces Together: Game-Based Learning in the Workplace
Putting the Pieces Together: Game-Based Learning in the WorkplacePutting the Pieces Together: Game-Based Learning in the Workplace
Putting the Pieces Together: Game-Based Learning in the Workplace
 
How to coach people for maximum performance
How to coach people for maximum performanceHow to coach people for maximum performance
How to coach people for maximum performance
 
From Flat to Interactive in No Time - Create Online Educational Content Using...
From Flat to Interactive in No Time - Create Online Educational Content Using...From Flat to Interactive in No Time - Create Online Educational Content Using...
From Flat to Interactive in No Time - Create Online Educational Content Using...
 
E-Learning: Moving Beyond the Webinar to Truly Engaging Education
E-Learning: Moving Beyond the Webinar to Truly Engaging EducationE-Learning: Moving Beyond the Webinar to Truly Engaging Education
E-Learning: Moving Beyond the Webinar to Truly Engaging Education
 
MVP Types, Tools and Social Impact
MVP Types, Tools and Social ImpactMVP Types, Tools and Social Impact
MVP Types, Tools and Social Impact
 
Creating a competitive training plan
Creating a competitive training plan Creating a competitive training plan
Creating a competitive training plan
 
Career clarity and your next steps, 2 March 2022
Career clarity and your next steps, 2 March 2022Career clarity and your next steps, 2 March 2022
Career clarity and your next steps, 2 March 2022
 

Mehr von Megan Bowe

Mehr von Megan Bowe (20)

A Viable Process Model for Learning Analytics
A Viable Process Model for Learning AnalyticsA Viable Process Model for Learning Analytics
A Viable Process Model for Learning Analytics
 
Work Together, Better: Content Authoring and Publishing for Teams
Work Together, Better: Content Authoring and Publishing for TeamsWork Together, Better: Content Authoring and Publishing for Teams
Work Together, Better: Content Authoring and Publishing for Teams
 
Identifying Competency Gaps
Identifying Competency GapsIdentifying Competency Gaps
Identifying Competency Gaps
 
xAPI State of the State: xAPI for Reals
xAPI State of the State: xAPI for RealsxAPI State of the State: xAPI for Reals
xAPI State of the State: xAPI for Reals
 
xAPI and the Evolving Learning Ecosystem
xAPI and the Evolving Learning EcosystemxAPI and the Evolving Learning Ecosystem
xAPI and the Evolving Learning Ecosystem
 
Intro to xAPI Camp DevLearn 2018
Intro to xAPI Camp DevLearn 2018Intro to xAPI Camp DevLearn 2018
Intro to xAPI Camp DevLearn 2018
 
Immersive Learning with xAPI
Immersive Learning with xAPI Immersive Learning with xAPI
Immersive Learning with xAPI
 
Designing real world activities with xAPI
Designing real world activities with xAPIDesigning real world activities with xAPI
Designing real world activities with xAPI
 
Thoughts on humanity, technology, and community
Thoughts on humanity, technology, and communityThoughts on humanity, technology, and community
Thoughts on humanity, technology, and community
 
It's Time to do Learning Like Grown-ups: Content Systems
It's Time to do Learning Like Grown-ups: Content SystemsIt's Time to do Learning Like Grown-ups: Content Systems
It's Time to do Learning Like Grown-ups: Content Systems
 
Data Strategy and xAPI
Data Strategy and xAPI Data Strategy and xAPI
Data Strategy and xAPI
 
xAPI for Vets and Pets: Embarking on an Incredible Journey
xAPI for Vets and Pets: Embarking on an Incredible JourneyxAPI for Vets and Pets: Embarking on an Incredible Journey
xAPI for Vets and Pets: Embarking on an Incredible Journey
 
Data Interoperability for Learning Analytics and Lifelong Learning
Data Interoperability for Learning Analytics and Lifelong LearningData Interoperability for Learning Analytics and Lifelong Learning
Data Interoperability for Learning Analytics and Lifelong Learning
 
Jessie's Verbs
Jessie's VerbsJessie's Verbs
Jessie's Verbs
 
Riptide Learning Case Studies
Riptide Learning Case StudiesRiptide Learning Case Studies
Riptide Learning Case Studies
 
xAPI: The Landscape
xAPI: The LandscapexAPI: The Landscape
xAPI: The Landscape
 
Real World Solutions Leveraging xAPI
Real World Solutions Leveraging xAPIReal World Solutions Leveraging xAPI
Real World Solutions Leveraging xAPI
 
A Path from Training to Proficiency
A Path from Training to ProficiencyA Path from Training to Proficiency
A Path from Training to Proficiency
 
State of the State: Authoring Tools
State of the State: Authoring ToolsState of the State: Authoring Tools
State of the State: Authoring Tools
 
xAPI: The Landscape
xAPI: The LandscapexAPI: The Landscape
xAPI: The Landscape
 

Kürzlich hochgeladen

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 

Data Rules: Unmeasured Learning's Day Off

Hinweis der Redaktion

  1. Can get a lot of it very easily xAPI gives us more. But why? What can we do with xAPI “We can track people”
  2. Can get a lot of it very easily xAPI gives us more. But why? What can we do with xAPI “We can track people”
  3. Lesson – keep exploring – and – a little extra data goes a long way
  4. When we saw the reply rates, I wondered if that translated to improved completion rates…not really, but we learned something new
  5. IHG comment popularity – it wasn’t just what people were looking at, it’s what they were discussing QUALITATIVE
  6. It’s not just counts – it’s what those counts mean IHG – Business insights, regional concerns what content is meeting needs DfD – Diff roles like diff types of content – and it didn’t fall out how we anticipated.
  7. Power of Context– we saw that in IHG, we also see that here.
  8. Power of Context– we saw that in IHG, we also see that here. Everything in this preso was done with spreadsheets…
  9. Text analytics Recommenders Learning Paths