Employees are demanding more continuous and varied approaches to learning, but many L&D organizations struggle to keep up. One big reason: a lot of that informal learning happens on the open web, inside mobile apps, and in real life – not in an LMS. This means that L&D teams aren’t getting the whole picture. And without it, they’ll have an increasingly difficult time connecting learning to business results. Learn how CUES is using Tin Can API (xAPI) to plug L&D back into learning, and in the process plug learning back in to business results. In this webinar, we’ll discuss: *New types of learning methods and technologies for continuous learning *The Learning Tech Stack and why a cohesive one is important *How CUES empowers continuous learning for their members Presenters that you'll hear from on this webinar: * Dani Johnson, Research Manager, Bersin by Deloitte, Deloitte Consulting LLP * Wendy Wang-Audia, Sr. Research Analyst, Bersin by Deloitte, Deloitte Consulting LLP * Mike Rustici, President, Rustici Software * Christopher Stephenson, VP/Professional Development and Innovation, CUES

1. Empowering
Continuous Learning
with Tin Can (xAPI)
Dani Johnson, VP, L&D Research
Bersin by Deloitte, Deloitte Consulting LLP
Wendy Wang-Audia, Senior Research Analyst
Bersin by Deloitte, Deloitte Consulting LLP
Mike Rustici, President, Rustici Software
Christopher Stevenson, VP, Professional
Development and Innovation, CUES
June 2, 2015

2. Copyright © 2015 Deloitte Development LLC. All rights reserved.1 Empowering Continuous Learning with xAPI
Contents
Who we are
Global provider of leading practices, trends, and benchmarking research in talent
management, learning, and strategic HR.
6 research practices
• Human Resources
• Leadership Development
• Learning & Development
• Talent Acquisition
• Talent Management
• Tools & Technology
Offerings
• WhatWorks® Membership: Research, Tools, Education, Consulting
• IMPACT: The industry’s leading conference on the Business of Talent
• Advisory Services & Consulting
Human
Resources
Talent
Acquisition
Leadership
Development
Learning &
Development
Talent
Management
Tools &
Technology

3. Copyright © 2015 Deloitte Development LLC. All rights reserved.2 Empowering Continuous Learning with xAPI
Continuous learning
Tracking continuous learning
Tin Can API (xAPI)
CUES Story
Agenda

4. Copyright © 2015 Deloitte Development LLC. All rights reserved.3 Empowering Continuous Learning with xAPI
66% of L&D professionals surveyed have trouble
engaging learners with corporate learning.

5. Copyright © 2015 Deloitte Development LLC. All rights reserved.4 Empowering Continuous Learning with xAPI
Continuous Learning Model
Immediate
Performance support and other tools for point-of-
need learning
Q. WHAT DO I NEED TO SUPPORT MY SUCCESS
IN THE MOMENT?
Q. WHAT DO I NEED TO GROW IN
MY CURRENT ROLE?
Q. WHAT DO I NEED TO GROW IN MY CAREER?
Intermediate
Current job development and competency expansion
Transitional
Development of skills and relationships that will help
meet long-term business goals
Source: Bersin by Deloitte, 2014

6. Copyright © 2015 Deloitte Development LLC. All rights reserved.5 Empowering Continuous Learning with xAPI
Source: Bersin by Deloitte, 2015

7. Copyright © 2015 Deloitte Development LLC. All rights reserved.6 Empowering Continuous Learning with xAPI
Learning Tech Stack
Source: Bersin by Deloitte, 2015

8. Tracking Data for Continuous Learning

9. Copyright © 2015 Deloitte Development LLC. All rights reserved.8 Empowering Continuous Learning with xAPI
Consistently tracked learning activities
97%
72%
57%
14%
Instructor-led training
(e.g. classrooms,
workshops,
seminars)
Self-directed e-
learning courses /
modules
Virtual instructor-led
training / webinars
Informal learning
resources (e.g. blogs,
articles, YouTube,
Wikipedia, etc.)
Source: High-Impact Learning Measurement Study, Bersin by Deloitte, 2014

10. Copyright © 2015 Deloitte Development LLC. All rights reserved.9 Empowering Continuous Learning with xAPI
Challenges to measurement
Source: High-Impact Learning Measurement Study, Bersin by Deloitte, 2014
62%
59%
56%
50%Difficulty capturing data from informal
learning activities, mobiles devices/apps, etc.
Inadequate tools for reporting / analyzing data
Difficulty connecting learning to business outcomes
Lack of integration between LMS and related
systems (e.g. assessments, HRIS, TMS, or CRM)

11. Copyright © 2015 Deloitte Development LLC. All rights reserved.10 Empowering Continuous Learning with xAPI
Most Useful Tools
75%
61%
Standard office tools
General-purpose survey tools
Source: High-Impact Learning Measurement Study, Bersin by Deloitte, 2014
General-Purpose Tools
Standard LMS reports / analytics
64%
58%
Custom LMS reports / dashboards

12. Mike Rustici
President, Rustici Software
Mike.Rustici@WatershedLRS.com
@Mike_Rustici

13. The World Today:
The monolithic LMS
vs

14. What does the new
learning ecosystem look like?
LRS

15. What is ?

16. A shared language for two systems
to talk about the things that
a person does.

17. A two party system
Activity
Provider LRS

18. Making sense of all this data

19. This technology allows you to
learn things about your
organization that you never
thought possible.

21. Give modern learners the
continuous learning
environment they demand and
tie learning and training to real
business results.

22. How do I get started?

23. Empowering Member Learning

24. About CUES
CUES is a Madison, Wisconsin-based,
independent, not-for-profit, international
membership association for credit union
executives.
Its mission is to educate and develop credit
union CEOs, directors, and future leaders.

25. What We Do
• Member base of 13,000
credit union staff and
board members across
the United States,
Canada, and the
Caribbean
• Wide range of content
across channels
– Online
– Print
– Conferences, meetings,
and executive education
– Distance learning

26. The Business Challenge
Member Engagement

27. CUES offered online
learning with an
integrated LMS, but only a
small percentage of
members engaged in the
courses. Most member
activity could not be
tracked or reported.

30. Tin Can API
• Retrofit cues.org to track learning
– CCUBE
– Credit Union Management magazine
– Online courses
– Research library
– Online videos
• Tracks classroom and informal learning

31. Bookmarklet

33. Reporting: Most Active Learners

34. Popular Content

35. Content Delivery Preferences

36. Learning Paths

37. • Motivation
• Accountability
• Regulatory reporting
• Certification
Benefits to Members

38. • Flexibility
• Analytics
– Content development
– Sources of learning
• Tracking--simplifies
certification process
• Member engagement
Benefits to CUES

39. Copyright © 2015 Deloitte Development LLC. All rights reserved.38 Empowering Continuous Learning with xAPI
Poll / Q & A

40. Copyright © 2015 Deloitte Development LLC. All rights reserved.39 Empowering Continuous Learning with xAPI
Dani Johnson, VP of L&D Research
Bersin by Deloitte, Deloitte Consulting LLP
danjohnson@deloitte.com, @danij2
Wendy Wang-Audia, Senior Research Analyst
Bersin by Deloitte, Deloitte Consulting LLP
mwangaudia@deloitte.com
Mike Rustici, President
Rustici Software
mike.rustici@watershedLRS.com, @mike_rustici
Christopher Stevenson, VP / Professional Development and Innovation
CUES
christopher@cues.org

41. About Deloitte
As used in this document, “Deloitte” means Deloitte Consulting LLP, a subsidiary of Deloitte LLP. Please see www.deloitte.com/us/about for
a detailed description of the legal structure of Deloitte LLP and its subsidiaries. Certain services may not be available to attest clients under
the rules and regulations of public accounting.
This publication contains general information only and Deloitte is not, by means of this publication, rendering accounting, business, financial,
investment, legal, tax, or other professional advice or services. This publication is not a substitute for such professional advice or services,
nor should it be used as a basis for any decision or action that may affect your business. Before making any decision or taking any action
that may affect your business, you should consult a qualified professional advisor. Deloitte shall not be responsible for any loss sustained by
any person who relies on this publication.
Copyright © 2015 Deloitte Development LLC. All rights reserved.
Member of Deloitte Touche Tohmatsu Limited