Read this presentation to know :
ROI Comparison of Traditional Training vs. eLearning
How to calculate ROI on your training model
What usage can be expected from eLearning
How to reduce scrap learning
Visit www.24x7learning.com/resources.html To download the presentation
Or
Write to vinita.tyagi@24x7learning.com if you want a copy of this presentation
Connect to Us:
Facebook: facebook.com/24x7LearningIndia
Twitter: twitter.com/24x7learning
LinkedIn: lnkd.in/6qD2pY
In these days of tight budgets training is one of the first areas to come under pressure for cost cutting. Often this is a short term view as good training often contributes to the bottom line. In some industries training is mandated so companies are looking at getting the “Best Value” out of training. We must persuade senior management that training is value for money, and to look at the best method of achieving a training goal we must look at the Return on Investment or ROI. For some items, working out ROI is simple, for example, for mandated training is it more cost effective to use Instructor Led Training (ILT) or online eLearning? Unfortunately often we need to justify new training and measuring the return on this investment may be difficult, for example how do you give a monetary value to customer satisfaction? ROI is defined in the accounting discipline as earnings per dollar of investment. An ROI evaluation compares solution cost to the monetary benefits that result from the learning solution. Therefore, ROI enables an organization to determine if the solution breaks even or contributes to the bottom line. An ROI of 25 percent means that the investment cost is covered and an additional 25 percent of the investment is returned as earnings. In other words, for each dollar ($1.00) of investment, 25 cents ($0.25) is returned as earnings. An ROI of zero percent means that the investment breaks even.
eLearning saves time without decaying learning benefits Many independent studies have found that Technology Based Training (TBT) yield time savings of 35-45% over traditional classroom instruction while obtaining equivalent or better gains in learning retention and knowledge transfer. The amount of reduction in time ranged from 20-80% with 40-60% being the most common range for time saving. > eLearning minimizes travel costs As corporations become more global, the cost of moving and housing employees will only increase. But there is still hope. Numerous studies have shown that e-learning can minimize the travel and entertainment cost associated with training employees by at least 50%. > eLearning is cost effective The cost of developing multimedia training is significantly higher than creating custom classroom instruction. It is not uncommon for development costs for multimedia to be four times that of traditional classroom instruction. This is obviously not cost effective for small class size. But as the number of employees goes up, the cost per employee is dramatically reduced. This is the cost efficiency of e-learning; it can reach more people in a shorter amount of time than traditional learning. If this cost is spread out even further by purchasing off the self multimedia training on a "per head" basis the total cost is significantly lower than traditional instruction. > eLearning can better meet the needs of geographically dispersed employees eLearning is flexible. It is self-paced and can occur any time and any place. As such, it is ideally suited for training employees who are dispersed globally. eLearning is easily modified (especially web delivered content) thus making it more adaptable for translation and change of content for different cultures and languages. > eLearning provides more consistent course delivery The instructor can review, edit and re-edit their presentation until it is just right. In addition no matter how many times the class or learning module is presented it will not change or vary. Each employee will get exactly the same material no matter when they take the course. This leads to very consistent delivery of material that is not possible in a traditional classroom approach. Today, organizations are making investments in e-learning solutions with the expectation that these solutions will have a measurable impact on their performance by achieving specific business outcomes. While the most obvious impact of e-learning on ROI is the significant cost savings it can produce over traditional training, more significant impact on ROI can be achieved as a consequence of e-learning. Therefore, e-learning is not only faster and less expensive than classroom training but also more effective.
As you all know, the training process starts with training, needs identification; once these needs are identified, collated, categorized and summarized, then the prioritization of training needs is decided. Then for each program, one has to set learning objectives, which are measurable. This is followed by designing and developing training program, and delivering the training interventions, whether, it’s a classroom or eLearning mode. Finally we come to the evaluation step of the process where, we try to evaluate how much and to what extent did the training achieve the results that it set itself for.
Formula 1: ROI: The Costs were X; the Benefits were Y Give Management information and let them make an intelligent comparison; the math obscures the magnitude and importance of the numbers in the ROI calculation Formula 2: ROI = Benefits – Costs Subtracting costs from benefits gives a simple number, while keeping the magnitude of the numbers in front of Management Formula 3: ROI = Benefits Costs Give Management a ratio; it’s what they are used to seeing – like Return on Assets and Return on Sales calculations Formula 4: ROI = Benefits-Costs Costs Give a ratio, but use both formulas 2 and 3 to deflate the ROI so it does not make us look like we want too much credit
Data Collection A central challenge of the ROI process is data collection—selecting the most appropriate method(s) and the time table for gathering outcomes data at each evaluation level. Depending on the nature of the training program, hard data (representing output, quality, cost, and time) or soft data (customer satisfaction and job satisfaction) may be collected in the course of the evaluation. The following are some of the key data collection methods employed in the Phillips/Kirkpatrick approaches. Follow-up surveys and questionnaires to measure stakeholder satisfaction and reaction On-the-job observation to gauge application and use Tests and assessments to assess learning Interviews to record participant reaction and program implementation Focus groups to assess job application of the program Action plans to encourage application and record participants’ progress and impact realized Business performance monitoring of performance records or operational data to identify improvement
Let ’ s look at some examples of performance indicators – process measures and hard indicators – outcome measures
One of the most critical steps in a training evaluation is Isolation. Many other factors (e.g., marketing programs, employee bonus programs, etc.) can impact business outcomes after a new program is implemented. From the standpoint of credibility, therefore, it is important to use one or more isolation strategies to separate the business impact of the training program from the impact of other factors. The following are some of the most often used isolation techniques:
Control Groups: The outcomes of pilot group of participants in a program are compared with the outcomes of a control group of participants who are not participating in the program. This is the most effective way to isolate training’s impact.
ƒ Trend lines: Trend lines are commonly used to project expected business impact data into the future. Such projections are compared with the actual data after a major corporate program or initiative has been implemented to determine if the training has yielded improvement.
Participants/stakeholders estimates: Participants are asked to estimate the amount of improvement directly related to a training or HR program. Because participants have received the training and are personally involved in applying the new skills and knowledge to the workplace, they are often in the best position to assess training’s relative impact.
Converting Data to Monetary Values In order to calculate the ROI, the data collected in a Level 4 evaluation is converted to monetary values and compared to program costs. To do this, a value must be placed on each unit of improvement (output measure) impacted by the training program. Increases in output measures (increased sales, units produced, etc.) are converted to monetary values based on their unit contribution to profit. Often standard values are available for such measures in most organizations. There are several alternative ways to arrive at monetary value such as converting the value of quality improvements or using participants’ wages in those situations where the training has resulted in saving employee time
Considerations: While all measures can be converted to money, several factors should be considered. One factor is the cost to convert the measure. You don't want to spend more on data conversion than the evaluation itself. Importance of the measure is another consideration. Some measures, such as customer satisfaction and employee satisfaction, stand alone quite well. In that case, you might think twice before attempting to convert the measure to money. Also consider credibility. While most business decisions are made on somewhat subjective data, the source of the data, the perceived bias behind the data, and the motive in presenting the results are all concerns when data is potentially questionable.
Tabulating Program Costs In order to calculate the Benefit/Cost and the ROI, all of the costs involved in the program must be tabulated. Among the typical cost components of training programs that should be included are the needs assessment, cost to design and develop the program, the cost of all program materials provided to each participant, travel and accommodation, and the fully loaded salaries (i.e., salaries plus benefits) of participants and facilitators.
Intangible Benefits In addition to monetary benefits, most training programs will have intangible, nonmonetary benefits. Intangibles are those measures that cannot easily be converted to monetary values. According to Phillips, “In some programs, such as interpersonal skills training, team development, leadership, communications training, and management development, the intangible (non monetary) benefits can be more important than tangible (monetary) measures. Consequently, these measures should be monitored and reported as part of the overall evaluation. In practice, every project or program, regardless of its nature, scope, and content will have intangible measures associated with it. The challenge is to efficiently identify and report them.” (Phillips 2003) Page | 8 Typical intangible variables include items such as Stress reduction Employee engagement Grievance reduction Improved customer satisfaction Complaint reduction Conflict reduction/avoidance
Each organization must develop its own path for a learning strategy by reflecting on their business objectives and organizational culture. Every organization’s learning journey is as unique as the organization itself. That said, clients often ask SkillSoft what kind of usage they can expect to see from e-learning — whether it is to understand how many licenses they will need to start an e-learning program, or as a way to gauge “what’s normal” in a program that has been installed for years. With our experience helping thousands of clients implement e-learning programs, we have developed a good understanding of the factors that contribute to usage and other measures of success. This experience forms the basis for the SkillSoft Learning Growth Model® (LGM), a maturity framework that helps clients understand what to expect when implementing an e-learning program. The LGM breaks learning maturity into five distinct phases that progress from the most basic and tactical implementations to the most advanced enterprise learning approaches. Each phase has a unique set of indicators. Clients can compare their own situation to the indicators of each phase to determine where they stand in relation
Phase 1: Initiate Learning The first phase is entered when an organization introduces e-learning for the first time. The goals at this phase are typically to address learning needs that can’t be met by traditional (classroom) methods, as well as cost reduction. The L&D group is typically focused on introducing this new learning modality to employees and building awareness of its availability. Phase 2: Manage Learning In Phase 2 organizations have begun to recognize the benefits of e-learning and start expanding its use within the organization, making it available to more employees on more topics. Blended learning programs are implemented and redundant learning content is eliminated. The L&D group is becoming more capable of measuring the results and learners are beginning to demand/expect more types of learning content. Phase 3: Align Learning This phase begins when learning is recognized as a strategic tool and applied to targeted job competencies within key organizational roles, such as sales, customer services, and IT. More complex blends and systems are implemented. This also marks the point where the L&D group gains a stronger voice within the organization and obtains key executive sponsors. Phase 4: Integrate Learning In Phase 4 the organization provides the necessary infrastructure and resources required to expand e-learning access to all employees, and a strong cultural value is placed on learning. This may include investment in a more robust learning management system, authoring and rapid development tools, web collaboration platform and more. This stage often requires significant integration efforts, as learning becomes part of the everyday flow of work. Phase 5: Enterprise-Wide Learning Phase 5 of growth is entered when all levels of management are committed to ongoing and comprehensive e-learning programs that are linked to the organization’s business and human capital goals. Learning is made part of the daily flow of work, and learners are just as comfortable accessing learning assets as they are using email or the Internet. A wide variety of e-learning and performance support resources are made available, and the value of having these resources is understood at all levels. LGM indicators as a predictor of usage One can look at the indicators of the LGM as a diagnostic way to gauge what kind of adoption of e-learning may take effect within an organization. The process is actually quite simple: 1. Review the descriptions of the following LGM indicators within each of the five stages: • Business Drivers for Learning • Business Case for Learning • Learning & Development Department’s Role • Blended Learning Design • Marketing of Learning • Evaluation of Learning 2. Identify the indicator descriptions that most closely resemble your organization. Note which LGM stage they align to. Keep in mind that you should select the description that most accurately reflects your overall corporate learning program, not the characteristics of one learning curriculum or initiative. 3. Determine which stage is noted most frequently. For example, you may find that your organization reflects indicator descriptions that are mostly aligned to stage three because four out of the six descriptions align to stage three. There may be instances where your learning program resembles one or two descriptors from another stage, but in this exercise you want to try to identify the stage that most closely describes your current program. Once you have identified the LGM stage that most closely aligns to the profile of your learning program, you will be able to see what kind of usage to expect. So, if your learning program closely fits the characteristics of stage three, then you can anticipate approximately 60% adoption within your connected employee base.
Scrap learning—learning which is successfully delivered but not applied on the job—comes with high costs. When your employees can’t put what they’ve learned into practice, you’ve wasted effort, time, and money. Dr. Robert Brinkerhoff, an expert in training evaluation, estimates that scrap learning rates can be as high as 50%-80% of all learning delivered.1 “ No company could stay in business if its other processes were as inefficient as most learning and development programs seem to be,” says King. Fortunately, you can take action to ensure learning gets applied successfully, maximizing your return on investment.
1. Embed learning into the workflow Since 70-80% of learning occurs on the job, it stands to reason that learning should integrate seamlessly into one’s daily work. “Don’t solely rely on learners consciously making a decision to learn and find what they need,” King cautions. In addition to making learning available via a corporate learning management system (LMS), she advocates blending relevant learning into the workflow through business applications, SharePoint, intranets, and email. Learning must fit an employee’s schedule—breaking information into manageable chunks makes it more accessible and efficient. A short learning asset covering highly relevant content, available at the moment of need, offers a better investment than a longer learning experience with limited relevance. 2. Ensure quality content The first step in providing quality content: look for current content from credible sources. Next, examine the instructional design—your content should draw on adult learning principles. It should be performance-oriented and accommodate a variety of different learning styles and preferences. Sound instructional design includes observation, modeling, interactivity, assessment and practice. Dr. John R. Mattox II, director of research for KnowledgeAdvisors, stresses the importance of appropriate technology. “Learners are getting more savvy with higher expectations of quality. Learners will not suffer through pages and pages of text when interactive options are available,” he said.2 Videos, summaries, simulations, audio books, and e-learning courses can be as effective—or more effective—than instructor-led training. 3. Reinforce learning In the late 1880s, psychologist Hermann Ebbinghaus discovered that reinforcing training improves retention. He also observed that as the gap between training and practice or recall increases, so does the amount people forget. Nearly 125 years later, learning professionals still struggle to help workers retain what they have learned: this demands a shift away from the “one-and-done” or training as an event mindset. Work with employees to develop a learning plan so they have identified resources that complement and reinforce what they’ve learned. Spread refreshers across the days and weeks immediately following the training. 4. Align learning to business objectives Business-aligned learning requires an understanding of the organization’s objectives. “Learning solutions arise when a business driver calls for a certain type of performance. By partnering with business stakeholders to define performance expectations, learning professionals can translate performance criteria to a set of competencies or skills,” King says. She tells L&D professionals when they meet with stakeholders to plan training, the key question to consider is, “What are the business needs that you are seeking to impact?” not “What training needs to take place?” Once you’ve determined the business need, you can define the necessary performance requirements, align a learning solution and set goals to measure the impact. Consider what kinds of skills employees need to develop in order to achieve the desired performance, as well as the learning modalities and delivery methods that best suit the target audience. 5. Enlist greater manager support Managers should set expectations for training before it happens, detailing why the employee is getting training, the changes that should take place, and how training will be applied on the job. It is also recommended managers should evaluate each employee’s readiness for training—the person should have the appropriate knowledge and skills to draw value from the planned training. Post-training, managers should follow up with employees to ask what knowledge and skills they gained. Assigning projects that allow employees to reinforce those skills and recognizing performance changes have a powerful impact on reducing scrap learning.