Recommended
More Related Content
What's hot
What's hot (20)
Similar to Revised AUPHA presentation June25, 2009
Similar to Revised AUPHA presentation June25, 2009 (20)
Revised AUPHA presentation June25, 2009
- 1. 2009 Annual Meeting A CHANGE MANAGEMENT SIMULATION SCHOOL OF HEALTH SERVICES MANAGEMENT RYERSON UNIVERSITY Winston Isaac PhD, CHE Jake Pringle MBA, DC PriaNippak PhD
- 2. AGENDA Background 1 2 Why a Simulation? 3 Pedagogical Evidence for Simulations 4 THE SIMULATION – EXPERIENCEPOINT Central-Valleyview | ExperienceChange Objective 5 6 Methodology 7 Results 8 Limitations 9 Discussion Conclusion 10 Questions 11
- 4. CHIM 300 (Managing Health Information Services)
- 5. Online Delivery through Blackboard
- 6. Section on Innovation and Change Management
- 7. Past
- 8. Williams, Kondra, Vibert (2008). Management,(2nd Canadian Ed.) . Toronto: Ontario. Thomson-Nelson
- 10. 1 BACKGROUND Change http://www.youtube.com/v/P3-qfeCQvNA
- 11. 1 BACKGROUND SIMULATION? noun 1. imitation or enactment, as of something anticipated or in testing. 2. the act or process of pretending; feigning. 3. an assumption or imitation of a particular appearance or form; counterfeit; sham. 4. Psychiatry. a conscious attempt to feign some mental or physical disorder to escape punishment or to gain a desired objective. 5. the representation of the behavior or characteristics of one system through the use of another system, esp. a computer program designed for the purpose. (simulation. (n.d.). Dictionary.com Unabridged (v 1.1). Retrieved June 17, 2009, from Dictionary.com website: http://dictionary.reference.com/browse/simulation)
- 12. 1 BACKGROUND CHANGE MANAGEMENT High Failure Rate (~60-70%) Failure Performance measures are not achieved
- 13. 1 BACKGROUND CHANGE MANAGEMENT Why important? The problem may not be a lack of knowledge but an inability to translate the knowledge into practice Remember – definition of simulation The representation of the behavior or characteristics of one system through the use of another system, esp. a computer program designed for the purpose. (simulation. (n.d.). Dictionary.com Unabridged (v 1.1). Retrieved June 17, 2009, from Dictionary.com website: http://dictionary.reference.com/browse/simulation)
- 14. 2 WHY A SIMULATION? A Simulation: Provides a safe platform for practice Provides an opportunity to test theory through application Provides a powerful alternative approach to complement and extend traditional teaching approaches in change management.
- 15. 3 PEDAGOGICAL EVIDENCE FOR SIMULATIONS AS AN EDUCATIONAL TOOL Multiple studies have evaluated the efficacy of simulations as an educational tool Two recent meta-analysis studies Vogel, J.F., Vogel, D.S., Cannon-Bowes, J., Bowes, C.A., Muse, K., & Wright, M. (2006). Computer Gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229-243 Ke, F. (2008). A qualitative meta-analysis of computer games as learning tools. In R. E. Ferdig (Ed.), Handbook of Research on Effective Electronic Gaming in Education (pp 1-32), New York: IGI Global.
- 18. 5 major themes
- 19. Evaluating the effects of computer-based game on learning (65 out of 89 studies)
- 20. Exploring effective instructional game design (17 out of 89)
- 21. Exploring game-based learning activities or pedagogy (9 our of 89)
- 22. Evaluating the influence of learner characteristics on game based learning process (10 out of 89)
- 23. Investigating cognitive or motivational processes during game playing (4 out of 89)3 PEDAGOGICAL EVIDENCE FOR SIMULATIONS AS AN EDUCATIONAL TOOL
- 26. Gender is the most examined and seems evenly split
- 27. Gender has an effect
- 28. Gender has no effectKe, Fengfeng (2008)
- 29. 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange ExperiencePoint Founded by James Chisholm and Greg Warman on August 6, 2006 “The best way to learn is through experience. We create experiences that enable people to practice decision-making in realistic situations, so they can perform in real situations”
- 30. 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange Leading Organizations Leading Educators
- 31. 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange Explore Primer on Change Player’s Guide
- 33. SIMULATION GOAL: Spearhead the process of re-structuring the Emergency department of the two hospitals Create an urgent care centre at the former Valleyview Emergency Expand the 24/7 full service Emergency at Central Emergency 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange
- 34. Essential Elements Stakeholder Analysis Planning Organize and choose Tactics which are grouped into 4 categories: Informational (Gather Tactics), Educational (Share Tactics), Social (Lead Tactics), and Structural (Organize Tactics), Resources Cost and time allocated to each tactic. Implement 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange
- 35. 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange
- 36. ExperiencePoint trailer (2 minutes) 4 THE SIMULATION – EXPERIENCEPOINTCentral-Valleyview | ExperienceChange
- 37. 5 OBJECTIVE STUDY: What is the influence of repeat simulation testing on performance scores?
- 38. 6 METHODOLOGY Sample: 2 groups of students Group 1: Basic Instructions (12 females, 4 males) Group 2: Advanced Instructions (10 females, 4 males) Instrument EXPERIENCEPOINT simulation:Central-Valleyview | ExperienceChange Simulation
- 39. 6 METHODOLOGY Procedures: Students performed the simulation twice within seven days Group 1: were given standard instructions Group 2: were given the same instructions a Group 1 plus additional instructions created by the instructor
- 41. BIG HINT #1: You may benefit from reviewing the change management primer found within the 'Explore' section of ExperienceChange. Success in the simulation depends upon how well you apply the primer's 'staged approach to change'.
- 42. BIG HINT #2: The simulation is tough. Really tough (fewer than 20% of players succeed the first time through). If you find that you are struggling, think back to the staged model - maybe you've missed a step. Once you are done, check out the 'Reflect' section of ExperienceChange to see where you could improve and play again! 6 METHODOLOGY
- 43. 6 METHODOLOGY Instructors Instructions (Group 2): Same instructions as Group 1 PLUS Complete Stakeholder analysis FIRST and review feedback before proceeding Choose Tactics appropriately to fit Change Process outlined in Primer Pay attention to available resources – cost and time
- 44. Statistical Analysis A repeated measures ANOVA examining the influence of Gender and Instruction on two dependent measures Conversion Score Session Score No effect of Instruction was observed Two groups were collapsed 6 METHODOLOGY
- 45. 7 RESULTS: Conversion Score Effect
- 46. 7 RESULTS: Session Score Effect
- 47. 7 RESULTS
- 48. 7 RESULTS
- 49. 7 RESULTS: Conversion Score Effect for Group 2 Note: Only Group 2 was required to complete 3 simulation trials.
- 50. 7 RESULTS: Session Effect for Group 2 Note: Only Group 2 was required to complete 3 simulation trials.
- 53. Some subjects failed to complete the simulation twice (N = 2)
- 54. No verification that students read the additional instructions
- 55. No idea if knowledge was transferable beyond the simulation
- 56. Evaluate student knowledge using another measurement
- 57. Expose students to another simulation and assess for improved performance
- 58. Did not examine the influence of gaming capabilities as a tertiary factor8 LIMITATIONS
- 59. 9 DISCUSSION Change is Good: http://www.changeisgoodmovie.com
- 61. Our study demonstrated that when delivering a simulation in an online environment, students should be required to run through the simulation at least twice to achieve targeted scores.
- 64. Not significant in the current study, but scores were lower in the standard group
- 65. Variability may have accounted for the absence of an effect
- 66. Ensure that the delivery method can be verified
- 67. Provide another method of Change Management Evaluation
- 68. Ensures translation of Knowledge
- 69. Provide a forum to apply the Change Management Principles
- 70. Ensures generalized application of simulation learning objectives9 DISCUSSION
- 71. 10 CONCLUSION Simulations should be considered a valuable experiential tool for increasing motivation and learning outcomes when teaching change management.
- 73. 11 QUESTIONS?
- 74. 2009 Annual Meeting A CHANGE MANAGEMENT SIMULATION SCHOOL OF HEALTH SERVICES MANAGEMENT RYERSON UNIVERSITY Winston Isaac PhD, CHE: wisaac@ryerson.ca Jake Pringle MBA, DC: pringle@ryerson.ca PriaNippak PhD: pnippak@ryerson.ca
Editor's Notes
- Winston – Welcome and Introductions
- Jake – Brief review of agendaRemind people that not an expert on simulations
- JakeManaging health Information ServicesGeneral Management Course (Leadership, Teamwork, Decision Making, Strategy etc ) includes section on Innovation and Change ManagementFully On-Line using Blackboard Text Management – by Williams Kondra and Vibert
- Too much readingLack of understanding of complexity of managing change and how the concepts discussed in the textbook fit into a real world context that they can understand.Some wrote their final paper on Change Management – clearly did not have a good appreciation for the complexity of Change process and failure rate and potential problems
- JakeKevinValdarasFerris Bueller
- Pay attention to last part
- JakeGenerally Accepted to be ~ 60-70%Management Firm Bain and Company completed a recent survey of companies that had initiated large scale change project - 70% did not deliver expected results and this has remained unchanged from similar surveys in the 1980s and 1990sExample:In Toronto – in 1996 the Health services Restructuring commission initiated the changes that resulted in restructuring and some hospital mergers – due to the idea that it would reduce many redundancies and lead to greater efficiencies. In 1997 it released its plan for the city and called for the closing of eleven of forty-two hospital in this city and the amalgamation of others. Cost 123,000,000. Three years later the HSRC was disbanded. merger and demerger of Sunnybrook Health Sciences Centre and Women’s College Hospital-. Looked good on paper but in 2004/2005 the process to demerge the hospitals began. St. Michaels Hospital and Wellesley Hospital
- All this talk about change and focus is often on the efficiencies and dollar saved – forgetting the complexity of people and different organizational cultures and how this impacts on theory and plays out in the real world.
- Remember – I am not an expert on Simulations.
- Clear objective – was to evaluate the studies currently in the literature and get a better sense on whether traditional instruction or games and interactive simulations were better teaching methods.Examined 248 studies – 32 met the requirements for inclusion That they had a hypothesis that identified cognitive gains or attitudinal changes That they reported statistics assessing traditional classroom versus computer gaming and interactive simulationsA computer game is defined as activity that has goals, is interactive and is rewarding (gives feedback)An interactive simulation must interact with the user by offering the options to choose or define parameters of the simulation then observe the newly created sequence rather than simply selecting a prerecorded simulation.Findings that overall significantly higher cognitive gains were observed in subjects utilizing interactive simulations or games versus traditional teaching methods (Z=6.051, p<.0001 (N=8549)
- Objective was to inform policy What is the cumulative quantitative and qualitative evidence for using computer games for learning? What are the factors, if any that weigh in the effective application of instructional gamingGaming – a game is defined as being separate from a simulation in that a game involves competition and does not necessarily require two or more participants. If a Simulation enables a learner to compete against him or herself by comparing scores over successive attempts at the simulation or has a game structure imposed on the system, it is regarded as a game mode. If the focus of a simulation involves the completion of an event only (no score!), the simulation will not be considered a game.600 research reports or articles within the category of computer games in the literature. - content relevance – research focused on the design or applicaton of computer-based games for learning purpose - Year of publication was 1985-2007 - English language publicationsA total of 256 document on the design, use and evaluation of computer-based games were reviewed. - Of these, 167 could not be included in the analysis for a variety of reasons.Leaving - 89 research articles were included in the analysisAuthor conducted a qualitative meta analysis and found 5 major themes. Two of which are relevant to what we are looking at
- 34 out of 65 game effectiveness studies reported significantly positive effects of computer-based games17 reported mixed results (instructional games facilitated certain learning outcomes but not others)12 reported no difference between computer games and conventional instruction1 reported conventional instruction as more effective than computer games.
- Only 10 out of 89 studies looked at learner characteristics and gender was the most examinedThe studies that reported gender difference were qualitative in natureThe studies that reported no gender difference were experimental and comparative.
- Many organizations use the simulations by experience point and they have more than healthcare.Decision Making simulations regarding recognizing decision making biasesChange management for a Global tech companyChange management where they implement lean practices in a hospital emergency roomChange management where they implement holistic corporate social responsibility strategies for a global company Custom simulations
- Km to miles 1 kilometer = .62 milesSo 8 km is about 5 miles7km is about <4.5 miles4km is about 2.5 miles
- In general the main distinguishing feature of an Urgent Care Centre is that ist is not designated as a receiving centre for ambulance bound patients. Thus any patients being transported by ambulance will automatically be routed to an Emergency DepartmentThat doesn’t mean that an urgent care centre can’t handle cases which may develop into an emergency or life threatening clinical problemUrgent care centres are also typically only operate 12 -16 hours per day.
- Students must consider the positions, interests and advocacy efforts of a number of stakeholders who are affected by the Emergency restructuring. They will have the opportunity to interview some of these stakeholders in the simulation to learn more about their points of view. This is where they begin.
- This is the 7 stageexperiencechange model. They need to use this to develop their change plan that maximizes commitment and minimizes resistance to change.
- The first time I ran the simulation – I didn’t specify how many times they should run through the simulationHowever many ran through it more than once. What I noticed was a significant change in their scores if they ran through the simulation more than once.So in running the simulation this time I wanted to know how many times do they need to run through the simulation to score well on the simulation.