1. Mobile teaching and learning:Engaging students and measuring impact. ECAR Symposium 2010 Veronica Diaz, PhD Associate Director EDUCAUSE Learning Initiative

2. Download me! http://www.slideshare.net/drvdiaz/mecar2010

3. Agenda Mobility in the Horizon Report ELI 2010 focus session on mobile learning Community's findings Institutional examples of the potential of mobility in the areas of content delivery, student collaboration, and community building. Strategies and methodologies to help measure the impact of mobile tools on teaching and learning

4. question How many of your institutions or faculty members are involved in mobile learning in some way?

8. Mobility in Review

10. Mobility: 2005-2008

11. Mobility: 2009-2011

12. Gartner hype cycle model (ca. 1995)

13. Gartner hype cycle model (ca. 1995)

14. question How does the Horizon Report compare to what you’re seeing at your institutions?

15. ELI 2010 Online Spring Focus SessionMobile Learning 2.0: The Next Phase of Innovation in Mobility

16. Community’s Conclusions

17. Content Community Collaboration

18. Content Community Collaboration

19. Mobile technology is best suited for…

20. Tapping into the PLE

21. Content delivery is the low-hanging fruit

22. Innovation doesn’t always start in the classroom

23. Rapid growth in mobile applications and their interoperability with other tools

24. The new tool in the toolkit

25. Challenge of ownership patterns

26. Challenges Ownership patterns Costs Adoption Content delivery Time Beyond content and information delivery to engagement 26

27. question Ownership Variations Mobile Pedagogies Student Engagement

28. Mobility Examples

29. University of Utah’s Anatomy App More Info: http://www.unews.utah.edu/p/?r=092409-2

30. MARS - Mobile Augmented Reality Systems More Info: http://graphics.cs.columbia.edu/projects/mars/

31. http://www.wikitude.org/

32. Mobile Assessment: MOCA More Info: http://www.utexas.edu/academic/ctl/about/postcards/casestudy4_moca.pdf

33. Available at http://www.itap.purdue.edu/studio/

34. http://horizon.wiki.nmc.org/2011+Mobileshttp://www.delicious.com/tag/hz11+mobiles

35. http://www.delicious.com/tag/hz11+mobiles

36. Measuring the Impact

37. Review mobile technologies and ask… What would be the ramifications and opportunities for learning if this technology were adopted? What kinds of teaching and learning engagements might this technology: make better or enable? If we decide to do a pilot, what kind of evaluation methodology can we overlay on the project to assess outcomes? What kind of additional research needs to be done concerning this technology?

38. Join ELI as we Seek Evidence of Impact Advance evidence-based applications of learning innovation Encourage the teaching and learning community to explore new ways of gathering evidence

39. question What are some items you’d like to measure in evaluating your mobile learning initiatives?

40. Challenges and goals Source: https://lra.le.ac.uk/bitstream/2381/8162/3/%5B14%5DVavoulaSharples-mlearn2008%5B1%5D.pdf

41. Capturing learning context and learning across contexts Challenge 1

42. Has anyone learned anything yet? Challenge 2

43. An ethical question Challenge 3

44. The technology itself Challenge 4

45. The big picture Challenge 5

46. Formal vs informal Challenge 6

47. 5 recommendations Capture and analyselearning in context with consideration of learner privacy Assess the usability of the technology and how it affects the learning experience (PLE) Look beyond measurable cognitive gains into changes in the learning process and practice Consider organizational issues in the adoption of mobile learning practice and its integration with existing practices Span the lifecycle of the mobile learning innovation that is evaluated, from conception to full deployment and beyond

49. Comprehensive framework:usability, technical, functional Source: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.137.9318&rep=rep1&type=pdf

52. Thematic framework Source: http://www.scribd.com/doc/3115019/Traxler-Defining-Discussing-and-Evaluating-Mobile-Learning

53. Proportionate

54. Appropriate to the specific learning technologies, to the learners, and to the ethos of the learning – ideally built in, not bolted on

55. Consistent with the teaching and learning philosophy

56. Alignment between learning goals and technology

57. Consistent

58. Quality matters More info: http://qminstitute.org/home/Public%20Library/About%20QM/RubricStandards2008-2010.pdf

59. Section 6: Course Technology The tools and media support the learning objectives, and are appropriately chosen to deliver the content of the course. The tools and media support student engagement and guide the student to become an active learner. Navigationthroughout the online components of the course is logical, consistent, and efficient. Students have ready access to the technologies required in the course. The course components are compatible with current standards for delivery modes. Instructions on how to access resources at a distance are sufficient and easy to understand. The course design takes full advantage of available tools and media.

60. Mobile learning in a blended course: case study Source: http://www.docstoc.com/docs/38964563/Assessing-the-Effectiveness-of-Mobile-Learning-in-Large-HybridBlended

61. Focus Areas

63. Overall Satisfaction

64. Course Organization

65. Course Activities

66. Student Interaction

67. Instructor Interaction

68. Relationship to Content

69. Sustainability

70. Mobile learning in a medical school: case study Source: http://www.biomedcentral.com/1472-6920/10/57

71. Context 57 students in cohort 4-year Bachelor of Medicine Bachelor of Surgery 2 online tools Blackboard Interlearn Access to Internet Customized software Info repositories Sharing info within and between cohorts 2 RQs In what ways does ML support learning? What areas need development?

73. Student Improvement Suggestions Better and more electronic learning resources more materials, especially audiovisual resources a more logically arranged VLE more flexibility in accessing materials Guidelines on managing the VLE Improvements to VLE Streamlining organization of information Reduced the number of clicks to access resources orientation for students

74. Central mobility at the University of MD Source: http://www.mobility.umd.edu/

75. Initiative Goals

77. Year 1 175 students - ~40% iPhone/~60% iPod Touch Weekly seminars during Fall 2008 Applications: Mobile Portal MyeVu Clickers Pre- and post- semester evaluations

78. Year 2 Engaged faculty: Center for Teaching Excellence Summer Institute Six faculty fellows Call for Proposals process Four faculty fellows IDed specific courses: Comm, PE, Journalism Build customized mobile learning experiences Specifically evaluated those learning goals Offered a mobile programming course

79. Mobile Tool Uses Integration into the course/learning experience Communication with classmates Communication with instructors Access to course materials (syllabus, assignments, schedules) Conduct research Other activities (internal and external to institution)

80. Sample Questions How would you describe the experience of participating in the media diary project? Please give specific examples to demonstrate your answer. Describe your use of technology to maintain your media diary. How would you assess the role of technology in completing this project? Please provide specific examples reflecting on the pros and cons of using or not using mobile devices to record your data.

81. App rubric Johns Hopkins University 10/18/2010

84. questions What are your challenges/opportunities in mobile learning? What research in this area might be useful to the community to further mobility?

85. Resources http://tinyurl.com/mecar

86. Veronica Diaz, PhD Associate Director EDUCAUSE Learning Initiative vdiaz@educause.edu http://www.educause.edu/eli