The University of Adelaide's Beacon of Enlightenment Strategic and Operational Plans outline a number of key targets for online learning. The 2013-14 Benchmarking eLearning Projects provided a baseline of the University's performance in regard to these online learning targets and a defined set of benchmarks. This presentation will provide a background to the Benchmarking eLearning Project, the data collected and how the data is leveraged in the faculty to improve the online learning experience of students. The newly established Guidelines for Minimum use of MyUni and a targeted approach to enhancing online course design in line with the targets will be discussed. Future plans to automate reporting using an expanded source of data to inform support activities and ensure the university is improving over time will be outlined. Delivered at Innovate and Educate: Teaching and Learning Conference by Blackboard. 24 -27 August 2015 in Adelaide, Australia.

1. A whole of institution approach to
improving student experience using
usage data
Ting Chan, eLearning Adviser, University of Adelaide
Mary Hill, eLearning Adviser, University of Adelaide

2. Overview of session
• In the beginning …
• Data sorcery
• Faculty perspectives
• Future plans
2

3. In the beginning …
3

4. Beacon of Enlightenment
• Enhanced Online learning
• Active use of MyUni
• Lecture recording
• Online assignment submission
• Online marking
4

5. Benchmarking eLearning Project
Benchmarks and methods to measure performance in
eLearning at The University of Adelaide
 inform planning
 report against strategic eLearning targets
 allow Faculties and Schools to compare their
eLearning usage to other areas of the University
 evaluate changes/improvement in the use of
eLearning using the centrally supported eLearning
platform (called MyUni)
5
Usage
User
engagement
Support
Policy and
Strategy

6. Benchmark measures
6

7. Data sorcery …
7

8. Data sorcery
8
LTTLTT
MyUni
MyMedia
PeopleSoft
BI
BI-Annual University
e-Learning
Performance
Report
BI-Annual University
e-Learning
Performance
Report
Extract Data
Extract Data
Extract Data
Extract Data
Store
Data
Produce
SourceSystems
Copy Charts
and
Summary
Data
Spreadsheets
(Metrics Data)
Spreadsheets
(Metrics Data)
Extracted data is
stored,
manipulated,
supplemented,
charted and
analysed in
spreadsheets
Faculty and School
e-Learning
Performance Reports
Faculty and School
e-Learning
Performance Reports
Produce
Faculty/SchoolFaculty/School
View eLearning
Performance
Metrics

9. Excel sorcery
• Common field
• MyUni course id
• [term code]_[subject code]_[catalogue
number
• Excel functions
• =VLOOKUP(A5,'PS
CombinedCourses'!B:M,12,FALSE)
9
LTTLTT
MyUni
MyMedia
PeopleSoft
BI
BI-Annual University
e-Learning
Performance
Report
BI-Annual University
e-Learning
Performance
Report
Extract Data
Extract Data
Extract Data
Extract Data
Store
Data
Produce
SourceSystems
Copy Charts
and
Summary
Data
Spreadsheets
(Metrics Data)
Spreadsheets
(Metrics Data)
Extracted data is
stored,
manipulated,
supplemented,
charted and
analysed in
spreadsheets
Faculty and School
e-Learning
Performance Reports
Faculty and School
e-Learning
Performance Reports
Produce
Faculty/SchoolFaculty/School
View eLearning
Performance
Metrics

10. The final brew
10
LTTLTT
MyUni
MyMedia
PeopleSoft
BI
BI-Annual University
e-Learning
Performance
Report
BI-Annual University
e-Learning
Performance
Report
Extract Data
Extract Data
Extract Data
Extract Data
Store
Data
Produce
SourceSystems
Copy Charts
and
Summary
Data
Spreadsheets
(Metrics Data)
Spreadsheets
(Metrics Data)
Extracted data is
stored,
manipulated,
supplemented,
charted and
analysed in
spreadsheets
Faculty and School
e-Learning
Performance Reports
Faculty and School
e-Learning
Performance Reports
Produce
Faculty/SchoolFaculty/School
View eLearning
Performance
Metrics

11. Faculty perspectives …
11

12. From Quantity to Quality of engagement
• eLearning Advisers in Faculties
– Faculty & schools reports
– Identification of target areas for the faculties and
schools
• Targeting courses:
– eAssessment & eMarking
– eSELT
• Guidelines for Minimum Use of MyUni
– Socialising the Guidelines
– Resources to support the implementation of the
Guidelines
12

13. eLearning Advisers & the ‘Beacon’
• Faculty and School MyUni Usage Reports
– Faculty Learning and Teaching Committees
– Associate Deans, Learning and Teaching
• Identification of target areas for the Faculty and Schools
• Central strategic approaches
13

14. Targeting eSubmission & eMarking
• Through the Benchmarking project & Student eStrategy
– Targeting courses that do not have online assignment submission
– Identification of courses where eSubmission and eMarking were
inappropriate
• Strategies to engage course coordinators
– Negotiated with the school
• School based workshops focusing on examples & good practice
• Follow-up meetings with staff to identify what would ‘work’
14

15. To record or not to record …
• Lecture recordings / Video production to support a
‘blended’ approach:
– Lecture recordings - Key concepts videos
– Small group discovery experience
– Flipped classroom
15

16. Quality of engagement
• Student Evaluation of Learning and Teaching (SELT)
responses to Question 5, “This course uses appropriate
online resources and technologies to help me achieve its
learning outcomes”
– A targeted approach to enhancing online course design
16

17. Guidelines for minimum use of MyUni
Developed in the context of the University’s Operational Plan
in particular to define ‘active use’.
Course Coordinators should ensure that each University of
Adelaide course is available to students online and:
A. Administrative and course information
B. Communicate with students and encourage and monitor
communications among students
C. Online assessment, marking and feedback
17

18. Guidelines for Minimum Usage of MyUni
18
• Socialising the Guidelines for
Minimum Use of MyUni
– Learning & Teaching Committees
– Faculty newsletters
– Focus on new staff
– Presentations & Workshops
• Sessional staff development
programs
• MyUni Good Practice – what & why
– Individual appointments
• Support resources

19. Supporting the implementation …
• Development of
resources & templates to
support the
implementation of the
Guidelines for Minimum
Use of MyUni
– Content
– Communication
– Assessment
19

20. The Crystal ball …
20

21. Future plans
• Automate data processing, analysis and visualisation
• Report new performance measures
• Learning Analytics
21

22. Thank you for your interest…
Any questions?
Ting Chan, eLearning Adviser, University of Adelaide
jason.chan@adelaide.edu.au
Mary Hill, eLearning Adviser, University of Adelaide
mary.l.hill@adelaide.edu.au
22