SlideShare ist ein Scribd-Unternehmen logo
1 von 36
Downloaden Sie, um offline zu lesen
Learning Analytics Implementation at USW - 2017/18 activity
Playing the hand you’re dealt
Learning Analytics Implementation at USW 2017/18
Martin Lynch
Learning Systems Manager, CELT
Learning Analytics Implementation at USW
• What is happening regarding Learning Analytics implementation at USW;
• The cards in our deck
• Timeline of events
• What are we doing in the project – 4 use-cases
• Ethics and GDPR
• Challenges and successes
Learning Analytics Implementation at USW
The cards in the deck
• JISC
• Tribal
• Blackboard
• GDPR
• PVC
• Strategic alignment
• Professional Services – Library, Registry,
IT Services Development
• Governance
• Learning Technologist
• Developer
• Project manager
• PACs
• Students
STUDENTS
STUDENTS
External
InternalStakeholders
Learning Analytics Implementation at USW
June 2015 PVC Student Retention and Success Dr Ben Calvert promotes internal conversation
regarding Student Retention and Success – USW now looking for an analytics solution
USW put forward
for the last place on
the JISC discovery
phase - consultation
stage begins with Bb
Bb consulting run
Discovery phase at
USW in order to
produce a “Readiness
Assessment”
Memorandum of
understanding signed
between USW and JISC
Readiness
assessment
report published
University agrees to set up
Learning Analytics Project – 2
year duration 2 posts identified,
with 0.6FTE project management
Project board
initiated at USW
Recruitment process
setting up for learning
technologist and developer
Begin extraction
of historical data
from Blackboard
Assessment data
coming from Bb
Progression data from Student
Record system now in UDD
Appointment of
learning technologist
Student enrolment
form amended in
light of LA project
Module marks for
current session held
in Student Record
System showing in
Data Explorer
Decision taken that Data
explorer does not meet
minimum requirements
for use as a pilot tool –
data and usability issues
Senior faculty staff and data users
meet with Tribal to consider
predictive modelling requirements
– select 3 key models
Staff questionnaire
sent out to baseline
expectation on
functionality of Data
explorer 50 staff agree
to pilot use of Data
Explorer from Jan
Appointment of
IT Developer
RUHere
attendance data
surfacing in DX
Tribal develop
3 new models
for USW –
data still has
gaps
USW invited to
join the ‘group
of five’
Workshop conducted for
student-facing dashboards
for 2019
All marks and
grades from Bb
and Quercus
appearing in DX
Library ‘recipe’
simplified by JISC
– test data
extract can begin
Historical grade data
from Student Record
System and
Blackboard (3 years)
now in warehouse –
Tribal can review
their models
Project timeline May 2015 - May 2018
PROJECT SET-UP = 18 MONTHS
PROCESS AND PRODUCT DEVELOPMENT = CONTINUOUS
DATA = 14 MONTHS
Learning Analytics Implementation at USW
What we are doing in the project?
Use-case#1
Data Explorer for PAC’s
Learning Analytics Implementation at USW
• Personal Academic Coaches (PAC’s) 300+ at USW
• Every student allocated a PAC on enrolment
• Senior teaching staff from course team – understand delivery
• Follows student through their studies – 3X20 min meetings every year, focus on
academic progress
• Need to document the event and have data to inform conversation
• Data Explorer replaces accessing multiple data sources but more than the sum of
the parts
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Use-case#2
Data Explorer for Curriculum Design
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Use-case#3 – the value of “Predictive
Analytics” to the institution
Learning Analytics Implementation at USW
• Predictions are made with very large data set (3 years)
• Machine learning algorithm so refining factors (regression analysis) in each
context (module or course) to establish significance
• Applying pattern recognition from training set to current students to find close
matches
• Predictive models are questions you want to ask of your data
• Tribal our current data science partner and models are almost there…
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
• First models are retention-based and deal with risk
• Intention is to use intelligence to better target support
But..
• Are these models any good?
• What services to build - how should we use this data?
• What value is this to the institution?
Learning Analytics Implementation at USW
Use-case#4 – student-facing dashboards
Learning Analytics Implementation at USW
• Unexplored in the sector so breaking new ground in the UK
• Small-scale studies – ref. Dr Liz Bennett University of Huddersfield, Ed de Quincey
Keele University
• Understanding this as a type of feedback literacy – ref. Paul Sutton (2012) notions
of feedback literacy
Principles are;
• Access should be mediated in the first instance
• Motivation is personal so dashboards should be customisable to fit user needs
• Dispositional dimension is critical
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Learning Analytics Implementation at USW
Ethics and GDPR
• USW implementation of Learning Analytics GDPR compliant
• Enrolment process amended
• Consent on protected characteristics
• Clearly described data processing activity
• Student-facing guide
• Student involvement in project
• Guided by ICO guidance and JISC
• Using ‘legitimate business interest’ to process data
Learning Analytics Implementation at USW
Successes
• Good resourcing has driven success
• Good appointments and effective project management
• Effective governance – interested (but not too involved) executive sponsor and a good board that turn up
and ask questions
• Staff see the value already but important to wait until its ready before showing it
Challenges
• Supplier pilot processes – delayed deployment for a year
• Some developments and data wrangling too slow (predictor, library recipe)
• Developers are hard to find – took us 10 months
• Unclear internal business processes – who looks after wobbling students?
• Inconsistent use of data for decision making
Project successes and challenges
Learning Analytics Implementation at USW
• DX – full roll-out and use for Personal Academic Coaches (PAC’s)
• Use of DX by other roles – faculty management, course and module teams to assess engagement and to
contribute to course design, side-cases (eg to evidence non-payment of fees)
• Study Goal – pilot use as a simple attendance monitoring tool
• Use of predictive data to drive early-warning alerts (Tribal)
• Assess value to institution of predictive business intelligence (Tribal)
• Compare and contrast Tribal and JISC predictive offers
• Student-facing dashboards – prototype mash-ups – refactor to something more useful
• Attract research and development funding to incubate this
• Full project evaluation and analysis of impact>options appraisal >recommendations
Project Vision and plans for 2018/19
Learning Analytics Implementation at USW
Questions?
martin.lynch@southwales.ac.uk

Weitere ähnliche Inhalte

Was ist angesagt?

Learning Analytics Oer
Learning Analytics OerLearning Analytics Oer
Learning Analytics OerBCcampus
 
Learning analytics workshop
Learning analytics workshop Learning analytics workshop
Learning analytics workshop Eisa Rezaei
 
Co-developing bespoke, enterprise-scale analytics systems with teaching staff
Co-developing bespoke, enterprise-scale analytics systems with teaching staffCo-developing bespoke, enterprise-scale analytics systems with teaching staff
Co-developing bespoke, enterprise-scale analytics systems with teaching staffDanny Liu
 
Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining MehrnooshV
 
Effective student learning through goal setting v2
Effective student learning through goal setting v2Effective student learning through goal setting v2
Effective student learning through goal setting v2Catherine Zhao
 
Data visualisation with predictive learning analytics
Data visualisation with predictive learning analyticsData visualisation with predictive learning analytics
Data visualisation with predictive learning analyticsChris Ballard
 
Role of data analytics in educational industry
Role of data analytics in educational industryRole of data analytics in educational industry
Role of data analytics in educational industryRuthVanlalremruati
 
Educational Data Mining/Learning Analytics issue brief overview
Educational Data Mining/Learning Analytics issue brief overviewEducational Data Mining/Learning Analytics issue brief overview
Educational Data Mining/Learning Analytics issue brief overviewMarie Bienkowski
 
Educational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceEducational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceXavier Ochoa
 
Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016Paul Bailey
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...CITE
 
LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014Kennisnet
 
Rethinking Student Success: Analytics in Support of Teaching and Learning
Rethinking Student Success: Analytics in Support of Teaching and LearningRethinking Student Success: Analytics in Support of Teaching and Learning
Rethinking Student Success: Analytics in Support of Teaching and LearningTimothy Harfield
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"CITE
 
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)Shane Dawson
 
Learning Analytics (or: The Data Tsunami Hits Higher Education)
Learning Analytics (or: The Data Tsunami Hits Higher Education)Learning Analytics (or: The Data Tsunami Hits Higher Education)
Learning Analytics (or: The Data Tsunami Hits Higher Education)Simon Buckingham Shum
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning AnalyticsViplav Baxi
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyEd Foster
 
The UTS Connected Intelligence Centre
The UTS Connected Intelligence CentreThe UTS Connected Intelligence Centre
The UTS Connected Intelligence CentreSimon Buckingham Shum
 

Was ist angesagt? (20)

Learning Analytics Oer
Learning Analytics OerLearning Analytics Oer
Learning Analytics Oer
 
Learning analytics workshop
Learning analytics workshop Learning analytics workshop
Learning analytics workshop
 
Co-developing bespoke, enterprise-scale analytics systems with teaching staff
Co-developing bespoke, enterprise-scale analytics systems with teaching staffCo-developing bespoke, enterprise-scale analytics systems with teaching staff
Co-developing bespoke, enterprise-scale analytics systems with teaching staff
 
Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining Advances in Learning Analytics and Educational Data Mining
Advances in Learning Analytics and Educational Data Mining
 
Effective student learning through goal setting v2
Effective student learning through goal setting v2Effective student learning through goal setting v2
Effective student learning through goal setting v2
 
Data visualisation with predictive learning analytics
Data visualisation with predictive learning analyticsData visualisation with predictive learning analytics
Data visualisation with predictive learning analytics
 
Role of data analytics in educational industry
Role of data analytics in educational industryRole of data analytics in educational industry
Role of data analytics in educational industry
 
Educational Data Mining/Learning Analytics issue brief overview
Educational Data Mining/Learning Analytics issue brief overviewEducational Data Mining/Learning Analytics issue brief overview
Educational Data Mining/Learning Analytics issue brief overview
 
Educational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceEducational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial Intelligence
 
Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016Jisc learning analytics service oct 2016
Jisc learning analytics service oct 2016
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
 
Learning and Educational Analytics
Learning and Educational AnalyticsLearning and Educational Analytics
Learning and Educational Analytics
 
LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014LACE Masterclass Learning Analytics M&L Brussels 2014
LACE Masterclass Learning Analytics M&L Brussels 2014
 
Rethinking Student Success: Analytics in Support of Teaching and Learning
Rethinking Student Success: Analytics in Support of Teaching and LearningRethinking Student Success: Analytics in Support of Teaching and Learning
Rethinking Student Success: Analytics in Support of Teaching and Learning
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"
 
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)
A-LASI Getting started in learning analytics (Lockyer, Rogers and Dawson)
 
Learning Analytics (or: The Data Tsunami Hits Higher Education)
Learning Analytics (or: The Data Tsunami Hits Higher Education)Learning Analytics (or: The Data Tsunami Hits Higher Education)
Learning Analytics (or: The Data Tsunami Hits Higher Education)
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
ABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of DerbyABLE - the NTU Student Dashboard - University of Derby
ABLE - the NTU Student Dashboard - University of Derby
 
The UTS Connected Intelligence Centre
The UTS Connected Intelligence CentreThe UTS Connected Intelligence Centre
The UTS Connected Intelligence Centre
 

Ähnlich wie Exploring learning analytics

Jisc learning analytics service overview Aug 2018
Jisc learning analytics service overview Aug 2018Jisc learning analytics service overview Aug 2018
Jisc learning analytics service overview Aug 2018Paul Bailey
 
Curriculum analytics: Using data from student learning analytics
Curriculum analytics: Using data from student learning analyticsCurriculum analytics: Using data from student learning analytics
Curriculum analytics: Using data from student learning analyticsJisc
 
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at Tribal
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at TribalSoLAR Flare 2015 - Turning Learning Analytics Research into Practice at Tribal
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at TribalChris Ballard
 
A three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analyticsA three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analyticsUniversity of Newcastle, NSW.
 
Research in to Practice: Building and implementing learning analytics at Tribal
Research in to Practice: Building and implementing learning analytics at TribalResearch in to Practice: Building and implementing learning analytics at Tribal
Research in to Practice: Building and implementing learning analytics at TribalLACE Project
 
Jisc learning analytics service updates
Jisc learning analytics service updatesJisc learning analytics service updates
Jisc learning analytics service updatesJisc
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...Blackboard APAC
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEllen Wagner
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Blackboard APAC
 
FerrellWalker.pptx
FerrellWalker.pptxFerrellWalker.pptx
FerrellWalker.pptxJisc
 
FACT2 Learning Analytics Task Group (LATG) SCOA briefing
FACT2 Learning Analytics Task Group (LATG) SCOA briefingFACT2 Learning Analytics Task Group (LATG) SCOA briefing
FACT2 Learning Analytics Task Group (LATG) SCOA briefinggketcham
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analyticsJisc
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchAndrew Deacon
 
Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.EduSkills OECD
 
Jisc learning analytics scotland HEIDS
Jisc learning analytics scotland HEIDSJisc learning analytics scotland HEIDS
Jisc learning analytics scotland HEIDSPaul Bailey
 
Learning analytics research informed institutional practice
Learning analytics research informed institutional practiceLearning analytics research informed institutional practice
Learning analytics research informed institutional practiceYi-Shan Tsai
 
ABLE - Inside Government Nov 2017 - Rebecca Edwards
ABLE - Inside Government Nov 2017 - Rebecca EdwardsABLE - Inside Government Nov 2017 - Rebecca Edwards
ABLE - Inside Government Nov 2017 - Rebecca EdwardsEd Foster
 
SHEILA-CRLI seminar
SHEILA-CRLI seminarSHEILA-CRLI seminar
SHEILA-CRLI seminarYi-Shan Tsai
 

Ähnlich wie Exploring learning analytics (20)

Jisc learning analytics service overview Aug 2018
Jisc learning analytics service overview Aug 2018Jisc learning analytics service overview Aug 2018
Jisc learning analytics service overview Aug 2018
 
Curriculum analytics: Using data from student learning analytics
Curriculum analytics: Using data from student learning analyticsCurriculum analytics: Using data from student learning analytics
Curriculum analytics: Using data from student learning analytics
 
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at Tribal
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at TribalSoLAR Flare 2015 - Turning Learning Analytics Research into Practice at Tribal
SoLAR Flare 2015 - Turning Learning Analytics Research into Practice at Tribal
 
A three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analyticsA three tier model to promote the institutional adoption of learning analytics
A three tier model to promote the institutional adoption of learning analytics
 
Research in to Practice: Building and implementing learning analytics at Tribal
Research in to Practice: Building and implementing learning analytics at TribalResearch in to Practice: Building and implementing learning analytics at Tribal
Research in to Practice: Building and implementing learning analytics at Tribal
 
Jisc learning analytics service updates
Jisc learning analytics service updatesJisc learning analytics service updates
Jisc learning analytics service updates
 
Australian university teacher’s engagement with learning analytics: Still ea...
Australian university teacher’s engagement with learning analytics:  Still ea...Australian university teacher’s engagement with learning analytics:  Still ea...
Australian university teacher’s engagement with learning analytics: Still ea...
 
EDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINALEDUCA Leveraging Analytics FINAL
EDUCA Leveraging Analytics FINAL
 
Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...Learning analytics and the learning and teaching journey | Prof Deborah West ...
Learning analytics and the learning and teaching journey | Prof Deborah West ...
 
Florida Virtual School Research
Florida Virtual School ResearchFlorida Virtual School Research
Florida Virtual School Research
 
FerrellWalker.pptx
FerrellWalker.pptxFerrellWalker.pptx
FerrellWalker.pptx
 
FACT2 Learning Analytics Task Group (LATG) SCOA briefing
FACT2 Learning Analytics Task Group (LATG) SCOA briefingFACT2 Learning Analytics Task Group (LATG) SCOA briefing
FACT2 Learning Analytics Task Group (LATG) SCOA briefing
 
Exploring learning analytics
Exploring learning analyticsExploring learning analytics
Exploring learning analytics
 
Learning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational researchLearning Analytics: New thinking supporting educational research
Learning Analytics: New thinking supporting educational research
 
Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.Effective Creation, Mediation and Use of Knowledge in and about Education.
Effective Creation, Mediation and Use of Knowledge in and about Education.
 
Jisc learning analytics scotland HEIDS
Jisc learning analytics scotland HEIDSJisc learning analytics scotland HEIDS
Jisc learning analytics scotland HEIDS
 
Learning analytics research informed institutional practice
Learning analytics research informed institutional practiceLearning analytics research informed institutional practice
Learning analytics research informed institutional practice
 
ABLE - Inside Government Nov 2017 - Rebecca Edwards
ABLE - Inside Government Nov 2017 - Rebecca EdwardsABLE - Inside Government Nov 2017 - Rebecca Edwards
ABLE - Inside Government Nov 2017 - Rebecca Edwards
 
Learning Analytics
Learning AnalyticsLearning Analytics
Learning Analytics
 
SHEILA-CRLI seminar
SHEILA-CRLI seminarSHEILA-CRLI seminar
SHEILA-CRLI seminar
 

Mehr von Jisc

Digital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxDigital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxJisc
 
Open Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxOpen Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxJisc
 
Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Jisc
 
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...Jisc
 
Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc
 
Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc
 
Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc
 
JISC Presentation.pptx
JISC Presentation.pptxJISC Presentation.pptx
JISC Presentation.pptxJisc
 
Community-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxJisc
 
The Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxJisc
 
Are we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxJisc
 
JiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJisc
 
UWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxUWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxJisc
 
An introduction to Cyber Essentials
An introduction to Cyber EssentialsAn introduction to Cyber Essentials
An introduction to Cyber EssentialsJisc
 
MarkChilds.pptx
MarkChilds.pptxMarkChilds.pptx
MarkChilds.pptxJisc
 
RStrachanOct23.pptx
RStrachanOct23.pptxRStrachanOct23.pptx
RStrachanOct23.pptxJisc
 
ISDX2 Oct 2023 .pptx
ISDX2 Oct 2023 .pptxISDX2 Oct 2023 .pptx
ISDX2 Oct 2023 .pptxJisc
 
ExpertsknightOct23.pptx
ExpertsknightOct23.pptxExpertsknightOct23.pptx
ExpertsknightOct23.pptxJisc
 
BeyondBlended17Oct23.pptx
BeyondBlended17Oct23.pptxBeyondBlended17Oct23.pptx
BeyondBlended17Oct23.pptxJisc
 
Collective Funding Models for OA Books 3 - Thoth presentation.pptx
Collective Funding Models for OA Books 3 - Thoth presentation.pptxCollective Funding Models for OA Books 3 - Thoth presentation.pptx
Collective Funding Models for OA Books 3 - Thoth presentation.pptxJisc
 

Mehr von Jisc (20)

Digital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxDigital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptx
 
Open Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxOpen Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptx
 
Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...
 
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
 
Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023
 
Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023
 
Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023
 
JISC Presentation.pptx
JISC Presentation.pptxJISC Presentation.pptx
JISC Presentation.pptx
 
Community-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptx
 
The Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptx
 
Are we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptx
 
JiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
 
UWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxUWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptx
 
An introduction to Cyber Essentials
An introduction to Cyber EssentialsAn introduction to Cyber Essentials
An introduction to Cyber Essentials
 
MarkChilds.pptx
MarkChilds.pptxMarkChilds.pptx
MarkChilds.pptx
 
RStrachanOct23.pptx
RStrachanOct23.pptxRStrachanOct23.pptx
RStrachanOct23.pptx
 
ISDX2 Oct 2023 .pptx
ISDX2 Oct 2023 .pptxISDX2 Oct 2023 .pptx
ISDX2 Oct 2023 .pptx
 
ExpertsknightOct23.pptx
ExpertsknightOct23.pptxExpertsknightOct23.pptx
ExpertsknightOct23.pptx
 
BeyondBlended17Oct23.pptx
BeyondBlended17Oct23.pptxBeyondBlended17Oct23.pptx
BeyondBlended17Oct23.pptx
 
Collective Funding Models for OA Books 3 - Thoth presentation.pptx
Collective Funding Models for OA Books 3 - Thoth presentation.pptxCollective Funding Models for OA Books 3 - Thoth presentation.pptx
Collective Funding Models for OA Books 3 - Thoth presentation.pptx
 

Kürzlich hochgeladen

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapitolTechU
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxKatherine Villaluna
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationMJDuyan
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxDr. Asif Anas
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxSaurabhParmar42
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17Celine George
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxheathfieldcps1
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRATanmoy Mishra
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxMYDA ANGELICA SUAN
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICESayali Powar
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxKatherine Villaluna
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptxSandy Millin
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxEduSkills OECD
 

Kürzlich hochgeladen (20)

What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptx
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptx
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive Education
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptx
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptx
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17
 
The basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptxThe basics of sentences session 10pptx.pptx
The basics of sentences session 10pptx.pptx
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptx
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICE
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
 

Exploring learning analytics

  • 1. Learning Analytics Implementation at USW - 2017/18 activity Playing the hand you’re dealt Learning Analytics Implementation at USW 2017/18 Martin Lynch Learning Systems Manager, CELT
  • 2. Learning Analytics Implementation at USW • What is happening regarding Learning Analytics implementation at USW; • The cards in our deck • Timeline of events • What are we doing in the project – 4 use-cases • Ethics and GDPR • Challenges and successes
  • 3. Learning Analytics Implementation at USW The cards in the deck • JISC • Tribal • Blackboard • GDPR • PVC • Strategic alignment • Professional Services – Library, Registry, IT Services Development • Governance • Learning Technologist • Developer • Project manager • PACs • Students STUDENTS STUDENTS External InternalStakeholders
  • 4. Learning Analytics Implementation at USW June 2015 PVC Student Retention and Success Dr Ben Calvert promotes internal conversation regarding Student Retention and Success – USW now looking for an analytics solution USW put forward for the last place on the JISC discovery phase - consultation stage begins with Bb Bb consulting run Discovery phase at USW in order to produce a “Readiness Assessment” Memorandum of understanding signed between USW and JISC Readiness assessment report published University agrees to set up Learning Analytics Project – 2 year duration 2 posts identified, with 0.6FTE project management Project board initiated at USW Recruitment process setting up for learning technologist and developer Begin extraction of historical data from Blackboard Assessment data coming from Bb Progression data from Student Record system now in UDD Appointment of learning technologist Student enrolment form amended in light of LA project Module marks for current session held in Student Record System showing in Data Explorer Decision taken that Data explorer does not meet minimum requirements for use as a pilot tool – data and usability issues Senior faculty staff and data users meet with Tribal to consider predictive modelling requirements – select 3 key models Staff questionnaire sent out to baseline expectation on functionality of Data explorer 50 staff agree to pilot use of Data Explorer from Jan Appointment of IT Developer RUHere attendance data surfacing in DX Tribal develop 3 new models for USW – data still has gaps USW invited to join the ‘group of five’ Workshop conducted for student-facing dashboards for 2019 All marks and grades from Bb and Quercus appearing in DX Library ‘recipe’ simplified by JISC – test data extract can begin Historical grade data from Student Record System and Blackboard (3 years) now in warehouse – Tribal can review their models Project timeline May 2015 - May 2018 PROJECT SET-UP = 18 MONTHS PROCESS AND PRODUCT DEVELOPMENT = CONTINUOUS DATA = 14 MONTHS
  • 5. Learning Analytics Implementation at USW What we are doing in the project? Use-case#1 Data Explorer for PAC’s
  • 6. Learning Analytics Implementation at USW • Personal Academic Coaches (PAC’s) 300+ at USW • Every student allocated a PAC on enrolment • Senior teaching staff from course team – understand delivery • Follows student through their studies – 3X20 min meetings every year, focus on academic progress • Need to document the event and have data to inform conversation • Data Explorer replaces accessing multiple data sources but more than the sum of the parts
  • 17. Learning Analytics Implementation at USW Use-case#2 Data Explorer for Curriculum Design
  • 24. Learning Analytics Implementation at USW Use-case#3 – the value of “Predictive Analytics” to the institution
  • 25. Learning Analytics Implementation at USW • Predictions are made with very large data set (3 years) • Machine learning algorithm so refining factors (regression analysis) in each context (module or course) to establish significance • Applying pattern recognition from training set to current students to find close matches • Predictive models are questions you want to ask of your data • Tribal our current data science partner and models are almost there…
  • 27. Learning Analytics Implementation at USW • First models are retention-based and deal with risk • Intention is to use intelligence to better target support But.. • Are these models any good? • What services to build - how should we use this data? • What value is this to the institution?
  • 28. Learning Analytics Implementation at USW Use-case#4 – student-facing dashboards
  • 29. Learning Analytics Implementation at USW • Unexplored in the sector so breaking new ground in the UK • Small-scale studies – ref. Dr Liz Bennett University of Huddersfield, Ed de Quincey Keele University • Understanding this as a type of feedback literacy – ref. Paul Sutton (2012) notions of feedback literacy Principles are; • Access should be mediated in the first instance • Motivation is personal so dashboards should be customisable to fit user needs • Dispositional dimension is critical
  • 33. Learning Analytics Implementation at USW Ethics and GDPR • USW implementation of Learning Analytics GDPR compliant • Enrolment process amended • Consent on protected characteristics • Clearly described data processing activity • Student-facing guide • Student involvement in project • Guided by ICO guidance and JISC • Using ‘legitimate business interest’ to process data
  • 34. Learning Analytics Implementation at USW Successes • Good resourcing has driven success • Good appointments and effective project management • Effective governance – interested (but not too involved) executive sponsor and a good board that turn up and ask questions • Staff see the value already but important to wait until its ready before showing it Challenges • Supplier pilot processes – delayed deployment for a year • Some developments and data wrangling too slow (predictor, library recipe) • Developers are hard to find – took us 10 months • Unclear internal business processes – who looks after wobbling students? • Inconsistent use of data for decision making Project successes and challenges
  • 35. Learning Analytics Implementation at USW • DX – full roll-out and use for Personal Academic Coaches (PAC’s) • Use of DX by other roles – faculty management, course and module teams to assess engagement and to contribute to course design, side-cases (eg to evidence non-payment of fees) • Study Goal – pilot use as a simple attendance monitoring tool • Use of predictive data to drive early-warning alerts (Tribal) • Assess value to institution of predictive business intelligence (Tribal) • Compare and contrast Tribal and JISC predictive offers • Student-facing dashboards – prototype mash-ups – refactor to something more useful • Attract research and development funding to incubate this • Full project evaluation and analysis of impact>options appraisal >recommendations Project Vision and plans for 2018/19
  • 36. Learning Analytics Implementation at USW Questions? martin.lynch@southwales.ac.uk

Hinweis der Redaktion

  1. At USW we seem to be playing a strong game
  2. Jisc – main supplier for the project, providing technical infrastructure (Learning Data Hub), data schema, visualisation tools, network opportunities Tribal – data science provider – offering data science analysis and predictive models Blackboard – our VLE provider – provides a plug-in which is harvesting student activity data and passing in to JISC Learning data Hub currently the main proxy for engagement – no assessment data! Library – cooperation of Learning Services supplies us with data pertaining to library resource usage – books and e-resources Registry – providing profile data for student users being fed into the LDH, providing assessment data for formal assessments IT Services – providing development services – have managed to query Bb databases to extract ALL assessments – regardless of tool, both formative and summative including due dates and submission dates found in VLE Governance Students – the ultimate data owners and providers of the data need participation Learning Technologist – allocated to the project for 2 years – data wrangling and staff development Project Manager Pro-Vice Chancellor Teaching, Learning and Student Experience – executive sponsor and champion Strategic alignment – Learning Analytics finds itself woven into the university’s strategic plan for student success “The Student Experience Plan” GDPR – this has shaped the public declaration of data processing, the consent framework and the local interpretation of the legal definitions of processing and intervention
  3. First models are retention-based and deal with risk – obvious human and monetary cost to retention but with TEF in our mirrors, should be looking at data science to evidence added value and learner stretch Intention is to use intelligence to better target support – “Barry’s Bell” But.. Are these models any good? Need models to be ‘finished’ and need time to assess the results What services to build - how should we use this data? – is the institution ready to consume this in a way that would improve business? What value is this to the institution? – these are expensive services so what is the business case
  4. https://datax.jisc.ac.uk/#/login
  5. https://datax.jisc.ac.uk/#/login