Slides of the presentation given at the University Analytics Forum about how to approach privacy when deploying learning analytic systems with emphasis on what is perceived by the student.

1. ChadCooperPhotosFlickr
Ethics and Privacy in
Learning Analytics
University Analytics Forum
Melbourne, 27 September 2013
Dr Abelardo Pardo (@abelardopardo)
slideshare.net/abelardo_pardo

2. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 2
EleafFlickr.com
If you could ask a privacy
expert only one question...
Which one would you ask?

3. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 3
MarkCogginsflickr.com
Delicate issue!

4. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 4
Wootpeanutsflickr.com
Prevents reaching a practical solution

5. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 5
Gee311flickr.com
Environment Context
integrity
Scenarios

6. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 6
Gee311flickr.com
Environment

7. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 7
dougbelshawflickr.com
Ethics: set of rules that define the
correctness of a specified behavior
Privacy: how personal digital
information is being observed by
the self or distributed to other
observers

8. They are using
your device
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 8
www.forbes.com/sites/kashmirhill/2013/09/12/e-zpasses-get-read-all-over-new-york-not-just-at-toll-booths(lastaccessedSeptember2013)

9. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 9
www.nytimes.com/interactive/2013/09/05/us/documents-reveal-nsa-campaign-against-encryption.html(lastaccessedSep.2013)

10. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 10
money.cnn.com/2013/09/05/technology/social/facebook-privacy/index.html(lastaccessedSep.2013)

11. Database with
K-12 student data
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 11
http://www.reuters.com/article/2013/03/03/us-education-database-idUSBRE92204W20130303(lastaccessedSep.2013)

12. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 12
deepwarrenFlickr
Observe in and out of the classroom

13. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 13
www.smh.com.au/technology/technology-news/universities-monitor-online-activity-20130413-2hsj2.html(lastaccessedSep.2013)

14. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 14
Gee311flickr.com
Environment Context
integrity

15. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 15
anthonylibrarianFlickr
Internet requires a new approach to privacy
Before: Limiting
surveillance, restricting
access to information,
curtailing intrusions into
private space
Additionally: How is data
captured, who owns it, how
is it shared?

16. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 16
Small_RealmFlickr
People act in different roles and contexts
Applications should respect these contexts

17. Context integrity: framework to provide
guidance to solve privacy related conflicts
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 17
ContextTravelflickr.com
Appropriateness and distribution
(Nissenbaum, H., 2004, Privacy as Contextual Integrity, Washington Law Review, 79(1))

18. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 18
Cotton|JoeFlickr
Appropriateness
What is collected?
What is revealed?
Valid in one context,
invalid in another

19. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 19
johnthrmFlickr
Distribution
Who sees the data?
When?
For what purpose?

20. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 20
KarenRoeflickr.com
Privacy as
a currency

21. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 21
Gee311flickr.com
Environment Context
integrity
Scenarios

22. Case 1: University Blended Course
1 Data collected in LMS and mobile app
2 Available to instructors for personalization
3 Some data considered for assessment
4 Available to other university units:
counseling, recruiting, marketing
5 Analyzed retention vs demographic
6 eTextbook data available to publishers
7 Kept for ever
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 22

23. Case 2: Online Course
1 Data collected in LMS
2 Available to instructors for personalization
purposes
3 Analyzed performance vs demographic
4 Some data considered for assessment
5 Data used in scientific publication
6 Data made available to funding institutions
7 Students have the right to request data
removal
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 23

24. Ethical Principles
• LA as a moral practice
• Students as agents at the center
• Data is temporal and dynamic
• Student success is complex and
multidimensional
• Transparency
• Institutions obliged to use data
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 24
(Slade, S., Prinsloo, P. 2013, Learning Analytics: Ethical Issues and Dilemmas, American Behavioral Scientist)

25. Practical Principles
1 Transparency
2 Students as data owners
3 Data access policies
4 Accountability and assessment
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 25

26. Transparency
• Means to achieve legitimacy
• Applied across the board
• Accessible and clearly explained policies
• How is data collected?
• Who has access to the data?
• Which processes are in place?
• How long is the data valid and available?
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 26
chilangocoFlickr

27. Students as Data
Owners
• Right to access, amend,
delete data
• Institutions are
borrowing the data
• In conflict with derived
data
• Affects systems design
• Fixed life span of
collected data
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 27
ImagesofMoneyFlickr

28. • Clarify the roles when
accessing data
• Extend to derived data
• Consider connection
with research
• Beware of
anonymization or
deidentification
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 28
AaronEscobarFlickr
Data Access
Policies

29. Accountability and
Assessment
Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 29
ColemanaFlickr
• Each aspect has a
responsible person,
body, department
• Process continuously
under improvement
• Consider all
stakeholders

30. Dr Abelardo Pardo Ethics and Privacy in Learning Analytics 30
mangtronixFlickr
Privacy changed in Internet era
Integrity of the learning context
Appropriateness and distribution, perceived value
Implementation principles:
Transparency
Students own data
Data access policies
Accountability and assessment

31. ChadCooperPhotosFlickr
Ethics and Privacy in
Learning Analytics
University Analytics Forum
Melbourne, 27 September 2013
Dr Abelardo Pardo (@abelardopardo)
slideshare.net/abelardo_pardo