How can we encourage student engagement with their academic reading? What role can technology play for campus-based and online students in supporting their academic skills development? What solutions are available and how effective are they in supporting students?
These are some of the questions that are addressed in this cross-institutional study of social reading software, looking at the current market options (e.g. Talis Elevate, Leganto ‘Read and Respond’ and Hypothes.is) and the affordances of the supported technology.
Informed by pilot studies with Talis Elevate conducted over the autumn and spring terms (2021-22 academic year) at the University of Leicester, and market research by the University of York, we use this evidence-base to appraise the current state of the market - reporting on technical integration issues with reading lists and VLE platforms, as well as desired functionality to empower students to create and manage critical discussions around target resources, ranging from key texts to images, with scope to annotate key texts and resources online. We then go on to discuss the results of pilot studies with Talis Elevate, focusing on academic engagement strategies to help students make best use of the software to develop their academic reading skills, as well as practical issues related to copyright controls and permissions.
Encouraging academic skills development through social reading: A critical review of digital solutions and implementation strategies
1. Encouraging academic skills
development through social reading:
A critical review of digital solutions
and implementation strategies
ALT-C
Richard Walker, University of York
Samuel Parr, University of Leicester
6th September 2022
2. Today
Social reading and collaborative
annotation defined
– Support from literature
Collaborative Annotation
platform overview
How to use collaboration
annotation in your teaching
– Recommendations and tips for
encouraging social reading in courses
3. What is social reading?
Collaborative reading, where
students discuss their thoughts
and ideas about a resource
Book groups and seminar
discussions
4. Collaborative Annotation
Collaborative reading, where
students discuss their thoughts
and ideas about a resource
Book groups and seminar
discussions
Online through collaborative
annotation
6. Why is this relevant to HE?
Students’ textual understanding and engagement
– Academics report that students have limited critical engagement in texts
– It is difficult to see or measure student engagement in course texts
before summative assessment
– Course reading can feel very separate from the wider learning journey,
particularly for non-core texts
Community Building
– Community improves student academic and social achievement,
increases curricular integration, and increased satisfaction with learning
(Calderwood, 2000; Rovai, 2002; van Tyron & Bishop, 2009)
– Developing an online community can be challenging, and discussion
forums are often inadequate
7. How collaborative annotation might help
Students’ textual understanding
– “Collaborative annotation tools capture students’ thinking and
processing in the moment, more closely mirroring the learning that one
might see in a face-to-face class when students discuss content with
their instructor and/or classmates” (Adams & Wilson, 2020)
– Provides opportunities for students to ask questions, discuss ideas, and
provide peer-to-peer learning
– Educators can see and measure engagement and understanding
Community
– Provides a discussion forum that is a natural part of the student journey
8. Support from literature
Limited amount of published research
Focus on digital support for pre-class reading
assignments: an instructor-designed, flipped learning
approach (e.g. Miller et al., 2018)
Social learning environments may support continuous
conversations between learners, enabling them to reflect
on target learning resources and build understanding of
key concepts (Crouch & Mazur, 2001)
Li & Zhou (2021) found human to text interactivity in
social reading boosted students’ social presence
Various case studies with some evidence of success…
10. Talis Elevate
Pros:
Easy-to-use social reading tool
for staff and students
Allows annotation of documents,
images, and videos
Some linkage to Talis Aspire
reading lists and VLEs (via LTI
integration), meaning you can
use Talis Aspire Copyright
Clearance
Basic analytics functions
Cons:
No groups functionality
Analytics and linkage to Talis Aspire
and VLEs could be more advanced
Access control issues, including:
– No external access options
– All academics can find and enrol
in each other’s modules
– Documents shared through links
are a bit clunky
11. Perusall
Pros:
Established social reading
platform for HE
Allows annotation of
documents, images, and videos
Groups functionality
Advanced analytics
Free for educators
Cons:
No linkage to reading lists
Free for students, but asks them
to pay for additional content
Academics responsible for
managing copyright (unless
students pay for texts in
Perusall)
12. hypothes.is
Pros:
Allows annotation of web
pages and uploaded PDFs
Groups functionality
Free for educators
Cons:
No video annotation
No linkage to reading lists
Students need to add a
Chrome extension to use
Academics responsible for
managing copyright
13. ExLibris Leganto
Pros:
‘Read and Respond’ integrates with
LMS platforms (module site, Grade
Centre & reading list)
Instructor can link to target pdf file
and present questions for
discussion
Commenting function for students:
named or anonymous contributions
Group work assignments supported
Cons:
Students can’t set up
collaborative reading activities
– must be allocated a task by
instructor
Unclear whether images / web
resources can be reviewed
14. Discounted Tools
Word/Google Docs: Designed
primarily for collaborative editing,
rather than annotation
NowComment: Well established,
but lacks integration with VLEs
16. University of Leicester – Talis Elevate
Piloted Elevate to a module of
180 Bioscience students
Students discussed 4 resources
asynchronously in Talis Elevate:
– 2 academic papers
– Module Description and Practical
Assessment Description
17. University of Leicester – Results
91.6% of the cohort accessed Talis, but
only 18.3% of 180 students engaged to
make 83 discussion comments and 63
personal comments
60% of comments were anonymous
76% of all comments were questions to
the academic
Discussion was shallow, with comments
rarely having more than one reply
18. University of Leicester – Results
Limited evidence that collaborative
annotation encouraged active reading
However, Talis Elevate was useful for
facilitating questions to academics
Talis Elevate usage was much higher
than the module’s Blackboard
discussion forum (9 students making
22 comments overall)
There were a number of issues to the
pilot design that made findings
unreliable. We are repeating the pilot
in Autumn 2022
19. University of Sussex – Talis Elevate
Foundation Year Applied Psychology
2019-20 – 200 students
Talis Elevate used for
five weekly readings
40% of cohort engaged to make 400
responses and 1400 personal notes
Anecdotally, student feedback was
very positive
Usage decreased during Covid-19
20. Adams & Wilson (2020) – Perusall
15 students engaged in one or two texts
per week on a distance learning course
During the first reading, students
averaged nine texts interactions and
four to five peer interactions.
Engagement increased through the
semester - students’ average text
interactions increased by 30% while
their peer interactions increased by 40%
21. Case Study Conclusions
Social Reading platforms can provide more
natural discussion than VLE forums
Social Reading platforms show some promise for
improving community and textual engagement
Careful deployment and planning is crucial
23. Collaborative Annotation - Top Tips
1. Introduction:
– Introduce the social reading software to students at the start
of the module: demonstration & rationale
– Low-stakes, but used consistently throughout the module
2. Engagement:
– Target key texts and learning resources – central to module
– Scaffold engagement with social reading: modelling &
‘socialisation of learners’ (Walker & Baets, 2009)
– Post questions and discussion points to encourage
engagement. Then, as students grow in confidence, the
academic can let them lead discussions
24. Conclusions
Social reading and collaborative
annotation can increase active
reading and engagement
Using collaborative annotation
requires care and planning to
be effective
Platforms exist, but copyright
and reading list synchronisation
are key issues needing
attention
25. Next Steps
Another Talis Elevate Pilot with
three courses in Autumn 2022
Work with vendors
Developing knowledge of social
reading across UK HE institutions
If you’d like to talk more or
collaborate, reach out to us at
richard.walker@york.ac.uk
sp812@leicester.ac.uk
26. References
Adams, B., & Wilson, N. S. (2020). Building Community in Asynchronous Online Higher
Education Courses Through Collaborative Annotation. Journal of educational technology
systems, 2020, Vol.49 (2), p.250-261.
Crouch, C., & Mazur, E. (2001). Peer instruction: ten years of experience and results.
American Journal of Physics, 69 (9). https://aapt.scitation.org/doi/10.1119/1.1374249
Miller, K., Lukoff, B., King, G., & Mazur, E. (2018). Use of a social annotation platform for
pre-class reading assignments in a flipped introductory Physics class. Frontiers in Education.
07 March 2018. https://doi.org/10.3389/feduc.2018.00008
Walker, R., & Baets, W. (2009). Instructional design for class-based and computer-mediated
learning: creating the right blend for student-centred learning. Applied e-learning and
e-teaching in higher education, eds R. Donnelly & F. McSweeney, Hershey: Information
Science Reference, pp. 241–261. doi: 10.4018/978-1-59904-814-7
Wu Li, Yuanyi Mao, & Liuning Zhou (2021) The Impact of Interactivity on User Satisfaction in
Digital Social Reading: Social Presence as a Mediator, International Journal of Human–
Computer Interaction. https://doi.org/10.1080/10447318.2021.1898850
Hinweis der Redaktion
Social reading is a form of collaborative reading, where people share their thoughts and ideas about what they’ve read, and receive feedback.
It comes in many forms. Outside of HE, the most well known examples include book clubs. In HE, the classic place for social reading is through things like seminar discussions.
Over the past twenty years, various platforms have also allowed social reading to take place online. Of particular interest for HE are platforms that allow for collaborative annotation, which is what we’ll be discussing today.
One form of social reading is collaborative annotation. This is where users engage in discussion and analysis of a text through public annotations.
Collaborative annotation isn’t new. For example, monks used to leave messages and thoughts for each other in the margins of medieval manuscripts.
However, over the past twenty years, various platforms have also allowed collaborative annotation to take place online. For example…
A screenshot to show social reading in action.
There are two issues that collaborative annotation can help address: improving student engagement in academic texts, and developing a sense of community beyond the classroom.
Community building: full quote from Adams, Brittany ; Wilson, Nance S. (2020): “Researchers have presented compelling arguments that community is essential in higher education distance learning because it reduces feelings of isolation, improves student academic and social achievement, increases curricular integration, and increased satisfaction with learning (Calderwood, 2000; Rovai, 2002; van Tyron & Bishop, 2009)”
‘Provides a discussion forum that is a natural part of the student journey’ : For a discussion forum, students need to engage in a resource by themselves, then go to a discussion forum. This adds an extra step to engagement, and requires students to remember the text and the points they wish to discuss. In collaborative annotation, students can see and add to discussion as part of their core learning journey, make comments in real time, and see these comments in the context of the resource.
We could make the point that there isn’t loads of literature out there here!
So, there is reasonable evidence that collaborative annotation can be a useful tool
Article on copyright clearance in Talis: https://support.talis.com/hc/en-us/articles/360004596917
A key problem is that Elevate does not integrate with reading lists. Talis Aspire and Talis Elevate are not connected, so any target resources (files / images etc.) from a reading list for review in a social annotation task must be uploaded again to Elevate. Also - Elevate only accepts pdfs - so you can't include web links to collections of resources or playlists - or base annotations around a web page. (You can in open source annotation alternatives such as Hypothesis.)
You also can't search in Elevate for content which has been annotated. The only way to access target content is through a direct URL (e.g. a direct link from a VLE module site to an activity), or by creating a module within Elevate or joining an existing one. So that's a bit clunky.
Also the annotation functionality in Elevate is quite limited. For instance, you can't highlight text in a target document without having to make a comment. You can make personal or open comments - but you can't hide comments if someone in a shared doc blasts through it highlighting everything (you can hide all other comments by viewing Talis through ‘Personal Notes’).
Another problem that UCL staff found was after uploading images to Elevate for an annotation task, if there are formatting issues with the size of an image for instance, you can't edit it in any way. (UCL have noted that they can't quality control the resources that are uploaded - in relation to quality and copyright management.)
Elevate also doesn’t provide any groups functionality (unlike Perusall), where different groups of students can access the resource and see comments only from their groups.
Elevate does have some useful analytics for users, but these are generally limited.
Finally, there are access control issues (documents are shared through links) and users outside the institution can't access Elevate resources.
So, there is reasonable evidence that collaborative annotation can be a useful tool
Full stats:
91.6% of the cohort accessed at least one Talis Elevate document.
At maximum, 18.3% of 180 students engaged to make 83 discussion comments and 63 personal comments
60% of comments were anonymous
76% of all comments were on the practical handbook, posed as questions to the academic rather than student discussion
For the 18 comments of the academic papers, comments were of variable quality. 5 (27%) showed simple engagement, 9 (50%) medium engagement, and 4 (22%) high engagement.
Discussion was shallow, with comments rarely having more than one reply.
So, there’s not much success with Talis Elevate so far. However, a more successful example comes from Sussex. Thanks to Wendy Garnham for providing these details in an interview with Samuel Parr.
This is an interesting case study, as it shows potential for collaborative annotation in a distance learning rather than campus based course.
So, there is reasonable evidence that collaborative annotation can be a useful tool
“This introduction should be face-to-face, low-stakes, and engaging” : For example, at Sussex, they ran an in-person demo where students commented on a light-hearted but engaging psychological paper on whether dogs were likely to look like their owners.
“Then, as students grow in confidence, the academic can let them lead discussions.” – This didn’t happen at Leicester, which was one of the reasons for low student engagement.
Need to test the new Leganto LTI integration 1.3 with Bb Ultra to see if we can get this to work - but from what we have seen this is the furthest along, compared with other commercial and open source products.