SlideShare a Scribd company logo
1 of 23
Download to read offline
interACT:
Interactive
Assessment and
Collaboration via
Technology
Dr Sean McAleer – Programme Director   Grant Murray – Learning
                                             Technologist CME
Embarked on a literature review…
And synthesised some principles:
1. Supports personalised learning
2. Ensures feedback leads to learning
3. Focuses on student self-development
4. Stimulates dialogue
5. Inducts students in the educational culture
and assessment and feedback practices
6. Is acceptable to all stakeholders
Baseline activities
• Document analysis: external examiner reports
  (2006-2011); end of course evaluations (2006-
  2011); additional evaluation surveys
  conducted in 2010 and 2011 as part of our
  curriculum review; and the HEA postgraduate
  student experience survey
• Focus groups with staff including part-time
  tutors
• Feedback audit
Baseline activities revealed
1. Inconsistency in the quality and quantity of
     feedback provided
2. Assessment design (e.g. over-assessment,
     over-reliance on essays, lack of formative
     assessment)
3. Timeliness of the feedback
4. Lack of assessment and feedback dialogue
Reason for Feedback
Focus of Feedback
Re-engineered our assessment
          • Modular approach to
            sequencing of assessment
          • Explicating feedback times
            in a student-tutor charter
          • Development of
            assessment rubrics for all
            summative
          • Increased use of formative
            assessments
PG Certificate in Medical Education


   Equivalent 2   Equivalent 2       Equivalent 2       Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2
   chapters       chapters           chapters           chapters       chapters       chapters       chapters       chapters       chapters       chapters




  Equivalent 2    Equivalent 2       Equivalent 2   Equivalent 2       Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2   Equivalent 2
  chapters        chapters           chapters       chapters           chapters       chapters       chapters       chapters       chapters       chapters




   Revised PG Certificate in Medical Education

                                                                                                                       Formative assessment
Chapters    2                    4                  6                   8              10
                                                                                                                       Medium stakes assessment
                                                                                                                       High stakes assessment
Chapters   2                     4                  6                   8             10




Chapters   2                     4                  6                   8              10


                                                                                                                          ©Mark Russell 2010
Chapters    2                    4                  6                   8              10                           University of Hertfordshire
                                                                                                                                ESCAPE project
Faculty development
     • Workshops about feedback
       and importantly agreement
       on how to give feedback
       (process)
Include self-review
   • Self-review is a scenario where
     students make evaluative
     judgements about the own work
     and produce a written feedback
     commentary

   Nicol, D. (2012). Assessment and feedback - in the hands
   of the student [Online]. JISC. Available:
   http://jiscdesignstudio.pbworks.com/w/page/50118521
   /Assessment%20and%20feedback%20-
   %20in%20the%20hands%20of%20the%20student
   [Accessed 01/02/12].
Content (understanding of theory / principles and          Self-evaluation:
application to own context)

- Understanding of learning theory

- Evidence of critical reflection on learning theory and
key learning and teaching principles

- Evidence of application of learning theory to own
practice                                                   Tutor feedback:




Style, format and language (e.g. structure, coherence,     Self-evaluation:
flow, formatting, use of language)




                                                           Tutor feedback:




Sources and references (e.g. range of references cited,    Self-evaluation:
relevance, consistency, accuracy and completeness of
referencing)



                                                           Tutor feedback:




Which aspect(s) of your assignment would you               Student comment:
specifically like feedback on?




                                                           Tutor feedback:




How did previous feedback inform this assignment?          Student comment:


Name of Tutor:                                                       Date:
Engaging students in processing of
   feedback through the wiki
         When you receive your assignment
         with feedback please upload a copy to
         your wiki and include a reflection on
         the following four questions:
         1. How well does the tutor feedback
             match with your self-evaluation?
         2. What did you learn from the
             feedback process?
         3. What actions, if any, will you take in
             response to the feedback process?
         4. What if anything is unclear about
             the tutor feedback?
Aspects I would like feedback on:
• Ideas of not preparing too rigidly in order to be flexible
  within sessions – practical advice would be welcomed!
• As the first essay I have written in nearly 20 years, I would
  like to know whether the standard overall was acceptable
• Please advise me how I can enter a specific page number in
  a reference when using Endnote (I wanted to add “p. 58” to
  the first reference used in the text since this is an exact
  quote, but failed to find out how I can do it, despite using
  the help option of the software).
• Feedback on whether my peers have had similar thoughts
  for their own teaching, or other ideas that have been
  commonly developed would be beneficial in case I have not
  thought or considered them.
• any part of it
How did previous feedback inform this
            assignment
• It made me realise that instead of focusing on a
  single or a few key teaching principles, I focused
  on many of them without going into much detail.
  Also I had used bullet points in the text.
• Feedback that my writing style was agreeable
  was reassuring. I appreciated knowing my use of
  literature was valid and supportive in the previous
  assignment, so have tried to continue applying
  the literature to my work.
• I tried to be careful to define and reference jargon
• It was really helpful in writing present assignment
I really like the cover sheet and request for
self assessment and what you would like
feedback about ... consistent with principles of
feedback!! (M&L end of module feedback)
Added challenges of:



                       For sharing feedback
              •   Relationship and trust
              •   Asynchronous dialogue and
                  shared understanding
              •   Reliance on written feedback
              •   Technology
Future developments
• Develop a toolkit of e-activities designed to
  improve self, peer and tutor dialogic feedback
  through the use of available technologies such
  as blogs, Friendfeed, Skype/webinars, or
  synchronous chat
• Introduce a patchwork assignment at the end
  of the Certificate and
  Diploma
• Work to refine technology
Project website
http://blog.dundee.ac.uk/interact

More Related Content

Similar to InterACT JISC Case Study

Aace assessment of teacher candidate reflection in e-portfolios
Aace   assessment of teacher candidate reflection in e-portfoliosAace   assessment of teacher candidate reflection in e-portfolios
Aace assessment of teacher candidate reflection in e-portfolios
Daihong Chen
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
ASMZahidKausar
 
MGT708 ORGANISATIONAL BEHAVIOUR T0116 4 March 2016 Page .docx
MGT708 ORGANISATIONAL BEHAVIOUR T0116     4 March 2016 Page .docxMGT708 ORGANISATIONAL BEHAVIOUR T0116     4 March 2016 Page .docx
MGT708 ORGANISATIONAL BEHAVIOUR T0116 4 March 2016 Page .docx
ARIV4
 
Integrated Department Grants As An Implementation Strategy
Integrated  Department  Grants As An  Implementation  StrategyIntegrated  Department  Grants As An  Implementation  Strategy
Integrated Department Grants As An Implementation Strategy
guestb9aaf18
 
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
IvyAnnLeizelQuintas
 

Similar to InterACT JISC Case Study (20)

Aace assessment of teacher candidate reflection in e-portfolios
Aace   assessment of teacher candidate reflection in e-portfoliosAace   assessment of teacher candidate reflection in e-portfolios
Aace assessment of teacher candidate reflection in e-portfolios
 
Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...Improving student engagement with the assessment process in undergraduate mic...
Improving student engagement with the assessment process in undergraduate mic...
 
Progression Points
Progression Points Progression Points
Progression Points
 
BAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdfBAETE_workshop_for_PEV_October_2017.pdf
BAETE_workshop_for_PEV_October_2017.pdf
 
MGT708 ORGANISATIONAL BEHAVIOUR T0116 4 March 2016 Page .docx
MGT708 ORGANISATIONAL BEHAVIOUR T0116     4 March 2016 Page .docxMGT708 ORGANISATIONAL BEHAVIOUR T0116     4 March 2016 Page .docx
MGT708 ORGANISATIONAL BEHAVIOUR T0116 4 March 2016 Page .docx
 
Tuning process in education
Tuning process in educationTuning process in education
Tuning process in education
 
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'DonoghueLearning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
Learning about Assessment Literacy - Nicky Spawls and Clare O'Donoghue
 
EE Introduction Presentation (Students) Class of 2022.pptx
EE Introduction Presentation (Students) Class of 2022.pptxEE Introduction Presentation (Students) Class of 2022.pptx
EE Introduction Presentation (Students) Class of 2022.pptx
 
InterACT fry-up implementation talk
InterACT fry-up implementation talkInterACT fry-up implementation talk
InterACT fry-up implementation talk
 
Assessment for Learning I
Assessment for Learning IAssessment for Learning I
Assessment for Learning I
 
LOTW
LOTWLOTW
LOTW
 
Project guideline
Project guidelineProject guideline
Project guideline
 
Integrated Department Grants As An Implementation Strategy
Integrated  Department  Grants As An  Implementation  StrategyIntegrated  Department  Grants As An  Implementation  Strategy
Integrated Department Grants As An Implementation Strategy
 
CCSS 3 5-2016
CCSS 3 5-2016CCSS 3 5-2016
CCSS 3 5-2016
 
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
2.26.15-CEIT-Assessment-Rubric-Development-PowerPoint.pdf
 
13. using rubrics in student assessment
13. using rubrics in student assessment13. using rubrics in student assessment
13. using rubrics in student assessment
 
ADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdfADOVH Validity and Reliability of Online Assessments.pdf
ADOVH Validity and Reliability of Online Assessments.pdf
 
Capstone Assessment Project
Capstone Assessment ProjectCapstone Assessment Project
Capstone Assessment Project
 
Student peer assessment( BC Campus Symposium 2018)
Student peer assessment( BC Campus Symposium 2018)Student peer assessment( BC Campus Symposium 2018)
Student peer assessment( BC Campus Symposium 2018)
 
Co estimating
Co estimating Co estimating
Co estimating
 

More from r_ajjawi

Education research cultures
Education research culturesEducation research cultures
Education research cultures
r_ajjawi
 
How to get the most out of assessment through feedback
How to get the most out of assessment through feedbackHow to get the most out of assessment through feedback
How to get the most out of assessment through feedback
r_ajjawi
 

More from r_ajjawi (7)

Rethinking feedback practices: Keynote Med Ed Conference Taiwan 18Oct 2014
Rethinking feedback practices: Keynote Med Ed Conference Taiwan 18Oct 2014Rethinking feedback practices: Keynote Med Ed Conference Taiwan 18Oct 2014
Rethinking feedback practices: Keynote Med Ed Conference Taiwan 18Oct 2014
 
Surgical Education Research: Tips, Skills and Opportunities
Surgical Education Research: Tips, Skills and Opportunities Surgical Education Research: Tips, Skills and Opportunities
Surgical Education Research: Tips, Skills and Opportunities
 
Education research cultures
Education research culturesEducation research cultures
Education research cultures
 
Building medical education research community hea event 29052013
Building medical education research community hea event 29052013Building medical education research community hea event 29052013
Building medical education research community hea event 29052013
 
How to get the most out of assessment through feedback
How to get the most out of assessment through feedbackHow to get the most out of assessment through feedback
How to get the most out of assessment through feedback
 
Building medical education research community_about this project
Building medical education research community_about this projectBuilding medical education research community_about this project
Building medical education research community_about this project
 
Review of Assessment and Feedback Literature for HEA sponsored seminar
Review of Assessment and Feedback Literature for HEA sponsored seminarReview of Assessment and Feedback Literature for HEA sponsored seminar
Review of Assessment and Feedback Literature for HEA sponsored seminar
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Recently uploaded (20)

FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 

InterACT JISC Case Study

  • 2. Dr Sean McAleer – Programme Director Grant Murray – Learning Technologist CME
  • 3.
  • 4. Embarked on a literature review… And synthesised some principles: 1. Supports personalised learning 2. Ensures feedback leads to learning 3. Focuses on student self-development 4. Stimulates dialogue 5. Inducts students in the educational culture and assessment and feedback practices 6. Is acceptable to all stakeholders
  • 5. Baseline activities • Document analysis: external examiner reports (2006-2011); end of course evaluations (2006- 2011); additional evaluation surveys conducted in 2010 and 2011 as part of our curriculum review; and the HEA postgraduate student experience survey • Focus groups with staff including part-time tutors • Feedback audit
  • 6. Baseline activities revealed 1. Inconsistency in the quality and quantity of feedback provided 2. Assessment design (e.g. over-assessment, over-reliance on essays, lack of formative assessment) 3. Timeliness of the feedback 4. Lack of assessment and feedback dialogue
  • 7.
  • 10.
  • 11.
  • 12. Re-engineered our assessment • Modular approach to sequencing of assessment • Explicating feedback times in a student-tutor charter • Development of assessment rubrics for all summative • Increased use of formative assessments
  • 13. PG Certificate in Medical Education Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 chapters chapters chapters chapters chapters chapters chapters chapters chapters chapters Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 Equivalent 2 chapters chapters chapters chapters chapters chapters chapters chapters chapters chapters Revised PG Certificate in Medical Education Formative assessment Chapters 2 4 6 8 10 Medium stakes assessment High stakes assessment Chapters 2 4 6 8 10 Chapters 2 4 6 8 10 ©Mark Russell 2010 Chapters 2 4 6 8 10 University of Hertfordshire ESCAPE project
  • 14. Faculty development • Workshops about feedback and importantly agreement on how to give feedback (process)
  • 15. Include self-review • Self-review is a scenario where students make evaluative judgements about the own work and produce a written feedback commentary Nicol, D. (2012). Assessment and feedback - in the hands of the student [Online]. JISC. Available: http://jiscdesignstudio.pbworks.com/w/page/50118521 /Assessment%20and%20feedback%20- %20in%20the%20hands%20of%20the%20student [Accessed 01/02/12].
  • 16. Content (understanding of theory / principles and Self-evaluation: application to own context) - Understanding of learning theory - Evidence of critical reflection on learning theory and key learning and teaching principles - Evidence of application of learning theory to own practice Tutor feedback: Style, format and language (e.g. structure, coherence, Self-evaluation: flow, formatting, use of language) Tutor feedback: Sources and references (e.g. range of references cited, Self-evaluation: relevance, consistency, accuracy and completeness of referencing) Tutor feedback: Which aspect(s) of your assignment would you Student comment: specifically like feedback on? Tutor feedback: How did previous feedback inform this assignment? Student comment: Name of Tutor: Date:
  • 17. Engaging students in processing of feedback through the wiki When you receive your assignment with feedback please upload a copy to your wiki and include a reflection on the following four questions: 1. How well does the tutor feedback match with your self-evaluation? 2. What did you learn from the feedback process? 3. What actions, if any, will you take in response to the feedback process? 4. What if anything is unclear about the tutor feedback?
  • 18. Aspects I would like feedback on: • Ideas of not preparing too rigidly in order to be flexible within sessions – practical advice would be welcomed! • As the first essay I have written in nearly 20 years, I would like to know whether the standard overall was acceptable • Please advise me how I can enter a specific page number in a reference when using Endnote (I wanted to add “p. 58” to the first reference used in the text since this is an exact quote, but failed to find out how I can do it, despite using the help option of the software). • Feedback on whether my peers have had similar thoughts for their own teaching, or other ideas that have been commonly developed would be beneficial in case I have not thought or considered them. • any part of it
  • 19. How did previous feedback inform this assignment • It made me realise that instead of focusing on a single or a few key teaching principles, I focused on many of them without going into much detail. Also I had used bullet points in the text. • Feedback that my writing style was agreeable was reassuring. I appreciated knowing my use of literature was valid and supportive in the previous assignment, so have tried to continue applying the literature to my work. • I tried to be careful to define and reference jargon • It was really helpful in writing present assignment
  • 20. I really like the cover sheet and request for self assessment and what you would like feedback about ... consistent with principles of feedback!! (M&L end of module feedback)
  • 21. Added challenges of: For sharing feedback • Relationship and trust • Asynchronous dialogue and shared understanding • Reliance on written feedback • Technology
  • 22. Future developments • Develop a toolkit of e-activities designed to improve self, peer and tutor dialogic feedback through the use of available technologies such as blogs, Friendfeed, Skype/webinars, or synchronous chat • Introduce a patchwork assignment at the end of the Certificate and Diploma • Work to refine technology