SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Group-work: automated peer assessment,
moderation and feedback
Tim Bullough
Dan Hibbert
School of Engineering
Univ of Liverpool L&T Conf 23 June ‘10
Good way for students to get to know themselves and each other.
Reflection of own and others contributions.
Achieve outcomes that couldn’t be achieved individually.
Simulate real-life experiences (key for Engineers’ employability) &
practice project management theory
Reduce the amount of assessment (single group output) & allows
an assessment of students’ contributions without an academic
having to observe everything
Why do group/team work?
How is group/team work developed within
the Engineering curriculum?
Year 1: Short “active learning” experiences (labs, design-build-test) & a
superficial introduction to team roles. Some reflection on team dynamics and
contributions.
Year 2: Theories of team-work and project management are taught. Group
activities vary from half-day to whole-year. Reflection on contribution, and
peer moderation of group marks for group output(s)/achievements.
Year 3&4: Formal “capstone” industry-facilitated 1-2 year team projects
(required for accreditation).
Problems/concerns: group membership, dealing with conflict
and lack of contribution; assessment and peer moderation criteria and
process.......
What is peer moderation?
Process to allow individual contribution to a group activity to be “rewarded”:
i.e. individual mark = group mark x “peer moderation factor”
How do we do it?
1. Single group mark awarded for each assessed output.
2. Academic decides on criteria and extent to which individual contribution
should be rewarded.
3. Students rate their own and others contributions against these criteria.
4. Use an algorithm to produce an individual “peer moderation factor” for
each student in the group (keeping the average factor as 1)
5. Individual marks obtained
+ 6. FEEDBACK TO STUDENTS (later)
Old paper-based peer moderation proformas
Dan............WebPA
e.g. MATS213 “Manufactured Article” activity: 4-5 weeks of lab-
based group-work with single group wiki assessment.........
FEEDBACK
FEEDBACK
FEEDBACK
FEEDBACK
FEEDBACK
Discuss..........
10 minutes to kick-off!!!

Weitere ähnliche Inhalte

Was ist angesagt?

Project Slide Show
Project Slide ShowProject Slide Show
Project Slide Show
sonjadeeann
 
Looking atstudentwork, michelle swanson theron cosgrave
Looking atstudentwork, michelle swanson theron cosgraveLooking atstudentwork, michelle swanson theron cosgrave
Looking atstudentwork, michelle swanson theron cosgrave
NAFCareerAcads
 
Business Collaboratives UEP
Business Collaboratives UEPBusiness Collaboratives UEP
Business Collaboratives UEP
ccpc
 
EES2014_full paper_Benjamin Aisya Aug 30 2014
EES2014_full paper_Benjamin Aisya Aug 30 2014EES2014_full paper_Benjamin Aisya Aug 30 2014
EES2014_full paper_Benjamin Aisya Aug 30 2014
Benjamin Aisya
 
Stanford Design Lab: Ideation by Wendy Elman
Stanford Design Lab: Ideation by Wendy ElmanStanford Design Lab: Ideation by Wendy Elman
Stanford Design Lab: Ideation by Wendy Elman
Wendy Elman
 

Was ist angesagt? (20)

Cit 2011-multiple-integrating-final
Cit 2011-multiple-integrating-finalCit 2011-multiple-integrating-final
Cit 2011-multiple-integrating-final
 
The ADDIE Model
The ADDIE ModelThe ADDIE Model
The ADDIE Model
 
eTwinning Live profile: rubric
eTwinning Live profile: rubriceTwinning Live profile: rubric
eTwinning Live profile: rubric
 
Rubric: eTwinning profile
Rubric: eTwinning profileRubric: eTwinning profile
Rubric: eTwinning profile
 
Making a plan iatefl
Making a plan iateflMaking a plan iatefl
Making a plan iatefl
 
Instructional Design
Instructional DesignInstructional Design
Instructional Design
 
Learning networks-2012 griffiths-richards-harrison
Learning networks-2012 griffiths-richards-harrisonLearning networks-2012 griffiths-richards-harrison
Learning networks-2012 griffiths-richards-harrison
 
A Collaborative System for Corporate Performance Evaluation using Gamificatio...
A Collaborative System for Corporate Performance Evaluation using Gamificatio...A Collaborative System for Corporate Performance Evaluation using Gamificatio...
A Collaborative System for Corporate Performance Evaluation using Gamificatio...
 
Instructional Systems Design (ISD) ADDIE 2.0
Instructional Systems Design (ISD) ADDIE 2.0Instructional Systems Design (ISD) ADDIE 2.0
Instructional Systems Design (ISD) ADDIE 2.0
 
Digitally enhanced Patchwork Text Assessment workshop
Digitally enhanced Patchwork Text Assessment workshopDigitally enhanced Patchwork Text Assessment workshop
Digitally enhanced Patchwork Text Assessment workshop
 
Project Slide Show
Project Slide ShowProject Slide Show
Project Slide Show
 
Slicing the evaluation cake
Slicing the evaluation cakeSlicing the evaluation cake
Slicing the evaluation cake
 
Looking atstudentwork, michelle swanson theron cosgrave
Looking atstudentwork, michelle swanson theron cosgraveLooking atstudentwork, michelle swanson theron cosgrave
Looking atstudentwork, michelle swanson theron cosgrave
 
Business Collaboratives UEP
Business Collaboratives UEPBusiness Collaboratives UEP
Business Collaboratives UEP
 
EES2014_full paper_Benjamin Aisya Aug 30 2014
EES2014_full paper_Benjamin Aisya Aug 30 2014EES2014_full paper_Benjamin Aisya Aug 30 2014
EES2014_full paper_Benjamin Aisya Aug 30 2014
 
Stanford Design Lab: Ideation by Wendy Elman
Stanford Design Lab: Ideation by Wendy ElmanStanford Design Lab: Ideation by Wendy Elman
Stanford Design Lab: Ideation by Wendy Elman
 
work relationships - lesson 1
work relationships - lesson 1work relationships - lesson 1
work relationships - lesson 1
 
CRLI Seminar Series - Thomas Carey
CRLI Seminar Series - Thomas CareyCRLI Seminar Series - Thomas Carey
CRLI Seminar Series - Thomas Carey
 
Instructional Design Concepts
Instructional Design ConceptsInstructional Design Concepts
Instructional Design Concepts
 
University to Job - Prototypes
University to Job - PrototypesUniversity to Job - Prototypes
University to Job - Prototypes
 

Ähnlich wie Tim bullough &_dan_hibbert

Course outline epc
Course outline epcCourse outline epc
Course outline epc
G-ny Gynie
 

Ähnlich wie Tim bullough &_dan_hibbert (20)

Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?
 
Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?Tbl, pbl, ebl, scale up, buzz, virtual or what?
Tbl, pbl, ebl, scale up, buzz, virtual or what?
 
Teamwork seda may 2018
Teamwork seda may 2018Teamwork seda may 2018
Teamwork seda may 2018
 
Pascual Ale06
Pascual Ale06Pascual Ale06
Pascual Ale06
 
A study of a multi-discipline built environment project
A study of a multi-discipline built environment projectA study of a multi-discipline built environment project
A study of a multi-discipline built environment project
 
Building resilience within our university community: Enterprise education at ...
Building resilience within our university community: Enterprise education at ...Building resilience within our university community: Enterprise education at ...
Building resilience within our university community: Enterprise education at ...
 
Course outline EPC
Course outline EPCCourse outline EPC
Course outline EPC
 
epc course outline
epc course outline epc course outline
epc course outline
 
01 com30103 course outline (mra september 2015)
01 com30103 course outline (mra september 2015)01 com30103 course outline (mra september 2015)
01 com30103 course outline (mra september 2015)
 
EPC
EPCEPC
EPC
 
Course outline ep com
Course outline ep comCourse outline ep com
Course outline ep com
 
EPC module outline
EPC module outlineEPC module outline
EPC module outline
 
Epc Course Outline
Epc Course OutlineEpc Course Outline
Epc Course Outline
 
Course outline
Course outlineCourse outline
Course outline
 
EPC Course outline
EPC Course outlineEPC Course outline
EPC Course outline
 
FNBE0115 EPC - MODULE OUTLINE
FNBE0115 EPC - MODULE OUTLINEFNBE0115 EPC - MODULE OUTLINE
FNBE0115 EPC - MODULE OUTLINE
 
Course outline
Course outlineCourse outline
Course outline
 
EPC course outline
EPC course outlineEPC course outline
EPC course outline
 
Course outline epc
Course outline epcCourse outline epc
Course outline epc
 
Effective Public Communication Course Outline
Effective Public Communication Course OutlineEffective Public Communication Course Outline
Effective Public Communication Course Outline
 

Mehr von Educational Development Division, University of Liverpool

Mehr von Educational Development Division, University of Liverpool (20)

Bob read
Bob readBob read
Bob read
 
Ian sinha
Ian sinhaIan sinha
Ian sinha
 
Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012 Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012
 
Tammy thiele june 2012
Tammy thiele  june 2012Tammy thiele  june 2012
Tammy thiele june 2012
 
Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012
 
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
 
Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...
 
FOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ LiverpoolFOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ Liverpool
 
The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...
 
Mike knight
Mike knightMike knight
Mike knight
 
Audio feedback – better feedback?
Audio feedback – better feedback?Audio feedback – better feedback?
Audio feedback – better feedback?
 
Vaughn l&t 21012 presentation
Vaughn l&t 21012 presentationVaughn l&t 21012 presentation
Vaughn l&t 21012 presentation
 
Glynis cousin keynote
Glynis cousin keynoteGlynis cousin keynote
Glynis cousin keynote
 
Alison hobden
Alison hobdenAlison hobden
Alison hobden
 
Arora anu
Arora anuArora anu
Arora anu
 
M hammond
M hammondM hammond
M hammond
 
Lt conf 2011 drywood presentation
Lt conf 2011 drywood presentationLt conf 2011 drywood presentation
Lt conf 2011 drywood presentation
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L+t2011(csu)
L+t2011(csu)L+t2011(csu)
L+t2011(csu)
 

Kürzlich hochgeladen

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Kürzlich hochgeladen (20)

SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 

Tim bullough &_dan_hibbert

  • 1. Group-work: automated peer assessment, moderation and feedback Tim Bullough Dan Hibbert School of Engineering Univ of Liverpool L&T Conf 23 June ‘10
  • 2. Good way for students to get to know themselves and each other. Reflection of own and others contributions. Achieve outcomes that couldn’t be achieved individually. Simulate real-life experiences (key for Engineers’ employability) & practice project management theory Reduce the amount of assessment (single group output) & allows an assessment of students’ contributions without an academic having to observe everything Why do group/team work?
  • 3. How is group/team work developed within the Engineering curriculum? Year 1: Short “active learning” experiences (labs, design-build-test) & a superficial introduction to team roles. Some reflection on team dynamics and contributions. Year 2: Theories of team-work and project management are taught. Group activities vary from half-day to whole-year. Reflection on contribution, and peer moderation of group marks for group output(s)/achievements. Year 3&4: Formal “capstone” industry-facilitated 1-2 year team projects (required for accreditation). Problems/concerns: group membership, dealing with conflict and lack of contribution; assessment and peer moderation criteria and process.......
  • 4. What is peer moderation? Process to allow individual contribution to a group activity to be “rewarded”: i.e. individual mark = group mark x “peer moderation factor” How do we do it? 1. Single group mark awarded for each assessed output. 2. Academic decides on criteria and extent to which individual contribution should be rewarded. 3. Students rate their own and others contributions against these criteria. 4. Use an algorithm to produce an individual “peer moderation factor” for each student in the group (keeping the average factor as 1) 5. Individual marks obtained + 6. FEEDBACK TO STUDENTS (later)
  • 5. Old paper-based peer moderation proformas
  • 7. e.g. MATS213 “Manufactured Article” activity: 4-5 weeks of lab- based group-work with single group wiki assessment......... FEEDBACK