1. TRansforming Assessment &
Feedback For Institutional Change:
our journey so far…
Birmingham | May 2013
Professor Mark Stubbs
Head of Learning & Research Technologies
m.stubbs@mmu.ac.uk http://twitter.com/thestubbs
http://slideshare.net/markstubbs
2. Strand A : Goal = institution-wide impact
• Hitched TRAFFIC to the EQAL delivery wagon
• Took our baseline report to committees that matter
• Influenced ICP on Assessment of Students
• Analysed assessment data & appeals
3. EQAL: new rules for summative assessment
• Aim to address over-assessment in FT UG provision
– Max 2 summative elements per 30 credit module
– Rolling out year-by-year to all UGs from Sep 2011
2011/12 (n=8,708) 2012/13 (n=8,646)
FB SATISFCN HAND-INS BUNCHING FB SATISFCN HAND-INS BUNCHING
L4 3.75 5.61 1.29 3.79 (+1%) 5.59 (0%) 1.25 (-3%)
L5 3.70 10.47 1.38 3.77 (+2%) 5.76 (-45%) 1.25 (-10%)
L6 3.72 7.81 1.30 3.8 (+2%) 7.86 (+1%) 1.26 (-3%)
FB SATISFCN = response (5=Agree Strongly...1=Disagree Strongly) to
Feedback on my work helped me to clarify things I did not understand
BUNCHING = HAND-INS / WEEKS_WITH_HAND_INS
4. A&F Analytics
• Statistical analysis of ~17,000 cases of
student satisfaction, attainment &
assignment submission patterns
– Satisfaction with course organisation predicts
overall satisfaction
– Satisfaction with feedback NOT a predictor of
overall satisfaction
– Satisfaction with feedback NOT a predictor of
average marks
– Assignment bunching NOT a predictor of
average marks but partial dependence plot is
interesting
BUNCHING = HAND-INS
WEEKS_WITH_HAND-INS
6. Where TRAFFIC goes next …
Open
source
EAM
A&F
Analytics
A&F
Lifecycle
Webinar
May 15
Find out
more from
our blog
Moodle 2.4
pilot planned
for Sep
Linking
Moodle &
SRS
Notify
SRS of
Moodle
submits
Notify
SRS of
Moodle
marks
EAM