The document discusses using rubrics in Mahara to facilitate self-assessment and course assessment. It presents a course improvement cycle model using assessment for and of learning with rubrics and student artifacts. A rubric plugin is demonstrated that allows adding rubric templates, student self-assessment, and displaying assessment data in tables, charts and graphs to support the course improvement process. The plugin aims to contribute these assessment features to the Mahara community.

1. Rubric plugin: Assessment for / of
learning in Mahara
Makoto Miyazaki, Assistant Professor
Center for Teaching, Learning and Technology,
Kio University
m.miyazaki@kio.ac.jp
mahara hui 2015
AUCKLAND, NEW ZEALAND
9 April 2015

2. Outline
• Introduction
• Course Improvement Cycle Model
• Self-‐‑‒Assessment and Course
Assessment
• Assessment for/of learning
• Rubric Plugin
• Demo

3. Outcomes based course design
Objective of course
Objective of curriculum
Objective of department
Objective of institution
Educational system or
policy objective
DP
CP, CM
Gakushiryoku,
Employability
DP: Diploma Policy
CP: Curriculum Policy
CM: Curriculum Map
Ministry of Education, Assessment, Industry
DP
CP, CM
DP
CP, CM
Learning goal
syllabus, task analysis
Knowledge,
Abilities,
Skills
Rubric,
Checklist
Knowledge,
Abilities,
Skills
Knowledge,
Abilities,
Skills

4. Reflection
Learning is similar to climbing. Reflection is to recognize path
to the top of mountain and to reflect climbed path.
No goal, no path cause student lost the way.

5. Rubric
Rubric is similar to signpost or map.
Rubric:
define skills or competencies as learning goal (top)
show learning achievement as some levels(path to the top).
MAP

6. Course Improvement Cycle Model
Do
Check
Action
Plan
Rubric
・Clarify the learning goals
・NOT what faculty teach,
what student can do
Self-‐‑‒Assessment
・Student checks learning
achievement using rubric
・Record artefacts and reflection
comments as evidence
Course Assessment
・Quantitatively review
studentsʼ’ scores by rubrics
・Difference between studentsʼ’ scores
and teacherʼ’s expected score
Course Improvement
・Improve the course content of
low score items
・Revise the descriptors
Assessment of
learningAssessment for learning
PDCA cycle for authentic-‐‑‒assessment based on learning achievements

7. Self-‐‑‒Assessment and Course Assessment
Lv.1 Lv.2 Lv.3 Lv.4
Skill1 △△△ □□□ ◯◯◯ ◎◎◎
Skill2 △△△ □□□ ◯◯◯ ◎◎◎
Skill3 △△△ □□□ ◯◯◯ ◎◎◎
Student A
Student B
Student C
S1 S2 S3
Student A
3 1 4
Student B
3 1 3
Student C
2 1 3
Avg. 2.7 1.0 3.3
Self-‐‑‒Assessment
Course Assessment
Teacher guess S2
average point is over
2.5, but that is only 1.0.
Teachers find out the
unreachable skills of
students.
Lv.1 Lv.2 Lv.3 Lv.4
Skill1 △△△ □□□ ◯◯◯ ◎◎◎
Skill2 △△△ □□□ ◯◯◯ ◎◎◎
Skill3 △△△ □□□ ◯◯◯ ◎◎◎
Lv.1 Lv.2 Lv.3 Lv.4
Skill1 △△△ □□□ ◯◯◯ ◎◎◎
Skill2 △△△ □□□ ◯◯◯ ◎◎◎
Skill3 △△△ □□□ ◯◯◯ ◎◎◎

8. Assessment for/of learning
Assessment for learning Assessment of learning
Checks learning to decide what to do
next
Checks what has been learned to date
Is designed to assist teachers and
students
Is designed for those not directly involved
in daily learning and teaching
Is used in conversation about learning Is presented in a formal report
Usually detailed, specific and descriptive
feedback in words (instead of numbers,
scores and grades)
Usually gathers information into easily
digestible numbers, scores and grades
Usually focused on improvement,
compared with the student's 'previous
best' and progress toward a standard
Usually compares the student's learning
with either other students or the 'standard'
for a grade level
Needs to involve the student -- the person
most able to improve learning
Does not need to involve the student
Ref.: Barrett, H. 2004. “Electronic Portfolios as Digital Stories of Deep Learning”

9. Rubric Plugin - Features
• Artifact type plugin
• manages templates and rubrics as contents
• shows some view styles such as
• Table layout, radar chart, line graph
• links between studentʼ’s self-‐‑‒assessment and
artifacts as evidence
• shows snapshots of self-‐‑‒assessments
• Block type plugin
• provides pages with adding a rubric
• shows above 3 view styles

10. Rubric artifact (Use case)
Mahara
Add rubric
templates
Add rubric
Self-‐‑‒assessment
Teacher
Student
Support
Stuff

11. Demo
Artifact Type Plugin for Self-‐‑‒Assessment
Block Type Plugin for Pages

12. Concluding Remarks
• We have already started
relay development among Japan MUG
and SCSK which is one of education
supporting company
• If possible, I contribute these plugins for
Mahara community.

13. This work was supported by JSPS
KAKENHI Grant Number 26730177.
Makoto Miyazaki, Assistant Professor
Center for Teaching, Learning and Technology, Kio
University
e-mail: m.miyazaki@kio.ac.jp
Github: https://github.com/eportfolio/rubric-plugin