ppt

1. Elements of a quality assessment
system
Kerrie-Anne Sommerfeld
Rubric Training Solutions

2. 1. What I want to know is……………..
2. My role is teacher/manager/consultant/other?

4. 1311
0
NUMBER OF RTOS AUDITED BY ASQA
2013 - 2014

5. assessments done
properly 26%
assessments needs
improvement
74%
% RTOS MEETING ASSESSMENT REQUIREMENTS

6. Common assessment issues
Presentation Title Here

7. Common assessment issues
Presentation Title Here
• Assessments don’t assess what they are meant to assess
• Assessments are too hard/ too easy
• Lack of clear instructions to students & assessors
• No (or unreliable) marking criteria
• Third party evidence put forward as primary evidence
• Not enough evidence to make sound assessment judgements
• Lack of industry consultation
• Assessors don’t have currency/competency at the unit level
• Assessments not being validated or not validated ‘properly’

8. Standards for RTOs 2015
Conduct effective assessment 1.8 – 1.12
Overview
1.8 RTOs have an assessment system in place
A system to ensure assessments
• Meet the principles of assessment and rules of evidence
• Meet the requirements of the Training Package
• Including RPL assessments

9. Where to start?

10. Build strong foundations

12. accountability

13. Build strong foundations

14. Build strong foundations

15. Assessment policies and procedures
• Developing/identifying good assessments
• Conducting assessment
• Recording and storing assessments
• Validating assessment
Templates
• Assessment validation schedule
• Assessment validation report
• Assessment mapping template
• Assessment task templates

16. Policies and procedures

18. Policy and/or procedure Templates / guidelines
1. Plan assessment TAS
Industry consultation record
2. Develop assessment tools Assessment task templates for:
Practical assessments
Knowledge assessments
Portfolio assessments
RPL assessments
Third party evidence
3. Map assessments Assessment mapping templates
4. Validate assessments Assessment Validation Report
Validation schedule for all qualifications/skills sets/ stand
alone units
5. Conducting assessment Assessment appeals
Time for assessments to be judged
Recording results
RTO allowance for repeating assessments
Retention and storage of assessments
6. Evaluating assessments Student feedback/industry feedback/Continuous
improvement strategies

19. Qualification
e.g SIB50110
Overview docs
Unit code 1
Unit code 2
Unit code 3
Unit code 4
Unit code 5
etc
Assessment mapping
Assessment validation
Delivery/session plans
Assessments
Learner guide
Teacher guide
TAS
Assessment validation
schedule
Industry consultation
Student feedback
Work placement
Suggested training and assessment system
Policies/ Procedures/ templates/professional
development/management support/monitoring

20. Why is validation so important?

21. Validation is
quality control
of your training
and assessment

22. Training and
assessment strategy
for the qualification
Assessment tasks
Mapping information
for at least 2
units/qualification
Sample of completed
student assessments

23. Checking our assessments are ok
Assess the skills and knowledge required by the unit
Relevant to work practices
Clear instructions to students
Clear instructions to assessors
Good marking guides
Don’t over assess/ assess things not required
Can be adjusted for certain learners
Our judgements of competent/ not yet competent are
reasonable

24. Validation schedule for all qualifications/skill sets/
Stand alone units
What units, when and who
2015 Year 1
Qualification (e.g. 15 units)
2016
2017
2018
2019 Year 5
Assessments for at least 2 units
including a sample of completed
assessments have been validated

25. AURE318866A
Repair electrical systems
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments

26. AURE318866A
Repair electrical systems
Current TAE qualification or
assessor skill set
Current industry skills and
knowledge in the unit but not
using these assessments
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments

27. AURE318866A
Repair electrical systems
Current industry skills and
knowledge in the unit but is
not a qualified trainer/assessor
Current TAE qualification or
assessor skill set
Current industry skills and
knowledge in the unit but not
using these assessments
Current TAE qualification
or assessor skill set
without the skills and
knowledge in the unit
Current TAE qualification or
assessor skill set and a
trainer/assessor of this unit
using these assessments

28. TAE Training and Education
And for providers of

29. Standards for RTOs 2015
Delivery of TAE qualifications 1.21 – 1.25
Overview
By 2016
trainers delivering any qualification or skill set from the TAE Training
Package must hold the qualification at least to the level they are
delivering or higher level qualification in adult education
Demonstrate that the assessments, policies and procedures have
been independently validated
By 2017
Trainers delivering any qualification or skill set from the TAE Training
Package must hold will need to hold a TAE Diploma or higher level
qualification in adult education to deliver any TAE qualification or
skill set or work under supervision of a person that does.

30. TAE qualifications
TAE assessor skill set
Current knowledge and
skills in VET learning and
teaching
The TAE qualification or
skill set to the level
being validated

31. TAE qualifications
TAE assessor skill set
Current knowledge and
skills in VET learning and
teaching
The TAE qualification or
skill set to the level
being validated
Not employed or
subcontracted by the
RTO
Have no other
involvement or
interest in the
operations of the RTO

32. The resources your RTO
uses for training And
how you structure your
delivery
The industry skills and
knowledge trainers and
assessors need
Your training strategies and resources
That assessments ensure
graduates have the skills and
knowledge required by
industry and the units of
competency
Assessment methods

33. Ask and record industry responses to the following questions :
Do the assessment method/s reflect workplace situations?
Is the workplace environment appropriately simulated?
Do assessments demonstrate that students can apply their skills in
different situations?
Are Assessments assessing things not required by the unit?
Do these assessments equip students with entry level skills
expected by the unit for my industry?
Other comments?

34. TAE Training and Education
And for providers of

35. Training and
assessment strategy
for the qualification
Assessment tasks
Mapping information
Completed student
assessments
Assessment policies and
procedures
• Developing/identifying good
assessments
• Conducting assessment
• Recording and storing assessments
• Validating assessment

36. Refer to
• ASQA’s Guide to RTO Standards
• ASQA Fact Sheet: Conducting Validation
• ASQA Fact Sheet: Using third party evidence
to assess competency
• ASQA Guide: Developing Assessment Tools

37. Key requirements of assessments
1. Clear written instructions to students including:
How they will be assessed, when, when, how long they have, what
resources/equipment they need to supply, what
resources/equipment will be supplied
2. Clear written instructions to assessors including:
Any special requirements in terms of setting up for assessment, how
much support students can be provided, how to record results and
store completed assessments
3. Detailed marking guide
E.g. Observations checklist/ model answers to questions/rubric
4. Meet Principles of Assessment and Rules of Evidence

38. Do your assessments meet the principles of assessment?

39. Principles of assessment - VRFF
Valid Reliable
Flexible Fair

40. Validation includes reviewing a statistically valid
sample of completed assessments against the
rules of evidence.
refer to ASQA’s validation sample size calculator in the
Conducting Validation fact sheet

41. Rules of Evidence
Valid Current
Sufficient Authentic
(VIC / SA)

42. Policy and/or procedure Templates / guidelines
1. Plan assessment TAS
Industry consultation record
2. Develop assessment tools Assessment task templates for:
Practical assessments
Knowledge assessments
Portfolio assessments
RPL assessments
Third party evidence
3. Map assessments Assessment mapping templates
4. Validate assessments Assessment Validation Report
Validation schedule for all qualifications/skills sets/ stand
alone units
5. Conducting assessment Assessment appeals
Time for assessments to be judged
Recording results
RTO allowance for repeating assessments
Retention and storage of assessments
6. Evaluating assessments Student feedback/industry feedback/Continuous
improvement strategies

44. The quality stamp

45. Other associated webinars on this topic:
• Techniques to help you successfully map assessments
• Engage effectively with employers and industry
• Volume of learning and amount of training –
introduction
• ACPET Validation Sessions in Victoria initially then
nationally - sharyn.bellingham@acpet.edu.au