6. “Standards”, not “standardisation”
Generalising the
Performance
principles of good
assessment will
encourage
diversification and
excellence
Minimum standard
Score distributions for eight groups
(institutions, faculties, subjects, etc.)
7. Commitment to
effectiveness
Effectiveness
Little data Happiness data
data
Elite Mass Universal
9. Plan Data for
leadership
Improve Act
Evaluate
Hunch
10. Enhanced management, evaluation and quality
monitoring – to do more, better, with less
Higher education growing in significance and Shaping
scale: clear rationales for increasing output complexities
and ensuring quality outcomes
Huge cost and competitive pressures – evidence-based
management helps expand provision with quality
Further reliance on flawed, simplistic rankings will
constrain growth and prosperity – robust
multidimensional perspectives required
Internationalisation pervades all facets of
teaching and learning, and graduate outcomes –
international perspectives are vital
13. Are valid and reliable cross-cultural/-institutional/-
linguistic comparisons of HE learning outcomes
scientifically and practically feasible?
AHELO at
a glance
An international feasibility study – not a ‘pilot’
Conceived ~2005, announced 06, scoping 06-09, work 10-13
>300 individuals involved
directly
~270 HEIs
For students near end of ‘bachelor degree’, also faculty, national
managers, institutional coordinators, policymakers, expert advisors, etc.
Up to 30,000 leaders,
faculty, students
Design, develop, validate and evaluate Many thousands of public
frameworks,
tests, infrastructure and processes stakeholders
~$30m total cost
HEI reports (not for systems), along with international reports and
materials, and recommendations for a main study
14. „Strands‟ of testing
Generic Skills Economics Engineering
Contextual dimension
National Context Information
Institution Context Instrument
Faculty Context Instrument
Student Context Instrument
22. Assessment
Build frameworks collaborations
Produce items
Analyse and
report
Select and use
Types of
Definitions Tasks Processes Results
sharing
23. How
Preparation
Establish assessment
coordinating centre
Translate and collaborations
validate instruments work
Assessment
Select students
Engage institutions
Administer secure
Train institution test
coordinators
Score responses
Prepare for testing
Verify and provide Prepare multilevel
Reporting
data benchmarking
reports
Distribute reports
to institutions
Interpretation for
monitoring and
improvement
