SlideShare ist ein Scribd-Unternehmen logo
1 von 16
 
The reliability of educational assessments Dylan Wiliam www.dylanwiliam.net Ofqual Annual Lecture, Coventry: 7 May 2009
The argument ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Dealing with uncertainty in society ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The very first high-stakes assessment… ,[object Object],[object Object],[object Object]
Reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Uncertainty in assessing English ,[object Object]
Uncertainty in assessing mathematics ,[object Object]
Measures of reliability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Test length and reliability From To Just about the only way to increase the reliability of a test is to make it longer, or narrower (which amounts to the same thing). 0.70 0.75 0.80 0.85 0.90 0.95 0.70 1.0 0.75 1.3 1.0 0.80 1.7 1.3 1.0 0.85 2.4 1.9 1.4 1.0 0.90 3.9 3.0 2.3 1.6 1.0 0.95 8.1 6.3 4.8 3.4 2.1 1.0
Reliability is not what we really want ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Reliability v consistency ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Uncertainty in assessment at A-level ,[object Object],[object Object]
Here’s the table that got me into trouble… ,[object Object]
AERA, APA, NCME Standards (4 e/d,1999) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object]

Weitere ähnliche Inhalte

Andere mochten auch

A level reform and university entrance - A view from the Regulator
A level reform and university entrance - A view from the RegulatorA level reform and university entrance - A view from the Regulator
A level reform and university entrance - A view from the RegulatorOfqual Slideshare
 
Regulatory IT Systems (RITS) Roadshow Presentation
Regulatory IT Systems (RITS) Roadshow PresentationRegulatory IT Systems (RITS) Roadshow Presentation
Regulatory IT Systems (RITS) Roadshow PresentationOfqual Slideshare
 
Fiona Pethick Speech To PAA\ VQ-SET National Conference
Fiona Pethick Speech To PAA\ VQ-SET National ConferenceFiona Pethick Speech To PAA\ VQ-SET National Conference
Fiona Pethick Speech To PAA\ VQ-SET National ConferenceOfqual Slideshare
 
Getting to grips with RITS
Getting to grips with RITSGetting to grips with RITS
Getting to grips with RITSOfqual Slideshare
 
What should we want from GCSEs & A levels?
What should we want from GCSEs & A levels?What should we want from GCSEs & A levels?
What should we want from GCSEs & A levels?Ofqual Slideshare
 
GCSE Science Score Seminar
GCSE Science Score SeminarGCSE Science Score Seminar
GCSE Science Score SeminarOfqual Slideshare
 
Maintaining standards of qualifications for Summer 2010
Maintaining standards of qualifications for Summer 2010Maintaining standards of qualifications for Summer 2010
Maintaining standards of qualifications for Summer 2010Ofqual Slideshare
 
SSAT National Headteacher Steering Group
SSAT National Headteacher Steering GroupSSAT National Headteacher Steering Group
SSAT National Headteacher Steering GroupOfqual Slideshare
 
Dylan Wiliam's slides - 2013 11-21 bcssa
Dylan Wiliam's slides - 2013 11-21 bcssaDylan Wiliam's slides - 2013 11-21 bcssa
Dylan Wiliam's slides - 2013 11-21 bcssaHélène Galdin-O'Shea
 
the Independent Regulator
the Independent Regulatorthe Independent Regulator
the Independent RegulatorOfqual Slideshare
 

Andere mochten auch (12)

A level reform and university entrance - A view from the Regulator
A level reform and university entrance - A view from the RegulatorA level reform and university entrance - A view from the Regulator
A level reform and university entrance - A view from the Regulator
 
Regulatory IT Systems (RITS) Roadshow Presentation
Regulatory IT Systems (RITS) Roadshow PresentationRegulatory IT Systems (RITS) Roadshow Presentation
Regulatory IT Systems (RITS) Roadshow Presentation
 
Fiona Pethick Speech To PAA\ VQ-SET National Conference
Fiona Pethick Speech To PAA\ VQ-SET National ConferenceFiona Pethick Speech To PAA\ VQ-SET National Conference
Fiona Pethick Speech To PAA\ VQ-SET National Conference
 
Getting to grips with RITS
Getting to grips with RITSGetting to grips with RITS
Getting to grips with RITS
 
What should we want from GCSEs & A levels?
What should we want from GCSEs & A levels?What should we want from GCSEs & A levels?
What should we want from GCSEs & A levels?
 
GCSE Science Score Seminar
GCSE Science Score SeminarGCSE Science Score Seminar
GCSE Science Score Seminar
 
Maintaining standards of qualifications for Summer 2010
Maintaining standards of qualifications for Summer 2010Maintaining standards of qualifications for Summer 2010
Maintaining standards of qualifications for Summer 2010
 
SSAT National Headteacher Steering Group
SSAT National Headteacher Steering GroupSSAT National Headteacher Steering Group
SSAT National Headteacher Steering Group
 
Achieving Quality
Achieving QualityAchieving Quality
Achieving Quality
 
Maintaining Standards
Maintaining StandardsMaintaining Standards
Maintaining Standards
 
Dylan Wiliam's slides - 2013 11-21 bcssa
Dylan Wiliam's slides - 2013 11-21 bcssaDylan Wiliam's slides - 2013 11-21 bcssa
Dylan Wiliam's slides - 2013 11-21 bcssa
 
the Independent Regulator
the Independent Regulatorthe Independent Regulator
the Independent Regulator
 

Ă„hnlich wie Dylan Wiliam's presentation at Ofqual's Chief Regulator's Report event

How to judge approximations? Pitfalls of statistics
How to judge approximations? Pitfalls of statisticsHow to judge approximations? Pitfalls of statistics
How to judge approximations? Pitfalls of statisticswinterschool
 
A New Generation of Assessments: 3 Things You Need to Know
A New Generation of Assessments: 3 Things You Need to KnowA New Generation of Assessments: 3 Things You Need to Know
A New Generation of Assessments: 3 Things You Need to Knowcatapultlearn
 
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptx
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptxCopie de PRESENTATION_ RELIABILITY _ VALIDITY.pptx
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptxMonsefJraid
 
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docx
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docxQuantitative MethodsChoosing a Sample.pptxChoosing a Samp.docx
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docxamrit47
 
The Reliability Programme: Leading the way to better tests and assessments
The Reliability Programme: Leading the way to better tests and assessmentsThe Reliability Programme: Leading the way to better tests and assessments
The Reliability Programme: Leading the way to better tests and assessmentsOfqual Slideshare
 
Testing in language programs (chapter 8)
Testing in language programs (chapter 8)Testing in language programs (chapter 8)
Testing in language programs (chapter 8)Tahere Bakhshi
 
Meaning and Importance of Statistics
Meaning and Importance of StatisticsMeaning and Importance of Statistics
Meaning and Importance of StatisticsFlipped Channel
 
Fulcher standardized testing
Fulcher standardized testingFulcher standardized testing
Fulcher standardized testingMelikarj
 
The Developmental Coordination Disorder Questionnaire
The Developmental Coordination Disorder QuestionnaireThe Developmental Coordination Disorder Questionnaire
The Developmental Coordination Disorder QuestionnaireMandy Cross
 
Validity & reliability
Validity & reliabilityValidity & reliability
Validity & reliabilityPraisy AB Vineesh
 
anchoring-heuristic Decision Making
anchoring-heuristic Decision Makinganchoring-heuristic Decision Making
anchoring-heuristic Decision MakingĂ–zkan Ă–zer
 
Descriptive statistics research survey analysis (part 2)
Descriptive statistics research   survey analysis (part 2)Descriptive statistics research   survey analysis (part 2)
Descriptive statistics research survey analysis (part 2)Ghivitha Kalimuthu
 
Descriptive statistics research survey analysis (part 2)
Descriptive statistics research   survey analysis (part 2)Descriptive statistics research   survey analysis (part 2)
Descriptive statistics research survey analysis (part 2)Ghivitha Kalimuthu
 
Interventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleInterventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleMatt Williams
 
Interventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleInterventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleMatt Williams
 

Ă„hnlich wie Dylan Wiliam's presentation at Ofqual's Chief Regulator's Report event (20)

The Error of Our Ways
The Error of Our WaysThe Error of Our Ways
The Error of Our Ways
 
How to judge approximations? Pitfalls of statistics
How to judge approximations? Pitfalls of statisticsHow to judge approximations? Pitfalls of statistics
How to judge approximations? Pitfalls of statistics
 
A New Generation of Assessments: 3 Things You Need to Know
A New Generation of Assessments: 3 Things You Need to KnowA New Generation of Assessments: 3 Things You Need to Know
A New Generation of Assessments: 3 Things You Need to Know
 
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptx
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptxCopie de PRESENTATION_ RELIABILITY _ VALIDITY.pptx
Copie de PRESENTATION_ RELIABILITY _ VALIDITY.pptx
 
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docx
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docxQuantitative MethodsChoosing a Sample.pptxChoosing a Samp.docx
Quantitative MethodsChoosing a Sample.pptxChoosing a Samp.docx
 
EBP-2.ppt
EBP-2.pptEBP-2.ppt
EBP-2.ppt
 
The Reliability Programme: Leading the way to better tests and assessments
The Reliability Programme: Leading the way to better tests and assessmentsThe Reliability Programme: Leading the way to better tests and assessments
The Reliability Programme: Leading the way to better tests and assessments
 
1 1 data
1 1 data1 1 data
1 1 data
 
Testing in language programs (chapter 8)
Testing in language programs (chapter 8)Testing in language programs (chapter 8)
Testing in language programs (chapter 8)
 
Meaning and Importance of Statistics
Meaning and Importance of StatisticsMeaning and Importance of Statistics
Meaning and Importance of Statistics
 
Fulcher standardized testing
Fulcher standardized testingFulcher standardized testing
Fulcher standardized testing
 
lecture5.ppt
lecture5.pptlecture5.ppt
lecture5.ppt
 
The Developmental Coordination Disorder Questionnaire
The Developmental Coordination Disorder QuestionnaireThe Developmental Coordination Disorder Questionnaire
The Developmental Coordination Disorder Questionnaire
 
Validity & reliability
Validity & reliabilityValidity & reliability
Validity & reliability
 
Chapter 11
Chapter 11Chapter 11
Chapter 11
 
anchoring-heuristic Decision Making
anchoring-heuristic Decision Makinganchoring-heuristic Decision Making
anchoring-heuristic Decision Making
 
Descriptive statistics research survey analysis (part 2)
Descriptive statistics research   survey analysis (part 2)Descriptive statistics research   survey analysis (part 2)
Descriptive statistics research survey analysis (part 2)
 
Descriptive statistics research survey analysis (part 2)
Descriptive statistics research   survey analysis (part 2)Descriptive statistics research   survey analysis (part 2)
Descriptive statistics research survey analysis (part 2)
 
Interventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleInterventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scale
 
Interventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scaleInterventions for children’s dental anxiety: Validating a coping styles scale
Interventions for children’s dental anxiety: Validating a coping styles scale
 

Mehr von Ofqual Slideshare

Ofqual Audit Approach: April 2015
Ofqual Audit Approach: April 2015Ofqual Audit Approach: April 2015
Ofqual Audit Approach: April 2015Ofqual Slideshare
 
The Ethics of Accountability in Education Assessment: Ofqual ethics symposium
The Ethics of Accountability in Education Assessment: Ofqual ethics symposiumThe Ethics of Accountability in Education Assessment: Ofqual ethics symposium
The Ethics of Accountability in Education Assessment: Ofqual ethics symposiumOfqual Slideshare
 
The Rational Teacher: Ofqual ethics symposium
The Rational Teacher: Ofqual ethics symposiumThe Rational Teacher: Ofqual ethics symposium
The Rational Teacher: Ofqual ethics symposiumOfqual Slideshare
 
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...Ofqual Slideshare
 
Teacher Ethics in Summative Assessment: Ofqual ethics symposium
Teacher Ethics in Summative Assessment: Ofqual ethics symposiumTeacher Ethics in Summative Assessment: Ofqual ethics symposium
Teacher Ethics in Summative Assessment: Ofqual ethics symposiumOfqual Slideshare
 
Next steps for the regulation of adult vocational qualifications: March 2015
Next steps for the regulation of adult vocational qualifications: March 2015Next steps for the regulation of adult vocational qualifications: March 2015
Next steps for the regulation of adult vocational qualifications: March 2015Ofqual Slideshare
 
Phil Beach's presentation to the Association of Colleges A level reform confe...
Phil Beach's presentation to the Association of Colleges A level reform confe...Phil Beach's presentation to the Association of Colleges A level reform confe...
Phil Beach's presentation to the Association of Colleges A level reform confe...Ofqual Slideshare
 
Assessment arrangements for reformed religious studies qualifications
Assessment arrangements for reformed religious studies qualificationsAssessment arrangements for reformed religious studies qualifications
Assessment arrangements for reformed religious studies qualificationsOfqual Slideshare
 
Preparing for validity audits
Preparing for validity auditsPreparing for validity audits
Preparing for validity auditsOfqual Slideshare
 
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...Ofqual Slideshare
 
Ofqual’s work on quality of marking
Ofqual’s work on quality of marking Ofqual’s work on quality of marking
Ofqual’s work on quality of marking Ofqual Slideshare
 
Securing Standards in Qualifications and Assessment (October 2014)
Securing Standards in Qualifications and Assessment (October 2014)Securing Standards in Qualifications and Assessment (October 2014)
Securing Standards in Qualifications and Assessment (October 2014)Ofqual Slideshare
 
Regulatory strategy, malpractice, event notifications and whistleblowing even...
Regulatory strategy, malpractice, event notifications and whistleblowing even...Regulatory strategy, malpractice, event notifications and whistleblowing even...
Regulatory strategy, malpractice, event notifications and whistleblowing even...Ofqual Slideshare
 
New approaches to dealing with malpractice and maladministration - cskills pr...
New approaches to dealing with malpractice and maladministration - cskills pr...New approaches to dealing with malpractice and maladministration - cskills pr...
New approaches to dealing with malpractice and maladministration - cskills pr...Ofqual Slideshare
 
Malpractice - lessons learned - ncfe presentation
Malpractice - lessons learned - ncfe presentationMalpractice - lessons learned - ncfe presentation
Malpractice - lessons learned - ncfe presentationOfqual Slideshare
 
Malpractice and maladministration
Malpractice and maladministrationMalpractice and maladministration
Malpractice and maladministrationOfqual Slideshare
 

Mehr von Ofqual Slideshare (20)

Ofqual Audit Approach: April 2015
Ofqual Audit Approach: April 2015Ofqual Audit Approach: April 2015
Ofqual Audit Approach: April 2015
 
The Ethics of Accountability in Education Assessment: Ofqual ethics symposium
The Ethics of Accountability in Education Assessment: Ofqual ethics symposiumThe Ethics of Accountability in Education Assessment: Ofqual ethics symposium
The Ethics of Accountability in Education Assessment: Ofqual ethics symposium
 
The Rational Teacher: Ofqual ethics symposium
The Rational Teacher: Ofqual ethics symposiumThe Rational Teacher: Ofqual ethics symposium
The Rational Teacher: Ofqual ethics symposium
 
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...
Teacher Malpractice in Assessment: the International Context: Ofqual Ethics S...
 
Teacher Ethics in Summative Assessment: Ofqual ethics symposium
Teacher Ethics in Summative Assessment: Ofqual ethics symposiumTeacher Ethics in Summative Assessment: Ofqual ethics symposium
Teacher Ethics in Summative Assessment: Ofqual ethics symposium
 
Next steps for the regulation of adult vocational qualifications: March 2015
Next steps for the regulation of adult vocational qualifications: March 2015Next steps for the regulation of adult vocational qualifications: March 2015
Next steps for the regulation of adult vocational qualifications: March 2015
 
Phil Beach's presentation to the Association of Colleges A level reform confe...
Phil Beach's presentation to the Association of Colleges A level reform confe...Phil Beach's presentation to the Association of Colleges A level reform confe...
Phil Beach's presentation to the Association of Colleges A level reform confe...
 
Assessment arrangements for reformed religious studies qualifications
Assessment arrangements for reformed religious studies qualificationsAssessment arrangements for reformed religious studies qualifications
Assessment arrangements for reformed religious studies qualifications
 
Preparing for validity audits
Preparing for validity auditsPreparing for validity audits
Preparing for validity audits
 
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...
Westminster Forum: The future for Apprenticeships in England: Trailblazers, f...
 
Ofqual’s work on quality of marking
Ofqual’s work on quality of marking Ofqual’s work on quality of marking
Ofqual’s work on quality of marking
 
Securing Standards in Qualifications and Assessment (October 2014)
Securing Standards in Qualifications and Assessment (October 2014)Securing Standards in Qualifications and Assessment (October 2014)
Securing Standards in Qualifications and Assessment (October 2014)
 
Regulatory strategy, malpractice, event notifications and whistleblowing even...
Regulatory strategy, malpractice, event notifications and whistleblowing even...Regulatory strategy, malpractice, event notifications and whistleblowing even...
Regulatory strategy, malpractice, event notifications and whistleblowing even...
 
A level reform
A level reformA level reform
A level reform
 
New approaches to dealing with malpractice and maladministration - cskills pr...
New approaches to dealing with malpractice and maladministration - cskills pr...New approaches to dealing with malpractice and maladministration - cskills pr...
New approaches to dealing with malpractice and maladministration - cskills pr...
 
Malpractice - lessons learned - ncfe presentation
Malpractice - lessons learned - ncfe presentationMalpractice - lessons learned - ncfe presentation
Malpractice - lessons learned - ncfe presentation
 
Event notifications
Event notificationsEvent notifications
Event notifications
 
Malpractice and maladministration
Malpractice and maladministrationMalpractice and maladministration
Malpractice and maladministration
 
Whistle blowing
Whistle blowingWhistle blowing
Whistle blowing
 
Regulatory operations
Regulatory operationsRegulatory operations
Regulatory operations
 

KĂĽrzlich hochgeladen

AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationRosabel UA
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxCarlos105
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxAshokKarra1
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 

KĂĽrzlich hochgeladen (20)

AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translation
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSGRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTS
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 

Dylan Wiliam's presentation at Ofqual's Chief Regulator's Report event

  • 2. The reliability of educational assessments Dylan Wiliam www.dylanwiliam.net Ofqual Annual Lecture, Coventry: 7 May 2009
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10. Test length and reliability From To Just about the only way to increase the reliability of a test is to make it longer, or narrower (which amounts to the same thing). 0.70 0.75 0.80 0.85 0.90 0.95 0.70 1.0 0.75 1.3 1.0 0.80 1.7 1.3 1.0 0.85 2.4 1.9 1.4 1.0 0.90 3.9 3.0 2.3 1.6 1.0 0.95 8.1 6.3 4.8 3.4 2.1 1.0
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.