SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Forty Years of Public Opinion
on Standardized Testing(c)
Richard P. Phelps
(c)
2003, by Richard P. Phelps
The vagaries of
opinion poll data
for use in research
Polling is episodic
Polls are often implemented quickly while a topic is in the
news, leaving little time to pretest and edit items
Pollsters are often unfamiliar with a topic and, as a result,
can pose questions based on naïve or inaccurate
assumptions
There are two types of sampling error and pollsters often tell
you about only one of them
Possible indicators
that a poll is of
low quality
Poll does not publish its response or cooperation rate
Data collection lasted only a few days (better polls will
use at least a week)
The pollsters can often be seen as pundits on television
news talk shows
Respondent groups
in public opinion
polls and research
surveys
Number of studies, 1965-2002
Respondent group
Teachers,
administrators
Public,
parents
Public opinion
polls
13 (5%) 232 (95%)
Research
studies
(evaluations,
surveys)
56 (73%) 21 (27%)
6
5
6
9
7
3
7
7
8
1
8
5
8
9
9
3
9
7
0
1
0
200
Items on standardized testing in n
Year
Pollsters pay more
attention to testing when
there's a national testing
proposal under
consideration
●
George H. W. Bush's national
testing plan (1990-92)
●
Bill Clinton's “Voluntary
National Tests” (1997-99)
●
George W. Bush's “No Child
Left Behind” testing
requirements (2000-02)
➔
(6 polls) +52 pp avg
➔
(6 polls) +48 pp avg
➔
(14 polls) +57 pp avg.
What should tests measure?
Should they be required?
Favor or oppose requiring standardized
national tests to measure...
●
...the academic achievement of students +60 pp
●
...knowledge in 5 core subjects +80 pp
●
...problem-solving skills +74 pp
●
...ability to write a clear composition +75 pp
Favor or oppose making these tests optional for districts?
+37 pp
i.e., +23 pp prefer required over optional tests
How should
tests be used?
Do you think tests should be used to...
(PDK '97)
●
...identify areas in which student need help +76 pp
●
...to rank the local public schools +39 pp
●
...to determine if a student advances to the next grade +28 pp
●
...to determine the level of funding school receives -18 pp
●
...to determine how much teachers should be paid -14 pp
Steadfast in support
of graduation exams
Should students be required to pass tests to graduate? +90 pp
(MOR '85)
●
...if your child failed the first time?
+86 pp
●
...if your child did not receive a diploma? +68 pp
●
...if 20% of low income students did not receive a diploma? +55 pp
Summary of public
opinion on high-
stakes
requirements
Among Education Providers (i.e. teachers, administrators, etc.)
Multiple polls and surveys, 1978-2003
Support for...
Number of
Polls Mean pp dif
...high school graduation test
requirements
26 34.3
...grade-level promotion test
requirements
5 38.4
Summary of public
opinion on high-
stakes
requirements
Among Education Consumers (i.e., public, parents, students, etc.)
Multiple polls and surveys, 1958-2003
Support for...
Number of
Polls Mean pp dif
...high school graduation test
requirements
33 47.3
...grade-level promotion test
requirements
23 45.3

Weitere ähnliche Inhalte

Was ist angesagt?

SCHOLAR Conference 2011 - Electronic Q and A
SCHOLAR Conference 2011 - Electronic Q and ASCHOLAR Conference 2011 - Electronic Q and A
SCHOLAR Conference 2011 - Electronic Q and A
SCHOLAR
 
Week 5 case analysis - rules and expectations
Week 5 case analysis - rules and expectationsWeek 5 case analysis - rules and expectations
Week 5 case analysis - rules and expectations
educw200
 

Was ist angesagt? (20)

SCHOLAR Conference 2011 - Electronic Q and A
SCHOLAR Conference 2011 - Electronic Q and ASCHOLAR Conference 2011 - Electronic Q and A
SCHOLAR Conference 2011 - Electronic Q and A
 
Teaching and Learning Bulletin 6 19 jan
Teaching and Learning Bulletin 6 19 janTeaching and Learning Bulletin 6 19 jan
Teaching and Learning Bulletin 6 19 jan
 
TerraNova
TerraNova TerraNova
TerraNova
 
Sat ppt
Sat pptSat ppt
Sat ppt
 
Introduction to Geometry & Measurement, Math 313
Introduction to Geometry & Measurement, Math 313Introduction to Geometry & Measurement, Math 313
Introduction to Geometry & Measurement, Math 313
 
Disadvantaged Pupils- Staff Briefing
Disadvantaged Pupils- Staff BriefingDisadvantaged Pupils- Staff Briefing
Disadvantaged Pupils- Staff Briefing
 
Week 5 case analysis - rules and expectations
Week 5 case analysis - rules and expectationsWeek 5 case analysis - rules and expectations
Week 5 case analysis - rules and expectations
 
ECA reflections
ECA reflectionsECA reflections
ECA reflections
 
Simposio “Ciencias e Inglés en la evaluación internacional”: Using assessment...
Simposio “Ciencias e Inglés en la evaluación internacional”: Using assessment...Simposio “Ciencias e Inglés en la evaluación internacional”: Using assessment...
Simposio “Ciencias e Inglés en la evaluación internacional”: Using assessment...
 
Simposio “Ciencias e Inglés en la evaluación internacional”: The principles o...
Simposio “Ciencias e Inglés en la evaluación internacional”: The principles o...Simposio “Ciencias e Inglés en la evaluación internacional”: The principles o...
Simposio “Ciencias e Inglés en la evaluación internacional”: The principles o...
 
Last Math Presentation Ever
Last Math Presentation EverLast Math Presentation Ever
Last Math Presentation Ever
 
Students and recorded lectures can you count on them
Students and recorded lectures can you count on themStudents and recorded lectures can you count on them
Students and recorded lectures can you count on them
 
Sat prep
Sat prepSat prep
Sat prep
 
Data Mining to Predict Student Success @A_L_T #altc
Data Mining to Predict Student Success  @A_L_T #altc Data Mining to Predict Student Success  @A_L_T #altc
Data Mining to Predict Student Success @A_L_T #altc
 
Mandatory Activity 1 ALA 1 School Trends 1.2 copy ppt.
Mandatory Activity 1 ALA 1 School Trends 1.2 copy ppt.Mandatory Activity 1 ALA 1 School Trends 1.2 copy ppt.
Mandatory Activity 1 ALA 1 School Trends 1.2 copy ppt.
 
SAT
SATSAT
SAT
 
Year 8 into 9subjectselection
Year 8 into 9subjectselectionYear 8 into 9subjectselection
Year 8 into 9subjectselection
 
Clicker
ClickerClicker
Clicker
 
Survey
SurveySurvey
Survey
 
MetaMath: Evaluation Methodology
MetaMath: Evaluation MethodologyMetaMath: Evaluation Methodology
MetaMath: Evaluation Methodology
 

Ähnlich wie Forty years of polls on standardized tests in education

SRI_SampleReport_NameRedacted
SRI_SampleReport_NameRedactedSRI_SampleReport_NameRedacted
SRI_SampleReport_NameRedacted
Matthew Gonzales
 
SocGradPrelimExperiencesSurveyReport
SocGradPrelimExperiencesSurveyReportSocGradPrelimExperiencesSurveyReport
SocGradPrelimExperiencesSurveyReport
Gina Spitz, Ph.D.
 
5.11.tupper,leitherer
5.11.tupper,leitherer5.11.tupper,leitherer
5.11.tupper,leitherer
afacct
 
5.11.tupper,leitherer
5.11.tupper,leitherer5.11.tupper,leitherer
5.11.tupper,leitherer
afacct
 
At d & data presentation
At d & data presentationAt d & data presentation
At d & data presentation
harrindl
 

Ähnlich wie Forty years of polls on standardized tests in education (20)

TESTA Interactive Masterclass
TESTA Interactive MasterclassTESTA Interactive Masterclass
TESTA Interactive Masterclass
 
The purpose driven assessment system
The purpose driven assessment systemThe purpose driven assessment system
The purpose driven assessment system
 
SRI_SampleReport_NameRedacted
SRI_SampleReport_NameRedactedSRI_SampleReport_NameRedacted
SRI_SampleReport_NameRedacted
 
NB Provincial Assessment Program
NB Provincial Assessment ProgramNB Provincial Assessment Program
NB Provincial Assessment Program
 
Survey designs
Survey designsSurvey designs
Survey designs
 
Aligningwith practicesmay202014
Aligningwith practicesmay202014Aligningwith practicesmay202014
Aligningwith practicesmay202014
 
Using Market Research to Improve Student Experiences
Using Market Research to Improve Student ExperiencesUsing Market Research to Improve Student Experiences
Using Market Research to Improve Student Experiences
 
SocGradPrelimExperiencesSurveyReport
SocGradPrelimExperiencesSurveyReportSocGradPrelimExperiencesSurveyReport
SocGradPrelimExperiencesSurveyReport
 
Template.pptx
Template.pptxTemplate.pptx
Template.pptx
 
Calibrating Assessment Literacy Through Benchmarking Tasks
  Calibrating Assessment Literacy Through Benchmarking Tasks  Calibrating Assessment Literacy Through Benchmarking Tasks
Calibrating Assessment Literacy Through Benchmarking Tasks
 
Improving student learning through programme assessment
Improving student learning through programme assessmentImproving student learning through programme assessment
Improving student learning through programme assessment
 
QCL-14-v3_PROBLEM SOLVING_BANASTHALI UNIVERSITY_TANYA RATHORE
QCL-14-v3_PROBLEM SOLVING_BANASTHALI UNIVERSITY_TANYA RATHOREQCL-14-v3_PROBLEM SOLVING_BANASTHALI UNIVERSITY_TANYA RATHORE
QCL-14-v3_PROBLEM SOLVING_BANASTHALI UNIVERSITY_TANYA RATHORE
 
Nycoss presentation
Nycoss presentationNycoss presentation
Nycoss presentation
 
5.11.tupper,leitherer
5.11.tupper,leitherer5.11.tupper,leitherer
5.11.tupper,leitherer
 
5.11.tupper,leitherer
5.11.tupper,leitherer5.11.tupper,leitherer
5.11.tupper,leitherer
 
SUSD Review of Data
SUSD Review of DataSUSD Review of Data
SUSD Review of Data
 
At d & data presentation
At d & data presentationAt d & data presentation
At d & data presentation
 
Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium Birmingham Assessment and Feedback Symposium
Birmingham Assessment and Feedback Symposium
 
Portsmouth BAM Knowledge and Learning SIG
Portsmouth BAM Knowledge and Learning SIGPortsmouth BAM Knowledge and Learning SIG
Portsmouth BAM Knowledge and Learning SIG
 
Alumni Surveys Three Conceptualizations To Alumni Research
Alumni Surveys  Three Conceptualizations To Alumni ResearchAlumni Surveys  Three Conceptualizations To Alumni Research
Alumni Surveys Three Conceptualizations To Alumni Research
 

Mehr von Richard P Phelps

Comparing achievement and aptitude tests for university admission
Comparing achievement and aptitude tests for university admissionComparing achievement and aptitude tests for university admission
Comparing achievement and aptitude tests for university admission
Richard P Phelps
 
Economic perspectives on testing
Economic perspectives on testingEconomic perspectives on testing
Economic perspectives on testing
Richard P Phelps
 
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
Richard P Phelps
 

Mehr von Richard P Phelps (19)

Dismissive Reviews, Citation Cartels, and the Replication Crisis.pptx
Dismissive Reviews, Citation Cartels, and the Replication Crisis.pptxDismissive Reviews, Citation Cartels, and the Replication Crisis.pptx
Dismissive Reviews, Citation Cartels, and the Replication Crisis.pptx
 
The Successful Degradation of Evidence on Educational Testing in the United S...
The Successful Degradation of Evidence on Educational Testing in the United S...The Successful Degradation of Evidence on Educational Testing in the United S...
The Successful Degradation of Evidence on Educational Testing in the United S...
 
Comparing achievement and aptitude tests for university admission
Comparing achievement and aptitude tests for university admissionComparing achievement and aptitude tests for university admission
Comparing achievement and aptitude tests for university admission
 
Boarding School: Benefits and Drawbacks
Boarding School: Benefits and DrawbacksBoarding School: Benefits and Drawbacks
Boarding School: Benefits and Drawbacks
 
It's a myth: High stakes cause test score inflation
It's a myth: High stakes cause test score inflation It's a myth: High stakes cause test score inflation
It's a myth: High stakes cause test score inflation
 
It's a myth: High stakes cause test score inflation
It's a myth: High stakes cause test score inflationIt's a myth: High stakes cause test score inflation
It's a myth: High stakes cause test score inflation
 
Designing an Assessment System
Designing an Assessment SystemDesigning an Assessment System
Designing an Assessment System
 
Innovaciones en la evaluación en el aula: El uso de pruebas para promover el ...
Innovaciones en la evaluación en el aula: El uso de pruebas para promover el ...Innovaciones en la evaluación en el aula: El uso de pruebas para promover el ...
Innovaciones en la evaluación en el aula: El uso de pruebas para promover el ...
 
Fortalezas y debilidades de las pruebas estandarizadas como mecanismos inclus...
Fortalezas y debilidades de las pruebas estandarizadas como mecanismos inclus...Fortalezas y debilidades de las pruebas estandarizadas como mecanismos inclus...
Fortalezas y debilidades de las pruebas estandarizadas como mecanismos inclus...
 
Arkansas common core presentation
Arkansas common core presentationArkansas common core presentation
Arkansas common core presentation
 
Classroom testing: Using tests to promote learning
Classroom testing: Using tests to promote learningClassroom testing: Using tests to promote learning
Classroom testing: Using tests to promote learning
 
University Admission Testing in Chile: The PSU
University Admission Testing in Chile: The PSUUniversity Admission Testing in Chile: The PSU
University Admission Testing in Chile: The PSU
 
Test benefits slide show
Test benefits slide showTest benefits slide show
Test benefits slide show
 
Economic perspectives on testing
Economic perspectives on testingEconomic perspectives on testing
Economic perspectives on testing
 
L'effet de tests standardisés sur les résultats scolaires des élèves : 1910-...
L'effet de tests standardisés sur les résultats scolaires des élèves :  1910-...L'effet de tests standardisés sur les résultats scolaires des élèves :  1910-...
L'effet de tests standardisés sur les résultats scolaires des élèves : 1910-...
 
The effect of testing on student achievement: 1910-2010
The effect of testing on student achievement: 1910-2010The effect of testing on student achievement: 1910-2010
The effect of testing on student achievement: 1910-2010
 
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
L'effet de tests standardisés sur les résultats scolaires des élèves : Méta-a...
 
Source of Lake Wobegon
Source of Lake WobegonSource of Lake Wobegon
Source of Lake Wobegon
 
Worse Than Plagiarism: Dismissive Reviews
Worse Than Plagiarism: Dismissive ReviewsWorse Than Plagiarism: Dismissive Reviews
Worse Than Plagiarism: Dismissive Reviews
 

Kürzlich hochgeladen

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Kürzlich hochgeladen (20)

Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 

Forty years of polls on standardized tests in education

  • 1. Forty Years of Public Opinion on Standardized Testing(c) Richard P. Phelps (c) 2003, by Richard P. Phelps
  • 2. The vagaries of opinion poll data for use in research Polling is episodic Polls are often implemented quickly while a topic is in the news, leaving little time to pretest and edit items Pollsters are often unfamiliar with a topic and, as a result, can pose questions based on naïve or inaccurate assumptions There are two types of sampling error and pollsters often tell you about only one of them
  • 3. Possible indicators that a poll is of low quality Poll does not publish its response or cooperation rate Data collection lasted only a few days (better polls will use at least a week) The pollsters can often be seen as pundits on television news talk shows
  • 4. Respondent groups in public opinion polls and research surveys Number of studies, 1965-2002 Respondent group Teachers, administrators Public, parents Public opinion polls 13 (5%) 232 (95%) Research studies (evaluations, surveys) 56 (73%) 21 (27%)
  • 6. Pollsters pay more attention to testing when there's a national testing proposal under consideration ● George H. W. Bush's national testing plan (1990-92) ● Bill Clinton's “Voluntary National Tests” (1997-99) ● George W. Bush's “No Child Left Behind” testing requirements (2000-02) ➔ (6 polls) +52 pp avg ➔ (6 polls) +48 pp avg ➔ (14 polls) +57 pp avg.
  • 7. What should tests measure? Should they be required? Favor or oppose requiring standardized national tests to measure... ● ...the academic achievement of students +60 pp ● ...knowledge in 5 core subjects +80 pp ● ...problem-solving skills +74 pp ● ...ability to write a clear composition +75 pp Favor or oppose making these tests optional for districts? +37 pp i.e., +23 pp prefer required over optional tests
  • 8. How should tests be used? Do you think tests should be used to... (PDK '97) ● ...identify areas in which student need help +76 pp ● ...to rank the local public schools +39 pp ● ...to determine if a student advances to the next grade +28 pp ● ...to determine the level of funding school receives -18 pp ● ...to determine how much teachers should be paid -14 pp
  • 9. Steadfast in support of graduation exams Should students be required to pass tests to graduate? +90 pp (MOR '85) ● ...if your child failed the first time? +86 pp ● ...if your child did not receive a diploma? +68 pp ● ...if 20% of low income students did not receive a diploma? +55 pp
  • 10. Summary of public opinion on high- stakes requirements Among Education Providers (i.e. teachers, administrators, etc.) Multiple polls and surveys, 1978-2003 Support for... Number of Polls Mean pp dif ...high school graduation test requirements 26 34.3 ...grade-level promotion test requirements 5 38.4
  • 11. Summary of public opinion on high- stakes requirements Among Education Consumers (i.e., public, parents, students, etc.) Multiple polls and surveys, 1958-2003 Support for... Number of Polls Mean pp dif ...high school graduation test requirements 33 47.3 ...grade-level promotion test requirements 23 45.3