PISA Lessons from International Student Assessment Reforms
•Als PPTX, PDF herunterladen•
1 gefällt mir•653 views
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (20)
Ähnlich wie PISA Lessons from International Student Assessment Reforms
Ähnlich wie PISA Lessons from International Student Assessment Reforms (20)
Mehr von OECD
Mehr von OECD (10)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
PISA Lessons from International Student Assessment Reforms
- 1. Programme for International Student Assessment Strong performers and successful reformersLessons from PISA President’s Forum Andreas Schleicher Special advisor to the Secretary-General on Education Policy Head of the Indicators and Analysis Division, EDU
- 2. A world of change – highereducation Expenditure per student at tertiary level (USD) Cost per student Graduate supply Tertiary-type A graduation rate
- 3. A world of change – highereducation Expenditure per student at tertiary level (USD) United States Cost per student Finland Japan Graduate supply Tertiary-type A graduation rate
- 4. A world of change – highereducation Expenditure per student at tertiary level (USD) Australia Finland United Kingdom Tertiary-type A graduation rate
- 5. A world of change – highereducation Expenditure per student at tertiary level (USD) Tertiary-type A graduation rate
- 6. A world of change – highereducation Expenditure per student at tertiary level (USD) Tertiary-type A graduation rate
- 7. A world of change – highereducation Expenditure per student at tertiary level (USD) Tertiary-type A graduation rate
- 8. A world of change – highereducation Expenditure per student at tertiary level (USD) Tertiary-type A graduation rate
- 9. A world of change – highereducation Expenditure per student at tertiary level (USD) Tertiary-type A graduation rate
- 10. A world of change – highereducation Expenditure per student at tertiary level (USD) United States Australia United Kingdom Finland Tertiary-type A graduation rate
- 11. A world of change – highereducation Expenditure per student at tertiary level (USD) United States Australia A A United Kingdom Finland A Tertiary-type A graduation rate
- 12. Changing skill demands The great collaborators and orchestrators The more complex the globalised world becomes, the more individuals and companies need various forms of co-ordination and management The great synthesisers Conventionally, our approach to problems was breaking them down into manageable bits and pieces, today we create value by synthesising disparate bits together The great explainers The more content we can search and access, the more important the filters and explainers become
- 13. Changing skill demands The great versatilists Specialists generally have deep skills and narrow scope, giving them expertise that is recognised by peers but not valued outside their domain Generalists have broad scope but shallow skills Versatilists apply depth of skill to a progressively widening scope of situations and experiences, gaining new competencies, building relationships, and assuming new roles. They are capable not only of constantly adapting but also of constantly learning and growing The great personalisers A revival of interpersonal skills, skills that have atrhophied to some degree because of the industrial age and the Internet The great localisers Localising the global
- 14. PISA 2009 in brief PISA countries in 2000 2003 1998 2001 2006 2009 Coverage of world economy 83% 77% 81% 85% 86% 87% Over half a million students… representing 28 million 15-year-olds in 74* countries/economies … took an internationally agreed 2-hour test… Goes beyond testing whether students can reproduce what they were taught… … to assess students’ capacity to extrapolate from what they know and creatively apply their knowledge in novel situations … and responded to questions on… their personal background, their schools and their engagement with learning and school Parents, principals and system leaders provided data on… school policies, practices, resources and institutional factors that help explain performance differences . * Data for Costa Rica, Georgia, India, Malaysia, Malta, Mauritius, Venezuela and Vietnam will be published in December 2011
- 15. How the demand for skills has changedEconomy-wide measures of routine and non-routine task input (US) Mean task input as percentiles of the 1960 task distribution The dilemma of assessments: The skills that are easiest to teach and test are also the ones that are easiest to digitise, automate and outsource (Levy and Murnane)
- 16. PISA 2009 in brief PISA countries in 2000 2003 1998 2001 2006 2009 Coverage of world economy PISA seeks to… … Support governments to prepare students… … to deal with more rapid change than ever before… … for jobs that have not yet been created… … using technologies that have not yet been invented… … to solve problems that we don’t yet know will arise … Provide a basis for policy dialogue and global collaboration in defining and implementing educational goals, policies and practices Show countries what achievements are possible Help governments set policy targets in terms of measurable goals achieved elsewhere Gauge the pace of educational progress Facilitate peer-learning on policy and practice . 83% 77% 81% 85% 86% 87%
- 17. PISA 2009 in brief PISA countries in 2000 2003 1998 2001 2006 2009 Key principles ‘Crowd sourcing’ and collaboration PISA draws together leading expertise and institutions from participating countries to develop instruments and methodologies… … guided by governments on the basis of shared policy interests Cross-national relevance and transferability of policy experiences Emphasis on validity across cultures, languages and systems Frameworks built on well-structured conceptual understandingof assessment areas and contextual factors Triangulation across different stakeholder perspectives Systematic integration of insights from students, parents, school principals and system-leaders Advanced methods with different grain sizes A range of methods to adequately measure intended constructs with different grain sizes to serve different decision-making needs Productive feedback, at appropriate levels of detail, to fuel improvement at multiple levels . Coverage of world economy 83% 77% 81% 85% 86% 87%
- 18. High reading performance Average performanceof 15-year-olds in reading – extrapolate and apply … 17 countries perform below this line Low reading performance
- 19. High reading performance Average performanceof 15-year-olds in science – extrapolate and apply High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 20. High reading performance 2009 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 21. High reading performance 2009 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 22. High performing systems often prioritize the quality of teachers over the size of classesContribution of various factors to upper secondary teacher compensation costsper student as a percentage of GDP per capita (2004) Percentage points
- 23. High reading performance 2009 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 24. High reading performance 2000 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 25. High reading performance 2000 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Other rapid improvers in reading: Peru, Indonesia, Latvia, Israel and BrazilRapid improvers in mathematics: Mexico, Brazil, Turkey, Greece, Portugal, Italy and Germany Rapid improvers in science: Qatar, Turkey, Portugal, Korea, Brazil, Colombia, Italy, Norway, United States, Poland Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 26. Changes in performance by type of task Increase percentage correct 2009 2009 2006 2006
- 27. Percentage of students reading for enjoyment Percentage 2006 2006 2009 2009
- 28. Student performance PISA Index of socio-economic background Advantage Disadvantage School performance and social background Canada Private school Public school in rural area Public school in urban area 700
- 29. Student engagement with learning and school
- 30. Students' views of their teacher-student relations
- 31. Students’ views of how well teachers motivate them to read Index of teachers’ stimulation of students’ reading engagement based on students’ reports %
- 33. Does it all matter?
- 34. Increased likelihood of postsec. particip. at age 19/21 associated with PISA reading proficiency at age 15 (Canada)after accounting for school engagement, gender, mother tongue, place of residence, parental, education and family income (reference group PISA Level 1) Odds ratiohigher education entry School marks at age 15 PISA performance at age 15
- 35. High reading performance Average performanceof 15-year-olds in reading – extrapolate and apply … 17 countries perform below this line Low reading performance
- 36. Relationship between test performance and economic outcomesAnnual improved GDP from raising performance by 25 PISA points Percent addition to GDP
- 37. Increase average performance by 25 PISA points (Total 115 trillion $) bn$
- 38. What does it all mean?
- 39. Tools Standards Curricula Technology Assessments Data systems Processes Selection Preparation Recruitment/induction Work organisation Development Supervision Retention People TeachersPrincipals Support personnel Families Practices Instruction Intervention Support systems Design, implementation and alignment of policies Student learning
- 42. Schools transferring students due to low achievement or behavioural problems: 33%, and where students are grouped by ability for all subjects: 38% Schools transferring students due to low achievement or behavioural problems: 15%, and where students are grouped by ability for all subjects: 8% Grade repetition: 7% Students out of modal starting ages: 7% How school systems select and group students for schools, grades and programmes Grade repetition: 29% Students out of modal starting ages: 11% High vertical differentiation Low vertical differentiation Low horizontal differentiation at the school level High horizontal differentiation at the school level High horizontal differentiation at the school level Low horizontal differentiation at the school level Number of programmes: 1.1 First age of selection: 15.8 Selective schools: 17% Lowhorizontaldifferentiation at thesystemlevel Australia, Canada, Denmark, Estonia, Finland, Greece, Iceland,NewZealand, Norway,Poland, Sweden, United States, United Kingdom, Kazakhstan, Latvia, Lithuania, Russian Federation Jordan Spain, Argentina, Brazil, Tunisia, Uruguay Chile, Colombia, Peru Number of programmes: 3.0 First age of selection: 14.5 Selective schools: 42% Ireland, Israel, Italy, Japan,Korea, Slovenia, Albania, Azerbaijan, Dubai (UAE), Hong Kong-China, Montenegro, Shanghai-China, Thailand Indonesia, Kyrgyzstan, Qatar, Romania, Chinese Taipei Luxembourg, Macao-China, Panama Medium horizontaldifferentiation at thesystemlevel Mexico, Portugal Number of programmes: 4.3 First age of selection: 11.2 Selective schools: 61% Highhorizontaldifferentiation at thesystemlevel Austria, Czech Republic, Hungary, Slovak Republic, Croatia, Liechtenstein, Singapore Turkey, Bulgaria, Serbia Belgium, Germany, Trinidad and Tobago Netherlands, Switzerland
- 43. High reading performance 2009 Durchschnittliche Schülerleistungen im Bereich Mathematik High average performance Large socio-economic disparities High average performance High social equity Strong socio-economic impact on student performance Socially equitable distribution of learning opportunities Early selection and institutional differentiation High degree of stratification Low degree of stratification Low average performance Large socio-economic disparities Low average performance High social equity Low reading performance
- 45. Well established delivery chain through which curricular goals translate into instructional systems, instructional practices and student learning (intended, implemented and achieved)
- 46. High level of metacognitive content of instruction Lessons from PISA on successful education systems
- 48. Attracting, developing and retaining high quality teachers and school leaders and a work organisation in which they can use their potential
- 49. Instructional leadership and human resource management in schools
- 50. Keeping teaching an attractive profession
- 51. System-wide career developmentLessons from PISA on successful education systems
- 52. Teacher in-service development No matter how good the pre-service education for teachers is … it cannot prepare teachers for rapidly changing challenges throughout their careers High-performing systems rely on ongoing professional to… … update individuals’ knowledge of a subject in light of recent advances … update skills and approaches in light of new teaching techniques, new circumstances, and new research … enable teachers to apply changes made to curricula or teaching practice … enable schools to develop and apply new strategies concerning the curriculum and teaching practice … exchange information and expertise among teachers and others … help weaker teachers become more effective . Effective professional development is on-going… … includes training, practice and feedback, and adequate time and follow-up support
- 53. Percentage of teachers without mentoring and induction Source: OECD, TALIS Table 3.6 (Fig 2.1 Building a High-Quality Teaching Profession)
- 54. Relatively few teachers participate in the kinds of professional development which they find has the largest impact on their work Comparison of teachers participating in professional development activities and teachers reporting moderate or high level impact by types of activity
- 55. Relatively few teachers participate in the kinds of professional development which they find has the largest impact on their work Comparison of teachers participating in professional development activities and teachers reporting moderate or high level impact by types of activity
- 58. Degree to which students have incentives to take tough courses and study hard
- 60. Improve their own performance and the performance of their colleagues
- 61. Pursue professional development opportunities that lead to stronger pedagogical practices
- 62. A balance between vertical and lateral accountability
- 63. Effective instruments to manage and share knowledge and spread innovation – communication within the system and with stakeholders around it
- 64. A capable centre with authority and legitimacy to act Lessons from PISA on successful education systems
- 65. How school systems are governed Schools competing with other schools: 73% Private schools: 8% Schools competing with other schools: 89% Private schools: 52% Less school choice More school choice Less school autonomy in curriculum and assessment Establishing student assessment policies: 61% Choosing which textbooks are used: 55% Determining course content: 14% Greece, Mexico, Portugal, Turkey, Albania, Azerbaijan, Bulgaria, Croatia, Kazakhstan, Jordan, Montenegro, Qatar, Serbia, Tunisia, Uruguay _ More school autonomy in curriculum and assessment Austria, Canada, Czech Republic, Denmark, Estonia, Finland, Germany, Hungary, Iceland, Israel, Italy, Japan, Luxembourg, New Zealand, Norway, Poland, Slovak Republic, Slovenia, Spain, Sweden, Switzerland, United Kingdom, United States, Panama, Argentina, Brazil, Colombia, Kyrgyzstan, Latvia, Liechtenstein, Lithuania, Peru, Romania, Russian Federation, Shanghai-China, Singapore, Thailand, Trinidad and Tobago Australia, Belgium, Chile, Ireland, Korea, Netherlands, Dubai (UAE), Hong Kong-China, Indonesia, Macao-China, Chinese Taipei Establishing student assessment policies: 92% Choosing which textbooks are used: 97% Determining course content: 85%
- 66. How school systems use student assessments Schools competing with other schools: 73% Private schools: 8% Schools competing with other schools: 89% Private schools: 52% Infrequent use of achievement data for benchmarking and information purposes identified below Frequent use of achievement data for benchmarking and information purposes identified below Establishing student assessment policies: 61% Choosing which textbooks are used: 55% Determining course content: 14% Deciding which courses are offered: 18% Infrequent use of achievement data for decision making Finland, Greece, Ireland, Luxembourg, the Netherlands, Switzerland, Liechtenstein, Austria, Belgium, Germany Hungary, Norway, Turkey, Montenegro, Tunisia, Slovenia Denmark, Italy, Japan, Argentina, Macao-China, Chinese Taipei, Spain, Uruguay Australia, Canada, Chile, Czech Republic, Estonia, Iceland, Israel, Korea, Mexico, New Zealand, Poland, Portugal, Slovak Republic, Sweden, United Kingdom, United States, Albania, Azerbaijan, Brazil, Bulgaria, Colombia, Croatia, Dubai (UAE), Hong Kong-China, Indonesia, Jordan, Kazakhstan, Kyrgyzstan, Latvia, Lithuania, Panama, Peru, Qatar, Romania, Russian Federation, Shanghai-China, Singapore, Thailand, Trinidad and Tobago, Serbia Frequent use of achievement data for decision making Establishing student assessment policies: 92% Choosing which textbooks are used: 97% Determining course content: 85% Deciding which courses are offered: 87%
- 67. How much autonomy individual schools have over resource allocation
- 68. Local responsibility and system-level prescription Trend in OECD countries System-level prescription ‘Tayloristic’ work organisation The past The industrial model, detailed prescription of what schools do The future Every school an effective school Current trend Building capacity Schools leading reform Teachers as ‘knowledge workers’
- 69. School autonomy, accountability and student performanceImpact of school autonomy on performance in systems with and without accountability arrangements PISA score in reading
- 70. Public and private schools % Score point difference Private schoolsperform better Public schoolsperform better
- 72. Alignment of resources with key challenges (e.g. attracting the most talented teachers to the most challenging classrooms)
- 74. An outward orientation of the system to keep the system learning, international benchmarks as the ‘eyes’ and ‘ears’ of the system
- 75. Recognising challenges and potential future threats to current success, learning from them, designing responses and implementing theseLessons from PISA on successful education systems
- 77. Alignment of policies across all aspects of the system
- 78. Coherence of policies over sustained periods of time
- 80. Fidelity of implementation (without excessive control)Lessons from PISA on successful education systems
- 81. Education reform trajectories The old bureaucratic system The modern enabling system Student inclusion Some students learn at high levels All students need to learn at high levels Curriculum, instruction and assessment Routine cognitive skills, rote learning Learning to learn, complex ways of thinking, ways of working Teacher quality Few years more than secondary High-level professional knowledge workers Work organisation ‘Tayloristic’, hierarchical Flat, collegial Accountability Primarily to authorities Primarily to peers and stakeholders
- 83. High policy value Providing countries with effective tools to review the choices and trade-offs which they face as they seek to improve the effectiveness and efficiency of their education systems Quick wins Must haves Examining individual, institutional and systemic factors associated with quality, equity and efficiency in education Understanding drivers of successful reform trajectories Monitoring educational progress Extending the range of competencies through which quality is assessed A brief history of PISA PISA 2000 More difficult Less difficult Measuring student learning outcomes in key subjects Electronic delivery of assessments Proliferation of assessment areas . Money pits Low-hanging fruits Moderate policy value
- 84. High policy value Providing countries with effective tools to review the choices and trade-offs which they face as they seek to improve the effectiveness and efficiency of their education systems Quick wins Must haves Examining individual, institutional and systemic factors associated with quality, equity and efficiency in education Understanding drivers of successful reform trajectories Monitoring educational progress Extending the range of competencies through which quality is assessed PISA 2003 More difficult Less difficult Measuring student learning outcomes in key subjects and establishing the comparative strengths and weaknesses of education systems Electronic delivery of assessments Proliferation of assessment areas . Money pits Low-hanging fruits Moderate policy value
- 85. High policy value Providing countries with effective tools to review the choices and trade-offs which they face as they seek to improve the effectiveness and efficiency of their education systems Quick wins Must haves Examining individual, institutional and systemic factors associated with quality, equity and efficiency in education Understanding drivers of successful reform trajectories Monitoring educational progress Extending the range of competencies through which quality is assessed PISA 2006 More difficult Less difficult Measuring student learning outcomes in key subjects and establishing the comparative strengths and weaknesses of education systems Electronic delivery of assessments Proliferation of assessment areas . Money pits Low-hanging fruits Moderate policy value
- 86. High policy value Providing countries with effective tools to review the choices and trade-offs which they face as they seek to improve the effectiveness and efficiency of their education systems Quick wins Must haves Examining individual, institutional and systemic factors associated with quality, equity and efficiency in education Understanding drivers of successful reform trajectories Monitoring educational progress Extending the range of competencies through which quality is assessedAffective dimensions of outcomes Assessment of digital literacy PISA 2009 More difficult Less difficult Measuring student learning outcomes in key subjects and establishing the comparative strengths and weaknesses of education systems Electronic delivery of assessments Proliferation of assessment areas Money pits Low-hanging fruits Moderate policy value
- 87. Beyond schooling
- 88. Parental support at the beginning of primary school Score point difference between students whose parents often do (weekly or daily) and those who do not: "talk about what they had done"
- 89. Performance difference between students who had attended pre-primary school for more than one year and those who did not Score point difference Observed performance advantage Performance advantage after accounting for socio-economic factors
- 90. Find out more about PISA at… OECD www.pisa.oecd.org All national and international publications The complete micro-level database U.S. White House www.data.gov Email: Andreas.Schleicher@OECD.org … and remember: Without data, you are just another person with an opinion Thank you !
Hinweis der Redaktion
- I am delighted to share our analysis of the latest PISA findings with you, and I am particularly pleased to do this in Japan, a country which has maintained its high levels of student performance, and which has seen important improvements in student engagement since 2000, an area that traditionally was one of Japan’s weaknesses.I want to start with a brief overview of the objectives and origins of PISA, then analyse where Japan stands on measures ranging from student performance up to student attitudes to learning and engagement with school, and then conclude with what we have learned about effective policies and practices that may help Japan to further raise its already impressive educational performance.
- The pace of change is most clearly visible in higher education, and I want to bring two more dimensions into the picture here. Each dot on this chart represents one country. The horizontal axis shows you the college graduation rate, the proportion of an age group that comes out of the system with a college degree. The vertical axis shows you how much it costs to educate a graduate per year.
- *Lets now add where the money comes from into the picture, the larger the dot, the larger the share of private spending on college education, such as tuition.The chart shows the US as the country with the highest college graduation rate, and the highest level of spending per student. The US is also among the countries with the largest share of resources generated through the private sector. That allows the US to spend roughly twice as much per student as Europe. US, FinlandThe only thing I have not highlighted so far is that this was the situation in 1995. And now watch this closely as you see how this changed between 1995 and 2005.
- You see that in 2000, five years, later, the picture looked very different. While in 1995 the US was well ahead of any other country – you see that marked by the dotted circle, in 2000 several other countries had reached out to this frontier. Look at Australia, in pink.
- What do weseefrom this?- Every country has seen improvements in terms of output The example of the UK shows that you can set ambitious national targets and actually get close to them within a decade What you cannot do is prevent others from surpassing themAnd in a global economy, it is no longer simply improvement by national standards, but the best prepared individuals, companies and countries that are the benchmarks for success. What international comparisons can do is to show how the goal post keeps changing.
- Thatwasallveryquick, letusgothroughthisdevelopmentonceagain
- We started to develop PISA in 1998 with 28 OECD countries, but since then country participation has grown and our latest PISA assessment covers 74 education systems that make up 86% of the world economy. Coverage in China and India is still patchy though, in China we have now covered 12 provinces and in India we are working in two states only.One aspect that makes PISA stand apart from traditional school tests is that PISA puts less emphasis on whether students can reproduce what they were taught, but focuses on their capacity to extrapolate from what they know and creatively apply what they know in novel situations. Some people complain that PISA is unfair, because it confronts students with tasks they have not dealt with before, but if you take that line, then you should consider life unfair, because in this fast-changing world, that is precisely what will expect students later in life.Students also provided data on their socio-economic context, their schools and their attitudes and engagement with school and learning.In addition, PISA collected data from parents, principals and system leaders to yield insights on school policies, practices, resources and institutional factors that help explain performance differences.
- Levy and Murnane show how the composition of the US work force has changed. What they show is that, between 1970 and 2000, work involving routine manual input, the jobs of the typical factory worker, was down significantly. Non-routine manual work, things we do with our hands, but in ways that are not so easily put into formal algorithms, was down too, albeit with much less change over recent years – and that is easy to understand because you cannot easily computerise the bus driver or outsource your hairdresser. All that is not surprising, but here is where the interesting story begins: Among the skill categories represented here, routine cognitive input, that is cognitive work that you can easily put into the form of algorithms and scripts saw the sharpest decline in demand over the last couple of decades, with a decline by almost 8% in the share of jobs. So those middle class white collar jobs that involve the application of routine knowledge, are most at threat today. And that is where schools still put a lot of their focus and what we value in multiple choice accountability systems.The point here is, that the skills that are easiest to teach and test are also the skills that are easiest to digitise, automatise and offshore. If that is all what we do in school, we are putting our youngsters right up for competition with computers, because those are the things computers can do better than humans, and our kids are going to loose out before they even started. Where are the winners in this process? These are those who engage in expert thinking – the new literacy of the 21st century, up 8% - and complex communication, up almost 14%.
- The idea of PISA is to support governments in preparing students for life. In a sense, PISA provides schools and nations with a mirror in which they can judge their performance in light of what other systems show is possible to achieve.
- Let me conclude this introduction with a couple of factors that were key to the success of PISAAt the heart of PISA is not a bureaucracy but the largest international network of educators and researchers. These experts develop and validate the assessment material and methodologies, guided by governments on the basis of shared policy interests.Whenever you engage in cross-national collaboration, you will run into the question of whether measures and policy lessons travels well across cultural and national contexts. That is an area where PISA has made unprecedented progress.Third, in the field of education, nobody really knows how learning occurs in the classroom, but everybody has a view on this. So in PISA, we approached the issues from many perspectives, collecting data from students, parents, school principals, experts and system leaders and then through triangulation tried to get to the bottom to the issues. Finally, PISA employs a range of methods to ensure adequate measurement at different grain size to serve different decision-making needs.
- The red dot indicates classroom spending per student, relative to the spending capacity of countries, the higher the dot, the more of its GDP a country invests. High salaries are an obvious cost driver. You see Korea paying their teachers very well, the green bar goes up a lot. Korea also has long school days, another cost driver, marked here by the white bar going up. Last but not least, Korea provides their teachers with lots of time for other things than teaching such as teacher collaboration and professional development, which costs money as well. So how does Korea finances all of this? They do this with large classes, the blue bar pulls costs down. If you go to the next country on the list, Luxembourg, you see that the red dot is about where it is for Korea, so Luxembourg spends roughly the same per student as Korea. But parents and teachers in Luxembourg mainly care about small classes, so policy makers have invested mainly into reducing class size, you see the blue bar as the main cost driver. But even Luxembourg can only spend its money once, and the result is that school days are short, teacher salaries are average at best and teachers have little time for anything else than teaching. Finland and the US are a similar contrast.Countries make quite different spending choices. But when you look at this these data long enough, you see that many of the high performing education systems tend to prioritise the quality of teachers over the size of classes.
- In my view, one of the most important improvements in Japan has been the significant rise in the performance of Japanese students on open-ended tasks, the kind of tasks that require students to create an answer, rather than to just reproduce an answer from a multiple-choice task. In other words, Japan is advancing fastest on the kind of ‘new skills’ that I spoke about at the beginning.
- PISA shows that students who enjoy reading the most perform significantly better than students who enjoy reading the least (Table III.1.1). More Japanese students reported that they do not read for enjoyment at all compared to many other OECD countries, but about the average proportion of students spend one to two hours per day on reading for enjoyment.Across OECD countries, we have seen a decline in students reading for enjoyment, but in Japan we have seen a significant increase. That is one of the most important messages coming out of PISA for Japan.
- Positive teacher-student relations can help to establish an environment that is conducive to learning. Research finds that students, particularly disadvantaged students, tend to learn more and have fewer disciplinary problems when they feel that their teachers take them seriously. One explanation is that positive teacher-student relations help foster social relationships, create communal learning environments and promote and strengthen adherence to norms conducive to learning. PISA asked students to agree or disagree with several statements regarding their relationships with the teachers in school. These statements include whether students get along with the teachers and whether teachers are interested in their personal well-being, whether teachers take the student seriously, whether teachers are a source of support if students need extra help, and whether teachers treat the student fairly. Students in Japan reported one of the weakest teacher-student relations among OECD countries (Figure IV.4.1). For example, 28% of students in Japan agree or strongly agree that their teachers are interested in their well-being (the OECD average is 66%), 63% agree or strongly agree that most teachers really listen to what the student has to say (the OECD average is 67%), 64% agree or strongly agree that teachers are a source of support if students need extra help (the OECD average is 79%), 73% agree or strongly agree that they get along with their teachers (the OECD average is 85%) and 74% agree or strongly agree that teachers treat the student fairly (the OECD average is 79%). There is a positive relationship between teacher-student relations and student performance in Japan. For example, the quarter of students in Japan reporting the poorest student-teacher relations are two times more likely to also be among the quarter of the poorest performing students, which is the highest likelihood among the countries and economies that participated in PISA (Table IV.4.1). Differences in student-reported teacher interest in their well-being may reflect either different student expectations of their teachers’ level of involvement, or different roles that teachers assume with respect to their students. A low percentage of agreement with these statements suggests a possible mismatch between student expectations and what teachers are actually doing.
- Let me briefly summarise the influences that we have measured in PISA.
- You have seen very large performance differences among schools and countries, but how predictive are these for the success of students and nations?
- To what extent is performance in school predictive of success in later life?The best way to find out whether what students have learned at school matters for their life is to actuallywatch what happens to them after they leave school. This is exactly what we have done that with around 30,000 students in Canada. We tested them in the year 2000 when they were 15 years old in reading, math and science, and since then we are following up with them each year on what choices they make and how successful they are in their transition from school to higher education and work.The horizontal axis shows you the PISA level which 15-year-old Canadians had scored in 2000. Level 2 is the baseline level on the PISA reading test and Level 5 the top level in reading.The red bar shows you how many times more successful someone who scored Level 2 at age 15 was at age 19 to have made a successful transition to university, as compared to someone who did not make it to the baseline PISA level 1. And to ensure that what you see here is not simply a reflection of social background, gender, immigration or school engagement, we have already statistically accounted for all of these factors. The orange bar. …How would you expect the picture to be like at age 21? We are talking about test scores here, but for a moment, lets go back to the judgements schools make on young people, for example through school marks. You can do the same thing here, you can see how well school marks at age 15 predict the subsequent success of youths. You see that there is some relationship as well, but that it is much less pronounced than when we use the direct measure of skills. What this tells you how important reliable measures of student performance are, an area where the UK is leading the field since some years.
- I am going to present evidence on separate issues in turn, but it is their interdependence that is key to understanding the nature of the policy and implementation challenges. If you simply raise entrance standards for teachers, you will choke off supply unless compensation and working conditions are aligned. Raising pay and changing working conditions alone won’t automatically translate into improvements in teacher quality unless standards are raised. Teacher evaluation systems have limited impact where they only relate to compensation but not professional development and career advancement. Giving teachers more autonomy can be counterproductive if the quality and education of the teachers are inadequate.Education is ultimately about student learning outcomes……and these Learning outcomes are the result of what happens in the classroom.Instructional policies and practices, in turn, are shaped by people - teachers, principles and families. And that’s why the quality of an education system cannot exceed the quality of its teachers.But it works the other way round too: The quality of teachers cannot exceed the quality of work organization, the quality of teacher selection and education, teacher careers and teacher evaluation.And it is those processes that we can shape with policy tools. And success depends on the design and implementation of effective policies.
- First, there is no question that most nations declare that education is important. But the test comes when these commitments are weighed against others. How do countries pay teachers, compared to other highly-skilled workers? How are education credentials weighed against other qualifications when people are being considered for jobs? Would you want your child to be a teacher? How much attention do the media pay to schools and schooling? What we have learned from PISA is that in high performing systems political and social leaders have persuaded citizens to make choices that show they value education more than other things. But placing a high value on education is only part of the equation. Another part is belief in the possibilities for all children to achieve success. In some countries, students are separated into different tracks at an early age, reflecting a notion shared by teachers, parents and citizens that only a subset of the nation’s children can or need to achieve world class standards. Our analysis shows that systems that track students in this way, based differing expectations for different destinations, tend to be fraught with large social disparities. By contrast, the best performing systems deliver strong and equitable learning outcomes across very different cultural and economic contexts. In Finland, Japan, Singapore, Shanghai-China and Hong Kong-China, parents, teachers and the public at large share the belief that all students are capable of achieving high standards and need to do so, and they provide great examples for how public policy can support the achievement of universal high standards.
- High-performing education systems also share clear and ambitious standards across the board. Everyone knows what is required to get a given qualification, both in terms of the content studied and the level of performance needed to earn it. Students cannot go on to the next stage—be it in work or in further education—unless they show that they are qualified to do so. They know what they have to do to realise their dream, and they put in the work that is needed to do it.
- Third, the quality of an education system cannot exceed the quality of its teachers and principals. Just like companies, high quality school systems pay attention to how they select and train their staff. They watch how they improve the performance of those who are struggling; how structure teachers’ pay packets; and how they reward their best teachers. They provide an environment in which teachers work together to frame good practice. That is where teachers conduct field-based research to confirm or disprove the approaches they develop, and they judge their colleagues by the degree to which they use these practices in their classrooms. Listen to what the Finnish Minister had to say about that.
- Now, so far so good, and we all get very exited when we talk about teacher recruitment and initial training. And the reason why we get exited is because public policy can easily shape these. Some claim that the best performing systems all recruit their teachers from the top third of school graduates. That’s true for Finland and Korea. But if I look around the table, how many more countries can really claim that teaching is the first choice of graduates? Singapore perhaps? But it simply does not hold for the majority of countries around the table here. If we wait for this marvellous spaceship that will arrive one day and bring us new teachers – and maybe send those who are not effective to the moon - then we will find ourselves in the same situation years from now. And you see that other sectors have acted in much smarter ways. Imagine Nokia, the Finnish technology leader. In the 1960s, Nokia produced car tyres and rubber products. Imagine where they would be now if they had said then: We would really like to produce something more advanced than car tyres, but our engineers are not up to the task. Lets wait until they are retired, then we will train new engineers, and when the new graduates trickle into the labour-market, we will start to do something great. And there is more to this. If you put great teachers into a poor system, the system will win every time. There are plenty of examples for this. No matter how good the pre-service education for teachers is, it cannot be expected to prepare teachers for all the challenges they will face throughout their careers. So let us move on to the second summit topic. [Slide – How teachers are developed] So as important as recruitment and selection of promising graduates is, it can only be one component of human resource management in education. Successful reform requires investment in quality professional development to continuously: Simply look at how significantly the profile of teacher requirements has changed in the last decade alone: They must now place much greater emphasis on integrating students with special learning needs. They need to make more effective use of information technologies. They are required to engage more in planning within evaluative and accountability frameworks. And they are asked to do more to involve parents in schools. I think we all recognize that education is still far from being a knowledge industry, in the sense that its own practices are being continuously transformed by greater understanding of their efficacy. While in many other fields, people enter their professional lives expecting that what they do and how they do it will be transformed by evidence and research, this is still not generally the case in education. Ongoing professional development is a crucial instrument to:update teachers subject knowledge; update teachers skills and approaches in light of new teaching techniques, new circumstances, and new research; enable teachers to master changes made to curricula or teaching practice; enable schools to develop and apply new strategies; and facilitate exchange of experience; In some countries, ongoing professional development already plays an important role. In Shanghai, each teacher is expected to engage in 240 hours of professional development within five years. Singapore provides teachers with 100 hours of professional development per year. But there is a lot of variation in the incidence and intensity of teacher participation in professional development both across and within countries.
- There are some lessons we have learned about teacher development: Well-structured and resourced induction programs can support new teachers in their transitionMany countries carefully induct their teachers before they confer on them all the rights and responsibilities of full-time teachers. During that period, they are supervised by master teachers and they get additional instruction and coaching from their supervisory teachers, and observe other teachers. Typically, teachers in this induction period can be coached out of the profession, if, in the opinion of their supervisory teachers, they have not demonstrated that they have the knowledge and skills needed to be a competent professional. [Slide: percentage of teachers without mentoring or induction] But our data show a substantial share of teachers is left without induction - or mentoring. Effective professional development is on-going, include training, practice and feedback, and provide adequate time and follow-up supportSecond, we have learned that effective professional development needs to be on-going, include training, practice and feedback, and provide adequate follow-up. Successful programs involve teachers in learning activities that are similar to those they will use with their students, and encourage the development of teachers’ learning communities. Teacher development needs to be linked with appraisal and feedback practices and school evaluationTeacher development also needs to be linked with appraisal and feedback. And it’s important to provide sufficient room for teachers to employ inquiry- and group-based approaches, especially in the core areas of curriculum and assessment. Our data show that teachers’ participation in professional development goes hand-in-hand with their mastery of a wider repertoire of pedagogical practices. We also see a close relationship between professional development and a positive school climate, co-operation between teachers and teacher job satisfaction. But we also see that that schools and systems need to better match the costs and benefits of, and supply and demand for, professional development.
- Here you see the percentage of teachers that participate in various types of professional development across the countries that took part in our TALIS survey.
- When you now contrast this with the impact of such professional development, you see that relatively few teachers participate in the kinds of professional development that they believe has the largest impact on their work, namely qualification programs and individual and collaborative research. Teacher demand for professional development is often not met, sometimes for lack of time, sometimes for lack of opportunity…More than half the teachers surveyed also said that they wanted more professional development than they received. Of course, people never feel well enough prepared, but the extent of unsatisfied demand appears large. We have no data on the extent to which this undermines the effectiveness of these teachers. But the cost of providing additional professional development needs to be seen in relation to the cost of not providing it.
- Fourth, as you have seen, success has to do with incentives and accountability, and how these are aligned in the system. It has also to do with how vertical accountability to superiors is balanced with horizontal or professional accountability towards peers, how knowledge is shared and spread. have we learned?
- The most impressive outcome of world class education systems is perhaps that they deliver high quality learning consistently across the entire education system so that every student benefits from excellent learning opportunity. To achieve this, they invest educational resources where they can make most of a difference, they attract the most talented teachers into the most challenging classroom, and they establish effective spending choices that prioritise the quality of teachers. Let me come back to the example of Shanghai once more here. Let us have a look at the struggling schools six years later.
- Some of the most successful systems are also actively looking outward, realising that the benchmark for success is no longer simply improvement by national standards, but the best performing systems internationally. Whether Singapore is interested in designing a better sewer system, retirement system or school system, it sends key people in the relevant sector to visit those countries that are the world’s best performers in those areas with instructions to find out how they do it, and to put together a design for Singapore that is superior to anything that they have seen anywhere.
- Last but not least, in high performing systems these policies and practices are aligned across all aspects of the system, they are coherent over sustained periods of time, and they are consistently implemented. And PISA shows, success is within the reach for nations that have the capacity to creating and executing policies with maximum coherence in the system. Of course, the path to reform is not easy and it can be fraught with political controversy. Moving away from administrative and bureaucratic control toward professional norms of control can be counterproductive if a nation does not yet have teachers and schools with the capacity to implement these policies and practices. Pushing authority down to lower levels can be as problematic if there is not agreement on what the students need to know and should be able to do. Recruiting high quality teachers is not of much use if those who are recruited are so frustrated by what they perceive to be a mindless system of initial teacher education that they will not participate in it and turn to another profession. Or if they become school teachers, but are so turned off by the bureaucratic forms of work organisation they find there that they leave teaching for some other occupation. So this is all about alignment.
- I want to conclude with what we have learned about successful reform trajectories In the past when you only needed a small slice of well-educated people it was efficient for governments to invest a large sum in a small elite to lead the country. But the social and economic cost of low educational performance has risen substantially and all young people now need to leave school with strong foundation skills.When you could still assume that what you learn in school will last for a lifetime, teaching content and routine cognitive skills was at the centre of education. Today, where you can access content on Google, where routine cognitive skills are being digitised or outsourced, and where jobs are changing rapidly, the focus is on enabling people to become lifelong learners, to manage complex ways of thinking and complex ways of working that computers cannot take over easily.In the past, teachers had sometimes only a few years more education than the students they taught. When teacher quality is so low, governments tend to tell their teachers exactly what to do and exactly how they want it done and they tend to use Tayloristic methods of administrative control and accountability to get the results they want. Today the challenge is to make teaching a profession of high-level knowledge workers. But such people will not work in schools organised as Tayloristic workplaces using administrative forms of accountability and bureaucratic command and control systems to direct their work. To attract the people they need, successful education systems have transformed the form of work organisation in their schools to a professional form of work organisation in which professional norms of control complement bureaucratic and administrative forms of control.
- The world is undergoing profound changes and these changes are reflected in schools and education systems. Let me just highlight some key points:In the past, learning was considered a place, we brought kids to school. Now learning is an activity that cuts through everything children do at all stages of our lives.In old bureaucratic education systems, teachers were often left alone in classrooms with a lot of prescription what to teach. The most successful systems now set ambitious goals, are clear about what students should be able to do and then provide teachers with the tools to establish what content and instruction they need to deliver to their individual students. The past was about delivered wisdom, the challenge now is to enable user-generated wisdom.In the past, different students were taught in similar ways, today the challenge is to embrace increasing diversity with differentiated pedagogical practices. The goal of the past was standardization and conformity, now it’s about being ingenious, about personalizing educational experiences, about realising that ordinary students have extraordinary talents. Education systems have always talked about equity, now we measure their success by how well they deliver equity, in terms of moderating the impact which social background has on learning outcomes.The past was curriculum-centered, the future is learner centered. In the past, the policy focus was on the provision of education, today it’s on outcomes, shifting from looking upwards in the bureaucracy towards looking outwards to the next teacher, the next school, about creating networks of innovation In the past we emphasized school management, now it is about leadership, with a focus on supporting, evaluating and developing teacher quality as its core, which includes coordinating the curriculum and teaching program, monitoring and evaluating teacher practice, promoting teacher professional development and supporting collaborative work cultures.In the past, we considered social background and culture as obstacles to learning, the best performing systems capitalize on the diversity of learners; see diversity not as the problem, but as the potential of the knowledge society. And Ontario is actually a great example in this respect.
- Figure II.5.8
- Figure II.5.9