SlideShare ist ein Scribd-Unternehmen logo
1 von 33
Downloaden Sie, um offline zu lesen
The tricky relationship
between research and
practice
29 June 2018
Christian Bokhove
HCS conference
Evidence informed education
• Evidence-based medicine
• Evidence-based practice
• Evidence-informed education
"Evidence-based practice is about making
decisions through the conscientious, explicit
and judicious use of the best available
evidence from multiple sources by …
Asking:
Translating a practical issue or problem into an
answerable question
Acquiring: Systematically searching and retrieving the evidence
Appraising:
Critically judging the trustworthiness and relevance of the
evidence
Aggregating: Weighing and and pulling together the evidence
Applying:
Incorporating the evidence in the decision-making
process
Assessing: Evaluating the outcome of the decision taken
.
… to increase the likelihood of a favorable outcome."
https://www.cebma.org/a-definition-of-evidence-based-management/
Evidence-informed still means ‘based on scientific
research’ but we’re in the field of learning sciences,
which is an interdisciplinary science
• Sociology
• Cognitive psychology
• Etc..
“dealing with so many variables that are extremely
hard to (all) control.”
https://3starlearningexperiences.wordpress.com/2018/06/26/working-in-an-evidence-informed-way/
Some age-old issues 1
• Cause and effect
• Hume’s Skepticism and Kant
• Correlation and causation
• Falsification
• Popper and Kuhn
• Does one study falsify a body of research?
• Context
• Berliner: ‘the hardest science of them all’
Some age-old issues 2
• A lesser form of knowledge?
• Labaree: soft knowledge.
• Negative: lower status, weaker authority, push
quantification.
• Positive: knowledge for practice, free from consumer
pressures, no disciplinary boundaries, general public.
Some age-old issues 3
• Quantification and measurement
• To improve credibility, origins ‘statistics’
• But could destroy local practical knowledge
• What are we measuring (fMRI, SES, mindset, load)
This requires a vast knowledge base…
But there are tensions with this
The tricky relationship between research and practice
“Modal models for prospective teachers should use folk
psychological terms whenever doing so will not
mislead. For example, the core properties of working
memory can be conveyed with the intuitive
observations that there is a mental “space” for thinking,
that this space is limited, and that it can be occupied by
things perceived in the environment and/or things from
the long-term memory.”
But the key question then becomes: when misleading?
(Willingham, 2017)
https://impact.chartered.college/article/bokhove-new-myth/
A thought-provoking example
• Everyone loves Cognitive Load Theory
• It is good science not bad science
• So how can you be critical of it?
• Being a Skeptic
• Being skeptical does not mean I disagree with it
• It forces people to reflect on their thinking
• Let me ‘strip it and flip it’ (Willingham, 2012)
REDUCE COGNITIVE LOAD
This is often interpreted as to ‘take away’
something
Load from words
R I S D E S
Add a P and I can make SPIDERS
A unit with meaning
Load interacts with prior knowledge and schemas.
Load from picturebooks research
(Flack & Horst, 2017)
Rest of slide Intentionally left blank to not impose too much load.
Scale originates from Paas (1992)
Feedback might reduce load
“Across the three experiments–with different
problem-solving tasks and participant populations–
we found that subjective ratings of effort
investment were significantly higher after negative
than after positive feedback; ratings given without
feedback fell in between. These findings show that
feedback valence alters perceived effort investment
(possibly via task perceptions or affect), which can be
problematic when effort is measured as an indicator
of cognitive load.”
(Raaijmakers et al., 2017)
Moment of measuring…
“The findings from Experiment 1 (between-subjects) and
2 (within-subjects), using different arrangements of
simple and complex tasks, showed that a single rating
after a series of tasks resulted in a higher mental effort
score than the average of ratings provided immediately
after every task. A similar result was obtained in
Experiment 3 with series of complex tasks, but not with
simple tasks. Experiment 4 showed that knowing
beforehand that mental effort rating will be required
after completing all tasks results in lower scores, but
average retrospective ratings per task still differed from a
single retrospective rating.”
(Van Gog et al, 2012)
Message
• NOT that we can’t get something out of this, but…
• “It’s complex”
• Messages get distorted as they propagate through
the system.
• So even a statement like “REDUCE COGNITIVE
LOAD” must be unpicked.
How do misconceptions start?
“examples of cases in which entrepreneurs have
knowingly set out to mislead educators are difficult
to find.” (Howard-Jones, 2014, p. 817)
“more likely that such interventions originate from
uninformed interpretations of genuine scientific facts
and are promoted by victims of their own wishful
thinking who hold a “sincere but deluded fixation on
some eccentric theory that the holder is absolutely
sure will revolutionize science and society” (Howard-
Jones, 2014, p. 817)
Perpetuated
• Cultural conditions e.g.
differences in
terminology and
language
• Also check Lilienfeld et al.
(2015, 2017) for lists with
psychological terms to
avoid and pairs of
confusion
• Counter-evidence
difficult to access
• Untestable
• Biases
• Complex
Robin-Garcia et al. (2017)
• Dentistry
• “tweeting about scholarly articles
represents curating and
informing about state-of-the-art
appears not to be realized in
practice.”
• “Simplistic and naïve use of
social media data risks damaging
the scientific enterprise,
misleading both authors and
consumers of scientific
literature.”
• (Now check the paper, it says
much more, and it has its own
limitations)
Do teachers need research
literacy skills?
• Ideally, yes, as much as possible
• But it is clear this can be quite challenging for all
kinds of reasons, ranging from time, knowledge,
skills constraints.
So why not *work* with Academics?
Academia interested in links?
• This is very likely
• Universities seek impact
• Researchers seek research participants
• It is good for ecological validity that schools and
classrooms participate.
• But because of all kinds of privacy and safegaurding
reasons increasingly difficult.
• Societal responsiblity
Example collaborations
PhD work
• Finished in 2011
• Worked with 12 teachers in 9 schools in the
Netherlands
• Algebraic skills training with technology
(Bokhove & Drijvers, 2010)
MC-squared project
• Design and develop a new genre of authorable e-book,
which we call 'the c-book' (c for creative)
• Creative Mathematical Thinking (CMT)
• Initiate a ‘Community of Interest’ (CoI)
• A community of interest consists of several
stakeholders from various ‘Communities of Practice.
• England, Spain, Greece, France
• Within these, teachers who co-design and use
resources for teaching, can contribute to their own
professional development.
• Social Creativity
• UK CoI: learning analytics and feedback
(e.g. Fischer, 2001; Wenger, 1998)
www.mc2-project.eu
The tricky relationship between research and practice
Building blocks
Building blocks
Summary - chances
• So despite the challenges it can be done…
• Needs action from both sides (I know: workload!
But benefits could outweigh the ‘cost’)
• But we can benefit from each other… schools gain a
research culture, universities gain societal impact
In the meantime
• Try to follow up sources as much as possible
• Refrain from too firm a position, until you feel you have reviewed a
fair amount of material, from different actors, might be a good
strategy. Sorry – this is just hard work, and I understand that
practitioners do not always have this time.
• Be mindful of over-simplifications.
• Follow the facts and, if one simplifies, be aware of the limitations or
what it leaves out. See what I said about Willingham (2017).
• Be cautious about developing policy based on new claims.
• Research findings should be accompanied by a clear scope and
disclaimer with regard to claims. No silver bullet.
• Look up a researcher
• They don’t bite.
Thank you
• C.Bokhove@soton.ac.uk
• Twitter: @cbokhove
• Website: www.bokhove.net
• Want to collaborate?
• Please let me know.
There are only two types of
people in the world: those
who believe in false
dichotomies, and penguins.
Selected references
Bokhove, C., & Drijvers, P. (2010). Digital tools for algebra education: criteria and evaluation. International Journal of Computers for
Mathematical Learning, 15(1), 45-62. Online first.
Fischer, G. (2001). Communities of interest: learning through the interaction of multiple knowledge systems. In the Proceedings of the
24th IRIS Conference. S. Bjornestad, R. Moe, A. Morch, A. Opdahl (Eds.) (pp. 1-14). August 2001, Ulvik, Department of Information
Science, Bergen, Norway.
Flack, Z. M., & Horst, J.S. (2017). Two sides to every story: Children learn words better from one storybook page at a time. Infant and
Child Development, 27(1)
Howard-Jones, P. (2014). Neuroscience and education: myths and messages. Nature Reviews Neuroscience, 15(12), 817-824.
Mintrop, R. (2016). Design-Based School Improvement: A Practical Guide for Education Leaders. Cambridge. Harvard Education Press.
Paas, F. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of
Educational Psychology, 84(4), 429-434.
Raaijmakers, S. F., Baars, M., Schaap, L., Paas, F. & Van Gog, T. (2017). Effects of performance feedback valence on perceptions of
invested mental effort. Learning and Instruction, 51 36-46.
Robinson-Garcia, N., Costas, R., Isett, K., Melkers, J., & Hicks, D. (2017). The unbearable emptiness of tweeting—About journal articles.
PLOS one. https://doi.org/10.1371/journal.pone.0183551
Van Gog, T., Kirschner, F., Kester, L., & Paas, F. (2012). Timing and frequency of mental effort measurement: Evidence in favour of
repeated measures. Applied Cognitive Psychology, 26, 833-839.
Wenger, E. (1998). Communities of Practice: Learning, Meaning, Identity. Cambridge University Press.
Willingham, D. T. (2012). When can you trust the experts: How to tell good science from bad in education .
Willingham, D. T. (2017). A Mental Model of the Learner: Teaching the Basic Science of Educational Psychology to Future Teachers.
Mind, Brain and Education, 11(4), 166-175.

Weitere ähnliche Inhalte

Ähnlich wie The tricky relationship between research and practice

Learning, creativity and collective intelligence
Learning, creativity and collective intelligenceLearning, creativity and collective intelligence
Learning, creativity and collective intelligenceHróbjartur Árnason
 
Personal digital inquiry slides 2016 keynote final
Personal digital inquiry slides 2016 keynote finalPersonal digital inquiry slides 2016 keynote final
Personal digital inquiry slides 2016 keynote finalJulie Coiro
 
ResearchEd 2018 Amsterdam - This is the new m*th!
ResearchEd 2018 Amsterdam - This is the new m*th!ResearchEd 2018 Amsterdam - This is the new m*th!
ResearchEd 2018 Amsterdam - This is the new m*th!Christian Bokhove
 
Information Literacy Summit Presentation
Information Literacy Summit PresentationInformation Literacy Summit Presentation
Information Literacy Summit PresentationMelissa Cornwell
 
Roundtable slides RiTE Paderborn 24/9/2021
Roundtable slides RiTE Paderborn 24/9/2021Roundtable slides RiTE Paderborn 24/9/2021
Roundtable slides RiTE Paderborn 24/9/2021Christian Bokhove
 
Ossiannilsson the next normal/s building forward  differently  for wellbeing...
Ossiannilsson the next normal/s building forward  differently   for wellbeing...Ossiannilsson the next normal/s building forward  differently   for wellbeing...
Ossiannilsson the next normal/s building forward  differently  for wellbeing...Ebba Ossiannilsson
 
Collaboration in the arts and humanities
Collaboration in the arts and humanitiesCollaboration in the arts and humanities
Collaboration in the arts and humanitiesNomadWarMachine
 
What is Heutagogy? And And how can we use it to help develop self-determined ...
What is Heutagogy? And And how can we use it to help develop self-determined ...What is Heutagogy? And And how can we use it to help develop self-determined ...
What is Heutagogy? And And how can we use it to help develop self-determined ...Lisa Marie Blaschke
 
Multimedia Academic Literacy
Multimedia Academic LiteracyMultimedia Academic Literacy
Multimedia Academic LiteracySpelman College
 
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018Sarah de Rijcke
 
What is learning?
What is learning?What is learning?
What is learning?Johan Koren
 
Week 1 intro to research 702 2015
Week 1 intro to research 702 2015Week 1 intro to research 702 2015
Week 1 intro to research 702 2015Ryrinn Azman
 
Week 1 intro to research 702 2015
Week 1 intro to research 702 2015Week 1 intro to research 702 2015
Week 1 intro to research 702 2015wawaaa789
 
Conceptual framing for educational research through Deleuze and Guattari
Conceptual framing for educational research through Deleuze and GuattariConceptual framing for educational research through Deleuze and Guattari
Conceptual framing for educational research through Deleuze and GuattariDavid R Cole
 
Leibowitz being and becoming a good university teacher
Leibowitz being and becoming a good university teacherLeibowitz being and becoming a good university teacher
Leibowitz being and becoming a good university teacherBrenda Leibowitz
 

Ähnlich wie The tricky relationship between research and practice (20)

Learning, creativity and collective intelligence
Learning, creativity and collective intelligenceLearning, creativity and collective intelligence
Learning, creativity and collective intelligence
 
Learning Theory
Learning TheoryLearning Theory
Learning Theory
 
Personal digital inquiry slides 2016 keynote final
Personal digital inquiry slides 2016 keynote finalPersonal digital inquiry slides 2016 keynote final
Personal digital inquiry slides 2016 keynote final
 
ResearchEd 2018 Amsterdam - This is the new m*th!
ResearchEd 2018 Amsterdam - This is the new m*th!ResearchEd 2018 Amsterdam - This is the new m*th!
ResearchEd 2018 Amsterdam - This is the new m*th!
 
Information Literacy Summit Presentation
Information Literacy Summit PresentationInformation Literacy Summit Presentation
Information Literacy Summit Presentation
 
Roundtable slides RiTE Paderborn 24/9/2021
Roundtable slides RiTE Paderborn 24/9/2021Roundtable slides RiTE Paderborn 24/9/2021
Roundtable slides RiTE Paderborn 24/9/2021
 
Eps2
Eps2Eps2
Eps2
 
Ossiannilsson the next normal/s building forward  differently  for wellbeing...
Ossiannilsson the next normal/s building forward  differently   for wellbeing...Ossiannilsson the next normal/s building forward  differently   for wellbeing...
Ossiannilsson the next normal/s building forward  differently  for wellbeing...
 
Collaboration in the arts and humanities
Collaboration in the arts and humanitiesCollaboration in the arts and humanities
Collaboration in the arts and humanities
 
What is Heutagogy? And And how can we use it to help develop self-determined ...
What is Heutagogy? And And how can we use it to help develop self-determined ...What is Heutagogy? And And how can we use it to help develop self-determined ...
What is Heutagogy? And And how can we use it to help develop self-determined ...
 
Multimedia Academic Literacy
Multimedia Academic LiteracyMultimedia Academic Literacy
Multimedia Academic Literacy
 
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018
The Evaluative inquiry Approach, Sarah de Rijcke + SES group, 2018
 
What is learning?
What is learning?What is learning?
What is learning?
 
Week 1 intro to research 702 2015
Week 1 intro to research 702 2015Week 1 intro to research 702 2015
Week 1 intro to research 702 2015
 
Week 1 intro to research 702 2015
Week 1 intro to research 702 2015Week 1 intro to research 702 2015
Week 1 intro to research 702 2015
 
Conceptual framing for educational research through Deleuze and Guattari
Conceptual framing for educational research through Deleuze and GuattariConceptual framing for educational research through Deleuze and Guattari
Conceptual framing for educational research through Deleuze and Guattari
 
What is learning ?
What is learning ?What is learning ?
What is learning ?
 
Leibowitz being and becoming a good university teacher
Leibowitz being and becoming a good university teacherLeibowitz being and becoming a good university teacher
Leibowitz being and becoming a good university teacher
 
Passion CF
Passion CFPassion CF
Passion CF
 
Information Literacy
Information LiteracyInformation Literacy
Information Literacy
 

Mehr von Christian Bokhove

Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?Christian Bokhove
 
Creating interactive digital books for the transition from secondary to under...
Creating interactive digital books for the transition from secondary to under...Creating interactive digital books for the transition from secondary to under...
Creating interactive digital books for the transition from secondary to under...Christian Bokhove
 
Research on school inspections: What do we know?
Research on school inspections: What do we know?Research on school inspections: What do we know?
Research on school inspections: What do we know?Christian Bokhove
 
Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?Christian Bokhove
 
The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...Christian Bokhove
 
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Christian Bokhove
 
Help-seeking in an online maths environment: A sequence analysis of log files
Help-seeking in an online maths environment: A sequence analysis of log filesHelp-seeking in an online maths environment: A sequence analysis of log files
Help-seeking in an online maths environment: A sequence analysis of log filesChristian Bokhove
 
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
Learning loss and learning inequalities during the covid-19 pandemic: an anal...Learning loss and learning inequalities during the covid-19 pandemic: an anal...
Learning loss and learning inequalities during the covid-19 pandemic: an anal...Christian Bokhove
 
The challenge of proof in the transition from A-level mathematics to university
The challenge of proof in the transition from A-level mathematics to universityThe challenge of proof in the transition from A-level mathematics to university
The challenge of proof in the transition from A-level mathematics to universityChristian Bokhove
 
How can we develop expansive, research-informed ITE ?
How can we develop expansive, research-informed ITE ?How can we develop expansive, research-informed ITE ?
How can we develop expansive, research-informed ITE ?Christian Bokhove
 
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijsChristian Bokhove
 
Transparency in Data Analysis
Transparency in Data AnalysisTransparency in Data Analysis
Transparency in Data AnalysisChristian Bokhove
 
Proof by induction in Calculus: Investigating first-year students’ examinatio...
Proof by induction in Calculus: Investigating first-year students’ examinatio...Proof by induction in Calculus: Investigating first-year students’ examinatio...
Proof by induction in Calculus: Investigating first-year students’ examinatio...Christian Bokhove
 
Evidence informed: Waar is de Bijsluiter?
Evidence informed: Waar is de Bijsluiter?Evidence informed: Waar is de Bijsluiter?
Evidence informed: Waar is de Bijsluiter?Christian Bokhove
 
Methodological innovation for mathematics education research
Methodological innovation for mathematics education researchMethodological innovation for mathematics education research
Methodological innovation for mathematics education researchChristian Bokhove
 
Structural Topic Modelling of Ofsted Documents
Structural Topic Modelling of Ofsted DocumentsStructural Topic Modelling of Ofsted Documents
Structural Topic Modelling of Ofsted DocumentsChristian Bokhove
 
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...Christian Bokhove
 
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...Christian Bokhove
 

Mehr von Christian Bokhove (20)

Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?Can data from largescale assessments ever be useful For mathematics education?
Can data from largescale assessments ever be useful For mathematics education?
 
Creating interactive digital books for the transition from secondary to under...
Creating interactive digital books for the transition from secondary to under...Creating interactive digital books for the transition from secondary to under...
Creating interactive digital books for the transition from secondary to under...
 
Research on school inspections: What do we know?
Research on school inspections: What do we know?Research on school inspections: What do we know?
Research on school inspections: What do we know?
 
Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?Master mathematics teachers: What do Chinese primary schools look like?
Master mathematics teachers: What do Chinese primary schools look like?
 
The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...The role of non-cognitive factors in science achievement: an analysis of PISA...
The role of non-cognitive factors in science achievement: an analysis of PISA...
 
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...Multilevel modelling of Chinese primary children’s metacognitive strategies i...
Multilevel modelling of Chinese primary children’s metacognitive strategies i...
 
Cryptography
CryptographyCryptography
Cryptography
 
Help-seeking in an online maths environment: A sequence analysis of log files
Help-seeking in an online maths environment: A sequence analysis of log filesHelp-seeking in an online maths environment: A sequence analysis of log files
Help-seeking in an online maths environment: A sequence analysis of log files
 
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
Learning loss and learning inequalities during the covid-19 pandemic: an anal...Learning loss and learning inequalities during the covid-19 pandemic: an anal...
Learning loss and learning inequalities during the covid-19 pandemic: an anal...
 
The challenge of proof in the transition from A-level mathematics to university
The challenge of proof in the transition from A-level mathematics to universityThe challenge of proof in the transition from A-level mathematics to university
The challenge of proof in the transition from A-level mathematics to university
 
How can we develop expansive, research-informed ITE ?
How can we develop expansive, research-informed ITE ?How can we develop expansive, research-informed ITE ?
How can we develop expansive, research-informed ITE ?
 
Discussant EARLI sig 27
Discussant EARLI sig 27Discussant EARLI sig 27
Discussant EARLI sig 27
 
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
(On)waarheden en (on)bekende zaken uit onderzoek over reken-wiskundeonderwijs
 
Transparency in Data Analysis
Transparency in Data AnalysisTransparency in Data Analysis
Transparency in Data Analysis
 
Proof by induction in Calculus: Investigating first-year students’ examinatio...
Proof by induction in Calculus: Investigating first-year students’ examinatio...Proof by induction in Calculus: Investigating first-year students’ examinatio...
Proof by induction in Calculus: Investigating first-year students’ examinatio...
 
Evidence informed: Waar is de Bijsluiter?
Evidence informed: Waar is de Bijsluiter?Evidence informed: Waar is de Bijsluiter?
Evidence informed: Waar is de Bijsluiter?
 
Methodological innovation for mathematics education research
Methodological innovation for mathematics education researchMethodological innovation for mathematics education research
Methodological innovation for mathematics education research
 
Structural Topic Modelling of Ofsted Documents
Structural Topic Modelling of Ofsted DocumentsStructural Topic Modelling of Ofsted Documents
Structural Topic Modelling of Ofsted Documents
 
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
Learning loss and learning inequalities during the Covid-19 pandemic: an anal...
 
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
USING MRQAP TO ANALYSE THE DEVELOPMENT OF MATHEMATICS PRE-SERVICE TRAINEES’ C...
 

Kürzlich hochgeladen

How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17Celine George
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdf
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdfNOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdf
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdfSumit Tiwari
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17Celine George
 
How to Filter Blank Lines in Odoo 17 Accounting
How to Filter Blank Lines in Odoo 17 AccountingHow to Filter Blank Lines in Odoo 17 Accounting
How to Filter Blank Lines in Odoo 17 AccountingCeline George
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17Celine George
 
How to Print Employee Resume in the Odoo 17
How to Print Employee Resume in the Odoo 17How to Print Employee Resume in the Odoo 17
How to Print Employee Resume in the Odoo 17Celine George
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxEduSkills OECD
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapitolTechU
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptxSandy Millin
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and stepobaje godwin sunday
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationMJDuyan
 

Kürzlich hochgeladen (20)

How to Solve Singleton Error in the Odoo 17
How to Solve Singleton Error in the  Odoo 17How to Solve Singleton Error in the  Odoo 17
How to Solve Singleton Error in the Odoo 17
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
Personal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdfPersonal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdf
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdf
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdfNOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdf
NOTES OF DRUGS ACTING ON NERVOUS SYSTEM .pdf
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17
 
How to Filter Blank Lines in Odoo 17 Accounting
How to Filter Blank Lines in Odoo 17 AccountingHow to Filter Blank Lines in Odoo 17 Accounting
How to Filter Blank Lines in Odoo 17 Accounting
 
Prelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quizPrelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quiz
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17How to Add a New Field in Existing Kanban View in Odoo 17
How to Add a New Field in Existing Kanban View in Odoo 17
 
How to Print Employee Resume in the Odoo 17
How to Print Employee Resume in the Odoo 17How to Print Employee Resume in the Odoo 17
How to Print Employee Resume in the Odoo 17
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptxPISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
PISA-VET launch_El Iza Mohamedou_19 March 2024.pptx
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptx
 
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
2024.03.23 What do successful readers do - Sandy Millin for PARK.pptx
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and step
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive Education
 

The tricky relationship between research and practice

  • 1. The tricky relationship between research and practice 29 June 2018 Christian Bokhove HCS conference
  • 2. Evidence informed education • Evidence-based medicine • Evidence-based practice • Evidence-informed education
  • 3. "Evidence-based practice is about making decisions through the conscientious, explicit and judicious use of the best available evidence from multiple sources by … Asking: Translating a practical issue or problem into an answerable question Acquiring: Systematically searching and retrieving the evidence Appraising: Critically judging the trustworthiness and relevance of the evidence Aggregating: Weighing and and pulling together the evidence Applying: Incorporating the evidence in the decision-making process Assessing: Evaluating the outcome of the decision taken . … to increase the likelihood of a favorable outcome." https://www.cebma.org/a-definition-of-evidence-based-management/
  • 4. Evidence-informed still means ‘based on scientific research’ but we’re in the field of learning sciences, which is an interdisciplinary science • Sociology • Cognitive psychology • Etc.. “dealing with so many variables that are extremely hard to (all) control.” https://3starlearningexperiences.wordpress.com/2018/06/26/working-in-an-evidence-informed-way/
  • 5. Some age-old issues 1 • Cause and effect • Hume’s Skepticism and Kant • Correlation and causation • Falsification • Popper and Kuhn • Does one study falsify a body of research? • Context • Berliner: ‘the hardest science of them all’
  • 6. Some age-old issues 2 • A lesser form of knowledge? • Labaree: soft knowledge. • Negative: lower status, weaker authority, push quantification. • Positive: knowledge for practice, free from consumer pressures, no disciplinary boundaries, general public.
  • 7. Some age-old issues 3 • Quantification and measurement • To improve credibility, origins ‘statistics’ • But could destroy local practical knowledge • What are we measuring (fMRI, SES, mindset, load) This requires a vast knowledge base…
  • 8. But there are tensions with this
  • 10. “Modal models for prospective teachers should use folk psychological terms whenever doing so will not mislead. For example, the core properties of working memory can be conveyed with the intuitive observations that there is a mental “space” for thinking, that this space is limited, and that it can be occupied by things perceived in the environment and/or things from the long-term memory.” But the key question then becomes: when misleading? (Willingham, 2017)
  • 12. A thought-provoking example • Everyone loves Cognitive Load Theory • It is good science not bad science • So how can you be critical of it? • Being a Skeptic • Being skeptical does not mean I disagree with it • It forces people to reflect on their thinking • Let me ‘strip it and flip it’ (Willingham, 2012) REDUCE COGNITIVE LOAD This is often interpreted as to ‘take away’ something
  • 13. Load from words R I S D E S Add a P and I can make SPIDERS A unit with meaning Load interacts with prior knowledge and schemas.
  • 14. Load from picturebooks research (Flack & Horst, 2017)
  • 15. Rest of slide Intentionally left blank to not impose too much load. Scale originates from Paas (1992)
  • 16. Feedback might reduce load “Across the three experiments–with different problem-solving tasks and participant populations– we found that subjective ratings of effort investment were significantly higher after negative than after positive feedback; ratings given without feedback fell in between. These findings show that feedback valence alters perceived effort investment (possibly via task perceptions or affect), which can be problematic when effort is measured as an indicator of cognitive load.” (Raaijmakers et al., 2017)
  • 17. Moment of measuring… “The findings from Experiment 1 (between-subjects) and 2 (within-subjects), using different arrangements of simple and complex tasks, showed that a single rating after a series of tasks resulted in a higher mental effort score than the average of ratings provided immediately after every task. A similar result was obtained in Experiment 3 with series of complex tasks, but not with simple tasks. Experiment 4 showed that knowing beforehand that mental effort rating will be required after completing all tasks results in lower scores, but average retrospective ratings per task still differed from a single retrospective rating.” (Van Gog et al, 2012)
  • 18. Message • NOT that we can’t get something out of this, but… • “It’s complex” • Messages get distorted as they propagate through the system. • So even a statement like “REDUCE COGNITIVE LOAD” must be unpicked.
  • 19. How do misconceptions start? “examples of cases in which entrepreneurs have knowingly set out to mislead educators are difficult to find.” (Howard-Jones, 2014, p. 817) “more likely that such interventions originate from uninformed interpretations of genuine scientific facts and are promoted by victims of their own wishful thinking who hold a “sincere but deluded fixation on some eccentric theory that the holder is absolutely sure will revolutionize science and society” (Howard- Jones, 2014, p. 817)
  • 20. Perpetuated • Cultural conditions e.g. differences in terminology and language • Also check Lilienfeld et al. (2015, 2017) for lists with psychological terms to avoid and pairs of confusion • Counter-evidence difficult to access • Untestable • Biases • Complex
  • 21. Robin-Garcia et al. (2017) • Dentistry • “tweeting about scholarly articles represents curating and informing about state-of-the-art appears not to be realized in practice.” • “Simplistic and naïve use of social media data risks damaging the scientific enterprise, misleading both authors and consumers of scientific literature.” • (Now check the paper, it says much more, and it has its own limitations)
  • 22. Do teachers need research literacy skills? • Ideally, yes, as much as possible • But it is clear this can be quite challenging for all kinds of reasons, ranging from time, knowledge, skills constraints. So why not *work* with Academics?
  • 23. Academia interested in links? • This is very likely • Universities seek impact • Researchers seek research participants • It is good for ecological validity that schools and classrooms participate. • But because of all kinds of privacy and safegaurding reasons increasingly difficult. • Societal responsiblity
  • 25. PhD work • Finished in 2011 • Worked with 12 teachers in 9 schools in the Netherlands • Algebraic skills training with technology (Bokhove & Drijvers, 2010)
  • 26. MC-squared project • Design and develop a new genre of authorable e-book, which we call 'the c-book' (c for creative) • Creative Mathematical Thinking (CMT) • Initiate a ‘Community of Interest’ (CoI) • A community of interest consists of several stakeholders from various ‘Communities of Practice. • England, Spain, Greece, France • Within these, teachers who co-design and use resources for teaching, can contribute to their own professional development. • Social Creativity • UK CoI: learning analytics and feedback (e.g. Fischer, 2001; Wenger, 1998) www.mc2-project.eu
  • 30. Summary - chances • So despite the challenges it can be done… • Needs action from both sides (I know: workload! But benefits could outweigh the ‘cost’) • But we can benefit from each other… schools gain a research culture, universities gain societal impact
  • 31. In the meantime • Try to follow up sources as much as possible • Refrain from too firm a position, until you feel you have reviewed a fair amount of material, from different actors, might be a good strategy. Sorry – this is just hard work, and I understand that practitioners do not always have this time. • Be mindful of over-simplifications. • Follow the facts and, if one simplifies, be aware of the limitations or what it leaves out. See what I said about Willingham (2017). • Be cautious about developing policy based on new claims. • Research findings should be accompanied by a clear scope and disclaimer with regard to claims. No silver bullet. • Look up a researcher • They don’t bite.
  • 32. Thank you • C.Bokhove@soton.ac.uk • Twitter: @cbokhove • Website: www.bokhove.net • Want to collaborate? • Please let me know. There are only two types of people in the world: those who believe in false dichotomies, and penguins.
  • 33. Selected references Bokhove, C., & Drijvers, P. (2010). Digital tools for algebra education: criteria and evaluation. International Journal of Computers for Mathematical Learning, 15(1), 45-62. Online first. Fischer, G. (2001). Communities of interest: learning through the interaction of multiple knowledge systems. In the Proceedings of the 24th IRIS Conference. S. Bjornestad, R. Moe, A. Morch, A. Opdahl (Eds.) (pp. 1-14). August 2001, Ulvik, Department of Information Science, Bergen, Norway. Flack, Z. M., & Horst, J.S. (2017). Two sides to every story: Children learn words better from one storybook page at a time. Infant and Child Development, 27(1) Howard-Jones, P. (2014). Neuroscience and education: myths and messages. Nature Reviews Neuroscience, 15(12), 817-824. Mintrop, R. (2016). Design-Based School Improvement: A Practical Guide for Education Leaders. Cambridge. Harvard Education Press. Paas, F. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. Journal of Educational Psychology, 84(4), 429-434. Raaijmakers, S. F., Baars, M., Schaap, L., Paas, F. & Van Gog, T. (2017). Effects of performance feedback valence on perceptions of invested mental effort. Learning and Instruction, 51 36-46. Robinson-Garcia, N., Costas, R., Isett, K., Melkers, J., & Hicks, D. (2017). The unbearable emptiness of tweeting—About journal articles. PLOS one. https://doi.org/10.1371/journal.pone.0183551 Van Gog, T., Kirschner, F., Kester, L., & Paas, F. (2012). Timing and frequency of mental effort measurement: Evidence in favour of repeated measures. Applied Cognitive Psychology, 26, 833-839. Wenger, E. (1998). Communities of Practice: Learning, Meaning, Identity. Cambridge University Press. Willingham, D. T. (2012). When can you trust the experts: How to tell good science from bad in education . Willingham, D. T. (2017). A Mental Model of the Learner: Teaching the Basic Science of Educational Psychology to Future Teachers. Mind, Brain and Education, 11(4), 166-175.

Hinweis der Redaktion

  1. The recent move towards more 'evidence informed teaching' has seemingly  increased the interest of schools in researchers and academia, and of academia in schools. This development presents us with several questions. How can we best organise this relationship? Do teachers need research literacy skills? Why would academia be interested in cultivating teacher-researcher links? This talk will explore these questions and give several examples of research projects, most concerning mathematics in secondary education, where fruitful collaboration between me as researcher and classroom teachers, brought benefits to the school and higher education. I will try to convey what opportunities and chances there are in working together, but also -in light of workload discussions- some of the risks.