The document discusses France's experience assessing critical thinking, creativity, and collaboration. It outlines several national assessment programs in France that evaluate students in various subjects and competencies. It also describes ongoing projects to develop online tests to measure broad skills like critical thinking, creativity, problem solving, and collaboration for grades 6 through 10. Frameworks for assessing critical thinking and initial data collection in 2019 are mentioned. Projects on creativity and collaboration involving individual and group tasks are also discussed.

1. Assessment of critical thinking, creativity and
collaboration
French experience at Depp
Dr. Thierry Rocher
Head Office for Student Assessment at DEPP / IEA Chair
CERI conference, 24-25 September 2019, London

2. National surveys
French assessment programmes
CEDRE
Subjects
Sample-based subject-
based assessment
programme
Grades 5 and 9
- French
- Foreign languages
- History & Geography
- Science
- Mathematics
Common
Base
Sample-based
competences
assessment
programme
Grades 3, 6 and 9
- Common base
competences,
- Socio-cognitive
competences,
- 21st century skills
(4C)
Longitudinal
Longitudinal surveys:
school pathways and
family resources
Grade 6 2007, Grade 1
2011, handicapped
students (2005 & 2010)
Subjects and competences
Policy evaluation
Class size
reduction
policy in socio-
economic
disadvantaged
schools, grade
1 to 3
Digital
education
policy
evaluation
PISA
Programme for
International
Student Assessment
15 years-old
Reading Literacy
Mathematical
Literacy
Scientific Literacy
PIRLS
Progress in
International Reading
Literacy Survey
Grade 4
Reading
Comprehension
TIMSS
Trends in International
Mathematics and
Science Study
Grades 4, 8 and 12
Mathematics &
Science
ICILS
International Computer
and Information
Literacy Study
Grade 8
Digital Literacy
Computational thinking
ICCS
International Civic and
Citizenship education Study
Grade 8
Civic knowledge,
understanding of concepts
and issues related, civic
attitudes and engagement
Grades 1 & 2
Diagnostic Test
Early and mid
Grade 1
Early Grade 2
French
Maths
Grade 6
Diagnostic test
& monitoring
test
Early grade 6
French
Maths
Grade 10
Diagnostic
Early Grade 10
French
Maths
Army Day
Illiteracy
diagnostic
17-years old
French girls and
boys
Reading
International surveys
Nation-wide assessments
DEPP, Department of Statistics of the
Min of Ed, leads many standardised
assessment programmes

3. Cross-curricular Competences
Including broad skills, such as critical thinking, creativity, collaboration, problem
solving…
Socle commun de connaissances, de compétences et
de culture

4. Ongoing projects on “broad skills”
• Axes:
• Critical thinking
• Collaboration
• Creativity
• Complex problem solving (maths and science)
• Aim: to build online tests for grade 6 to grade 10 students
• Collaborative work: DEPP – researchers – teachers
• 2018-2019: from frameworks to first data collections
• Work in progress!

5. Critical thinking
• Framework (Delphi Report)

6. Critical thinking
• Associated researchers: Audrey Bedel, Nicolas Gauvrit, Virginie Bagneux, Sylvain
Delouvée, Katia Terriot
• Data collection in 2019 (3000 students)
• Issues araised:
• Are we measuring
• disposition or social desirability?
• interpretation or reading comprehension?
• inference or fluid intelligence?
• Dimensionality?
• Promising dimension:
• Explanation: Capacité à formaliser, communiquer et justifier son propre
raisonnement de manière claire

7. Example

8. The importance of critical thinking
ICILS measures grade 8 students’
abilities on a computer and information
literacy scale
ICILS 2013 revealed that only 2 % of
students use their critical thinking
whilst searching for information online
SAVE THE DATE: 5th November 2019,
ICILS 2018 release

9. Creativity & Collaboration
• Creativity meets collaboration:
• Creative Task in individual or collaborative contexts
• Non creative task in collaboration
• Associated researchers: Todd Lubart, Jean-Marie Burkhardt, Françoise Détienne,
Michael Baker, Séverine Maggio, Cyrille Feybesse
• See Todd Lubart’s presentation

10. Math complex problem solving
• Math interactive items • Process data analysis
Procedural
approach,
failure
Structural approach,
failure
Structural
approach,
success
Procedural
approach,
success

11. FLIP+ e-assessment community
• Goals
• Sharing innovative experiences
• Sharing IT developments
• Sharing contents: towards an item library
• Association is open to any non-profit institution in the field of assessment
• To know more and join the association, visit: https://flip-plus.org/

12. FLIP+ projects examples (Qti compatible)
Computational thinkingMind map
Collaborative pad

13. Merci