SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Practical Alignment  for Item / Test Developers: Revised Bloom’s Taxonomy (RBT) and  Depth of Knowledge Levels (DOK) Staff Trainings,  2009 Jerrie W. Brown, Content Lead for Social Studies Assessments North Carolina State University  Center for Urban & Community Services Technical Outreach for Public Schools (TOPS)
[object Object],[object Object],[object Object],“ Alignment also helps ensure the validity of test results. If standards and tests are not aligned, results might provide a misleading picture of how well students are attaining standards.” -Robert Rothman, 2003 Annenberg Institute for School Reform
What is alignment? The No Child Left Behind Act of 2001 (NCLB) requires that each state align assessments to content standards.  Once the  enacted  (instruction),  intended  (state standards), and  assessed  (state tests)  curricula  have been measured, questions can be asked about the extent to which content is similar across them.  To the extent  content  is the same, they are said to be aligned.  J. Brown, NCSU, 2009
Defining Alignment ,[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Alignment Procedure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Alignment Dimensions ,[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009 ,[object Object],[object Object],[object Object],[object Object],6. Create 5. Evaluate 4. Analyze 3. Apply 2. Understand 1. Remember Content Topic/Strand A 4. Extended Thinking 3. Strategic Thinking 2. Skill/Concept 1. Recall A. Factual B. Conceptual C. Procedural D. Meta-Cognitive Content Topic/Strand B Content Topic/Strand C (Note:  achieves  content  validity) (Note:  achieves  content  validity and  instructional  validity)
Revised Bloom’s Taxonomy (RBT) Table  for _____________________________ (Subject / Grade Level) Adapted from  Anderson, Lorin W. and David R. Krathwohl, et al., (2001).   J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) B. Conceptual Knowledge (0%) C. Procedural Knowledge (0%) D. Meta- Cognitive Knowledge (0%)
Depth of Knowledge (DOK) Levels  for _____________________________ (Subject / Grade Level) Adapted from  Norm Webb, (2002).   J. Brown, NCSU, 2009 Content Categories Depth of Knowledge Levels Categorical Concurrence Yes / No 1. Recall 2. Skill/Concept 3. Strategic Thinking 4. Extended Thinking A.  Topic/Strand __________ (Specify) B. Topic/Strand __________ (Specify) C. Topic/Strand __________ (Specify)
RBT’s Knowledge Dimension:  J. Brown, NCSU, 2009 Major Types Definitions A Factual The basic elements students must know to be acquainted with a discipline or solve problems in it B Conceptual The interrelationships among the basic elements within a larger structure that enable them to function together C Procedural How to do something, methods of inquiry, and criteria for using skills, algorithms, techniques, and methods D Metacognitive Knowledge of cognition in general as well as awareness and knowledge of one’s own cognition
RBT’s Knowledge Dimension:  J. Brown, NCSU, 2009 Major Types Subtypes A Factual AA.  Knowledge of terminology AB.  Knowledge of specific details and elements B Conceptual BA.  Knowledge of classifications and categories BB.  Knowledge of principles and generalizations BC.  Knowledge of theories, models, and structures C Procedural CA.  Knowledge of subject-specific skills and algorithms CB.  Knowledge of subject-specific techniques and methods CC.  Knowledge of criteria for determining when to use appropriate procedures D Metacognitive DA.  Strategic knowledge DB.  Knowledge about cognitive tasks, including appropriate contextual and conditional knowledge DC.  Self-knowledge
RBT’s Cognitive Process Dimension:  J. Brown, NCSU, 2009 Cognitive Process Categories Definitions 1 Remember Retrieve relevant knowledge from long-term memory 2 Understand Construct meaning from instructional messages, including oral, written, and graphic communication 3 Apply Carry out or use a procedure in a given situation 4 Analyze Break material down into its constituent parts and determine how the parts relate to one another and to an overall structure or purpose 5 Evaluate Make judgments based on criteria and standards 6 Create Put elements together to form a coherent or functional whole; reorganize elements into a new pattern or structure
RBT’s Cognitive Process Dimension:  J. Brown, NCSU, 2009 Cognitive Process Categories Cognitive Processes 1 Remember 1.1  Recognizing 1.2  Recalling 2 Understand 2.1  Interpreting 2.2  Exemplifying 2.3  Classifying 2.4  Summarizing 2.5  Inferring 2.6  Comparing 2.7  Explaining 3 Apply 3.1  Executing 3.2  Implementing 4 Analyze 4.1  Differentiating 4.2  Organizing 4.3  Attributing 5 Evaluate 5.1  Checking 5.2  Critiquing 6 Create 6.1  Generating 6.2  Planning 6.3  Producing
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Formal Alignment Studies and Depth of Knowledge Levels (DOKs) J. Brown, NCSU, 2009
Depth of Knowledge Levels ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Subject-Specific DOKs J. Brown, NCSU, 2009 Science Social Studies Math Level 1 Recall and Reproduction Recall of Information Recall Level 2 Skills and Concepts Basic Reasoning Skill/ Concept Level 3 Strategic Thinking Complex Reasoning Strategic Thinking Level 4 Extended Thinking Extended Reasoning Extended Thinking
Reading DOKs J. Brown, NCSU, 2009 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Getting Started ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],J. Brown, NCSU, 2009
Rating WA State Standards J. Brown, NCSU, 2009
Plotting Standards J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
Rating ‘WASL’ Test Items J. Brown, NCSU, 2009
Plotting Test Items J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order =  0% )  Cognitive Process Dimension  (Higher Order =  0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A.  Factual Knowledge  (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
Individual and Group Results
Thank You for Participating! FOR MORE INFORMATION : Mr. Jerrie W. Brown, Consultant North Carolina State University Center for Urban and Community Services Technical Outreach for Public Schools 1500 Blue Ridge Road Raleigh, N. Carolina  27607 Tel:  (919) 515-1125 Email:  [email_address] Website:  http://www.cuacs.ncsu.edu

Weitere ähnliche Inhalte

Was ist angesagt?

435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
nona wayne dela pena
 
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdfEnglish 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
EverdinaGiltendez
 

Was ist angesagt? (20)

cot rating sheets 2023-2024.pdf
cot rating sheets 2023-2024.pdfcot rating sheets 2023-2024.pdf
cot rating sheets 2023-2024.pdf
 
cot in rpms forms
cot in rpms formscot in rpms forms
cot in rpms forms
 
435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
435802176-Apply-Knowledge-Content-Within-Across-Curriculum-Areas.pptx
 
Activity matrix
Activity matrixActivity matrix
Activity matrix
 
RPMS Portfolio for Teachers I-III
RPMS Portfolio for Teachers I-IIIRPMS Portfolio for Teachers I-III
RPMS Portfolio for Teachers I-III
 
OBE ACTION PLAN 2022-2023.docx
OBE ACTION PLAN 2022-2023.docxOBE ACTION PLAN 2022-2023.docx
OBE ACTION PLAN 2022-2023.docx
 
Sample Lesson Plan in Content-Based Integration - Filipino (Education)
Sample Lesson Plan in Content-Based Integration - Filipino (Education)Sample Lesson Plan in Content-Based Integration - Filipino (Education)
Sample Lesson Plan in Content-Based Integration - Filipino (Education)
 
11. layers of the earth (crust)
11. layers of the earth (crust)11. layers of the earth (crust)
11. layers of the earth (crust)
 
HIGHER ORDER THINKING SKILLS
HIGHER ORDER THINKING SKILLSHIGHER ORDER THINKING SKILLS
HIGHER ORDER THINKING SKILLS
 
MIDYEAR-REVIEW-on-IPCRF.pptx
MIDYEAR-REVIEW-on-IPCRF.pptxMIDYEAR-REVIEW-on-IPCRF.pptx
MIDYEAR-REVIEW-on-IPCRF.pptx
 
use of cot in rpms
 use of cot in rpms use of cot in rpms
use of cot in rpms
 
The Four E's of Effective Learning: Teaching Tips for Helping Students Become...
The Four E's of Effective Learning: Teaching Tips for Helping Students Become...The Four E's of Effective Learning: Teaching Tips for Helping Students Become...
The Four E's of Effective Learning: Teaching Tips for Helping Students Become...
 
ILMP (Objective # 11).docx
ILMP (Objective # 11).docxILMP (Objective # 11).docx
ILMP (Objective # 11).docx
 
Practice Teaching Portfolio Episode 3
Practice Teaching Portfolio Episode 3Practice Teaching Portfolio Episode 3
Practice Teaching Portfolio Episode 3
 
RPMS SLAC 2023-2024.pptx
RPMS SLAC 2023-2024.pptxRPMS SLAC 2023-2024.pptx
RPMS SLAC 2023-2024.pptx
 
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdfEnglish 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
English 2_q2_mod2_Generating Ideas Through Pre-Writing Activities_v2.pdf
 
COT Tool 2023-2024.doc
COT Tool 2023-2024.docCOT Tool 2023-2024.doc
COT Tool 2023-2024.doc
 
DLL Math Grade 7 Third week
DLL Math Grade 7 Third weekDLL Math Grade 7 Third week
DLL Math Grade 7 Third week
 
action-plan-2022-2023-template.docx
action-plan-2022-2023-template.docxaction-plan-2022-2023-template.docx
action-plan-2022-2023-template.docx
 
DLL for grade 8
DLL for grade 8DLL for grade 8
DLL for grade 8
 

Andere mochten auch

Table of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction ReviewTable of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction Review
Rivera Arnel
 

Andere mochten auch (13)

2014 penilaian hasil belajar oleh pendidik-prof udin
2014 penilaian hasil belajar oleh pendidik-prof udin 2014 penilaian hasil belajar oleh pendidik-prof udin
2014 penilaian hasil belajar oleh pendidik-prof udin
 
Bergenfield workshop on common core and parcc
Bergenfield workshop on common core and parccBergenfield workshop on common core and parcc
Bergenfield workshop on common core and parcc
 
Depth of Knowledge
Depth of KnowledgeDepth of Knowledge
Depth of Knowledge
 
Providing vegetables for the full eating season 2013 Pam Dawling
Providing vegetables for the full eating season 2013 Pam DawlingProviding vegetables for the full eating season 2013 Pam Dawling
Providing vegetables for the full eating season 2013 Pam Dawling
 
Depth of Knowledge in Math
Depth of Knowledge in MathDepth of Knowledge in Math
Depth of Knowledge in Math
 
Instructional Objectives: Bloom's Revised Taxonomy
Instructional Objectives: Bloom's Revised TaxonomyInstructional Objectives: Bloom's Revised Taxonomy
Instructional Objectives: Bloom's Revised Taxonomy
 
How to make table of specs
How to make table of specsHow to make table of specs
How to make table of specs
 
Preparing table of specification for Grade 7 and Grade 8
Preparing table of specification for Grade 7 and Grade 8Preparing table of specification for Grade 7 and Grade 8
Preparing table of specification for Grade 7 and Grade 8
 
Second periodical test english grade 3
Second periodical test english grade 3Second periodical test english grade 3
Second periodical test english grade 3
 
TOS in Science III and Sample Test
TOS in Science III and Sample TestTOS in Science III and Sample Test
TOS in Science III and Sample Test
 
Preparing The Table of Specification
Preparing The Table of SpecificationPreparing The Table of Specification
Preparing The Table of Specification
 
Table of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction ReviewTable of Specifications (TOS) and Test Construction Review
Table of Specifications (TOS) and Test Construction Review
 
Table of specifications
Table of specificationsTable of specifications
Table of specifications
 

Ähnlich wie RBT and DOK Alignment for Practitioners

Nj model curriculum
Nj model curriculumNj model curriculum
Nj model curriculum
MrSanchez
 
William paper presentation
William paper presentationWilliam paper presentation
William paper presentation
William Kapambwe
 
Stages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testingStages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testing
patiluna
 
Task based language test
Task based language testTask based language test
Task based language test
Vronit82
 

Ähnlich wie RBT and DOK Alignment for Practitioners (20)

Drafting written questions and marking schemes Liz Norman ANZCVS 2020
Drafting written questions and marking schemes Liz Norman ANZCVS 2020Drafting written questions and marking schemes Liz Norman ANZCVS 2020
Drafting written questions and marking schemes Liz Norman ANZCVS 2020
 
Objectives and Assessments
Objectives and AssessmentsObjectives and Assessments
Objectives and Assessments
 
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptx
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptxResaerch-design-Presentation-MTTE-1st-sem-2023.pptx
Resaerch-design-Presentation-MTTE-1st-sem-2023.pptx
 
Assignment· using the instructional task created earliergradual
Assignment· using the instructional task created earliergradualAssignment· using the instructional task created earliergradual
Assignment· using the instructional task created earliergradual
 
RUBRICS.pptx
RUBRICS.pptxRUBRICS.pptx
RUBRICS.pptx
 
pr2 dll week 1.docx
pr2 dll week 1.docxpr2 dll week 1.docx
pr2 dll week 1.docx
 
Nj model curriculum
Nj model curriculumNj model curriculum
Nj model curriculum
 
2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus2010 01 psyf 588 master syllabus
2010 01 psyf 588 master syllabus
 
Designing language test
Designing language testDesigning language test
Designing language test
 
Rubrics sb
Rubrics sbRubrics sb
Rubrics sb
 
Daily alignment (1)
Daily alignment (1)Daily alignment (1)
Daily alignment (1)
 
General Framework for Setting Examination Papers and Test Papers
General Framework for Setting Examination Papers and Test PapersGeneral Framework for Setting Examination Papers and Test Papers
General Framework for Setting Examination Papers and Test Papers
 
William paper presentation
William paper presentationWilliam paper presentation
William paper presentation
 
Syllabus
SyllabusSyllabus
Syllabus
 
Pgptp session 2
Pgptp session 2Pgptp session 2
Pgptp session 2
 
Stages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testingStages of test writings final by joy,, language testing
Stages of test writings final by joy,, language testing
 
The Revised Blooms Taxonomy of Educational Objectives.pdf
The Revised Blooms Taxonomy of Educational Objectives.pdfThe Revised Blooms Taxonomy of Educational Objectives.pdf
The Revised Blooms Taxonomy of Educational Objectives.pdf
 
Task based language test
Task based language testTask based language test
Task based language test
 
COT.pptx
COT.pptxCOT.pptx
COT.pptx
 
TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)TEST DEVELOPMENT AND EVALUATION (6462)
TEST DEVELOPMENT AND EVALUATION (6462)
 

Kürzlich hochgeladen

Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Kürzlich hochgeladen (20)

How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Third Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptxThird Battle of Panipat detailed notes.pptx
Third Battle of Panipat detailed notes.pptx
 
Dyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptxDyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 

RBT and DOK Alignment for Practitioners

  • 1. Practical Alignment for Item / Test Developers: Revised Bloom’s Taxonomy (RBT) and Depth of Knowledge Levels (DOK) Staff Trainings, 2009 Jerrie W. Brown, Content Lead for Social Studies Assessments North Carolina State University Center for Urban & Community Services Technical Outreach for Public Schools (TOPS)
  • 2.
  • 3. What is alignment? The No Child Left Behind Act of 2001 (NCLB) requires that each state align assessments to content standards. Once the enacted (instruction), intended (state standards), and assessed (state tests) curricula have been measured, questions can be asked about the extent to which content is similar across them. To the extent content is the same, they are said to be aligned. J. Brown, NCSU, 2009
  • 4.
  • 5.
  • 6.
  • 7. Revised Bloom’s Taxonomy (RBT) Table for _____________________________ (Subject / Grade Level) Adapted from Anderson, Lorin W. and David R. Krathwohl, et al., (2001). J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) B. Conceptual Knowledge (0%) C. Procedural Knowledge (0%) D. Meta- Cognitive Knowledge (0%)
  • 8. Depth of Knowledge (DOK) Levels for _____________________________ (Subject / Grade Level) Adapted from Norm Webb, (2002). J. Brown, NCSU, 2009 Content Categories Depth of Knowledge Levels Categorical Concurrence Yes / No 1. Recall 2. Skill/Concept 3. Strategic Thinking 4. Extended Thinking A. Topic/Strand __________ (Specify) B. Topic/Strand __________ (Specify) C. Topic/Strand __________ (Specify)
  • 9. RBT’s Knowledge Dimension: J. Brown, NCSU, 2009 Major Types Definitions A Factual The basic elements students must know to be acquainted with a discipline or solve problems in it B Conceptual The interrelationships among the basic elements within a larger structure that enable them to function together C Procedural How to do something, methods of inquiry, and criteria for using skills, algorithms, techniques, and methods D Metacognitive Knowledge of cognition in general as well as awareness and knowledge of one’s own cognition
  • 10. RBT’s Knowledge Dimension: J. Brown, NCSU, 2009 Major Types Subtypes A Factual AA. Knowledge of terminology AB. Knowledge of specific details and elements B Conceptual BA. Knowledge of classifications and categories BB. Knowledge of principles and generalizations BC. Knowledge of theories, models, and structures C Procedural CA. Knowledge of subject-specific skills and algorithms CB. Knowledge of subject-specific techniques and methods CC. Knowledge of criteria for determining when to use appropriate procedures D Metacognitive DA. Strategic knowledge DB. Knowledge about cognitive tasks, including appropriate contextual and conditional knowledge DC. Self-knowledge
  • 11. RBT’s Cognitive Process Dimension: J. Brown, NCSU, 2009 Cognitive Process Categories Definitions 1 Remember Retrieve relevant knowledge from long-term memory 2 Understand Construct meaning from instructional messages, including oral, written, and graphic communication 3 Apply Carry out or use a procedure in a given situation 4 Analyze Break material down into its constituent parts and determine how the parts relate to one another and to an overall structure or purpose 5 Evaluate Make judgments based on criteria and standards 6 Create Put elements together to form a coherent or functional whole; reorganize elements into a new pattern or structure
  • 12. RBT’s Cognitive Process Dimension: J. Brown, NCSU, 2009 Cognitive Process Categories Cognitive Processes 1 Remember 1.1 Recognizing 1.2 Recalling 2 Understand 2.1 Interpreting 2.2 Exemplifying 2.3 Classifying 2.4 Summarizing 2.5 Inferring 2.6 Comparing 2.7 Explaining 3 Apply 3.1 Executing 3.2 Implementing 4 Analyze 4.1 Differentiating 4.2 Organizing 4.3 Attributing 5 Evaluate 5.1 Checking 5.2 Critiquing 6 Create 6.1 Generating 6.2 Planning 6.3 Producing
  • 13.
  • 14.
  • 15. Subject-Specific DOKs J. Brown, NCSU, 2009 Science Social Studies Math Level 1 Recall and Reproduction Recall of Information Recall Level 2 Skills and Concepts Basic Reasoning Skill/ Concept Level 3 Strategic Thinking Complex Reasoning Strategic Thinking Level 4 Extended Thinking Extended Reasoning Extended Thinking
  • 16.
  • 17.
  • 18. Rating WA State Standards J. Brown, NCSU, 2009
  • 19. Plotting Standards J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
  • 20. Rating ‘WASL’ Test Items J. Brown, NCSU, 2009
  • 21. Plotting Test Items J. Brown, NCSU, 2009 Knowledge Dimension (Lower Order = 0% ) Cognitive Process Dimension (Higher Order = 0% ) 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual Knowledge (0%) 10 1, 5 9 B. Conceptual Knowledge (0%) 2, 3 8 6 C. Procedural Knowledge (0%) 7 4 D. Meta- Cognitive Knowledge (0%)
  • 23. Thank You for Participating! FOR MORE INFORMATION : Mr. Jerrie W. Brown, Consultant North Carolina State University Center for Urban and Community Services Technical Outreach for Public Schools 1500 Blue Ridge Road Raleigh, N. Carolina 27607 Tel: (919) 515-1125 Email: [email_address] Website: http://www.cuacs.ncsu.edu