2012 getting ready_for_2013_assessments_-rms

Pennsylvania State Assessments 2013
Tom Corbett, Governor

▪

Ronald J. Tomalis, Secretary of Education

Pennsylvania State
Assessments
2012 – 2013
Edited for
RMS- PTO
11/28/12

www.education.state.pa.us


▪



New This Year

• Return of the Keystone Exams
• No PSSA-M or Grade 11 PSSA
• All students in Grade 11 who have not taken
the Keystone Exams must take them
• All PA assessments are available on-line
– PSSA, Keystone Exams, CDT

• Field testing PACC-aligned items in grades
3 – 5 in Math, Reading and Writing


▪



Important Dates
Keystone Exams Testing Window
Wave 1: December 3 – December 14, 2012
Wave 2: January 9 – January 23, 2013

May 13 – May 24, 2013
July 29 – August 2, 2013


▪



Important Dates
PSSA Math and Reading
April 8 - April 19, 2013
PSSA Writing Field Test
February 4 – February 13, 2013

PSSA Science
April 22 - April 26, 2013


▪



Important Dates
PSSA make-up for Writing
March 18 – March 22, 2013
PSSA make-up for Math, Reading and
Science
April 29 – May 3, 2013
ACCESS for ELLs Test Window Grades K-12

January 28 – March 8, 2013


▪



Important Dates
PASA Math & Reading Grades 3 - 8, 11
February 18– March 29, 2013

PASA Science Grades 4, 8, 11
May 6 – May 31, 2013

NAEP Math, Reading, Science, Writing and
Economics. Grades 4, 8, 12 in selected
schools
January 28 – March 8, 2013


▪



Pennsylvania Alternate System of
Assessment (PASA)
 Math & Reading: Feb 18 – Mar 29, 2013
 Science: May 6 – May 31 , 2013
 Writing: No statewide test form; individually created
(by teacher), scored (by teacher), and stored (in IEP
folder)
 Who participates in the PASA?
 Grades 3-8 and 11
 Students with a significant cognitive disability


▪



Who Takes the PSSA?

 Math/Reading – All students in grades 3-8

 Writing – All students in grades 5 and 8
 Science – All students in grades 4 and 8


▪



PA Common Core Standards
The Pennsylvania Common Core Standards
(PACC) and draft Assessment Anchors are
available on SAS at:
http://www.pdesas.org/Standard/CommonCore


▪



The Taxonomy of Assessment
Anchor Content Standards
1.
2.
3.
4.

Content Area
Grade Level
Reporting Category
Assessment Anchor Content Standards
1.

(Assessment Anchors)

5. Assessment Anchor Descriptor
6. Eligible Content


▪



Assessment Anchor Coding
S4.A.1.1.1
Science
Grade
Level
Reporting
Category

Eligible
Content
Assessment
Anchor
Assessment Descriptor
Anchor


▪



Keystone Exams
 Offered three times each year – winter, spring
and summer
 Offered in Algebra I, Biology and Literature
 Students can retake them until they score at the
proficient level
 The Project-Based Assessment part of the
Keystones is being piloted


▪



Who Takes the Keystones?

 All students in Grade 11 who have not already taken
a Keystone Exam in Algebra I, Biology, and
Literature
 All students who will complete a Biology course this
school year
 All students who will complete an Algebra I course
this year
 All students who will complete coursework that
covers the content of the Literature Exam this year


▪



Keystones and Regulations
 Students must take the Keystone Exams to
meet graduation requirements under Chapter 4
Regulations
 Students must take the Keystone Exams to
meet AYP requirements under NCLB


▪


Math 2013
 Criterion Referenced
 Five Reporting Categories
- Numbers and Operations
- Measurement
- Geometry
- Algebra
- Data Analysis



▪



Math 2013
 Student score comes from:




- 60 multiple choice questions
- Three open-ended questions
Students take:
- 72 multiple choice in grades 3 - 8 and 11
- Four open-ended questions
All grades will alternate subject areas with Math coming first.


▪



Math 2013
2013 Math Test Format
Number of Multiple
Choice Items per
Student
(1 point each)

Number of OpenEnded Items per
Student
(4 points each)

Grade

Estimated
Time of
Test

Common
Multiple
Choice
Items

Equating
Block
Items

Field
Test
Items

Common
OpenEnded
Items

Equating
Block
Items

Field
Test
Items

3-8 and
11

180
minutes
3 sessions

60

2

10

3

0

1

Scores come from the COMMON ONLY.

Total
Number
of Score
Points

60+12=

72


▪



Math 2013
 Embedded Field Test

 Gr 3-5 FT items based on PACC
 Gr 6-8 FT items based on current Anchors

 Open-Ended items scored on a 0-4 scale
 Item-specific scoring guidelines but no general rubric
 Formula sheets will be provided for grades 7 and 8. Formulas
needed in grades 5 and 6 are provided with the item
- See Resource Materials on our web site for the formula
sheets and item samplers


▪



Item Specifics
 Multiple choice items based on Eligible Content*
 Open-ended items based on Anchor (Verbs come from


Anchor, Anchor Descriptor or Eligible Content; Content
comes from Eligible Content.)
Reminder:
Have students read the OE items carefully and
answer exactly what is being asked.

*All items based on the PACC may cross Eligible Content and Anchors and
Reporting Categories.


▪



Item Specifics
 Examples of how OE items might be phrased:
- Show or explain all your work.
- Show all your work. Explain why you did each
step.
- Explain why [something is true or false]
- Describe how [doing something affects
something else; to find something, etc.]


▪


Math 2013
Rubric (for sample item only):
Part A:
- ½ point for correct answer
- 1 point for complete and correct work OR
½ point for correct but incomplete work.
Part B:
- 1/2 point for correct answer
- 1 point for correct and compete work OR
½ point for correct but incomplete work.
- 1 point for correct and complete explanation.
½ point for correct but incomplete explanation.



▪



Math 2013
Rubric Metric:
Total Points (within)
4
3–3½
2–2½
½-1½
0

Score (on)
4
3
2
1
0


▪



Math 2013
 Some notes about open-ended items:
- Guess and Check is a valid method but at least two incorrect
guesses must be shown to receive full credit.
- Not all open-ended items require a “why.”
- At least half the score points must come from one Anchor.
The rest can come from anywhere else in that Reporting
Category.


▪



Math 2013
 Testing time is approximately 150-180 minutes for Math.
 Testing in Grades 3 - 8 and 11.
 Can have a “blemish” and still get a score of 4
 “e.g. missing $” may or may not be a blemish depending on


the item and grade.
“Guess and check” is a valid, acceptable strategy but to get full
credit at least two incorrect “guesses” must be shown.


▪



Math 2013
 Grade 4 and up: calculators ARE permitted on all but the




beginning few items.
Rulers and protractors will be provided at grades where
needed. Students must use the rulers and protractors provided
for the PSSA. (For current items, protractors are provided
within the item itself. For items measuring the PACC, a
separate protractor may be provided.)
Rulers scaled in U.S. Customary and Metric as required by the
Anchors.


▪



Math 2013
Calculator Policy
The PSSA is designed so that calculators are not necessary
for students to be successful. If students choose to use a
calculator on the portions of the PSSA for which
calculators are permitted then they must adhere to the
guidelines listed below. It is incumbent upon the school test
coordinator to ensure that all calculator policies are
implemented and followed, including making sure
calculators have no programs stored in their memory.
Please note that if a student wants to restore the deleted
programs he or she will have to back them up prior to the
assessment.


▪



Math 2013
The following are NOT allowed for the PSSA
or Keystones:

 Non-calculators such as cell phones, PDAs, laptops,
minicomputers, pocket organizers, etc.
 Beaming capabilities. (These must be disabled.)
 Wireless communication technologies. Calculators having



wireless communication technologies may be used if those
technologies are disabled.
Calculators with QWERTY keyboards or other typewriter-like
keyboards or keypads (e.g. Dvorak).


▪



Math 2013
The following are NOT allowed for the PSSA
or Keystones:

 Calculators with built in Computer Algebra Systems – CAS.
 Calculators that make noise, have paper tape, need to be



plugged in or talk unless these specific calculators are required
as an accommodation. (Please refer to the Accommodations
Manual.)
Sharing calculators by students during a test session.
All programs/information stored in a calculator. These must be
deleted prior to using that calculator on any section of the
PSSA. Typically these are graphing calculators but scientific
calculators may also contain stored programs.


▪



Math Test Blueprint
Reporting
Category

Grade
3

Grade
4

Grade
5

Grade
6

Grade
7

Grade
8

Grade
11

Numbers and
Operations

40-50%

43-47%

41-45%

28-32%

20-24%

18-22%

12-15%

Measurement

12-15%

12-15%

12-15%

12-15%

12-15%

12-15%

12-15%

Geometry

12-15%

12-15%

12-15%

15-21%

15-21%

15-20%

12-18%

Algebraic
Concepts

12-15%

12-15%

13-17%

15-20%

20-27%

25-30%

36-42%

Data Analysis
and
Probability

13-16%

12-15%

12-15%

15-20%

15-20%

15-20%

12-18%

Total Points

72
Points

72
Points

72
Points

72
Points

72
Points

72
Points

72
Points


▪



Math Performance Level Cut
Scores
Performance
Level

Grade
3

Grade
4

Grade
5

Grade
6

Grade
7

Grade
8

Advanced

1370
and up

1445
and up

1483
and up

1476
and up

1472
and up

1446
and up

Proficient

11801369

12461444

13121482

12981475

12981471

12841445

Basic

10441179

11561245

11581311

11741297

11831297

11711283

Below Basic

7501043

7001155

7001157

7001173

7001182

7001170


▪



Keystone Algebra I
• Two modules
• Each Module has 30 points – 18 from multiple
choice and 12 from open-ended
• Each open-ended is worth four points
• Some open-ended will be machine scored
• Students in the class of 2017 must score at the
proficient or advanced level to graduate


▪



Keystone Algebra I
• Modules are scored separately and can be
passed separately
• Students must score proficient (or higher) on
the entire exam but not necessarily pass each
module
• If a student retakes the exam the highest score
on each module will count


▪



Keystone Algebra I – What It
Measures


▪



Keystone Algebra I – Test Format


▪



Keystone Algebra I – Point
Distribution


▪



Keystone Algebra I – Estimated
Time


▪



About the Eligible Content


The Eligible Content at each grade level shows the
range of knowledge and skills drawn upon to design
the PSSA for that grade level.



Examining the Eligible Content across grade levels
shows the progression of expectations from one grade
to the next.


▪



About the Test
 Three Reading Sections on the PSSA
 Math and Reading sections alternate




- Math: Sections 1, 3, 5
- Reading: Sections 2, 4, 6
Alignment with PA Academic Standards: Assesses
knowledge and skills described in the Assessment Anchor
Content Standards
Target Passage Types
- Eligible passage genres identified at each grade level


▪



Question Types and Scoring






Multiple-choice responses are bubbled in by the student and
scored by machine.
- One point each
Open-ended (short answer) responses are written out by the
student and scored by trained raters.
- Three points are possible for each
- Item-specific scoring guide
Grade 3
- Students write in test booklets
Grades 4 – 8
 - Students write in answer booklets


▪


Grades 6-8









Three sessions
Sections 2, 4, & 6 (alternates w/Math)
Approximately 50 –75 minutes each
Target Passage Types (mix varies by grade)
- Story (all grades)
- Poem (all grades)
- Informational (all grades)
- Autobiography/Biography (eligible at all grades)
- Practical/How-to/Advertisement
- Essay/Editorial (grades 5, 6, 7, 8)
58 Multiple-choice items (40 common items)
Five Open-ended items (four common items)
Students write answers in answer booklet



▪



Grades 6-8 Test Format
Approximate
length

Number of Multiple-Choice
Number of Open-Ended Items
Items
(3 points each)
(1 point each)

50 - 75
Common
minutes
each section
40

Total 170 –
215 minutes

Equating
Block

Field
Test

Common

Equating
Block

Field Test

8

8

4

0

1

Student score (Common Only): 52 points
Total points on each test: 73*
*Field test items do not count for student score


▪



Reading Reporting Clusters
Grade

Comprehension
and Reading Skills
(Category A)

Literature and
Interpretation
(Category B)

3

60-80%

20-40%

4

60-80%

20-40%

5

60-80%

20-40%

6

50-70%

30-50%

7

50-70%

30-50%

8

40-60%

40-60%


▪



Genre Coverage
Grade

Fiction
(and Nonfiction)
Narrative

Nonfiction

3

50-70%

30-50%

4

50-70%

30-50%

5

50-70%

30-50%

6

40-60%

40-60%

7

40-60%

40-60%

8

40-60%

40-60%

11

30-50%

50-70%


▪



Reading Scale Score Ranges
by Performance Level and Grade
Grade
3

Grade
4

Grade
5

Grade
6

Grade
7

Grade
8

Grade
11

Advanced

1442
and up

1469
and up

1497
and up

1456
and up

1470
and up

1473
and up

NA

Proficient

12351441

12551468

12751496

12781455

12791469

12801472

NA

Basic

11681234

11121254

11371274

11211277

11311278

11461279

NA

Below
Basic

10001167

7001111

7001136

7001120

7001130

7001145

Level

NA


▪



Not the Same!


Performance Level
Descriptors
– Advanced
– Proficient
– Basic
– Below Basic



≠

Scores on Open-Ended
Reading Questions
– 3 points
– 2 points
– 1 point
– 0 points

1) Scores on open-ended questions contribute to a student’s raw score.
2) The student’s raw score is converted to a scale score.
3) The student’s scale score is interpreted as a Performance Level.


▪


Writing 2013
 Grades 5, 8
 Multiple-Choice
 Writing Prompts
 Mode-specific Scoring Guidelines for composition
 Conventions scored separately



▪



Writing 2013
 Alignment


- Standards (not the revised PACC)
- End of elementary and middle
Holistic “hybrid” scoring
- Holistic scoring for composition—more appropriate for
large-scale assessments
- Separate scoring for conventions leaves emphasis on
composing
- Multiple-choice adds validity & reliability


▪



Who takes the test?
 All students in grades 5 and 8
 Exceptions:
- ELL students in first 12 months
- PASA students
* Take an alternate writing test based on IEP goals
* Scored test is stored in IEP folder


▪



Grade 8
 Multiple-Choice Section given first


- Five passages (three core, two field test) with embedded
editing and revision errors
- Four questions for each passage, total 20 questions
Writing prompts
- Two core prompts
- One field test prompt
- Informational and Persuasive modes only


▪



How Are Responses Scored?

 Each writing prompt will be scored using a 4 pt. conventions



rubric and a 4 pt. writing rubric with a variable mode
emphasis.
 Writing prompt responses scored by hand (with 10 percent
read twice)
- Focus, Content, Organization and Style
* Scored holistically
* 1-4 pt. Mode-specific Scoring Guide
- Editing and Revising:
* Scored separately
* 1-4 pt. Conventions Scoring Guideline
Bubbled multiple choice responses scored by machine
* 1 pt. each


▪



Common Score Points
Writing Prompts
Multiple
Choice

Totals
Conventions

8

12
12 items each
worth 1 point each

(12 X 1) = 12

Mode

80

2 items each worth a
maximum of 4 points
each

(2 X 4 = 8)

2 items each worth a
maximum of 4 points
each
(The raw score is
multiplied by 10)

(2 X 4) X 10 = 80
Field test items are not reflected in this chart.
No scores are reported for field test items.

100

12+8+80=100


▪


Non-scorable
 Illegible
 Incoherent
 Insufficient
 Blank paper
 Off-prompt: Still receives a Conventions score
 Off-mode: Loss of one point in Composition score



▪



2013 Writing Test Format
Session

1

2

3

4

Approx.
Minutes

Number of
Test Items

Conventions
Score Points

Composition
Score Points

30

20
Multiple
Choice

12 (Common)

0

1 Writing
Prompt

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

1 Writing
Prompt

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

1 Writing
Prompt

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

4 (if prompt is
Common)
N/A (if prompt is
Field Test)

60

60

60


▪



Writing Scaled Score Ranges by Grade and
Performance level
Performance
level

Grade 5

Grade 8

Grade 11

Advanced

1909
and up

1748
and up

NA

Proficient

12361908

12361747

NA

Basic

7451235

9141746

NA

Below Basic

700744

700913

NA


▪



Test Design

 Aligned with PACC Standards
 Grade 3-5 will be operational 2014
 Grades 6-8 will field test in 2014
 Grades 3-8 will be operational 2015

 All grades will be assessed on writing composition
 All grades eligible for three modes
 All multiple choice are stand-alone items
 Grade 3 has short answer responses


▪



 Keystone Exams will be used for two purposes:
 Proposed state requirement that the class of 2017 and
beyond demonstrate proficiency for the purpose of
graduation
 Accountability as per No Child Left Behind (NCLB), i.e.
Adequate Yearly Progress (AYP)


▪



The Literature Keystone Exam will assess
students’ mastery of the Literature Assessment
Anchors as defined by the Eligible Content and
will be aligned to the Concepts and
Competencies.
Module 1
Assessment Anchors Covered

Number of Eligible Content Covered

Module 2

Fiction Literature

Nonfiction Literature

25

31

▪




Types of questions and number of questions
covered in the Literature Keystone Exam
operational form.
Module 1
Multiple
* Choice
Questions

Module 2

Constructed
Response
Questions

*

Multiple
Choice
Questions

Total

Constructed
Response
Questions

*

Multiple
Choice
Questions

Constructed
Response
Questions

Number of
Operational
Questions

2

17

3

2

17

3

4

34

6

Number of
Field Test
Questions

1

6

1

1

6

1

2

12

2

Total

3

23

4

3

23

4

6

46

8

* Number of passages


▪



Types of questions and number of points covered
in the Literature Keystone Exam operational
form.
Module 1

Module 2

Number of Operational Multiple
Choice Questions

17 questions @ 1 point each = 17
points

17 questions @ 1 point each = 17
points

Number of Operational ConstructedResponse Questions

3 questions at 3 points each = 9 points

3 questions at 3 points each = 9 points

Total Number of Points

26 points

26 points

Percentage of Points for Entire Test

50%

50%

There will be a total of 52 points (Module 1 and Module 2 combined), with
approximately 65 percent multiple-choice points and 35 percent constructedresponse points.


▪



Estimated time a typical student would need to
complete Module 1 and Module 2 of the
Literature Keystone Exam operational form.
Operational
Questions

Number of Minutes

104

Field Test
Questions

42

Total Questions

146


▪


PSSA Science 2013
 All students in grades 4 and 8
 Exception:
- PASA students



▪


PSSA Science 2013
 Criterion Reference
 Four Reporting Categories





- The Nature of Science
- Biological Sciences
- Physical Sciences
- Earth and Space Sciences
Embedded Field Test
Open-Ended items scored on a 0-2
Item-specific scoring guidelines



▪


PSSA Science 2013
District and School Reporting
A. The Nature of Science
1. Reasoning and Analysis
2. Processes, Procedures, and
Tools of Scientific Investigation
3. Systems, Models, and Patterns



▪


PSSA Science 2013
B. Biological Sciences
1. Structure and Function of Organisms
2. Continuity of Life
3. Ecological Behavior and Systems



▪



PSSA Science 2013
C. Physical Sciences
1. Structure, Properties and Interactions of Matter
2. Forms, Sources, Conversions, and Transfer of
Energy
3. Principles of Force and Motion


▪


PSSA Science 2013
D. Earth and Space Sciences
1. Earth Features and Processes that
Change Earth and Its Resources
2. Weather, Climate, and Atmospheric
Processes
3. Composition and Structure of the
Universe



▪


PSSA Science 2013
Science Test Composition
50% Nature of Science

(Inquiry)
50% Biological Science
Physical Science
Earth and Space Sciences
(Content)



▪



PSSA Science 2013 Test Blueprint


▪



PSSA Science
Performance Level Cut Scores


▪


PSSA Science 2013
Student score comes from:

 Grades 4 and 8

- 58 Multiple Choice items
- Five open-ended items (two points each)



▪


PSSA Science 2013
Total number of items:

 Grade 4

- 68 Multiple Choice Items
- Seven open-ended Items
 Grade 8
- 70 Multiple Choice Items
- Seven open-ended Items



▪



2013 PSSA Science Format
Total Number of Multiple Choice
Items per Student

G
R
A
D
E

Approx.
Length

Total Number of OpenEnded Items per Student

Total Number of
points
(Common Items
Only)

Common
Items

Common
Scenario
Items

Equating
Block
Items

Field
Test
Items

Common
Items
(2 points
each)

Equating
Block
Items

Field
Test
items

Number of Score
Points per Student

4

110-115
Minutes
2
Sections

58

0

2

8

5

1

1

58+10=68

8

120-125
Minutes
2
Sections

54

4

2

10

5

1

1

58+10=68


▪



Biology Keystone 2012-2013
The Biology Keystone Exam takes the place of the
Grade 11 PSSA Science Assessment for 2012-2013
Two purposes:
- Proposed state requirement that the class of 2017 and
beyond must demonstrate proficiency for the purpose of
earning a PA high school diploma
- Accountability as per No Child Left Behind (NCLB) for
Adequate Yearly Progress (AYP) calculations


▪



Biology Keystone 2012-2013
The Biology Keystone Exam will measure the
Biology Assessment Anchors as defined by the
Eligible Content and will be aligned to the Concepts
and Competencies
Module 1 - Cells and Cell Processes
Module 2 - Continuity and Unity of Life


▪



Classroom Diagnostic Tools


The Pennsylvania Department of Education has
completed development of the Classroom Diagnostic
Tools (CDTs) to support teachers and students in
grades 6 through 12 in Mathematics,
Reading/Literature and Science. These tools available at no cost to districts - are fully integrated
and aligned to the Standards Aligned System (SAS)
and enable educators to identify a student’s academic
strengths and areas of need as well as links to
classroom resources.


▪



Monitoring
 In 2007 PDE began monitoring schools and districts regarding
test security, administration, etc. This process will continue in
2012-13.

 All visits will be unannounced.
 PDE representatives are treated very well.
THANK YOU!


▪



Coming in 2014
 Grades 3 – 5 Reading and Writing
transitioning to ELA
 Grades 3 – 5 Math and ELA based on PACC
 Separate booklets for Math and ELA
 Stand-alone field test for Writing in grades
6–8
 No change for grades 6 – 8 except for field
test items based on PACC

2012 getting ready_for_2013_assessments_-rms

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie 2012 getting ready_for_2013_assessments_-rms

Ähnlich wie 2012 getting ready_for_2013_assessments_-rms (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

2012 getting ready_for_2013_assessments_-rms