1. Background and Overview of RFP-09 on
Test & CAT Specifications
1 of 3
Background
The Test Design and Validation & Pychometrics Work Groups have been designated co-leads in overseeingand
managingprocurement activities related to bundle #9 resultingin the development and delivery of the test and
CAT specificationsfor the SBAC Assessment System. (Refer to page 41 of RTTA Program Application,section A3 on
the SBAC Assessment Design: http://www.k12.wa.us/SMARTER/pubdocs/SBAC_Narrative.pdf)
The Officeof the Executive Director (OED) has commissioned a white paper by Stanley Rabinowitzmapping out the
options availableto the Consortiumwith respect to the design and development of an interim assessmentand its
associated bank of non-secure items. The white paper will beshared with member states within the next week or
so. To allowthe members of the Consortiumto convene face-to-face to discussand decideon critical aspects of
the assessmentdesign,the OED has requested that both the Pyschometrics Services RFP-05 and the Test/CAT
specifications RFP-09 includeas deliverables 1) the gathering of requirements for the interim assessment
framework and 2) the facilitation of Consortium-wideconvocations amongwork group co-chairs,stateleads,TAC
experts, and external partners to reach consensus and authorizefurther development of an interim assessment
and item back.
Both work groups (i.e. TD and VP) are being asked to augment their scope of work accordingly,and to that end the
OED has communicated to Dr. McCall and our Quad that a cost-option for the interim assessmentdesign be made
part of both RFPs scheduled to be issued per the schedulebelow. This schedulereflects the work plan agreed to
by our Quad and Dr. McCall. You have each received a copy of Marty’s firstdraft, and duringour discus sion on
Tuesday, September 20, 2011 we hope to further elaborateon the procurement strategy and work plan so as to
have our RFP-09 issued on October 14, accordingto plan.
Next Steps
1) FinalizeRFP draftto enable sharingwith WG/GS/EC by Monday, September 26, 2011.
2) Decide on composition of RFP-09 Evaluation Committee
3) Confirmpost-issuanceschedule
The PMP Liaison has been in contactwith OSPI via MikeMiddleton to confirmthe post-issuanceschedulefor our
RFP-09. OSPI’s guidanceon dates, however, fails to meet the dates targeted by the Master Work Plan 4.1.1 for a
mid-December vendor startdate. As such, the PMP has counter-proposed the dates highlighted in yellowin
column #3. Column #2 notes dates for the RFP writingphases through RFP issuanceon October 14, and then
registers the current scheduleproposed by OSPI. The PMP will reportback as soon as we here back from OSPI on
their disposition to our request for expedited handlingof this procurement bundle.
Procurement Bundle #9: Components for Test & CAT Specifications RFP-09
5 Develop Test Specifications and Blueprints
Expected Outcome: Definition of test form components (e.g., number of items/tasks,breadth and depth of
content coverage) necessary to consistently build valid and reliabletestforms that reflect emphasized CCSS
content.
Scope Parameters:
 Specificationsinclude,but arenot limited to, details on the following:
- Purpose, use, and validity claims of each test
- Item/Task Attributes
- Form Attributes
- CAT Attributes
 Review and revisebased on Computer Adaptive Testing simulation studies,small-scaletrials,Pilotand
Field Testing, and other information as necessary

2. Background and Overview of RFP-09 on
Test & CAT Specifications
2 of 3
Test Design RFP Bundle #9 (ID# 5 and 55)
Proposed RFP Draftingand Development Schedule for fall 2011 (items in red To-Be-Scheduled: TBS)
Month Day
Counter
Proposal from
PMP
Activities
Sept. 6 - Kick-off meeting with TD and VP Quads and Marty McCall
12 - Announce RFP-09 Review to Liaisons
13
- TDWG Quad Review of RFP Outline(Test Specs Model from Marty)
- Heads-up Notice about RFP review to WG/GS
16 - End-of-day: 1stDraft due from Writer to VP and TD WGs
19
- RFP Review Session w/ Marty and TD Co-chairs from11amto 1pm
Pacific
Note: VP Quad to be invited for an extended session (CFC to issue new
calendar invites)
20
- TDWG Mtg. (extended session to review drafts before releaseto WG/GS
on 9/26)
11:30 am to 2:30 pm (CFC to issue new calendar invites and WebEx)
23
- 2nd DRAFT: RFP Reviewing Session w/ Marty and TD Co-chairs (TBS)—
possibletouch pointif early in day
26
- DRAFT_FOR_REVIEW submitted by Marty to TD co-chairs for distribution
to GS & WGs
- Draft RFP released to all WGs and State Leads and OSPI (released COB to
lists #31 and #6 de-duped by Amy Reff)
Oct. 3
- Comments from GS/WG due back to TDWG by Noon via
sbac@wested.org
- End-of-day call with TD Quad (may inviteVP Quad) 3:30 pm to 5:30 pm
4
- Full TDWG meeting, 11:30 am to 3:30 pm (CFC to issue new calendar
invites and WebEx)
7 - RFP final DRAFT sent to EC for Approval and to OSPI for pre-processing
11
- TD received EC approval to proceed with issuanceand any draft
redactions
12 - TDWG hands off RFP final draftto OSPI for processingand posting
14 - Test RFP posted/issued on OSPI Website
17 OK - Question and Answer Period begins
26 OK - Letter of Intent Due
55 Develop CAT Specifications and Conduct Initial CAT Simulation Studies
Expected Outcome: Definition of business rules and constraints for Computer Adaptive Testing item
selection algorithmconsistentwith the test specifications,testblueprints,termination and item exposure
criteria,reportingrequirements, and system response time usingsimulation studies and other relevant
sources or data.
Scope Parameters:
 Monte Carlo-typesimulation studies
 CAT Specifications documentreviewed and approved by SBAC Technical Advisory Committee and other
SBAC advisors asappropriate
 Report of findings,usinga variety of constraintmodels,includingconsiderationsand recommendations
(includingpossiblechanges to blueprints and/or test specifications)

3. Background and Overview of RFP-09 on
Test & CAT Specifications
3 of 3
Month Day
Counter
Proposal from
PMP
Activities
Nov. 2 10/28 - Last Date for Questions RegardingRFP
10 11/07
- Final Question and Answer Addendum or Amendment Posting(must be
posted on OSPI’s website and WEBS)
22 11/18 - Proposals Due
Nov.
29-
Dec. 9
11/22-12/02
- Ship/Mail Evaluation packets to reviewers on 11/21 (OSPI)
- Evaluation of Written Proposals
Dec. 20-21 12/12-13 - Oral Interviews with Finalists(if determined necessary by OSPI)
29 12/19
- Announce “Apparent Successful Contractor”and Send Notification to
Unsuccessful Proposers
TBS - Debriefing Conferences (if requested)
Jan. 3-13 12/20-30 - Contract Negotiation
31 1/16/12 - Contract Start Date