1. AN INVESTIGATION OF THE RELATIONSHIP BETWEEN THE MODE OF READING ASSESSMENT AND INSTRUCTION, AND READING ACHIEVEMENT OF GRADE SIX STUDENTS Tania Sterling Walden University EDUC 8030-10 Dr. Mitchell Olson Does Alignment Matter? Group 2 February 26, 2010
2.
3.
4. What are the implications for continuing the use of pencil-paper assessments?
5.
6.
7.
8.
9.
10.
11.
12. Research Questions blog.patientslikeme.com/2008/10/ Q1. What prior experience with technology use at home and at school, and attitudes about technology do students possess? (Qualitative) Q2. Is there a difference in the reading achievement results on pencil-paper and computer-based reading tests of grade six males and females with or without regular access to technology at home and at school? (Quantitative) Q3. How does aligning the mode of literacy instruction and the mode of literacy assessment impact student achievement? (Both)
13.
14.
15.
16. New Literacies Defined Theoretical Framework #1 http://www.edutopia.org/images/graphics/fea_programming.jpg The new literacies of the Internet and other ICTs include the skills, strategies, and dispositions necessary to successfully use and adapt to the rapidly changing information and communication technologies and contexts that continuously emerge in our world and influence all areas of our personal and professional lives. These new literacies allow us to use the Internet and other ICT to identify important questions, locate information, critically evaluate the usefulness of that information, synthesize information to answer those questions, and then communicate the answers to others. (Leu, Kinzer, Coiro, and Cammack, 2004, p.1).
21. 3 rd largest district in Ontario, Canada More than 112,000 pupils,10,000+ staff 92 schools Research Context Theoretical Framework #2 Rationale for Research Design
22. The role of policy Rationale for Research Design
23.
24.
25.
26.
27. Interested in finding out more…? Visit my wiki at http://learning- leadingbydesign.wikispaces.com / NEW
28.
29.
30.
31.
Hinweis der Redaktion
Hook: Identifies your connection to the interest area--perhaps a student or illustration that defines or characterizes the problem. An example might be a short bio on a particular student that defines your interest in the topic area.
Today’s learner interacts with a whole variety of electronic and social networking tools. We need to help bring the gap between the tools they are accessing outside of school, and those they interact with inside of school.
Today’s learner interacts with a whole variety of electronic and social networking tools. We need to help bring the gap between the tools they are accessing outside of school, and those they interact with inside of school. When the teaching methods used and the assessment tasks are not aligned to the learning activities assumed in the intended outcomes, the learner fails to find relevance in what is being taught and measured. The theory of constructive alignment (Biggs 1999; 2003) whereby the mode of literacy instruction is aligned with literacy assessment may provide a solution to this problem.
Purpose Research Questions Theoretical Frameworks & Empirical Research Diagram of Proposed Inquiry Rationale for Design Proposed Significance References
Particular to the proposed reading test mode investigation, pencil-based reading assessments are still predominantly used to assess the literacy achievement of learners who frequently use technology and new literacies at home and at school (Ibid).
Research indicates an overwhelming trend to use computer-based testing (CBT) to measure achievement (Wang, S., Jiao, H., Young, M., Brooks, T., & Olson, J., 2008). While the advantages over traditional pencil-based tests are many, researchers question the equivalency and inter-changeability of results between these two test modes. This paper proposes an investigation of the relationship between pencil-paper and computer-based tests, and student reading achievement in classrooms where technology is integral to literacy teaching and learning. Constructivist theories that support computer-based instruction and assessment are discussed and test mode research from the past five years is critically analyzed. This paper concludes with implications of this review on the proposed reading test mode study. Before changing reading assessments from pencil-paper to computer-based testing formats in Ontario, it is not only important to understand the learning theories that support computer-based instruction; comprehending “the impact of different test administration modes on reading scores” (Wang et al., 2008, p. 10) is imperative.
Research indicates an overwhelming trend to use computer-based testing (CBT) to measure achievement (Wang, S., Jiao, H., Young, M., Brooks, T., & Olson, J., 2008). While the advantages over traditional pencil-based tests are many, researchers question the equivalency and inter-changeability of results between these two test modes. This paper proposes an investigation of the relationship between pencil-paper and computer-based tests, and student reading achievement in classrooms where technology is integral to literacy teaching and learning. Constructivist theories that support computer-based instruction and assessment are discussed and test mode research from the past five years is critically analyzed. This paper concludes with implications of this review on the proposed reading test mode study. Before changing reading assessments from pencil-paper to computer-based testing formats in Ontario, it is not only important to understand the learning theories that support computer-based instruction; comprehending “the impact of different test administration modes on reading scores” (Wang et al., 2008, p. 10) is imperative.
Research indicates an overwhelming trend to use computer-based testing (CBT) to measure achievement (Wang, S., Jiao, H., Young, M., Brooks, T., & Olson, J., 2008). While the advantages over traditional pencil-based tests are many, researchers question the equivalency and inter-changeability of results between these two test modes. This paper proposes an investigation of the relationship between pencil-paper and computer-based tests, and student reading achievement in classrooms where technology is integral to literacy teaching and learning. Constructivist theories that support computer-based instruction and assessment are discussed and test mode research from the past five years is critically analyzed. This paper concludes with implications of this review on the proposed reading test mode study. Before changing reading assessments from pencil-paper to computer-based testing formats in Ontario, it is not only important to understand the learning theories that support computer-based instruction; comprehending “the impact of different test administration modes on reading scores” (Wang et al., 2008, p. 10) is imperative.
3 part mixed methods sequential exploratory design involving a total of 30 students randomly selected from 2 grade six classrooms in YRDSB: classroom A is part of a technology demonstration classroom program called Literacy@School and is therefore outfitted with additional hardware and software to support teaching and learning. Teacher A also attends professional development to learn and share effective technology integration strategies. Classroom B and teacher B do not have access to additional hardware, training or technology support. Phase 1: Qualitative investigation (phase one), students will complete an online survey to gauge their prior experience using computers at home and at school, as well as their attitudes to on and off computer literacy learning. The teacher participants will complete a similar online survey to identify specific new digital literacies, strategies and skills that they are, or are not employing during literacy instruction. Phase Two: Quantitative, students will complete three reading tests of varying modes over a six week period. Achievement results will be shared with students between test modes. Test #1 will be done on the computer; reading assessment #2 will be administered using pencil-paper; and students will then choose and complete a third reading assessment using the test mode of their choice. Students will be stratified according to gender, reading achievement, and test mode preference. Phase Three: Qualitative, a representative sub-sample of respondents from all classrooms will participate in semi-structured face-to-face interviews regarding their test-mode preference and overall experience. Discussions will be audio recorded and transcribed for data analysis, and the researcher will make field notes. This sequential explanatory design will allow for priority to be placed on the students’ reading test mode data gathered from the three separate reading assessments in phase two.
Q1. What prior experience with technology use at home and at school, and attitudes about technology do students possess? (Qualitative) Q2. Is there a difference in the reading achievement results on pencil-paper and computer-based reading tests of grade six males and females with or without regular access to technology at home and at school? (Quantitative) Q3. How does aligning the mode of literacy instruction and the mode of literacy assessment impact student achievement? (Both)
Text in today’s world is shifting from the printed page to electronic formats. Therefore, today’s learner interprets meaning from a variety of media including the Internet. The new literacies of the Internet and other ICTs include the skills, strategies, and dispositions necessary to successfully use and adapt to the rapidly changing information and communication technologies and contexts that continuously emerge in our world and influence all areas of our personal and professional lives. These new literacies allow us to use the Internet and other ICT to identify important questions, locate information, critically evaluate the usefulness of that information, synthesize information to answer those questions, and then communicate the answers to others. (page 1).
Emerging technologies and the Internet are drastically changing the way students receive and produce information everyday. New literacies demand a change in the way we teach and assess literacy (Leu, Kinzer, Coiro, & Cammack, 2004). CLICK-read definition In an interview with Mokhtari, Kymes, and Edwards (2008), the Connecticut new literacies team further emphasize the importance of figuring out how to assess the new literacies (p. 355).
This is the new learning environment that promotes and establishes the 21 st century literacies, and we have many tools already available to assist us to support a 21 st century approach to learning. Let’s use them to promote positive use and help student prepare for the world of work, post secondary education and life long learning? And in doing so we ensure our students will demonstrate positive use of ICT and they will be able to find, locate, synthesize, evaluate and present information and ideas, and they will be the literate graduates of the 21 st century.
Fortunately, CA might help: Therefore, quality literacy learning in today’s elementary classrooms in Ontario should align the revised Language curriculum expectations (what?) with their instruction (how?) and assessment strategies (how well?). In relation to the proposed investigation, literacy teachers who use new literacies and ICT strategies to instruct reading, should use new literacies and ICT to assess reading
As cited in Becta’s report (2002), when teachers use ICT in their classrooms, a student’s commitment to learning increases and learners are very eager to work using ICT on their own time, before and after school. Furthermore, when students use ICT in their learning they seem to work more independently during regularly timetabled sessions and take more responsibility for their own learning (Harris & Kington, 2002). While some report that ICT embedded instruction and online knowledge building forums improve students’ higher order thinking (Kanuka, 2005) and problem solving skills, meta-cognition, and conceptual understandings (Chan & van Aalst, 2004), unanswered questions remain “about the impact of technology in the long and short term on students’ learning, and how it has affected simple and complex learning tasks” (Cox & Marshall, 2007, p. 59). Questions surrounding literacy teaching and learning, “assessment, curriculum, and teacher education, and how these are impacted by present and emerging technologies, must be addressed if we are to shape theories and pedagogies of literacy that dynamically respond to social and technological change” (Leu, Kinzer, Coiro & Cammack, 2004, p.1).
Describe YRDSB context
To bridge the gap between outside and inside literacies, the Ontario Ministry of Education revised its 1-8 Language curriculum (2006) to include a fourth strand called Media Literacy . Now in its fourth year of implementation however , the new literacies curriculum is still not aligned with new approaches to literacy assessment.
Describe rationale for selecting my sample
When educators better understand the way learners are reading, the type of reading will be valued, and learners might perceive themselves more as readers. This has the ability to impact social change because the needs of learners will be better met, and students will be better prepared for the emerging world of work that lies ahead for them. Who are the stakeholders and main players? What will its importance be to students, families, instructors, administrators, and community partners? How will your work impact a larger context?
Provide a conclusion that has an application for others in your audience: Provide links to websites that will help the audience be informed or equipped Highlight important articles they should know about or that inform them about your topic Include suggestions for navigating your problem better
Provide a conclusion that has an application for others in your audience: Provide links to websites that will help the audience be informed or equipped Highlight important articles they should know about or that inform them about your topic Include suggestions for navigating your problem better