The study evaluated the impact of training students in open book test-taking strategies on exam performance in online courses. Students who received training before their midterm scored significantly higher than untrained students. However, training only before the midterm did not lead to higher final exam scores compared to untrained students, suggesting one training was not enough to create lasting change. The study demonstrated training can improve open book exam scores but more research is needed on effective online assessment.
1. e-Learning Research Review Presentation Presented by Liberty Joy Open Book Testing in Online Learning Environments
2.
3. What did the book say? Online course and program offerings have penetrated the mainstream of colleges and universities across the United States One continuing concern associated with online courses is assessment of student performance A variety of performance assessments, including examinations, should be employed to assure quality in online instruction One option for online assessment is the use of open book tests
4.
5. Review of Literature Most of the related research available concerning open book testing is based on traditional, face-to-face classroom settings Past studies maintain different views on open book testing as well as student performance on such tests Students tend to not prepare adequately for open book tests; not investing as much study time or effort into preparation compared to preparation for traditional, closed book, supervised examinations Open book examinations reduce anxiety levels in students Tendency to “cram” at the last minute and dependency on rote memorization is reduced Comprehensive student preparation and more consistent learning during a course
6. Research Motivation Lack of preparation on open book examinations may be related to the fact that anxiety is reduced , to the point students believe little or no preparation is required Mild anxiety can enhance learning and performance on assessments by focusing learners’ attention Lack of readiness may also be due to a lack of understanding differences between preparation for traditional, proctored tests and preparation for open book tests Students may not understand what strategies are needed to succeed on open book examinations, spending too much time with books and notes during the test period, which limits their ability to successfully complete the test
7.
8. 1) Is there a difference in midterm examination scores for students who were provided training in open book testing strategies immediately before the midterm and midterm scores for students who were not provided any training? 2) Is there a difference in final examination scores for students who were provided training in open book testing strategies only before the midterm examination and final exam scores for students who were not provided any training? Research Questions
9. Convenience sample - 122 masters-level graduate students enrolled in eight sections of the same online introductory instructional technology course in a teacher education program accredited by the National Council for the Accreditation of Teacher Education (NCATE) at a public, mid-southern university Control group - 71 students who took online, unproctored, open book examinations in Blackboard No training regarding open book test taking strategies The experimental group - 51 students enrolled in same course Provided Web-based training regarding open book test taking strategies before the midterm examination only Study Sample
10.
11.
12. Results to First Research Question Is there a difference in midterm examination scores for students who were provided training in open book testing strategies immediately before the midterm and midterm scores for students who were not provided any training?
13. When the tutorial was required before beginning the examination, the experimental group ( n =51) scored significantly higher ( M =88.4; SD =8.3) than the control group ( n =71) that did not complete the tutorial ( M =84.8; SD =9.3). The Cohen’s d effect size of the difference in means was moderate
14. Results to Second Research Question Is there a difference in final examination scores for students who were provided training in open book testing strategies only before the midterm examination and final exam scores for students who were not provided any training?
15. When the tutorial was completed immediately before the midterm examination but was not completed before the final examination, the experimental group’s ( n =51) mean final examination score ( M =87.0; SD =8.6) was higher than the control group’s ( n =71) mean final examination score ( M =86.4; SD =5.4), but the difference was not significant.
19. Importance of the research problem? E-learning communities and programs are rapidly growing and becoming an integral component of education, therefore adequate evaluation/assessment/grading methods must be examined. This research study presented an introductory view of one method of learner evaluation and resources to encourage positive learning practices. As the author mentioned, learner assessment in online communities is an area that would benefit from further research and is in fact a worthy and important area to be examined .
20. How well defined is the purpose? The intent of this study is clearly delineated: Evaluate the impact of training in open book test-taking strategies on student performance in online, timed, open book, unproctored test environments.
21. How well-developed and appropriate is the literature review? The literature review is comprehensive encompassing both studies in support and against open-book testing. There is an obvious absence of citations of studies performed in e-learning environments, in part due to the fact that online learning is in its infancy. How sound are the methodological approaches? The study employs ANOVA testing to analyze the difference of variance between the two independent sample groups. The effect size was analyzed through the partial eta-squared formula. The significance level was set p <0.05. The methodology appears to be appropriate for the testing. How well-organized, well-written, and readable is the article? The article is presented in a clearly outlined and organized manner. The details are presented in a straightforward, easily readable fashion.