When a Closer Look at Potential Collusion Becomes Necessary

•Als PPTX, PDF herunterladen•

1 gefällt mir•315 views

Presented by Dr. Sherry Jimenez, Assistant Provost for Teaching Excellence and Assessment of Learning at Marian University. In this webinar the issue of collusion will be discussed. The three elements of the Fraud Triangle will be reviewed as well as how they present in the exam environment. Common cheating prophylaxis will be revisited and new methods for investigating potential collusive behavior in an online examination environment will be described.

Bildung

When a Look at Potential
Collusion Becomes Necessary
Sherry Jimenez, Ed.D.
Assistant Provost

Agenda
• Marian University and MUCOM brief overview
• Audience Response
• Framework: Fraud Triangle
• Exam security
• Using ExamSoft to investigate potential collusion
• Q&A

Marian University
• Marian College -Est. mid 1936-7
• Co-Ed in 1948
• Marian University - 2009
• College of Osteopathic Medicine announced in 2010
• MU-COM opened August 2013

MU-COM Overview
• Graduate 1st class 2017
• Competency Based Curricular Design
• Systems based/integrated curriculum
o Course Director, multiple internal faculty and external
clinicians
o e.g. Cardiovascular course + OSCE
• iPad exclusive
• Written exams – Lecture Hall holds approx. 175-200

Poll 1
• Indicate the level to which you are concerned about
collusive behavior during exams at your institution
o Very High
o High
o Moderate
o Low
o Very Low

Poll 2
• In the last year has your institution needed to investigate
potential collusive behavior in one or more exams?
o Yes
o No

The Fraud Triangle
• A majority of students have reported cheating to some
degree during college
Bolin, 2004
McCabe, et al., 2001)
Ramos, 2003
Rationalization

Incentive
• Competition
o In his/her field of study
o Land a job ahead of peers
o Higher test scores

Opportunity
• Temptation to gain an advantage
• “I won’t get caught”

Rationalization
Rationalization
• “Everyone is doing it.”
• Cheating is acceptable behavior

Traditional Exam Security
• No cell phones
• Random seating
• Color coded scratch paper
• No bags in the lecture all
• No tripods for iPads

Online Exam Security
• Lock down – No internet
• Randomized questions
• Randomize distractors
• No font expansion
• Tracking exam navigation behavior – Described during
orientation

Potential Collusion
• Compare previous exam scores of test takers side by
side
• Compare questions answered wrong
• Test taker navigation (Snapshot)

Examinee A-Incorrect Answers Report Examinee B-Incorrect Answers Report
Test Answer Comparison

Navigational Behavior
Examinee A-Snapshot Examinee B-Snapshot

Contact info
sjimenez@marian.edu
Thank you!!

Innovations in Assessment
• Learn innovative processes in assessment
• Network with colleagues
• Pre-conference workshops with ExamSoft
trainers
• Early bird rate valid through January 31
starting at $300
• Visit www.assessmentconference.com for
more details

Weitere ähnliche Inhalte

Was ist angesagt?

Using Metadata to Improve Instruction

Bett

Expectations

Expectations

Academic honesty in the ib diploma

cartlidge

Bim first day welcome

wildman099

Academic Integrity

Polly Nelson

BIM Welcome Back!

wildman099

2019 BEA Ignite: Christopher Winkler

Michael Bruce

Presentation1

Elizabeth Whitehead

European Distance Learning Week: Getting course evaluations ‘just right’

EDEN Digital Learning Europe

Web application of Antonucci's hierarchical approach for measuring social net...

Rules 6 Th

Utilizing

Machine learning[1]

Formative Assessment Technology Tools in the Math Classroom

Andrew Steinman

10 reasons why online tests help make perfect

fortune communications

September 3, 2014

khyps13

Classmarker

mr_nichols

Was ist angesagt? (19)

Using Metadata to Improve Instruction

Bett

Expectations

Academic honesty in the ib diploma

Bim first day welcome

Academic Integrity

BIM Welcome Back!

2019 BEA Ignite: Christopher Winkler

Presentation1

European Distance Learning Week: Getting course evaluations ‘just right’

Web application of Antonucci's hierarchical approach for measuring social net...

Rules 6 Th

Utilizing

Machine learning[1]

Formative Assessment Technology Tools in the Math Classroom

10 reasons why online tests help make perfect

September 3, 2014

Classmarker

Andere mochten auch

Presented by Karen Kier Vertical- Pharmacy Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams ExamSoft was utilized for all therapeutic modules for a 2-year cohort of pharmacy students. Prior to the students final capstone module, a pretest was given to the students (n=154). The pretest concept for the capstone module had existed for 15 years. This is the first time the pretest was constructed from the cohort of exams for those students. Previous pretests were derived by faculty teaching in the modules. The current pretest was based on evidence from ExamSoft categories and performance reports that allowed module coordinators to select questions which demonstrated a weak knowledge base for the class. The average score on the pretest was a 32% compared to past years performance of 55 to 63% averages. This demonstrated that the college did not have a good plan to help students remediate in their areas of weakness. If the student passed the module, they moved on to the next module but did not master material. The capstone course coordinator then created a dynamic class schedule that immediately took this information into account in designing the 7 week module for spring semester. The capstone module faculty created review materials on Moodle with review quizzes on ExamSoft. Any student that had a red weakness area on their Strengths and Opportunities report was required to do the review material and quizzes for each area. Any student could take advantage of this opportunity as well. Student progress was tracked in ExamSoft and Moodle. Post-test results are pending an April 17th exam and will be available for this session. The results of this cohort has started discussion on how to remediate students sooner in the modules. In addition, the faculty continue to use the rationale sections of the exam to provide immediate feedback to students on exams. The use of ExamSoft categories as well as student reports has created an opportunity to dialogue with students and faculty to improve student outcomes. At the end of the session, participants will be able to: 1) Understand the importance of tracking longitudinal outcomes to dynamically change a course to best suit student needs 2) Discuss the use of ExamSoft categories to pull relevant data for assessing outcomes 3) Discuss the ability to create an online review session and ExamSoft quizzes to allow students to improve knowledge base based on their individual ExamSoft Strengths and Opportunities Report

Restructuring a Capstone Course Based on Longitudinal Assessment of Module Exams

ExamSoft

Whether you are accountable to the American Council on Pharmacy Education, the Standards for Accreditation of Medical Education Programs Leading to the MD Degree, the World Federal Medical Education Standards, or any other accrediting agency, you have no doubt seen the increased emphasis on the use of student outcomes data. The call to articulate formal program objectives and track assessment of student achievement on those objectives is universal. This webinar will demonstrate how the learning analytics capabilities of ExamSoft can be used to address both didactic and experiential objectives to serve multiple purposes including remediation, curriculum development, and documentation for accreditation.

Universal Assessment Challenges in Health Care Related Education

ExamSoft

Presented by Dr. Melinda E. Lull, Assistant Professor of Pharmaceutical Sciences, Wegmans School of Pharmacy, St. John Fisher College While students are able to view their own assessment data and longitudinal reports from ExamSoft, they can easily become lost in a sea of numbers and categories. In order to best benefit student performance, students must understand both the interpretation of and the benefit from ExamSoft reports. This session will discuss ways to provide assessment data to students and aid them interpreting and using their results.

Helping Students Get the Most Out of ExamSoft Longitudinal Reports

ExamSoft

Presented by Jamie Lee, Assistant Professor / Undergraduate Testing Coordinator, James Madison University Before ExamSoft, it was difficult for the James Madison University School of Nursing to curate and analyze exam data. This left faculty wondering: “How do I know my exams test what I wanted them to test?” In this webinar you will see how one course from the school of nursing used data from ExamSoft to answer this question using ExamSoft's categories, tagging system, and exam blueprinting to track achievement of course performance and set up ""testing consults"" to help faculty identify any gaps in the assessment process. Through these processes, the program has been easily able to aggregate the data needed for their AACN visits, making previous accreditation visits much less painful.

Using Data to Demonstrate Achievement of Course Objectives and AACN Student L...

ExamSoft

Presented by Laurel Sampognaro,Clinical Associate Professor, David Caldwell, Director of Professional Affairs, and Adam Pate, Assistant Professor all from University of Louisiana Monroe School of Pharmacy This presentation will describe a process to improve examination item quality by educating and involving course instructors in an item review process using evidence based guidelines and describe application of this process to multiple courses. In this interactive session presenters will discuss personal experiences and barriers to implementation of a collaborative exam item review process involving 21 faculty members from 2 departments in 3 different courses. Attendees will be exposed to a review of item writing guidelines, a discussion of common errors in item writing, and effects of item writing on test performance. A post exam process to objectively categorize test items based on item statistics will also be outlined

Collaborative Examination Item Review Process in a Team-Taught Course

ExamSoft

Presented by Ms. Michelle Cruz, Graduate Program Associate at Oregon Health and Science University School of Nursing Training faculty in using computer-based testing can be a challenge. The Oregon Health and Science University’s School of Nursing and has developed faculty-friendly training process for the on-boarding of technology for their program. Through the development process, they have learned that some methods are more effective than others, especially when teaching faculty that are used to administering exams in paper format. This presentation will share points to consider when training faculty that also have clinical jobs outside of their busy academic careers.

Creating Effective CBT Training for Nursing Educators

ExamSoft

Presented by Brad Marcum and Margaret Sidle Vertical- Medical This session will show how one small medical school used data generated from ExamSoft reports to inform assumptive reports, specifically to inform the programmatic goal of improving licensure pass rates. At the end of the session, participants will be able to: 1) Participants will have a better understanding of what steps to follow to engage faculty in using data to improve their teaching. 2) Participants will be better able to identify what courses will predict how students perform on their board exams. 3) Participants will be able to identify test questions that address the learning outcomes for better board scores.

The Power of Prediction: Building a Better Test-Taker

ExamSoft

Dr. Kyumin Whang, Associate Professor, The University of Texas Health Science Center at San Antonio, School of Dentistry Implementation of a new technology in an educational program is never an easy feat. On-boarding and receiving faculty buy-in can be challenging, but with careful planning is achievable. This presentation will share The University of Texas Health Science Center at San Antonio (UTHSCSA) School of Dentistry’s best practices for implementation, set-up, and construction of assessment procedure to ensure successful adoption and continued use of ExamSoft. Topics covered will include: advantages and challenges of implementation, collaboration with specialists and technicians, setup of support systems, and construction of student academic misconduct procedures.

Top 10 “Must Do's” for Implementing an Assessment Process in Your Program

ExamSoft

Presented by Eric Ermie, Executive Director of Sales, ExamSoft Worldwide, Inc. Keep it? Throw it out? Content/teaching issue? Bad question? Too easy? Too hard? What the heck? More than likely you have asked some or all of these questions at one point or another when trying to understand the performance of questions on an assessment. With differing opinions on how to interpret the statistics provided, how do you know what all this data is trying to tell you? Join us for a webinar on the fundamentals of item analysis, how the data is derived, and the different ways they can be interpreted. This presentation will cover how to put data into a useful context that will allow you to draw your own conclusions on what it means, how you should apply them, and why you should ignore rules that others may use for their specific situation.

Psychometrics 101: Know What Your Assessment Data is Telling You

ExamSoft

Are you considering computer-based testing or would you like to improve your implementation process? This webinar will walk you through steps of the implementation process. We will explore challenges to implementation, discuss recommendations to address challenges, and review faculty perspectives on the use of ExamSoft. The webinar will also address the reliability of the product, the advantages of using ExamSoft across three campuses, and lessons learned by the Virginia Commonwealth University School of Pharmacy.

A Pathway to Continuous Improvement in Computer-Based Testing

ExamSoft

Presented by Ashley Castleberry, Assistant Professor and Director of Assessment, University of Arkansas for Medical Sciences College of Pharmacy Metacognition is an educational word that put simply, is thinking about thinking. Many accreditation standards require schools to develop and assess this skill in students, but this thought can be overwhelming. How can you assess thinking? This session will answer the following questions about metacognition: What is it? Why is it important? How can we assess it? How can I use ExamSoft to encourage it? Participants will leave this session with tools to develop and assess this skill in students to help with remediation.

Getting Students to Think about Their Thinking Using ExamSoft Features

ExamSoft

Presented by Mr. Albert Spiegel, Director of Scheduling,Laptop Program Coordinator, Chair, Computer Science, Bergen Catholic High School Bergen Catholic High School has been a 1:1 laptop school since 2002, and implemented a computer-based testing program in March of 2015. Less than three months later, the program successfully delivered all final exams via ExamSoft. This presentation will highlight Bergen Catholic’s usage of technology and underscore some key strategies implemented with faculty training and exam-day test-taking. It will also accentuate the various technological and personnel challenges that the school faced during the implementation process and how it managed to overcome them all.

How Bergen Catholic High School Got Its CBT On in Just Three Months

ExamSoft

Presented by Dan Thompson, Manager of Instructional Design and Educational Technology, Oklahoma State University Center for Health Sciences The use of formative assessment within all types of health sciences education programs is generally acknowledged as a necessity when measuring student attainment of knowledge. However, even with this acknowledgement, there is still a general lack of understanding of the true potential, benefits, and risks of this type of assessment. The lack of formative assessments is especially true for students in their third and fourth year of clinical rotations where learning opportunities can be dependent on patient visits. This presentation will address the idea that the implementation of formative assessments during this time frame will enhance the student learning experience in clinical rotations to include the necessary content for each specific rotation, while also ensuring that clerkship objectives are consistently met each month.

Improving Student Learning and Meeting Program Requirements by Implementing F...

ExamSoft

Presented by Eric Ermie, Executive Director of Sales for ExamSoft Worldwide Keep it? Throw it out? Content/teaching issue? Bad question? Too easy? Too hard? What the heck? More than likely you have asked some or all of these questions at one point or another when trying to understand the performance of questions on an assessment. With differing opinions on how to interpret the statistics provided, how do you know what all this data is trying to tell you? Join us for a webinar on the fundamentals of item analysis, how the data is derived, and the different ways they can be interpreted. This presentation will cover how to put data into a useful context that will allow you to draw your own conclusions on what it means, how you should apply them, and why you should ignore rules that others may use for their specific situation.

Psychometrics 101: Know What Your Assessment Data is Telling You

ExamSoft

Presented by Laura Logan, MSN, RN, CCRN, Instructor, DeWitt School of Nursing at Stephen F. Austin State University Nursing curriculum is rigorous, daunting, and uncompromising. Nursing educators know how important it is that students be able to digest and apply the curriculum to each course assessment, end of the course standardized exam, and especially to the bedside. Furthermore, these assessments within the nursing curriculum are preparations for the national exam, and one more way to help students succeed on the NCLEX. Reviewing incorrectly answered items, asking probing questions to the student after the exam, and reviewing with students best strategies for exam preparation based on testing performance have helped achieve student academic growth. This webinar will assist the nursing educator with remediation tactics using ExamSoft features to accomplish this outcome.

Nursing Student Remediation Made Easy with Embedded Assessment

ExamSoft

Andere mochten auch (15)