Presented by Dennis Maynes, Chief Scientist Data Forensics and Steve Addicott, Vice President, Caveon Test Security It’s no secret, your items and tests are under attack. The problem is big, and the challenges are…well…challenging. In this informative session, Dennis Maynes and Steve Addicott explore six security challenges initially faced by the IT certification industry, but which now impact all high stakes tests in Certification/Licensure, Higher Ed, K12 Education, and I/O. These challenges include: • Proxy test taking is big business • Braindump usage continues to undermine trustworthy test results • Test theft appears to be unchecked • Technology greatly facilitates collusive test taking • Stakeholder support must be won • Many test administration models present dilemmas While the threats are severe, many test program directors choose to stand up and fight. Maynes and Addicott present both tried and tested as well as new methods to both measure and manage against these threats.

1. Caveon Webinar Series:
Six Security Challenges to Your
High Stakes Test Program
and How Data Forensics May Help
Thwart Them
Steve Addicott, Vice President
Dennis Maynes, Chief Scientist
Caveon Test Security
January 22, 2014

2. Upcoming Caveon Events
Caveon Webinar Series: Next session, February 19
Protecting Your Tests Using U.S. Copyright Law
ATP Innovations In Testing Annual Conference
• March 2-5 in Scottsdale, AZ
• Check out our sessions here:
• http://www.caveon.com/atp-2014-innovations-in-testing-caveonsessions/
• Visit us in Booth 33 or make an appointment to talk to us about
your specific test security or test development concerns.

3. Agenda for Today
•
•
•
•
•

4. Magnitude of the Problem
•
•
•
•
•
•
•
•

5. Six Challenges

6. Proxy Test Taking
•
•
•
•
•
•
•
•
•
•
•

7. From the Internet

8. We Believe
•
•
•
•
•
•
•
•

9. Braindump Usage

10. Braindump/Theft Usage Case 2012
•
•
•
•
•
•
•
•
•

11. We Believe
•
•
•
•
•
•
•

12. Test Theft
•
•
•

13. A Real-Life Example
• Medical certification program
• Administration to 3,500 candidates on
Saturday
• Anonymous email on Wednesday
– “I thought you should know…”
– ENTIRE ITEM BANK ATTACHED!!

15. About Stolen Tests
•
•
•
•
•
•
•
•
•
•

16. Technology
•
•
•

17. Technology

18. Technology

19. Technology

20. Technology

21. Technology

22. Stakeholder Support

23. In Our Experience
•
•
•
•

24. Stakeholder Support Can Be Won

25. Test Administration Models
•
•
•
•
•
•
•

26. We Believe
•
•
•

27. Test Security is a Process, Not a State
Protect
Improve
Detect
Respond

28. Protect Against Security Breaches
•
•
•
•
•
•
•
•
•
•
•

29. Detect and Respond
•
•
•
•
•
•
•

30. Exam Inoculation
•
•
•
•
•
•
•

31. Data Forensics Detection
Statistical Anomalies
Testing
Irregularities
Security
Violations
Security
Breaches
Test Fraud

32. Type I Versus Type II Errors
•
•
•
•
•
•

33. Communicating with Stakeholders
•
•
•
•
•
•
•

34. Questions?

35. Caveon Online
•
•
•
•
•
•
•

36. Thank you!