1. WHEN RESPONSE RATES MATTER
Using Triton Data Collection System for Course Evaluations
Introduction
We live in a data-driven, information gathering society. When a consumer buys a product, they are sure to be inundated
e-mails, calls or mail asking them to respond to a survey about their buying experience and the product. Our schools
and universities have adopted this same philosophy through course evaluations to gauge student perceptions of the
class, the instructor and overall experience.
Researchers generally consider student evaluations to be a more reliable and valid way to measure the effectiveness of
a course instead of other methods such as evaluations by trained observers. Using paper and pencil surveys to conduct
course evaluations has long been the traditional method used for collecting data, but many schools are now moving to
electronic alternatives. These methods typically have low response rates because students do not view the evaluations
positively. They tend to see the evaluation as something that will require more of their time without providing an impact.
Because students rarely see the results, they feel that nothing will change about the course no matter what feedback
they provide including how the course is structured or the instructional methods that are used. In order to get valid
data about a course, the response rate must be higher and students must feel confident that their time isn’t being
wasted.
Responsive Evaluations
Response rates and acceptance of course evaluations are higher when using a student response system because of
its effectiveness and efficiency for data collection. Clickers serve as a real-time data collection device that can easily
gather group response data. The ability to collect data anonymously creates a safe environment during the gathering
of information. Student response technology is straightforward and simple, enabling the instructor to customize the
survey questions to their department or class and drill down to specific items in which to gather feedback. Students
appreciate the real-time data and ability to see how their responses match up with their peers. Because they can
see the data, students have more confidence that their voice is being heard and their thoughts are being considered
because of the feedback that they are providing.
Mentioned in an article by Derek Bruff (2009), Mark Scarbecz of the University of Tennessee College of Dentistry used
clickers for evaluating teaching at UT and stated, “Response rate and acceptance of the ARS (Audience Response System)
for course evaluation were greater than for a web-based system. The ARS was effective and efficient for data collection.
Random selection of keypads provided anonymity.”
Triton Improves Results
Turning Technologies, the global leader in student response systems, has developed Triton Data Collection System that
provides the following advantages:
• Simple: Triton is an easy to use system with a minimal learning curve. Anyone could walk in and administer the
evaluation if the professor isn’t comfortable doing so.
• Secure: Encryption ensures security of evaluation data from the point of answer submission until the evaluation is
complete.
• Reliable: The system performs without reliance on an external network, bandwidth or internet availability; creating
an evaluation environment where every response counts.
2. • Affordable: The system uses the same ResponseCard NXT that is widely adopted throughout universities and
schools, maximizing return on investment and reducing the costs of manual processing of the evaluation sheets.
• Efficient: High response rates can be expected. Near immediate digital results are transmitted and received once
the evaluation is complete. No need to wait for scanning.
• Builds Confidence: Students can review and validate their responses, providing strong confidence that their voice
will be heard and changes will be made ensuring valuable use of their time
Higher response rates on instructional evaluations are necessary to gauge how well a course and an instructor are
hitting their mark. Good teachers will listen and respond well to valid data; therefore, having a system in place that
will provide a trusting evaluation experience while reporting the needed data accurately, efficiently and effectively is
imperative. Turning Technologies and Triton provide a solid solution to improving the overall course survey experience.
Resources
D Bruff. (2009, July 24). Evaluating teaching with clickers. Retrieved from http://derekbruff.org/?p=287