This document summarizes a study that assessed pharmacy students' perceptions of a redesigned Objective Structured Clinical Examination (OSCE) used to evaluate core competency domains outlined by accreditation standards. The exam was administered to second and third year pharmacy students. A survey found most students had positive perceptions but second years were less positive. Many third years did not feel the exam prepared them for advanced pharmacy practice experiences, suggesting curriculum gaps. The OSCE assessed competencies across 11 domains with most stations covering over 75% of domains. Student feedback will be used to improve domain coverage and exam structure in the future.

1. Darowan Akajagbor, PharmD1, BCPS, Nicole E. Eckard, PharmD, BCPS1
1D’Youville College School of Pharmacy, Buffalo, New York
Corresponding Authors: Darowan Akajagbor, Nicole Eckard
akajagbd@dyc.edu. cierin@dyc.edu
No financial disclosures or conflicts of interest apply to authors
BACKGROUND
• Objective structured clinical examinations (OSCEs) have been extensively described in the
literature and are used to evaluate clinical competency in health professions education
around the world. 1,2
• An OSCE is usually comprised of a series of stations throughout which candidates rotate
on a timed basis and are required to perform specific functions to complete the task or
address a problem.
• The use of OSCEs in pharmacy education is growing. A study published in 2010 designed
to describe current OSCE practices in pharmacy programs in the United States found that
of the 88 programs included in the analysis, only 32 (36%) used OSCEs in their
curriculum. The study also observed that few programs conduct OSCEs in an optimal
manner and most do not adhere to best practices in OSCE construction and
administration.3
• In 2013, our school of pharmacy redesigned our OSCE content and format to include
objectives derived from core competency domains outlined in Appendix D from the 2007
accreditation council for pharmacy education (ACPE) standards (Table 1)
• Appendix D provides the pre-pre-advanced pharmacy practice experiences performance
domains and abilities as guidance for assessment of student capabilities before entering
APPEs.4
OBJECTIVE
• To assess students’perceptions of a restructured objective structured clinical
examination (OSCE) using competency domains derived from the pharmacy
education (ACPE) standards.
METHODS
 We created a blueprint for a 5-station OSCE and piloted it in the Spring of 2013 with full
implementation in the Fall of the 2013-2014 academic year for second (P2) and third (P3)
professional year pharmacy students.
 The OSCE was comprised of a preparatory station and a series of four interactive and non-
interactive stations. The students were expected to perform specific functions in each
station within a seven minute time block with one minute between stations.
 Competency domains assessed were derived from APPE performance domains and
abilities from Appendix D. Each exam was created to include at least 75% of the 11-core
competency domains.
 After the Spring 2014 OSCE, students completed an anonymous survey regarding their
perception of the exam structure, content, exam preparedness, knowledge, skills, and
APPE preparedness (P3’s).
 The survey was granted exempt status by the D’Youville College Internal Review Board.
RESULTS (OUTCOME)
IMPLICATIONS
• Based on the overall results, the majority of the students surveyed had positive
perceptions regarding the restructured OSCE but the P2’s had a less positive experience.
Many P3 students did not feel prepared for APPE’s after the exam which may imply
curriculum deficiencies.
• Using the Appendix D core domains to formulate OSCE content will enable
identification of areas for early intervention and to improve students’competency before
starting APPEs. Steps will be taken to address domains that are not covered or only
covered once during the OSCEs.
• Future OSCEs will be updated to be consistent with the 2016 ACPE standards.
REFERENCES
1. Awasiu A, Rahman N, Mohamed M, Bux S, Nazar N. Malaysian pharmacy students assessment of an objective structured clinical
examination. American Journal of Pharamceutical Education. 2010;74(2):34.
2. Austin Z, O’Byrne C, Pugsley J, Munoz LQ. Development and validation process of an objective structured clinical examination
(OSCE) for entry-to-practice certification in pharmacy: the Canadian experience. American Journal of Pharamceutical Education.
2003;67(3):76.
3. Sturpe DA. Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States. American Journal of
Pharmaceutical Education. 2010;74(8):148.
4. Accreditation standards and key elements for the professional program in pharmacy leading to the doctor of pharmacy degree:
(“Standards 2007”) Approved January 2006
RESULTS (SURVEY)
The survey had a response rate of 96% in the second professional year (P2) class and a 98% rate in the third
professional year (P3) class.
Students’perceptions of a redesigned objective structured clinical
examination for assessment of core competency domains
Table 3: Station Descriptions (Spring 2014 Only)
P2’s P3’s
Station 1 Identification and assessment of
drug related problems
Communication
Order fulfillment
Identification and assessment of drug related
problems
Basic patient assessment
Ethical, professional and legal
Station 2 Medical information (clinical
pharmacokinetics)
Pharmaceutical calculations
Medication information (pharmacology,)
Pharmaceutical calculations
Station 3 Drug information analysis and
literature research
Drug information analysis & literature research
Station 4 Order fulfillment
Communication
Patient device counseling
Communication
Patient counseling
Medication information (medicinal chemistry &
pharmacology)
75
50
100 100 100
75
100
75
100
25
0
0
50
100
150
#1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11
Table 1: 2007 ACPE Standards Appendix D Core Domains
1 Patient Safety/Accurately Dispense Medications (Order fulfillment)
2 Basic Patient Assessment
3 Medication Information
4 Identification and Assessment of Drug Related Problems
5 Mathematics applied to pharmaceutical calculations, compounded medications, dose
calculations, and applications of pharmacokinetic calculations
6 Ethical, Professional, & Legal Behavior
7 General Communication Abilities
8 Counseling Patients
9 Drug Information Analysis and Literature Research
10 Health and Wellness – Public Health
11 Insurance/Prescription Drug Coverage
Table 2: Students’ Free Text Response
Recommendations for Future Exams: One
thing you would absolutely KEEP
Recommendations for Future Exams:
One thing you would absolutely CHANGE
P2 Students Device counseling
Drug related problems
Case-based exam
Cases provided ahead of time
Prescription checking
Additional time per station
Kinetics/calculations
Journal club station
More preparatory activities during the semester
Case complexity
P3 Students Cases provided ahead of time
Prep station
Counseling station
“Hands on” station
Additional time per station
Additional instructions on how to use the prep station
Blood pressure station
Making more clinical recommendations
Feedback after, reflection of last semester’s OSCE
Journal club station
Figure 4: Combined Appendix D core domains covered during the
2013- 2014 academic year
Students’Responses(%)
Students’Responses(%)
AverageScore(%)
80
48 39
7465
77 84 91
Station 1 Station 2 Station 3 Station 4
Figure 3: Station Performance (Spring 2014)
P2 Average P3 Average
%Covered
Appendix D Domains (See table 1 for domain descriptions)