Talk given by Victoria Cannon of Ohio State University College of Medicine at MyKnowledgeMap's Innovation in Practice Assessment Conference, St George's University of London.

1. Direct Observation and Feedback
Victoria Cannon

2. Rationale
• LSI’s competency-based design is best supported
by an assessments system that allows for multiple
assessments from multiple evaluators gathered over
time.
• Many of these assessments are being done on
paper
• A more usable digital solution would enable more
frequent and accurate assessments of students in
clinical settings
2

3. LeadServeInspire Curriculum
3
Clinical
Foundations
• Didactics
• Longitudinal Practice
• Small Groups
Clinical
Applications
• Clinical Rotations
• Small Groups
• Didactics
Advanced
Clinical
Management
• Advanced Competencies
• Clinical Tracks
• Virtual Small Groups

4. Process
 My Progress Task Force
 Cross-functional membership
 Program coordinators
 Faculty
 IT Staff
 Weekly meetings
 Rolling Pilots (March – July)
 Longitudinal Practice
 Clerkships: Internal Medicine, Pediatrics, Neurology
 Genetic Counseling Program
 Ultrasound Advanced Competency
 Rolling Production (June – September)
4

5. Pilot Results
 Roles
 Tutor role too broad for our faculty
 Enhancement requests submitted to MKM
 Form design and reports
 Needed granular data  build individual questions
rather than bundle
 Multiple choice questions preferred over scale for
usability
 Assessment types
 Student deployed worked best
 Limited faculty deployed assessments
5

6. My Progress in Production
 Currently centrally managed though plan to
decentralize
 Statistics
 Implemented 4 programs and 10 courses
 156 assessment forms
 700+ users in 34 cohorts
 8,451 assessments completed to-date
6

7. Next Steps
 Expand to more programs
 Residency
 LSI Part 3
 Student Portfolios
 Replace PxDx tool (legacy logging application)
 Work with MKM on Enhancements to My Progress
 Reporting improvements
 Administrative management functions
 Usability tweaks
7

8. 8
Questions?