Accepted Type
Facilitated and Dedicated Poster
Code
P1 - 06
Acceptance Declaration
Accept
Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.
Was this work accepted for CCME 2020?
yes
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
Associate Dean of Educational Development
Affiliation
Considered for Poster
yes
Title
Evaluation of Entrustable Professional Activities Assessment in Undergraduate Medical Education using Mobile Technology
Length of Presentation
Background/Purpose
Memorial University introduced Entrustable Professional Activities (EPAs) into an undergraduate clerkship curriculum as formative assessments. This study applies the Norcini et al. (2018) consensus framework for good assessment to evaluate a mobile system in assessing undergraduate EPAs during clerkship.
Methods
An electronic clinic card was developed for mobile use by both clerks and preceptors. Clerks were tasked with transcribing in-the-moment coaching and assessment discussions with preceptors. Assessments were collated and analyzed by ordinal regression, and users were surveyed on satisfaction with the new modality.
Results
The mobile eClinic Card system enabled 80 clerks and 624 preceptors to document 6,850 submissions that included 18,661 EPA scores across 47 clinical sites over a 48-week core clerkship curriculum. The rating system was found to be generally consistent, reliable and equivalent between preceptors, clinical sites, or the specific activity assessed. Clerks documented progressive improvement. Some differences between disciplines were found in rating odds, in preceptor composition and workload. Student odds of success did not correlate to subject examination scores. Preceptors and students were satisfied with ease of use and dependability of the eClinic Card mobile app; however, clerks suggested the quality and utility of formative coaching feedback could be improved. Preceptors felt enhanced faculty development would be beneficial.
Conclusion
Findings support the utility, feasibility and acceptability of a mobile system in assessing work-based Entrustable Professional Activities within clerkship curriculum. Change management is a major determinant of success and user engagement is essential for uptake of mobile technologies for work- based assessment.
Keyword 1
Entrustable Professional Activities
Keyword 2
Workplace assessment
Keyword 3
Mobile apps
Level of Training
Undergraduate
Abstract Themes
Assessment
Assessment
- Formative
- Work-place based
- Technology
- Entrustable Professional Activities
Additional Theme (First choice)
Distributed Medical Education
Additional Theme (Second Choice)
Additional Theme (Third Choice)
Authors
Presenter
Vernon Curran
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
