Accepted Type
Oral
Code
OA2-1-3
Acceptance Declaration
Accept
Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.
Was this work accepted for CCME 2020?
yes
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
Faculty
Affiliation
Considered for Poster
no
Title
Entrustment within an objective structured clinical examination (OSCE) progress test: Bridging the gap towards competency-based medical education
Length of Presentation
Background/Purpose
Progress testing aligns well with competency-based medical education (CBME) frameworks, which stress the importance of continuous improvement. Entrustment is a useful assessment concept in CBME models. However, very little is known about the role of entrustment in performance-based assessment. The purpose of this study was to explore the use of an entrustability rating scale within the context of an objective structured clinical examination (OSCE) Progress Test.
Methods
A 9-case OSCE Progress Test was administered to Internal Medicine residents (PGYs 1-4). Residents were assessed using a checklist (CL), global rating scale (GRS), training level rating scale (TLRS), and entrustability scale (ENT). Reliability was calculated using Cronbach's alpha. Correlations between scores using the different rating instruments were calculated. Differences in performance by training year were explored using ANOVA and effect sizes were calculated using partial eta-squared. Examiners completed a post-examination survey.
Results
91 residents and 42 examiners participated in the OSCE. Inter-station reliability was high for all instruments (0.74 to 0.83). There was an overall effect of training level for all instruments (p < 0.001). Effect sizes were large. 88% of examiners completed the survey. Most preferred the ENT over other scales. Most (64%) indicated feeling comfortable in making entrustment decisions during the OSCE.
Conclusion
Entrustment scores were found to have high reliability and demonstrated significant differences in
OSCE performance by level of training. This supports the incorporation of entrustment scales in
OSCE progress tests.
Keyword 1
Entrustment
Keyword 2
OSCE
Keyword 3
Progress Test
Level of Training
Post Graduate
Abstract Themes
Assessment
Assessment
OSCE/OSPE/OSTE
Additional Theme (First choice)
Postgraduate
Additional Theme (Second Choice)
Additional Theme (Third Choice)
Authors
Presenter
Samantha Halman
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
