Accepted Type
Oral
Code
OE3-3-4
Acceptance Declaration
Accept
Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.
Was this work accepted for CCME 2020?
yes
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Innovation
Will the presenter be a:
Other
Presenter Other
Program Evaluation Specialist and Medical Education Researcher
Affiliation
Considered for Poster
yes
Title
An innovative approach to Program Evaluation in PGME: Design, Development, and Implementation
Length of Presentation
Background/Purpose
Residency program directors are required to gather evidence to make decisions about their
program, to improve its effectiveness, and to inform decisions. Recent changes to the CanRAC
accreditation standards include program evaluation. However, residency programs have diverse needs, and program directors (PDs) have limited time and varied knowledge of program evaluation. In response, we developed an innovative approach to support program evaluation in the over 70 different residency programs, using a scholarly and iterative process. This innovative approach included standardized templates delivered alongside capacity-building workshops.
Summary of the Innovation
The innovative approach was implemented in two phases. Phase 1 included a capacity-building
initiative for PDs as a one-day retreat. The retreat included three workshop activities using a stepwise approach to teaching principles of program evaluation, how to develop a logic model and evaluation matrix, and distributed logic model and evaluation matrix templates. Workshop activities integrated the CanRAC accreditation standards to provide PDs with concrete examples of how to use program evaluation to facilitate informed decisions on how to improve their residency program. Phase 2 included follow-up meetings with the education team members to review PD developed program evaluation plans. One-on-one support was offered to PDs once a month over the last year to assist PDs with the implementation of their program evaluation plans.
Conclusion
This innovative approach provides standardized program evaluation templates for PDs to use in their program evaluation process, contributes to capacity building in PGME for program evaluation, and is a practical process, which can be implemented in PGME across Canada.
Keyword 1
Program Evaluation
Keyword 2
Accreditation
Keyword 3
Templates
Level of Training
Post Graduate
Abstract Themes
Faculty Development
Additional Theme (First choice)
Postgraduate
Additional Theme (Second Choice)
Leadership
Additional Theme (Third Choice)
Assessment
Authors
Presenter
Theresa Beesley
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
