SubmissionId 59663

Accepted Type
Oral

Code
OE3-3-4

Acceptance Declaration
Accept

Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.

Was this work accepted for CCME 2020?
yes

Category
General Call (Workshop, Oral Presentation, Poster Presentation)

Type
Oral

Sub Type
Education Innovation

Will the presenter be a:
Other

Presenter Other
Program Evaluation Specialist and Medical Education Researcher

Affiliation

Considered for Poster
yes

Title
An innovative approach to Program Evaluation in PGME: Design, Development, and Implementation

Length of Presentation

Background/Purpose
Residency program directors are required to gather evidence to make decisions about their program, to improve its effectiveness, and to inform decisions. Recent changes to the CanRAC accreditation standards include program evaluation. However, residency programs have diverse needs, and program directors (PDs) have limited time and varied knowledge of program evaluation. In response, we developed an innovative approach to support program evaluation in the over 70 different residency programs, using a scholarly and iterative process. This innovative approach included standardized templates delivered alongside capacity-building workshops.

Summary of the Innovation
The innovative approach was implemented in two phases. Phase 1 included a capacity-building initiative for PDs as a one-day retreat. The retreat included three workshop activities using a stepwise approach to teaching principles of program evaluation, how to develop a logic model and evaluation matrix, and distributed logic model and evaluation matrix templates. Workshop activities integrated the CanRAC accreditation standards to provide PDs with concrete examples of how to use program evaluation to facilitate informed decisions on how to improve their residency program. Phase 2 included follow-up meetings with the education team members to review PD developed program evaluation plans. One-on-one support was offered to PDs once a month over the last year to assist PDs with the implementation of their program evaluation plans.

Conclusion
This innovative approach provides standardized program evaluation templates for PDs to use in their program evaluation process, contributes to capacity building in PGME for program evaluation, and is a practical process, which can be implemented in PGME across Canada.

Keyword 1
Program Evaluation

Keyword 2
Accreditation

Keyword 3
Templates

Level of Training
Post Graduate

Abstract Themes
Faculty Development

Additional Theme (First choice)
Postgraduate

Additional Theme (Second Choice)
Leadership

Additional Theme (Third Choice)
Assessment

Authors
Presenter
    Theresa Beesley

Term 1
Yes

Term 2
Yes

Term 3
Yes

Term 4
Yes

Term 5
Yes
x

Loading . . .
please wait . . . loading

Working...