Accepted Type
Facilitated and Dedicated Poster
Code
P1 - 07
Acceptance Declaration
Accept
Additional Information
Yes, I have/had in the past 2 years, a financial interest, arrangement, or affiliation with one or more organizations that could be perceived as a direct/indirect conflict of interest in the context/content of the subject of this or any other presentation.
Was this work accepted for CCME 2020?
no
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
Founder, Altus Assessments
Affiliation
Considered for Poster
yes
Title
How to measure "Fit": Standardized comparison of program and applicant alignment of values and priorities
Length of Presentation
Background/Purpose
As USMLE Step 1 scores transition to Pass/Fail, GME selection may need additional standardized data points. NRMP surveys of programs and applicants indicate "goodness of fit" as one of the most important factors influencing ranking. However, little consensus exists on what "fit" is and the factors that influence its perception.
Methods
This study sought to understand the factors influencing the concept of applicant/program alignment across GME programs, with a goal of creating a standardized measure of fit. Various perspectives of key stakeholders and subject matter experts including residency program directors, applicants and current residents were examined.A modified Delphi survey was conducted across 2 rounds, consisting of 47 potential factors, based on SME interviews and the literature. Diverse stakeholders (DIOs, Program Directors, Faculty, Residents, & Medical Students) participated in the Delphi and were asked to each factor on a Likert-type 4 point scale.
Results
38 SMEs responded to the 1st round of the Delphi survey Of the 47 factors, 34 reached consensus with a-priori ranking determined to be a threshold of 55% consensus. In the 2nd round consensus was reached on 4 additional factors. After integrating feedback on redundancy and terminology, 30 factors remained. The factors were then organized into 3 themes: culture, pedagogy and work environment for the assessment use in GME selection.
Conclusion
The results of the Delphi survey will be used to populate a paired-comparison ranking tool used in GME selection during the Fall of 2020 across thousands of applicants and multiple programs. This standardized method of evaluating fit will provide a more objective measure of including this important factor in selection.
Keyword 1
GME
Keyword 2
Selection
Keyword 3
Assessment
Level of Training
Post Graduate
Abstract Themes
Assessment
Assessment
- Admission/selection
- Psychometrics & Measurement
- Technology
Additional Theme (First choice)
Postgraduate
Additional Theme (Second Choice)
Admissions
Additional Theme (Third Choice)
Assessment
Authors
Presenter
Kelly Dore
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
