SubmissionId 60713

Accepted Type
Facilitated and Dedicated Poster

Code
P1 - 07

Acceptance Declaration
Accept

Additional Information
Yes, I have/had in the past 2 years, a financial interest, arrangement, or affiliation with one or more organizations that could be perceived as a direct/indirect conflict of interest in the context/content of the subject of this or any other presentation.

Was this work accepted for CCME 2020?
no

Category
General Call (Workshop, Oral Presentation, Poster Presentation)

Type
Oral

Sub Type
Education Research

Will the presenter be a:
Other

Presenter Other
Founder, Altus Assessments

Affiliation

Considered for Poster
yes

Title
How to measure "Fit": Standardized comparison of program and applicant alignment of values and priorities

Length of Presentation

Background/Purpose
As USMLE Step 1 scores transition to Pass/Fail, GME selection may need additional standardized data points. NRMP surveys of programs and applicants indicate "goodness of fit" as one of the most important factors influencing ranking. However, little consensus exists on what "fit" is and the factors that influence its perception.

Methods
This study sought to understand the factors influencing the concept of applicant/program alignment across GME programs, with a goal of creating a standardized measure of fit. Various perspectives of key stakeholders and subject matter experts including residency program directors, applicants and current residents were examined.A modified Delphi survey was conducted across 2 rounds, consisting of 47 potential factors, based on SME interviews and the literature. Diverse stakeholders (DIOs, Program Directors, Faculty, Residents, & Medical Students) participated in the Delphi and were asked to each factor on a Likert-type 4 point scale.

Results
38 SMEs responded to the 1st round of the Delphi survey Of the 47 factors, 34 reached consensus with a-priori ranking determined to be a threshold of 55% consensus. In the 2nd round consensus was reached on 4 additional factors. After integrating feedback on redundancy and terminology, 30 factors remained. The factors were then organized into 3 themes: culture, pedagogy and work environment for the assessment use in GME selection.

Conclusion
The results of the Delphi survey will be used to populate a paired-comparison ranking tool used in GME selection during the Fall of 2020 across thousands of applicants and multiple programs. This standardized method of evaluating fit will provide a more objective measure of including this important factor in selection.

Keyword 1
GME

Keyword 2
Selection

Keyword 3
Assessment

Level of Training
Post Graduate

Abstract Themes
Assessment

Assessment
  • Admission/selection
  • Psychometrics & Measurement
  • Technology

Additional Theme (First choice)
Postgraduate

Additional Theme (Second Choice)
Admissions

Additional Theme (Third Choice)
Assessment

Authors
Presenter
    Kelly Dore

Term 1
Yes

Term 2
Yes

Term 3
Yes

Term 4
Yes

Term 5
Yes
x

Loading . . .
please wait . . . loading

Working...