Accepted Type
Oral
Code
OF1-3-4
Acceptance Declaration
Accept
Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.
Was this work accepted for CCME 2020?
no
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
Faculty
Affiliation
Considered for Poster
yes
Title
Are age, gender, language, ethnicity and socioeconomic status associated with Casper scores? Findings from a multicenter study in Quebec, Canada
Length of Presentation
Background/Purpose
Casper is a situational judgment test widely used for selection in healthcare professions programs. Associations between sociodemographic characteristics and scores, which can impact diversity in admissions, were described in the USA. This study assesses subgroup performance differences for applicants in Quebec, Canada.
Methods
Sociodemographic data were collected using an exit-survey after Casper completion. Data from unique applicants to any of the four medical schools in Quebec were anonymized and linked with Casper z scores. A multiple regression model was created using backward stepwise regression.
Results
Of 5012 applicants who took Casper for the 2020 admission cycle, sociodemographic data was available for 3491 (69.7%). Overall, 17.3% were aged ≥26, 61.8% were women, 55.9% self-identified as white and 4.1% as black, 36.4% declared a family income <75,000$ and 19.3% spoke a different language than French or English. In a regression model, age ≥26 (β=-0.069; 95%CI -0.110;-0.028), male gender (β=-0.064; 95%CI -0.105;-0.022), language other than French or English (β=-0.102; 95%CI -0.136;-0.068), self-declared black race (β=-0.116; 95%CI -0.177;-0.055) were associated with significantly lower scores. Other non-white applicants had lower scores only if aged ≥26 (β=-0.125; -0.166;-0.084) or if their parental income was <75,000$ (β=-0.066; 95%CI -0.120;-0.012). Parental education level was non-significant.
Conclusion
For the 2020 application cycle in Quebec, Casper scores presented subgroup differences related to gender, age, language, parental income, and ethnicity/race. These findings are in accordance with previously published studies and need to be monitored and compared to subgroup differences observed with other admission tools such as academic measures to inform selection methods.
Keyword 1
selection
Keyword 2
fairness
Keyword 3
situational judgment test
Level of Training
Undergraduate
Abstract Themes
Admissions
Additional Theme (First choice)
Undergraduate
Additional Theme (Second Choice)
Assessment
Additional Theme (Third Choice)
Authors
Presenter
Jean-Michel Leduc
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
