Accepted Type
Oral
Code
OF1-3-2
Acceptance Declaration
Accept
Additional Information
Yes, I have/had in the past 2 years, a financial interest, arrangement, or affiliation with one or more organizations that could be perceived as a direct/indirect conflict of interest in the context/content of the subject of this or any other presentation.
MINI ABSTRACT DESCRIPTION
Increasingly, medical schools are using non-academic characteristics in admissions towards more
holistic decision making. Casper, a widely used SJT, has demonstrated reliability, however, little is
known regarding its relationship with in-program non-academic measures or sociodemographic
variables. Preliminary results suggest that Casper is significantly associated with OSCE, however, other academic and non-academic metrics only accounted for minimal total variance of in-program measures.
Was this work accepted for CCME 2020?
no
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
Researcher
Affiliation
Considered for Poster
yes
Title
Is the Casper test a good predictor of medical student outcomes?
Length of Presentation
Background/Purpose
Increasingly, medical schools are using non-academic characteristics in admissions towards more holistic decision making. Casper, a widely used SJT, has demonstrated reliability, however, little is known regarding its relationship with in-program non-academic measures or sociodemographic variables. This study aims to understand the associations between non-academic performance at admissions and in-program measures.
Methods
Graduating classes of 2020 and 2021 from University of Ottawa MD student data were retrospectively analyzed. Admissions data including demographics, interview score, Casper, and wGPA were compared to course grades, clerkship ratings and OSCE scores collected during training. Analysis included Independent samples t-tests, mon-parametric regressions, Spearman's rho, and multiple regression.
Results
Over the three graduation classes, the total number of students was (N=496). Of those, 55% were female, 67% had a bachelors, and the average age at the time of graduation was 22.4. There was no significant gender (p = .53 and .19), age (p = .41 and .68), language stream (p = .18 and .21) differences in Casper scores for both Classes of 2020 (p = .19 to .68) and 2021. Casper was significantly associated with professional and skill development OSCE score (b = 0.53, p = .02) for Class of 2020. The multiple regressions with GPA and Casper showed minimal total variance accounted for across clerkship scores (adjusted R2 = 0.03, p = .11; adjusted R2 = 0.08, p = .001).
Conclusion
Preliminary results suggest that Casper is significantly associated with OSCE, however, other academic and non-academic metrics only accounted for minimal total variance of in-program measures. Results from further analyses related to range restriction of scores and missing data will be reported.
Keyword 1
Admissions
Keyword 2
Undergraduate medical education
Level of Training
Undergraduate
Abstract Themes
Assessment
Assessment
- Admission/selection
- General
- Psychometrics & Measurement
- OSCE/OSPE/OSTE
- Competency-based assessment
- Technology
Additional Theme (First choice)
Professionalism
Additional Theme (Second Choice)
Assessment
Additional Theme (Third Choice)
Undergraduate
Authors
Presenter
Xin Wei Yan
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes