SubmissionId 60601

Accepted Type
Oral

Code
OF1-3-2

Acceptance Declaration
Accept

Additional Information
Yes, I have/had in the past 2 years, a financial interest, arrangement, or affiliation with one or more organizations that could be perceived as a direct/indirect conflict of interest in the context/content of the subject of this or any other presentation.

MINI ABSTRACT DESCRIPTION
Increasingly, medical schools are using non-academic characteristics in admissions towards more holistic decision making. Casper, a widely used SJT, has demonstrated reliability, however, little is known regarding its relationship with in-program non-academic measures or sociodemographic variables. Preliminary results suggest that Casper is significantly associated with OSCE, however, other academic and non-academic metrics only accounted for minimal total variance of in-program measures.

Was this work accepted for CCME 2020?
no

Category
General Call (Workshop, Oral Presentation, Poster Presentation)

Type
Oral

Sub Type
Education Research

Will the presenter be a:
Other

Presenter Other
Researcher

Affiliation

Considered for Poster
yes

Title
Is the Casper test a good predictor of medical student outcomes?

Length of Presentation

Background/Purpose
Increasingly, medical schools are using non-academic characteristics in admissions towards more holistic decision making. Casper, a widely used SJT, has demonstrated reliability, however, little is known regarding its relationship with in-program non-academic measures or sociodemographic variables. This study aims to understand the associations between non-academic performance at admissions and in-program measures.

Methods
Graduating classes of 2020 and 2021 from University of Ottawa MD student data were retrospectively analyzed. Admissions data including demographics, interview score, Casper, and wGPA were compared to course grades, clerkship ratings and OSCE scores collected during training. Analysis included Independent samples t-tests, mon-parametric regressions, Spearman's rho, and multiple regression.

Results
Over the three graduation classes, the total number of students was (N=496). Of those, 55% were female, 67% had a bachelors, and the average age at the time of graduation was 22.4. There was no significant gender (p = .53 and .19), age (p = .41 and .68), language stream (p = .18 and .21) differences in Casper scores for both Classes of 2020 (p = .19 to .68) and 2021. Casper was significantly associated with professional and skill development OSCE score (b = 0.53, p = .02) for Class of 2020. The multiple regressions with GPA and Casper showed minimal total variance accounted for across clerkship scores (adjusted R2 = 0.03, p = .11; adjusted R2 = 0.08, p = .001).

Conclusion
Preliminary results suggest that Casper is significantly associated with OSCE, however, other academic and non-academic metrics only accounted for minimal total variance of in-program measures. Results from further analyses related to range restriction of scores and missing data will be reported.

Keyword 1
Admissions

Keyword 2
Undergraduate medical education

Level of Training
Undergraduate

Abstract Themes
Assessment

Assessment
  • Admission/selection
  • General
  • Psychometrics & Measurement
  • OSCE/OSPE/OSTE
  • Competency-based assessment
  • Technology

Additional Theme (First choice)
Professionalism

Additional Theme (Second Choice)
Assessment

Additional Theme (Third Choice)
Undergraduate

Authors
Presenter
    Xin Wei Yan

Term 1
Yes

Term 2
Yes

Term 3
Yes

Term 4
Yes

Term 5
Yes
x

Loading . . .
please wait . . . loading

Working...