Accepted Type
Dedicated Poster
Code
P1 - 09
Was this work accepted for CCME 2020?
yes
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Poster
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
faculty
Affiliation
Title
Low-stakes progress test results are excellent predictors for success at the Medical Council of Canada Qualifying Examination part I
Length of Presentation
Background/Purpose
At Université de Montréal, progress tests (PT) are formative assessments which are administered on the final 2 years of the curriculum. We sought to assess the value of these tests for predicting success to the Medical Council of Canada Qualifying Examination part I (MCCQE I).
Methods
Five compulsory, formative PTs have to be taken by students during clerkship, the first 3 in year 3, and the last 2 during year 4. From 2013 to 2018, student scores from PTs and MCCQE I were prospectively gathered, and Pearson's coefficient was used to look for a relationship between the two. PT scores were also divided into deciles and analysed for risks of failing the MCCQE I.
Results
Results of 1496 students were analysed. A strong correlation was shown between PT scores and MCCQE I scores (r=0.635, n=1496, p<0.001). A good correlation of PT and MCCQE I scores was demonstrated from PT #3 (Pearson's r > 0.500). Students with mean PT scores in the lower decile were 6 times more likely to fail the MCCQE I (RR=6.4673, 95%IC 3.7727-11.0872, Z=6.788, p<0.0001) than those with mean scores in the higher deciles. Compared to those with no PT score in the lower decile, students with 2 PT scores in the lower decile had a RR of 20.9804 (95% CI 7.3114-60.2038, Z=5.659, p<0.0001), and those with 3 PT scores or more in the lower decile had a RR of 42.2716(95% CI 15.8893-112.4586, Z= 7.500, p<0.0001) of failing the MCCQE I.
Conclusion
Progress tests, as low-stakes assessments, are good predictors of MCCQE I scores. Moreover, students with very low PT scores are at higher risk of failing the MCCQE I. Analysis of PT scores can help to identify, as early as 1 year ahead of licensing examinations, students who could beneficiate from additional academic support.
Keyword 1
progress test
Keyword 2
assessment
Level of Training
Undergraduate
Abstract Themes
Assessment
Assessment
Formative
Additional Theme (First choice)
Undergraduate
Additional Theme (Second Choice)
Assessment
Additional Theme (Third Choice)
Authors
Presenter
Margaret Henri
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
