Accepted Type
Oral
Code
OG2-3-2
Acceptance Declaration
Accept
Additional Information
I declare I have no actual or potential conflict of interest in relation to this program.
Was this work accepted for CCME 2020?
no
Category
General Call (Workshop, Oral Presentation, Poster Presentation)
Type
Oral
Sub Type
Education Research
Will the presenter be a:
Other
Presenter Other
senior research psychometrician
Affiliation
Considered for Poster
yes
Title
Gathering Evidence of Validity for a Therapeutics Decision-Making (TDM) Examination for Assessing International Medical Graduates
Length of Presentation
Background/Purpose
The TDM Exam is one of the tools used by Pan-Canadian Practice-Ready Assessment (PRA) programs for selecting international medical graduates (IMGs) into over-time clinical assessment to determine their readiness to enter independent practice in Canada. It assesses the application of therapeutics knowledge and decision-making skills in the pharmacological and non-pharmacological management of medical conditions at the level required of family physicians (FM) practicing independently and safely in Canada.
This study assesses whether the TDM Exam measures therapeutics knowledge and skills at its intended level by comparing the performances of PRA applicants and a sample of Postgraduate Year 2 (PGY2) FM residents.
Methods
The study included 90 PRA applicants as the control group and 17 PGY2 FM residents as the experimental group. Both took the TDM Exam in January 2020 and their responses were marked by the same physician markers who were blind to examinee group membership.
The analyses included independent samples t-test and chi-square to compare total score means and pass/fail status between the two groups, and a multi-variate analysis of variance to compare their performances on sub-scores.
Results
There's no statistically significant difference in mean scores or pass rate between the two groups. They performed similarly on all sub-areas except for one dimension (i.e., Acute Illness).
Conclusion
This study provided preliminary evidence to support the use of the TDM Exam for its intended purpose as one of the tools for selecting IMGs who would likely succeed into PRA programs. A follow-up study will include more PGY2 residents.
Keyword 1
Assessment
Keyword 2
Validity
Keyword 3
Psychometrics
Level of Training
Post Graduate
Abstract Themes
Assessment
Assessment
- Admission/selection
- Psychometrics & Measurement
- Work-place based
- Written/Narrative
Additional Theme (First choice)
Postgraduate
Additional Theme (Second Choice)
Continuing Medical Education
Additional Theme (Third Choice)
Patient Safety
Authors
Presenter
Fang Tian
Term 1
Yes
Term 2
Yes
Term 3
Yes
Term 4
Yes
Term 5
Yes
