Submission ID 78083
| Code | OH-4-5 |
|---|---|
| At the end of this workshop, participants will be able to: | |
| Category | Medical Education |
| Type | Oral |
| Will the presenter be a: | Fellow |
| Title | Use the Right Words: Evaluating the Effect of Word Choice on Quality of Narrative Feedback in Ophthalmology Cbme Assessments |
| Background/Purpose | The purpose of this study was to investigate the effect of word choice on the quality of narrative feedback in ophthalmology resident trainee assessments since the introduction of competency-based medical education (CBME) at Queen's University. Specifically, this study investigated whether the use of specific coaching words correlated with better quality narrative feedback. |
| Methods | Ophthalmology resident assessment data from July 2017-December 2020 was retrieved from Elentra (Integrated Teaching and Learning Platform) and anonymized. Written feedback was assigned a Quality of Assessment for Learning (QuAL) score out of 5 based on the previously validated rubric. The correlation between total QUAL score and the words/phrases 'suggest,' 'try(ing),' 'because,' 'consider,' 'next step,' 'continue,' and, 'next time' was determined using a Spearman's Rho analysis. Independent samples t-tests were used to compare the QUAL score when a specific word was used, and when it was absent. |
| Results | A total of 2617 individual assessments were graded and 1998 with written feedback were used in this analysis. All identified coaching words were significantly and positively associated with the total QuAL score with the exception of "next time" (0.039, p=0.082). The strongest correlation was for "continue", "trying" and "next step" (0.182, p<0.001; 0.113, p<0.001; and, 0.103, p<0.001 respectively). The mean value of the QUAL score increased when coaching words were used vs. not used with the largest mean difference of 0.796 (p<0.001) for "next step". |
| Discussion | This study demonstrates that the use of certain coaching words in written comments may improve the quality of feedback of the assessment. |
| Keyword 1 | Assessment |
| Keyword 2 | Feedback |
| Keyword 3 | (CBME) Competency-based medical education |
| Abstract content most relevant to: (check all that apply) | Residency Education |
| Abstract Track - First Choice | Teaching and learning |
| Teaching and Learning | Competency-Based Education |
| Authors | Tessa Hanmore Rachel Curtis Christine Moon Tessa Hanmore Wilma Hopman Stephanie Baxter |
