Submission ID 78127
| Code | OB-5-3 |
|---|---|
| At the end of this workshop, participants will be able to: | |
| Category | Medical Education |
| Type | Oral |
| Will the presenter be a: | Other |
| Presenter Other | Faculty |
| Title | Use of the Macdot App for Monitoring and Promoting Direct Observation and Formative Feedback in the Undergraduate Medicine Clerkship at Mcmaster University. |
| Background/Purpose | Direct observation and feedback on student patient encounters is important for skill development and as an accreditation requirement. However, documenting this 'on the fly' in clinical settings can be a challenge. We developed the McMaster Direct Observation Tool (MacDOT) smartphone application as a way to log and monitor clinical clerk observed encounters; and to promote formative feedback. |
| Methods | Data was collected from two clerkship cohorts between November 2017 - March 2020. 5-10 prescribed observations were required per rotation. Observers would use the student's smartphone to document feedback with free text comments or 'quick picks' to answer two questions: 'What should the student do more of?' and 'What should the student keep doing?' as part of a formative educational conversation. Students would then document a learning plan and rate the encounter on a 5-point Likert scale. Students and observers could also rate their user experience of the app. |
| Results | 404 students underwent a total of 33,372 observations from over 2,400 active observers, with an average completion time of 8 minutes. The average student rating of observer feedback was 4.5/5, and ratings improved across all clerkships between the two cohorts. Feedback on the app was generally positive, with some observers and students noting that it helped to facilitate feedback. |
| Discussion | The MacDOT app is an efficient approach to documenting direct observation of clerks, and is positively regarded by both students and observers. Future work will include an analysis of the free text comments and iterative improvements to the app. |
| Keyword 1 | Clerkship |
| Keyword 2 | Logging clinical encounters |
| Keyword 3 | Formative feedback |
| Abstract content most relevant to: (check all that apply) | Undergraduate Medical Education |
| Abstract Track - First Choice | Assessment |
| Assessment | Formative Technology Work-place based |
| Authors | Anthony Levinson Jill Rudkowski Laura DiCarlo Stephanie Ayers Sandra Clark Helen Neighbour Robert Whyte Matthew Sibbald Anthony Levinson Andrew Scott |
