Submission ID 78176
| Code | OH-5-1 |
|---|---|
| At the end of this workshop, participants will be able to: | |
| Category | Medical Education |
| Type | Oral |
| Will the presenter be a: | Other |
| Presenter Other | Data Scientist |
| Title | : A New Era for the Analysis of Teacher Performance Data Using Data Analytics and Visualizations: Lessons Learned. |
| Background/Purpose | The University of Toronto have standardized the evaluation tool used to assess clinical teachers across the MD Program and PGME within an on-demand formative assessment model. The standardization of the tool created an opportunity to transform thousands of data points into meaningful interactive visual dashboards for education leaders to inform actions around teacher performance, also allowing a scholarly analysis of the data. |
| Methods | Data was extracted from three online platforms in use at Temerty Faculty of Medicine (TFoM) including all MD and PGME faculty for the 2021/22 academic year. Thousands of records were cleaned and restructured, using POWER BI based on identified data architecture standards. A visual dashboard structure and filters were created to easily disaggregate by teaching site, type of learner, and performance characteristics. |
| Results | Interactive dashboards were developed for Education leaders in all Departments at the TFoM, including summative statistics. Our work helped identify performance differences across departments, hospital sites, total assessments per clinical teacher, average word count for narrative comments, and level of training. This work has helped recognize best teaching practices to be shared across departments. |
| Discussion | Our work presented a novel approach to report and understand teacher performance data highlighting the benefits associated with a proper data structure. We were able to better understand the data meaning compared to the traditional practices of performance average comparisons across departments. Our results help inform Faculty Development practices in our institution. |
| Keyword 1 | Teacher Performance |
| Keyword 2 | Teacher Analytics |
| Keyword 3 | Data Visualization |
| Abstract content most relevant to: (check all that apply) | Continuing Professional Development (CPD) (faculty development, CME) |
| Abstract Track - First Choice | AI and Data Science |
| Authors | Caroline Abrahams Nima Krishnan Natasha Shaikhlislamova David Rojas Caroline Abrahams Nima Krishnan |
