Submission ID 77650
| Code | OG-3-3 |
|---|---|
| At the end of this workshop, participants will be able to: | |
| Category | Medical Education |
| Type | Oral |
| Will the presenter be a: | Early Career Faculty - (Less than 7 years of practice) |
| Title | Validating Learning Objectives Through the Lenses of Assessments: A Quality Improvement and Educational Alignment Study in Ugme |
| Background/Purpose | Discipline-based exams (DE) are considered a core component of assessing medical student competence during the UGME clerkship. They are used both summatively and formatively in supporting students' learning. The results also serve evaluations of the quality of training and validation of the course/program learning objectives. |
| Methods | Results of 30 DEs from 8 disciplines (items=1700) were analyzed by educational leaders and content experts to explore the objective based performances and to ensure if the learning objectives are accurate and adequate by cross checking the item tags. Then in collaboration with course directors, revisions of the course learning objectives and exam blueprints were made to bring teaching and assessment into greater alignment. |
| Results | The findings revealed 5 objectives were poorly performing, and around 25% of the items were weakly related to the learning objectives and required intervention to uncover discrepancies and/or inconsistencies. It also revealed weaknesses in course objectives as teachers implicitly taught concepts and preferred use of test items reflecting important yet implicit standards without adequately noting these in course learning objectives. After targeting discrepancies, the course learning objectives were improved. |
| Discussion | The study highlights the importance of considering alignment with learning objectives as a key process in interpreting exam results and reviewing the educational quality offered. With continuous data driven quality improvement, both the learning objectives and question banks can be significantly improved when an alignment lens is continuously applied to the review of relationships across these educational elements. |
| Keyword 1 | Quality assurance |
| Keyword 2 | learning objectives |
| Keyword 3 | Discipline-based exams |
| Abstract content most relevant to: (check all that apply) | Undergraduate Medical Education |
| Abstract Track - First Choice | Curriculum |
| Curriculum | Quality improvement |
| Authors | Shujiao Wang Shujiao Wang Marian Jazvac-Martek Fallavollita Fallavollita Julia Dornik Melanie Mondou |
