Submission ID 77706
| Code | WF-4 |
|---|---|
| At the end of this workshop, participants will be able to: | |
| Learning Objective 1 | Identify examiner biases common to assessment |
| Learning Objective 2 | Outline the impact of bias on validity |
| Learning Objective 3 | Develop methods of mitigating the impact of examiner bias on performance-based examination |
| Category | Medical Education |
| Type | Workshop |
| Title | (De)biasing Osce Raters |
| Rationale/Background | Assessments in performance-based examinations like OSCEs straddle the tension between so-called objective / reductionist methods and integrated holistic approaches. Human assessors are essential as scoring rubrics and checklists only support expert opinion, rather than shape or replace it. Thus, expert human judgement is essential for a successful performance-based assessment. Modern educational theory postulates that subjectivity is innate to the process of assessment, adding the 'value' in evaluation. However, assessments may be unconsciously affected by judgement biases which may influence examiners' initial subjective judgements. Unlike unreliability, judgment biases cannot be simply counteracted by improving item sampling, rubrics, or checklists. Unaddressed judgment biases are a threat to assessment validity and the inferences made about candidates' ability levels during the OSCE assessment process. Although bias is naturally occurring and therefore cannot be avoided, assessors may be trained to recognise and consciously mitigate against the influence of biases in performance-based assessment. |
| Instructional Methods | This interactive workshop will engage participants through small-group work to: review video vignettes to identify common biases in assessment; develop strategies to raise awareness in examiners; and design practical approaches to mitigate the impact of examiner bias. |
| Target Audience | Performance-based examination designers, administrators, and assessors |
| Keyword 1 | Biases |
| Keyword 2 | OSCEs |
| Keyword 3 | Examiners |
| Abstract content most relevant to: (check all that apply) | Residency Education
Undergraduate Medical Education |
| Abstract Track - First Choice | Assessment |
| Assessment | OSCE/OSPE/OSTE Raters |
| Authors | Teresa Cavett BSc MD CCFP FCFP MEd Brent Kvern MD CCFP FCFP Alan Ng MBChB, DipObst, DCH, DTM&H, MRCGP, CCFP, FCFP, MMEd |
