Workplace-based assessments in postgraduate medical education: A hermeneutic review

Shaun Prentice, Jill Benson, Emily Kirkpatrick, Lambert Schuwirth

    Research output: Contribution to journalReview article

    1 Citation (Scopus)

    Abstract

    Objectives: Since their introduction, workplace-based assessments (WBAs) have proliferated throughout postgraduate medical education. Previous reviews have identified mixed findings regarding WBAs' effectiveness, but have not considered the importance of user-tool-context interactions. The present review was conducted to address this gap by generating a thematic overview of factors important to the acceptability, effectiveness and utility of WBAs in postgraduate medical education. Method: This review utilised a hermeneutic cycle for analysis of the literature. Four databases were searched to identify articles pertaining to WBAs in postgraduate medical education from the United Kingdom, Canada, Australia, New Zealand, the Netherlands and Scandinavian countries. Over the course of three rounds, 30 published articles were thematically analysed in an iterative fashion to deeply engage with the literature in order to answer three scoping questions concerning acceptability, effectiveness and assessment training. As each round was coded, themes were refined and questions added until saturation was reached. Results: Stakeholders value WBAs for permitting assessment of trainees' performance in an authentic context. Negative perceptions of WBAs stem from misuse due to low assessment literacy, disagreement with definitions and frameworks, and inadequate summative use of WBAs. Effectiveness is influenced by user (eg, engagement and assessment literacy) and tool attributes (eg, definitions and scales), but most fundamentally by user-tool-context interactions, particularly trainee-assessor relationships. Assessors’ assessment literacy must be combined with cultural and administrative factors in organisations and the broader medical discipline. Conclusions: The pivotal determinants of WBAs' effectiveness and utility are the user-tool-context interactions. From the identified themes, we present 12 lessons learned regarding users, tools and contexts to maximise WBA utility, including the separation of formative and summative WBA assessors, use of maximally useful scales, and instituting measures to reduce competitive demands.
    Original languageEnglish
    Number of pages12
    JournalMedical Education
    Early online date13 May 2020
    DOIs
    Publication statusE-pub ahead of print - 13 May 2020

    Keywords

    • workplace‐based assessment
    • workplace‐based assessments (WBAs)
    • hermeneutic review
    • postgraduate medical education
    • Royal Australian College of General Practitioners
    • user‐tool‐context interactions

    Fingerprint Dive into the research topics of 'Workplace-based assessments in postgraduate medical education: A hermeneutic review'. Together they form a unique fingerprint.

  • Cite this