Programmatic assessment and Kane's validity perspective

Lambertus Schuwirth, Cees Van der Vleuten

    Research output: Contribution to journalArticle

    74 Citations (Scopus)

    Abstract

    Context Programmatic assessment is a notion that implies that the strength of the assessment process results from a careful combination of various assessment instruments. Accordingly, no single instrument is superior to another, but each has its own strengths, weaknesses and purpose in a programme. Yet, in terms of psychometric methods, a one-size-fits-all approach is often used. Kane's views on validity as represented by a series of arguments provide a useful framework from which to highlight the value of different widely used approaches to improve the quality and validity of assessment procedures. Methods In this paper we discuss four inferences which form part of Kane's validity theory: from observations to scores; from scores to universe scores; from universe scores to target domain, and from target domain to construct. For each of these inferences, we provide examples and descriptions of approaches and arguments that may help to support the validity inference. Conclusions As well as standard psychometric methods, a programme of assessment makes use of various other arguments, such as: item review and quality control, structuring and examiner training; probabilistic methods, saturation approaches and judgement processes, and epidemiological methods, collation, triangulation and member-checking procedures. In an assessment programme each of these can be used.

    Original languageEnglish
    Pages (from-to)38-48
    Number of pages11
    JournalMedical Education
    Volume46
    Issue number1
    DOIs
    Publication statusPublished - 2012

    Fingerprint Dive into the research topics of 'Programmatic assessment and Kane's validity perspective'. Together they form a unique fingerprint.

  • Cite this