Calibrating models in economic evaluation: A seven-step approach

Tazio Vanni, Jonathan Karnon, Jason Madan, Richard G. White, W. John Edmunds, Anna M. Foss, Rosa Legood

Research output: Contribution to journalArticle

81 Citations (Scopus)

Abstract

In economic evaluation, mathematical models have a central role as a way of integrating all the relevant information about a disease and health interventions, in order to estimate costs and consequences over an extended time horizon. Models are based on scientific knowledge of disease (which is likely to change over time), simplifying assumptions and input parameters with different levels of uncertainty; therefore, it is sensible to explore the consistency of model predictions with observational data. Calibration is a useful tool for estimating uncertain parameters, as well as more accurately defining model uncertainty (particularly with respect to the representation of correlations between parameters). Calibration involves the comparison of model outputs (e.g. disease prevalence rates) with empirical data, leading to the identification of model parameter values that achieve a good fit.This article provides guidance on the theoretical underpinnings of different calibration methods. The calibration process is divided into seven steps and different potential methods at each step are discussed, focusing on the particular features of disease models in economic evaluation. The seven steps are (i) Which parameters should be varied in the calibration process? (ii) Which calibration targets should be used? (iii) What measure of goodness of fit should be used? (iv) What parameter search strategy should be used? (v) What determines acceptable goodness-of-fit parameter sets (convergence criteria)? (vi) What determines the termination of the calibration process (stopping rule)? (vii) How should the model calibration results and economic parameters be integrated?The lack of standards in calibrating disease models in economic evaluation can undermine the credibility of calibration methods. In order to avoid the scepticism regarding calibration, we ought to unify the way we approach the problems and report the methods used, and continue to investigate different methods.

Original languageEnglish
Pages (from-to)35-49
Number of pages15
JournalPharmacoeconomics
Volume29
Issue number1
DOIs
Publication statusPublished - Jan 2011
Externally publishedYes

Keywords

  • Economic evaluation
  • calibration process
  • global extremum
  • Pharmacoeconomics.
  • Modelling

Fingerprint Dive into the research topics of 'Calibrating models in economic evaluation: A seven-step approach'. Together they form a unique fingerprint.

  • Cite this

    Vanni, T., Karnon, J., Madan, J., White, R. G., Edmunds, W. J., Foss, A. M., & Legood, R. (2011). Calibrating models in economic evaluation: A seven-step approach. Pharmacoeconomics, 29(1), 35-49. https://doi.org/10.2165/11584600-000000000-00000