The Value of Value of Information: Best Informing Research Design and Prioritization Using Current Methods

Simon Eckermann, Jonathan Karnon, Andrew R Willan

Research output: Contribution to journalReview articlepeer-review

61 Citations (Scopus)

Abstract

Value of information (VOI) methods have been proposed as a systematic approach to inform optimal research design and prioritization. Four related questions arise that VOI methods could address. (i) Is further research for a health technology assessment (HTA) potentially worthwhile? (ii) Is the cost of a given research design less than its expected value? (iii) What is the optimal research design for an HTA? (iv) How can research funding be best prioritized across alternative HTAs?Following Occams razor, we consider the usefulness of VOI methods in informing questions 14 relative to their simplicity of use. Expected value of perfect information (EVPI) with current information, while simple to calculate, is shown to provide neither a necessary nor a sufficient condition to address question 1, given that what EVPI needs to exceed varies with the cost of research design, which can vary from very large down to negligible. Hence, for any given HTA, EVPI does not discriminate, as it can be large and further research not worthwhile or small and further research worthwhile. In contrast, each of questions 14 are shown to be fully addressed (necessary and sufficient) where VOI methods are applied to maximize expected value of sample information (EVSI) minus expected costs across designs.In comparing complexity in use of VOI methods, applying the central limit theorem (CLT) simplifies analysis to enable easy estimation of EVSI and optimal overall research design, and has been shown to outperform bootstrapping, particularly with small samples. Consequently, VOI methods applying the CLT to inform optimal overall research design satisfy Occams razor in both improving decision making and reducing complexity. Furthermore, they enable consideration of relevant decision contexts, including option value and opportunity cost of delay, time, imperfect implementation and optimal design across jurisdictions.More complex VOI methods such as bootstrapping of the expected value of partial EVPI may have potential value in refining overall research design. However, Occams razor must be seriously considered in application of these VOI methods, given their increased complexity and current limitations in informing decision making, with restriction to EVPI rather than EVSI and not allowing for important decision-making contexts. Initial use of CLT methods to focus these more complex partial VOI methods towards where they may be useful in refining optimal overall trial design is suggested. Integrating CLT methods with such partial VOI methods to allow estimation of partial EVSI is suggested in future research to add value to the current VOI toolkit.

Original languageEnglish
Pages (from-to)699-709
Number of pages11
JournalPharmacoeconomics
Volume28
Issue number9
DOIs
Publication statusPublished - 2010
Externally publishedYes

Keywords

  • Value of Information (VOI)
  • Health Technology Assessment (HTA)
  • Central Limit Theorem (CLT)
  • decision-making
  • health-policy
  • value-of-information-analysis

Fingerprint Dive into the research topics of 'The Value of Value of Information: Best Informing Research Design and Prioritization Using Current Methods'. Together they form a unique fingerprint.

Cite this