Model validation reporting habits

Based on AdViSHE, Pieter de Boer and colleagues investigated the reporting habits of recently published studies on seasonal influenza and early breast cancer. After all, transparent reporting of validation efforts of health economic models give stakeholders better insight into the credibility of model outcomes.

They conclude that although validation is deemed important by many researchers, this is not reflected in the reporting habits of health economic modelling studies. Systematic reporting of validation efforts would be desirable to further enhance decision makers’ confidence in health economic models and their outcomes.

The paper (open access) can be downloaded here. The full reference is:

  • P.T. de Boer, G.W.J. Frederix, T.L. Feenstra, P. Vemer “Unremarked or Unperformed? Systematic Review on Reporting of Validation Efforts of Health Economic Decision Models in Seasonal Influenza and Early Breast Cancer” PharmacoEconomics 2016 Sep;34(9):833-45. doi: 10.1007/s40273-016-0410-3

Background information

This website contains all the relevant information on the project that spawned AdViSHE. The paper that presented AdVISHE was published in PharmacoEconomics in early 2016. The full text can be found on their website, or downloaded here. The full reference is:

P. Vemer, I. Corro Ramos, G.A.K. van Voorn, M.J. Al, T.L. Feenstra “AdViSHE: A Validation-Assessment Tool of Health-Economic Models for Decision Makers and Model Users” PharmacoEconomics (2016) 34:349–361 DOI 10.1007/s40273-015-0327-2 (Open Access)

Other publications that were part of this project were:

  • Comments on the validation guidelines of the ISPOR-SMDM modeling good research practices task force, published in Value in Health (2013). It can be found here.
  • Argumentation why patients should be involved in the modelling process. It was published in Applied Health Economics and Health Policy (2016) and can be found here.
  • A new Bayesian framework was developed, to measure the accuracy of health economic decision models statistically. It uses stepwise validation when new data becomes available. The paper is currently under review.