Bias due to differential and non-differential disease- and exposure misclassification in studies of vaccine effectiveness

PLoS One. 2018 Jun 15;13(6):e0199180. doi: 10.1371/journal.pone.0199180. eCollection 2018.

Abstract

Background: Studies of vaccine effectiveness (VE) rely on accurate identification of vaccination and cases of vaccine-preventable disease. In practice, diagnostic tests, clinical case definitions and vaccination records often present inaccuracies, leading to biased VE estimates. Previous studies investigated the impact of non-differential disease misclassification on VE estimation.

Methods: We explored, through simulation, the impact of non-differential and differential disease- and exposure misclassification when estimating VE using cohort, case-control, test-negative case-control and case-cohort designs. The impact of misclassification on the estimated VE is demonstrated for VE studies on childhood seasonal influenza and pertussis vaccination. We additionally developed a web-application graphically presenting bias for user-selected parameters.

Results: Depending on the scenario, the misclassification parameters had differing impacts. Decreased exposure specificity had greatest impact for influenza VE estimation when vaccination coverage was low. Decreased exposure sensitivity had greatest impact for pertussis VE estimation for which high vaccination coverage is typically achieved. The impact of the exposure misclassification parameters was found to be more noticeable than that of the disease misclassification parameters. When misclassification is limited, all study designs perform equally. In case of substantial (differential) disease misclassification, the test-negative design performs worse.

Conclusions: Misclassification can lead to significant bias in VE estimates and its impact strongly depends on the scenario. We developed a web-application for assessing the potential (joint) impact of possibly differential disease- and exposure misclassification that can be modified by users to their own study scenario. Our results and the simulation tool may be used to guide better design, conduct and interpretation of future VE studies.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Bias
  • Child
  • Humans
  • Influenza Vaccines / therapeutic use*
  • Influenza, Human / epidemiology*
  • Influenza, Human / prevention & control
  • Models, Statistical
  • Pertussis Vaccine / therapeutic use*
  • Research Design*
  • Treatment Outcome
  • Vaccination / methods
  • Whooping Cough / epidemiology*
  • Whooping Cough / prevention & control

Substances

  • Influenza Vaccines
  • Pertussis Vaccine

Grants and funding

This research was funded by the Innovative Medicines Initiative (IMI) Joint Undertaking through the ADVANCE project [№ 115557]. The IMI is a joint initiative (public-private partnership) of the European Commission and the European Federation of Pharmaceutical Industries and Associations (EFPIA) to improve the competitive situation of the European Union in the field of pharmaceutical research. The IMI provided support in the form of salaries for TDS and KB, but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The work by EM and DM was covered by EFPIA’s in-kind contribution to IMI projects. SPV and NA did not receive any financial compensation for their contribution to this research. The specific roles of these authors are articulated in the ‘author contributions’ section.