On optimality of kernels for approximate Bayesian computation using sequential Monte Carlo

Stat Appl Genet Mol Biol. 2013 Mar 26;12(1):87-107. doi: 10.1515/sagmb-2012-0069.

Abstract

Approximate Bayesian computation (ABC) has gained popularity over the past few years for the analysis of complex models arising in population genetics, epidemiology and system biology. Sequential Monte Carlo (SMC) approaches have become work-horses in ABC. Here we discuss how to construct the perturbation kernels that are required in ABC SMC approaches, in order to construct a sequence of distributions that start out from a suitably defined prior and converge towards the unknown posterior. We derive optimality criteria for different kernels, which are based on the Kullback-Leibler divergence between a distribution and the distribution of the perturbed particles. We will show that for many complicated posterior distributions, locally adapted kernels tend to show the best performance. We find that the added moderate cost of adapting kernel functions is easily regained in terms of the higher acceptance rate. We demonstrate the computational efficiency gains in a range of toy examples which illustrate some of the challenges faced in real-world applications of ABC, before turning to two demanding parameter inference problems in molecular biology, which highlight the huge increases in efficiency that can be gained from choice of optimal kernels. We conclude with a general discussion of the rational choice of perturbation kernels in ABC SMC settings.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Animals
  • Basic Helix-Loop-Helix Transcription Factors / genetics
  • Basic Helix-Loop-Helix Transcription Factors / metabolism
  • Bayes Theorem
  • Computer Simulation*
  • Gene Expression Regulation
  • Homeodomain Proteins / genetics
  • Homeodomain Proteins / metabolism
  • Humans
  • Likelihood Functions
  • Models, Biological*
  • Monte Carlo Method
  • Multivariate Analysis
  • Transcription Factor HES-1

Substances

  • Basic Helix-Loop-Helix Transcription Factors
  • Homeodomain Proteins
  • Transcription Factor HES-1
  • HES1 protein, human