Likelihood-Free Inference with Deep Gaussian Processes

Surrogate models have been successfully used in likelihood-free inference to decrease the number of simulator evaluations. The current state-of-the-art performance for this task has been achieved by Bayesian Optimization with Gaussian Processes (GPs). While this combination works well for unimodal target distributions, it is restricting the flexibility and applicability of Bayesian Optimization for accelerating likelihood-free inference more generally. This problem is addressed by proposing a Deep Gaussian Process (DGP) surrogate model that can handle more irregularly behaved target distributions. The experiments show how DGPs can outperform GPs on objective functions with multimodal distributions and maintain a comparable performance in unimodal cases. At the same time, DGPs generally require much fewer data to achieve the same level of performance as neural density and kernel mean embedding alternatives. This confirms that DGPs as surrogate models can extend the applicability of Bayesian Optimization for likelihood-free inference (BOLFI), while only adding computational overhead that remains negligible for computationally intensive simulators.

DOI

10.1016/j.csda.2022.107529

Citation

Aushev, A, Pesonen, H, Heinonen, M, Corander, J & Kaski, S 2022, 'Likelihood-Free Inference with Deep Gaussian Processes', Computational Statistics & Data Analysis, vol. 174, 107529, pp. 1-19. https://doi.org/10.1016/j.csda.2022.107529

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202210195969

Collections

[article-cris] Perustieteiden korkeakoulu / SCI

Show all metadata

Likelihood-Free Inference with Deep Gaussian Processes

Access rights

URL

Journal Title

Journal ISSN

Volume Title

Authors

Date

Department

Major/Subject

Mcode

Degree programme

Language

Pages

Series

Abstract

Description

Keywords

Other note

DOI

Citation

Permanent link to this item

Collections