Spatio-temporal variational Gaussian processes

We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales linearly with respect to time. Our natural gradient approach enables application of parallel filtering and smoothing, further reducing the temporal span complexity to be logarithmic in the number of time steps. We derive a sparse approximation that constructs a state-space model over a reduced set of spatial inducing points, and show that for separable Markov kernels the full and sparse cases exactly recover the standard variational GP, whilst exhibiting favourable computational properties. To further improve the spatial scaling we propose a mean-field assumption of independence between spatial locations which, when coupled with sparsity and parallelisation, leads to an efficient and accurate method for large spatio-temporal problems.

Citation

Hamelijnck, O, Wilkinson, W, Loppi, N, Solin, A & Damoulas, T 2021, Spatio-temporal variational Gaussian processes. in Advances in Neural Information Processing Systems 34 (NeurIPS 2021). Advances in Neural Information Processing Systems, Morgan Kaufmann Publishers, Conference on Neural Information Processing Systems, Virtual, Online, 06/12/2021. < https://papers.nips.cc/paper/2021/hash/c6b8c8d762da15fa8dbbdfb6baf9e260-Abstract.html >

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202202091811

Collections

[article-cris] Perustieteiden korkeakoulu / SCI

Show all metadata

Spatio-temporal variational Gaussian processes

Access rights

URL

Journal Title

Journal ISSN

Volume Title

Authors

Date

Department

Major/Subject

Mcode

Degree programme

Language

Pages

Series

Abstract

Description

Keywords

Other note

Citation

Permanent link to this item

Collections