Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorRiutort-Mayol, Gabriel
dc.contributor.authorBürkner, Paul Christian
dc.contributor.authorAndersen, Michael R.
dc.contributor.authorSolin, Arno
dc.contributor.authorVehtari, Aki
dc.contributor.departmentFoundation for the Promotion of Health and Biomedical Research of Valencia Region
dc.contributor.departmentDepartment of Computer Science
dc.contributor.departmentTechnical University of Denmark
dc.contributor.departmentComputer Science Professors
dc.date.accessioned2023-01-02T09:29:40Z
dc.date.available2023-01-02T09:29:40Z
dc.date.issued2023-02
dc.descriptionFunding Information: We thank Academy of Finland (Grants 298742, 308640, and 313122), Instituto de Salud Carlos III, Spain (Grant CD21/00186 - Sara Borrell Postdoctoral Fellowship) and co-funded by the European Union, Finnish Center for Artificial Intelligence, and Technology Industries of Finland Centennial Foundation (Grant 70007503; Artificial Intelligence for Research and Development), and Conselleria de Innovación, Universidades, Ciencia y Sociedad Digital, Generalitat Valenciana, Spain (Grant AICO/2020/285) for partial support of this research. We also acknowledge the computational resources provided by the Aalto Science-IT project. Publisher Copyright: © 2022, The Author(s).
dc.description.abstractGaussian processes are powerful non-parametric probabilistic models for stochastic functions. However, the direct implementation entails a complexity that is computationally intractable when the number of observations is large, especially when estimated with fully Bayesian methods such as Markov chain Monte Carlo. In this paper, we focus on a low-rank approximate Bayesian Gaussian processes, based on a basis function approximation via Laplace eigenfunctions for stationary covariance functions. The main contribution of this paper is a detailed analysis of the performance, and practical recommendations for how to select the number of basis functions and the boundary factor. Intuitive visualizations and recommendations, make it easier for users to improve approximation accuracy and computational performance. We also propose diagnostics for checking that the number of basis functions and the boundary factor are adequate given the data. The approach is simple and exhibits an attractive computational complexity dueto its linear structure, and it is easy to implement in probabilistic programming frameworks. Several illustrative examples of the performance and applicability of the method in the probabilistic programming language Stan are presented together with the underlying Stan model code.en
dc.description.versionPeer revieweden
dc.format.extent28
dc.format.extent1-28
dc.format.mimetypeapplication/pdf
dc.identifier.citationRiutort-Mayol , G , Bürkner , P C , Andersen , M R , Solin , A & Vehtari , A 2023 , ' Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming ' , STATISTICS AND COMPUTING , vol. 33 , no. 1 , 17 , pp. 1-28 . https://doi.org/10.1007/s11222-022-10167-2en
dc.identifier.doi10.1007/s11222-022-10167-2
dc.identifier.issn0960-3174
dc.identifier.otherPURE UUID: cd30fff6-ad75-45cb-a053-dc0fe21357ad
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/cd30fff6-ad75-45cb-a053-dc0fe21357ad
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85143802999&partnerID=8YFLogxK
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/95901670/Practical_Hilbert_space_approximate_Bayesian_Gaussian_processes_for_probabilistic_programming.pdf
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/118699
dc.identifier.urnURN:NBN:fi:aalto-202301021061
dc.language.isoenen
dc.publisherSPRINGER
dc.relation.ispartofseriesSTATISTICS AND COMPUTINGen
dc.relation.ispartofseriesVolume 33, issue 1en
dc.rightsopenAccessen
dc.subject.keywordBayesian statistics
dc.subject.keywordGaussian process
dc.subject.keywordHilbert space methods
dc.subject.keywordLow-rank Gaussian process
dc.subject.keywordSparse Gaussian process
dc.subject.keywordStan
dc.titlePractical Hilbert space approximate Bayesian Gaussian processes for probabilistic programmingen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion
Files