Bayesian leave-one-out cross-validation for large data

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2019
Major/Subject
Mcode
Degree programme
Language
en
Pages
10
Series
Proceedings of the 36th International Conference on Machine Learning, Proceedings of Machine Learning Research, Volume 97
Abstract
Model inference, such as model comparison, model checking, and model selection, is an important part of model development. Leave-one-out cross-validation (LOO) is a general approach for assessing the generalizability of a model, but unfortunately, LOO does not scale well to large datasets. We propose a combination of using approximate inference techniques and probability-proportional-to-size-sampling (PPS) for fast LOO model evaluation for large datasets. We provide both theoretical and empirical results showing good properties for large data.
Description
Keywords
Other note
Citation
Magnusson , M , Andersen , M , Jonasson , J & Vehtari , A 2019 , Bayesian leave-one-out cross-validation for large data . in 36th International Conference on Machine Learning, ICML 2019 . Proceedings of Machine Learning Research , vol. 97 , JMLR , International Conference on Machine Learning , Long Beach , California , United States , 09/06/2019 . < http://proceedings.mlr.press/v97/magnusson19a.html >