Approximate leave-future-out cross-validation for Bayesian time series models
Loading...
Access rights
openAccess
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal
View/Open full text file from the Research portal
Other link related to publication
View publication in the Research portal
View/Open full text file from the Research portal
Other link related to publication
Date
2020-06-25
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
25
1-25
1-25
Series
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION
Abstract
One of the common goals of time series analysis is to use the observed series to inform predictions for future observations. In the absence of any actual new data to predict, cross-validation can be used to estimate a model's future predictive accuracy, for instance, for the purpose of model comparison or selection. Exact cross-validation for Bayesian models is often computationally expensive, but approximate cross-validation methods have been developed, most notably methods for leave-one-out cross-validation (LOO-CV). If the actual prediction task is to predict the future given the past, LOO-CV provides an overly optimistic estimate because the information from future observations is available to influence predictions of the past. To properly account for the time series structure, we can use leave-future-out cross-validation (LFO-CV). Like exact LOO-CV, exact LFO-CV requires refitting the model many times to different subsets of the data. Using Pareto smoothed importance sampling, we propose a method for approximating exact LFO-CV that drastically reduces the computational costs while also providing informative diagnostics about the quality of the approximation.Description
Keywords
Bayesian inference, cross-Validation, pareto Smoothed importance sampling, Time series analysis
Other note
Citation
Bürkner, P C, Gabry, J & Vehtari, A 2020, ' Approximate leave-future-out cross-validation for Bayesian time series models ', JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, pp. 1-25 . https://doi.org/10.1080/00949655.2020.1783262
