Projection Predictive Inference for Generalized Linear and Additive Multilevel Models
Loading...
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2022
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
16
Series
INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, Proceedings of Machine Learning Research, Volume 151
Abstract
Projection predictive inference is a decision theoretic Bayesian approach that decouples model estimation from decision making. Given a reference model previously built including all variables present in the data, projection predictive inference projects its posterior onto a constrained space of a subset of variables. Variable selection is then performed by sequentially adding relevant variables until predictive performance is satisfactory. Previously, projection predictive inference has been demonstrated only for generalized linear models (GLMs) and Gaussian processes (GPs) where it showed superior performance to competing variable selection procedures. In this work, we extend projection predictive inference to support variable and structure selection for generalized linear multilevel models (GLMMs) and generalized additive multilevel models (GAMMs). Our simulative and real-world experiments demonstrate that our method can drastically reduce the model complexity required to reach reference predictive performance and achieve good frequency properties.Description
Keywords
BAYESIAN VARIABLE SELECTION, MAXIMUM-LIKELIHOOD, REGULARIZATION, HORSESHOE, SHRINKAGE
Other note
Citation
Catalina, A, Burkner, P & Vehtari, A 2022, Projection Predictive Inference for Generalized Linear and Additive Multilevel Models . in G Camps-Valls, FJR Ruiz & Valera (eds), INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151 . Proceedings of Machine Learning Research, vol. 151, JMLR, International Conference on Artificial Intelligence and Statistics, Valencia, Spain, 28/03/2022 . < https://proceedings.mlr.press/v151/catalina22a.html >