Multiple output regression with latent noise
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2016-06-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
35
Series
Journal of Machine Learning Research, Volume 17, pp. 1-35
Abstract
In high-dimensional data, structured noise caused by observed and unobserved factors affecting multiple target variables simultaneously, imposes a serious challenge for modeling, by masking the often weak signal. Therefore, (1) explaining away the structured noise in multiple-output regression is of paramount importance. Additionally, (2) assumptions about the correlation structure of the regression weights are needed. We note that both can be formulated in a natural way in a latent variable model, in which both the interesting signal and the noise are mediated through the same latent factors. Under this assumption, the signal model then borrows strength from the noise model by encouraging similar effects on correlated targets. We introduce a hyperparameter for the latent signal-to-noise ratio which turns out to be important for modelling weak signals, and an ordered infinite-dimensional shrinkage prior that resolves the rotational unidentifiability in reduced-rank regression models. Simulations and prediction experiments with metabolite, gene expression, FMRI measurement, and macroeconomic time series data show that our model equals or exceeds the state-of-the-art performance and, in particular, outperforms the standard approach of assuming independent noise and signal models.Description
Keywords
Bayesian reduced-rank regression, Latent signal-to-noise ratio, Latent variable models, Multiple-output regression, Nonparametric Bayes, Shrinkage priors, Structured noise, Weak effects
Other note
Citation
Gillberg, L, Marttinen, P, Pirinen, M, Kangas, A J, Soininen, P, Ali, M, Havulinna, A S, Järvelin, M R, Ala-Korpela, M & Kaski, S 2016, ' Multiple output regression with latent noise ', Journal of Machine Learning Research, vol. 17, pp. 1-35 . < http://jmlr.org/papers/volume17/14-436/14-436.pdf >