Stochastic Discriminant Analysis for Linear Supervised Dimension Reduction
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Date
2018
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
15
Series
Neurocomputing, Volume 291, pp. 136-150
Abstract
In this paper, we consider a linear supervised dimension reduction method for classification settings: stochastic discriminant analysis (SDA). This method matches similarities between points in the projection space with those in a response space. The similarities are represented by transforming distances between points to joint probabilities using a transformation which resembles Student’s t-distribution. The matching is done by minimizing the Kullback–Leibler divergence between the two probability distributions. We compare the performance of our SDA method against several state-of-the-art methods for supervised linear dimension reduction. In our experiments, we found that the performance of the SDA method is often better and typically at least equal to the compared methods. We have made experiments with various types of data sets having low, medium, or high dimensions and quite different numbers of samples, and with both sparse and dense data sets. If there are several classes in the studied data set, the low-dimensional projections computed using our SDA method provide often higher classification accuracies than the compared methods.Description
Keywords
Dimension reduction, Supervised learning, Linear model, Classification, Linear projection, Kullback–Leibler divergence, Information visualization, Distance based probabilities
Other note
Citation
Juuti, M, Corona, F & Karhunen, J 2018, ' Stochastic Discriminant Analysis for Linear Supervised Dimension Reduction ', Neurocomputing, vol. 291, pp. 136-150 . https://doi.org/10.1016/j.neucom.2018.02.064