Gated Boltzmann machine in texture modeling

No Thumbnail Available
Journal Title
Journal ISSN
Volume Title
School of Science | Master's thesis
Checking the digitized thesis and permission for publishing
Instructions for the author
Date
2012
Major/Subject
Informaatiotekniikka
Mcode
T-61
Degree programme
Language
en
Pages
(11) + 70 s. + liitt. 3
Series
Abstract
Recently, a new type of neural network method, namely deep learning, was discovered, which yielded excellent results in various tasks such as handwritten digit recognition, speech recognition and facial expression recognition. Different from traditional multi-layer perceptron learning methods (MLP), an unsupervised pre-training step before supervised learning is of huge importance in learning successful features. Also, it is argued that the deep architecture has more expressive power comparing to the conventional shallow networks, such as support vector machine or multi-layer perceptron's. Even though deep learning has yielded a large amount of world-class records in different tasks, there is little research on how the deep network can be used in texture analysis. For this particular problem, we consider the problem of modelling complex texture information using undirected probabilistic graphical models. Texture is a special type of data that one can better understand by considering its local structure. For that purpose, we propose a convolutional variant of the Gaussian gated Boltzmann machine (GGBM), inspired by the co-occurrence matrix in traditional texture analysis. We also link the proposed model to a much simpler Gaussian restricted Boltzmann machine where convolutional features are computed as a pre-processing step. The usefulness of the model is illustrated in texture classification and reconstruction experiments.
Description
Supervisor
Karhunen, Juha
Thesis advisor
Raiko, Tapani
Keywords
machine learning, unsupervised learning, deep learning, Boltzmann machine, texture analysis, pattern recognition
Other note
Citation