Cortex inspired network architectures for spatio-temporal information processing

Thumbnail Image

URL

Journal Title

Journal ISSN

Volume Title

School of Science | Master's thesis
Checking the digitized thesis and permission for publishing
Instructions for the author

Authors

Date

2013

Department

Perustieteiden korkeakoulu

Major/Subject

Informaatiotekniikka

Mcode

T-61

Degree programme

Language

en

Pages

v + 95

Series

Abstract

The abundance of high-dimensional datasets provides scientists with a strong foundation in their research. With high-performance computing platforms becoming increasingly available and more powerful, large-scale data processing represents an important step toward modelling and understanding the underlying processes behind such data. In this thesis, we propose general cortex-inspired information processing network architecture capable of capturing spatio-temporal correlations in data and forming distributed representations as cortical activation patterns. The proposed architecture has a modular and multi-layered organization which is efficiently parallelized to allow large-scale computations. The network allows unsupervised processing of multivariate stochastic time series, irregardless of the data source, producing a sparse de-correlated representation of the input features expanded by time delays. The features extracted by the architecture are then used for supervised learning with Bayesian confidence propagation neural networks and evaluated on speech classification and recognition tasks, exploited auditory signals for speech recognition as a use case for performance evaluation. In terms of classification performance, the proposed architecture outperforms modern machine-learning methods such as support vector machines and obtains results comparable to other state-of-the-art speech recognition methods. The potential of the proposed scalable cortex-inspired approach to capture meaningful multivariate temporal correlations and provide insight into the model-free high-dimensional data decomposition basis is expected to be of particular use in the analysis of large brain signal datasets such as EEG or MEG.

Description

Supervisor

Herman, Pawel|Vigário, Ricardo

Thesis advisor

Herman, Pawel

Keywords

cortical models, large-scale data analysis, spatio-temporal recognition, speech recognition, brain signal processing

Other note

Citation

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-2020122859936

Collections

[dipl] Perustieteiden korkeakoulu / SCI