Interpretable artificial neural networks for fMRI data classification

Abstract

Functional magnetic resonance imaging (fMRI) technology allows non-invasive measurement of neuronal activity in the human brain with a combination of reasonable temporal and fine spatial resolution. Recently, multivariate methods have attracted attention in fMRI data analysis to study task-related activation patterns. Concurrent research in the field of machine learning has led to the establishment of inherently multivariate computational graphs that facilitate efficient, robust and interpretable classification of fMRI data.

Here we studied methods for classification of fMRI data based on neural networks. In particular, we focused on techniques that assess the contribution of different brain regions to the classification result, referred to as "importance maps" and proposed novel neuroscientifically motivated architectures.

In the first study, we successfully classified basic emotions from fMRI data, elicited by short movies and mental imagery, generating whole brain importance maps indicating the contribution of individual voxels to the classification result.

The second study provided a comparison of importance extraction methods and their reproducibility, applied to both simulated and real data sets, revealing patterns that do not convey significant univariate information.

The third study examined the effect of distractors in visual imagery using classification methods and importance map extraction, identifying robust activation patterns related to shape imagery and a visual distractor in object-selective lateral extrastriate cortex at the junction of left occipital, temporal and parietal lobes.

The fourth study examined the use of anatomically driven topologies based on spatial information. In particular, the addition of layers motivated by voxel proximity and brain atlases to the model, led to an increase in the classification accuracy and produced smoother and more interpretable importance maps.

The purpose of this thesis is to showcase machine learning techniques specifically designed for analyzing neuroscience data. This work aims to motivate further research towards the use of machine learning as a means to gain a better understanding of the human brain.