Deconfounded Representation Similarity for Comparison of Neural Networks
Loading...
Access rights
openAccess
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
14
Series
Advances in Neural Information Processing Systems 35 (NeurIPS 2022), Advances in Neural Information Processing Systems ; Volume 35
Abstract
Similarity metrics such as representational similarity analysis (RSA) and centered kernel alignment (CKA) have been used to understand neural networks by comparing their layer-wise representations. However, these metrics are confounded by the population structure of data items in the input space, leading to inconsistent conclusions about the \emph{functional} similarity between neural networks, such as spuriously high similarity of completely random neural networks and inconsistent domain relations in transfer learning. We introduce a simple and generally applicable fix to adjust for the confounder with covariate adjustment regression, which improves the ability of CKA and RSA to reveal functional similarity and also retains the intuitive invariance properties of the original similarity measures. We show that deconfounding the similarity metrics increases the resolution of detecting functionally similar neural networks across domains. Moreover, in real-world applications, deconfounding improves the consistency between CKA and domain similarity in transfer learning, and increases the correlation between CKA and model out-of-distribution accuracy similarity.Description
| openaire: EC/H2020/951847/EU//ELISE | openaire: EC/H2020/101016775/EU//INTERVENE
Other note
Citation
Cui, T, Kumar, Y, Marttinen, P & Kaski, S 2022, Deconfounded Representation Similarity for Comparison of Neural Networks. in S Koyejo, S Mohamed, A Agarwal, D Belgrave, K Cho & A Oh (eds), Advances in Neural Information Processing Systems 35 (NeurIPS 2022). Advances in Neural Information Processing Systems, vol. 35, Morgan Kaufmann Publishers, Conference on Neural Information Processing Systems, New Orleans, Louisiana, United States, 28/11/2022. < https://arxiv.org/abs/2202.00095 >