Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
Series
Proceedings of the 24th Nordic Conference on Computational Linguistics, pp. 358-365
Abstract
This paper introduces Bayesian uncertainty modeling using Stochastic Weight Averaging-Gaussian (SWAG) in Natural Language Understanding (NLU) tasks. We apply the approach to standard tasks in natural language inference (NLI) and demonstrate the effectiveness of the method in terms of prediction accuracy and correlation with human annotation disagreements. We argue that the uncertainty representations in SWAG better reflect subjective interpretation and the natural variation that is also present in human language understanding. The results reveal the importance of uncertainty modeling, an often neglected aspect of neural language modeling, in NLU tasks.Description
| openaire: EC/H2020/771113/EU//FoTran
Keywords
Other note
Citation
Talman, A, Celikkanat, H, Virpioja, S, Heinonen, M & Tiedemann, J 2023, Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging. in Proceedings of the 24th Nordic Conference on Computational Linguistics. University of Tartu Library, pp. 358-365, Nordic Conference on Computational Linguistics, Tórshavn, Faroe Islands, 22/05/2023. < https://aclanthology.org/2023.nodalida-1.37/ >