Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging

Loading...
Thumbnail Image

Access rights

openAccess
publishedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

Major/Subject

Mcode

Degree programme

Language

en

Pages

Series

Proceedings of the 24th Nordic Conference on Computational Linguistics, pp. 358-365

Abstract

This paper introduces Bayesian uncertainty modeling using Stochastic Weight Averaging-Gaussian (SWAG) in Natural Language Understanding (NLU) tasks. We apply the approach to standard tasks in natural language inference (NLI) and demonstrate the effectiveness of the method in terms of prediction accuracy and correlation with human annotation disagreements. We argue that the uncertainty representations in SWAG better reflect subjective interpretation and the natural variation that is also present in human language understanding. The results reveal the importance of uncertainty modeling, an often neglected aspect of neural language modeling, in NLU tasks.

Description

| openaire: EC/H2020/771113/EU//FoTran

Keywords

Other note

Citation

Talman, A, Celikkanat, H, Virpioja, S, Heinonen, M & Tiedemann, J 2023, Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging. in Proceedings of the 24th Nordic Conference on Computational Linguistics. University of Tartu Library, pp. 358-365, Nordic Conference on Computational Linguistics, Tórshavn, Faroe Islands, 22/05/2023. < https://aclanthology.org/2023.nodalida-1.37/ >