Context Changes and the Performance of a Learning Human-in-the-loop System: A Case Study of Automatic Speech Recognition Use in Medical Transcription
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
10
Series
Proceedings of the 56th Hawaii International Conference on System Sciences, pp. 3121-3130
Abstract
The paper presents how organizational practices enable the improvement and maintenance of task performance in a learning human-in-the-loop system exposed to a wide range of context changes. We investigate how the case company tripled the efficiency of medical transcribers by leveraging its machine learning-based automatic speech recognition technology. We find that the focal system operated across stable, drifting, and jumping contexts. Despite changes, it continued to improve or maintained performance thanks to two sets of organizational practices aligning it with the context: extending and refining. This paper makes two key contributions: It shows the importance of considering context changes in the design and operation of learning human-in-the-loop systems. Our empirical findings help with resolving some contradictory outcomes of the recent conceptual work. Secondly, we show that context alignment practices are situated at the sociotechnical system level and, thus, are not just technical solution nor can be detached from social elements.Description
Other note
Citation
Mucha, T, Seppälä, J & Puraskivi, H 2023, Context Changes and the Performance of a Learning Human-in-the-loop System: A Case Study of Automatic Speech Recognition Use in Medical Transcription. in T X Bui (ed.), Proceedings of the 56th Hawaii International Conference on System Sciences. Hawaii International Conference on System Sciences, pp. 3121-3130, Annual Hawaii International Conference on System Sciences, Maui, Hawaii, United States, 03/01/2023. < https://hdl.handle.net/10125/103014 >