Stakeholder-dependent views on biases of human- and machine-based judging systems

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2021
Major/Subject
Mcode
Degree programme
Language
en
Pages
10
6327-6336
Series
Proceedings of the 54th Hawaii International Conference on System Sciences
Abstract
Motivated by recent controversy over biases associated with algorithmic decision-making, we embarked on studying various stakeholders’ perceptions related to potential biases in verdicts from human-based and algorithm-based judging. In an empirical study conducted in the domain of gymnastics judging, we found that, while our informants viewed both human- and AI-based judging systems as being subject to biases (of different types), they were quite welcoming of a shift from human-based judging to machine-based judging. Our findings show that the athletes trusted strongly in unknown, “magic” capabilities of AI, thought to be more objective and impartial. This, in turn, encouraged potential acceptance of new technology. While the gymnasts saw AI-based systems in a positive light, judges demonstrated less favorable perceptions overall and less acceptance of AI technology, expressing concern about possible challenges of AI.
Description
Keywords
bias, case study, gymnastics, human-based judging, machine learning
Other note
Citation
Mazurova , E , Penttinen , E & Salovaara , A 2021 , Stakeholder-dependent views on biases of human- and machine-based judging systems . in Proceedings of the 54th Hawaii International Conference on System Sciences . Hawaii International Conference on System Sciences , pp. 6327-6336 , Annual Hawaii International Conference on System Sciences , Maui , Hawaii , United States , 07/01/2020 . < http://hdl.handle.net/10125/71383 >