Stakeholder-dependent views on biases of human- and machine-based judging systems
Conference article in proceedings
Proceedings of the 54th Hawaii International Conference on System Sciences
AbstractMotivated by recent controversy over biases associated with algorithmic decision-making, we embarked on studying various stakeholders’ perceptions related to potential biases in verdicts from human-based and algorithm-based judging. In an empirical study conducted in the domain of gymnastics judging, we found that, while our informants viewed both human- and AI-based judging systems as being subject to biases (of different types), they were quite welcoming of a shift from human-based judging to machine-based judging. Our findings show that the athletes trusted strongly in unknown, “magic” capabilities of AI, thought to be more objective and impartial. This, in turn, encouraged potential acceptance of new technology. While the gymnasts saw AI-based systems in a positive light, judges demonstrated less favorable perceptions overall and less acceptance of AI technology, expressing concern about possible challenges of AI.
bias, case study, gymnastics, human-based judging, machine learning
Mazurova , E , Penttinen , E & Salovaara , A 2021 , Stakeholder-dependent views on biases of human- and machine-based judging systems . in Proceedings of the 54th Hawaii International Conference on System Sciences . Hawaii International Conference on System Sciences , pp. 6327-6336 , Annual Hawaii International Conference on System Sciences , Maui , Hawaii , United States , 07/01/2020 . < http://hdl.handle.net/10125/71383 >