Predicting Mid-Air Interaction Movements and Fatigue Using Deep Reinforcement Learning
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2020
Major/Subject
Mcode
Degree programme
Language
en
Pages
13
Series
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13
Abstract
A common problem of mid-air interaction is excessive arm fatigue, known as the "Gorilla arm" effect. To predict and prevent such problems at a low cost, we investigate user testing of mid-air interaction without real users, utilizing biomechanically simulated AI agents trained using deep Reinforcement Learning (RL). We implement this in a pointing task and four experimental conditions, demonstrating that the simulated fatigue data matches human fatigue data. We also compare two effort models: 1) instantaneous joint torques commonly used in computer animation and robotics, and 2) the recent Three Compartment Controller (3CC-) model from biomechanical literature. 3CC- yields movements that are both more efficient and relaxed, whereas with instantaneous joint torques, the RL agent can easily generate movements that are quickly tiring or only reach the targets slowly and inaccurately. Our work demonstrates that deep RL combined with the 3CC- provides a viable tool for predicting both interaction movements and user experiencein silico, without users.Description
Keywords
biomechanical simulation, reinforcement learning, computational interaction, user modeling
Other note
Citation
Cheema, N, Frey-Law, L A, Naderi, K, Lehtinen, J, Slusallek, P & Hämäläinen, P 2020, Predicting Mid-Air Interaction Movements and Fatigue Using Deep Reinforcement Learning . in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems ., 572, ACM, New York, NY, USA, pp. 1–13, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Honolulu, Hawaii, United States, 26/04/2020 . https://doi.org/10.1145/3313831.3376701