Breathing Life Into Biomechanical User Models

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2022-10-28
Major/Subject
Mcode
Degree programme
Language
en
Pages
14
1-14
Series
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
Abstract
Forward biomechanical simulation in HCI holds great promise as a tool for evaluation, design, and engineering of user interfaces. Although reinforcement learning (RL) has been used to simulate biomechanics in interaction, prior work has relied on unrealistic assumptions about the control problem involved, which limits the plausibility of emerging policies. These assumptions include direct torque actuation as opposed to muscle-based control; direct, privileged access to the external environment, instead of imperfect sensory observations; and lack of interaction with physical input devices. In this paper, we present a new approach for learning muscle-actuated control policies based on perceptual feedback in interaction tasks with physical input devices. This allows modelling of more realistic interaction tasks with cognitively plausible visuomotor control. We show that our simulated user model successfully learns a variety of tasks representing different interaction methods, and that the model exhibits characteristic movement regularities observed in studies of pointing. We provide an open-source implementation which can be extended with further biomechanical models, perception models, and interactive environments.
Description
Keywords
Other note
Citation
Ikkala, A, Fischer, F, Klar, M, Bachinski, M, Fleig, A, Howes, A, Hämäläinen, P, Müller, J, Murray-Smith, R & Oulasvirta, A 2022, Breathing Life Into Biomechanical User Models . in UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology ., 90, ACM, pp. 1-14, ACM Symposium on User Interface Software and Technology, Bend, Oregon, United States, 29/10/2022 . https://doi.org/10.1145/3526113.3545689