Modeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning
Loading...
Access rights
openAccess
acceptedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
18
Series
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)
Abstract
Although menu selection has been extensively studied in HCI, most existing studies have focused on sighted users, leaving blind users' menu selection under-studied. In this paper, we propose a computational model that can simulate blind users' menu selection performance and strategies, including the way they use techniques like swiping, gliding, and direct touch. We assume that selection behavior emerges as an adaptation to the user's memory of item positions based on experience and feedback from the screen reader. A key aspect of our model is a model of long-term memory, predicting how a user recalls and forgets item position based on previous menu selections. We compare simulation results predicted by our model against data obtained in an empirical study with ten blind users. The model correctly simulated the effect of the menu length and menu arrangement on selection time, the action composition, and the menu selection strategy of the users.Description
Other note
Citation
Li, Z, Ko, Y-J, Putkonen, A, Feiz, S, Ashok, V, Ramakrishnan, I V, Oulasvirta, A & Bi, X 2023, Modeling Touch-based Menu Selection Performance of Blind Users via Reinforcement Learning. in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23)., 357, ACM, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Hamburg, Germany, 23/04/2023. https://doi.org/10.1145/3544548.3580640