Chartist: Task-driven Eye Movement Control for Chart Reading
Loading...
Access rights
openAccess
CC BY
CC BY
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
Series
CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Abstract
To design data visualizations that are easy to comprehend, we need to understand how people with different interests read them. Computational models of predicting scanpaths on charts could complement empirical studies by offering estimates of user performance inexpensively; however, previous models have been limited to gaze patterns and overlooked the effects of tasks. Here, we contribute Chartist, a computational model that simulates how users move their eyes to extract information from the chart in order to perform analysis tasks, including value retrieval, filtering, and finding extremes. The novel contribution lies in a two-level hierarchical control architecture. At the high level, the model uses LLMs to comprehend the information gained so far and applies this representation to select a goal for the lower-level controllers, which, in turn, move the eyes in accordance with a sampling policy learned via reinforcement learning. The model is capable of predicting human-like task-driven scanpaths across various tasks. It can be applied in fields such as explainable AI, visualization design evaluation, and optimization. While it displays limitations in terms of generalizability and accuracy, it takes modeling in a promising direction, toward understanding human behaviors in interacting with charts.Description
| openaire: EC/HE/101141916/EU//Artificial User
Keywords
Other note
Citation
Shi, D, Wang, Y, Bai, Y, Bulling, A & Oulasvirta, A 2025, Chartist: Task-driven Eye Movement Control for Chart Reading. in CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems., 1167, ACM, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Yokohama, Japan, 26/04/2025. https://doi.org/10.1145/3706598.3713128