aalto1 untyped-item.component.html
VMS : Interactive Visualization to Support the Sensemaking and Selection of Predictive Models
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Date
Department
Major/Subject
Mcode
Degree programme
Language
en
Pages
16
Series
Proceedings of 2024 29th Annual Conference on Intelligent User Interfaces, IUI 2024, pp. 229-244, ACM International Conference Proceeding Series
Abstract
To compare and select machine learning models, relying on performance measures alone may not always be sufficient. This is particularly the case where different subsets, features, and predicted results may vary in importance relative to the task at hand. Explanation and visualization techniques are required to support model sensemaking and informed decision-making. However, a review shows that existing systems are mostly designed for model developers and not evaluated with target users in their effectiveness. To address this issue, this research proposes an interactive visualization, VMS (Visualization for Model Sensemaking and Selection), for users of the model to compare and select predictive models. VMS integrates performance-, instance-, and feature-level analysis to evaluate models from multiple angles. Particularly, a feature view integrating the value and contribution of hundreds of features supports model comparison on local and global scales. We exemplified VMS for comparing models predicting patients' hospital length of stay through time-series health records and evaluated the prototype with 16 participants from the medical field. Results reveal evidence that VMS supports users to rationalize models in multiple ways and enables users to select the optimal models with a small sample size. User feedback suggests future directions on incorporating domain knowledge in model training, such as for different patient groups considering different sets of features as important.
Description
Publisher Copyright: © 2024 Owner/Author.
Keywords
Other note
Citation
He, C, Raj, V, Moen, H, Gröhn, T, Wang, C, Peltonen, L M, Koivusalo, S, Marttinen, P & Jacucci, G 2024, VMS : Interactive Visualization to Support the Sensemaking and Selection of Predictive Models. in Proceedings of 2024 29th Annual Conference on Intelligent User Interfaces, IUI 2024. ACM International Conference Proceeding Series, ACM, pp. 229-244, International Conference on Intelligent User Interfaces, Greenville, South Carolina, United States, 18/03/2024. https://doi.org/10.1145/3640543.3645151