Adapting Interaction Based on Users' Visual Attention
Loading...
Journal Title
Journal ISSN
Volume Title
School of Arts, Design and Architecture |
Doctoral thesis (article-based)
| Defence date: 2020-06-11
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Author
Date
2020
Department
Muotoilun laitos
Department of Design
Department of Design
Major/Subject
Mcode
Degree programme
Language
en
Pages
154
Series
Aalto University publication series DOCTORAL DISSERTATIONS, 72/2020
Abstract
Successful interaction with many information systems depends on our ability to visually attend to the system feedback as well as to our own actions. However, at a given time, we are able to attend to only a portion of the available information. Among other constraints, what can we attend is limited by the spatial acuity of our eyes. Aware of this limitation, researchers have long pursued interfaces that decrease our dependence on visual attention during interaction. The newly proliferating sensing technologies such as eye and head tracking as well as methods for user modeling provide a novel venue for addressing this limitation: An information system can utilize users' visual attention information to change how it responds to user actions. This thesis contributes design knowledge about adapting the interaction based on users' level of visual monitoring during input through a series of prototypes that have been developed for different use cases. I first distinguish between different implications of visual attention information for interface design, and identify visual attention as a measure of user awareness as the main focus of the work presented in this thesis. Lack of visual attention during input decreases users' awareness of the environment. In these cases, the system can adapt the interaction through a number of methods such as handling input more flexibly or remediating the lack of visual attention through novel visual feedback techniques. These interaction methods have been formulated as part of a constructive research program and applied to single-user applications that require users to split their visual attention between multiple interface regions during pointing and also to collocated and synchronous multi-user applications. User studies provide evidence for the increased uncertainty during input with low visual attention and also show in which situations these interaction techniques can improve performance. The dissertation discusses these empirical findings in terms of the previously identified trade-offs between time and spatial multiplexing, and between predictability and adaptiveness in interface design. The thesis also makes a theoretical contribution to the general design challenge of building adaptive or context aware systems through an analysis of the concept implicit interaction. Overall, the thesis contributes to the existing line of work on attentive interfaces by developing interaction methods that specifically target handling user input with low visual attention, and contributes to the ongoing discussions about the integration of eye tracking into human–computer interaction.Description
The full text (PDF file) of this dissertation will be published on Open Internet on 11th June 2020.
The public defense on 11th June 2020 at 12:00 will be available via remote technology.
Link: https://aalto.zoom.us/j/66812379829
Zoom Quick Guide: https://www.aalto.fi/en/services/zoom-quick-guide
Electronic online display version of the doctoral thesis is available by email by request from aaltodoc-diss@aalto.fi
Supervising professor
Keinonen, Turkka, Prof., Aalto University, Department of Design, FinlandThesis advisor
Jacucci, Giulio, Prof., University of Helsinki, FinlandKeywords
visual attention, interface design, information systems, human-computer interaction
Other note
Parts
-
[Publication 1]: Barıs¸ Serim, Giulio Jacucci. Pointing while Looking Elsewhere: Designing for Varying Degrees of Visual Guidance during Manual Input. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5789-5800, May 2016. Full text is included in the PDF file of the dissertation.
DOI: 10.1145/2858036.2858480 View at publisher
-
[Publication 2]: Barıs¸ Serim, Khalil Klouche, Giulio Jacucci. Gaze-Adaptive Above and On-Surface Interaction. In Proceedings of the 2017 Conference on Designing Interactive Systems, 115-127, June 2017. Full text is included in the PDF file of the dissertation.
DOI: 10.1145/3064663.3064744 View at publisher
-
[Publication 3]: Barıs¸ Serim, Ken Pfeuffer, Hans Gellersen, Giulio Jacucci. Visual Attention- Based Access: Granting Access Based on Users’ Joint Attention on Shared Workspaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2, 3, Article No. 133, September 2018. Full text is included in the PDF file of the dissertation.
DOI: 10.1145/3264943 View at publisher
-
[Publication 4]: Barıs¸ Serim, Giulio Jacucci. Explicating “Implicit Interaction”: An Examination of the Concept and Challenges for Research. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Paper No. 417, May 2019. Full text is included in the PDF file of the dissertation.
DOI: 10.1145/3290605.3300647 View at publisher
