Adapting Interaction Based on Users' Visual Attention

Simple item page
dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.advisorJacucci, Giulio, Prof., University of Helsinki, Finland
dc.contributor.authorSerim, Barış
dc.contributor.departmentMuotoilun laitosfi
dc.contributor.departmentDepartment of Designen
dc.contributor.schoolTaiteiden ja suunnittelun korkeakoulufi
dc.contributor.schoolSchool of Arts, Design and Architectureen
dc.contributor.supervisorKeinonen, Turkka, Prof., Aalto University, Department of Design, Finland
dc.date.accessioned2020-05-28T09:00:05Z
dc.date.available2020-05-28T09:00:05Z
dc.date.defence2020-06-11
dc.date.issued2020
dc.descriptionThe full text (PDF file) of this dissertation will be published on Open Internet on 11th June 2020. The public defense on 11th June 2020 at 12:00 will be available via remote technology. Link: https://aalto.zoom.us/j/66812379829 Zoom Quick Guide: https://www.aalto.fi/en/services/zoom-quick-guide Electronic online display version of the doctoral thesis is available by email by request from aaltodoc-diss@aalto.fi
dc.description.abstractSuccessful interaction with many information systems depends on our ability to visually attend to the system feedback as well as to our own actions. However, at a given time, we are able to attend to only a portion of the available information. Among other constraints, what can we attend is limited by the spatial acuity of our eyes. Aware of this limitation, researchers have long pursued interfaces that decrease our dependence on visual attention during interaction. The newly proliferating sensing technologies such as eye and head tracking as well as methods for user modeling provide a novel venue for addressing this limitation: An information system can utilize users' visual attention information to change how it responds to user actions.  This thesis contributes design knowledge about adapting the interaction based on users' level of visual monitoring during input through a series of prototypes that have been developed for different use cases. I first distinguish between different implications of visual attention information for interface design, and identify visual attention as a measure of user awareness as the main focus of the work presented in this thesis. Lack of visual attention during input decreases users' awareness of the environment. In these cases, the system can adapt the interaction through a number of methods such as handling input more flexibly or remediating the lack of visual attention through novel visual feedback techniques. These interaction methods have been formulated as part of a constructive research program and applied to single-user applications that require users to split their visual attention between multiple interface regions during pointing and also to collocated and synchronous multi-user applications. User studies provide evidence for the increased uncertainty during input with low visual attention and also show in which situations these interaction techniques can improve performance. The dissertation discusses these empirical findings in terms of the previously identified trade-offs between time and spatial multiplexing, and between predictability and adaptiveness in interface design. The thesis also makes a theoretical contribution to the general design challenge of building adaptive or context aware systems through an analysis of the concept implicit interaction.  Overall, the thesis contributes to the existing line of work on attentive interfaces by developing interaction methods that specifically target handling user input with low visual attention, and contributes to the ongoing discussions about the integration of eye tracking into human–computer interaction.en
dc.format.extent154
dc.identifier.isbn978-952-60-3873-5 (electronic)
dc.identifier.isbn978-952-60-3870-4 (printed)
dc.identifier.issn1799-4942 (electronic)
dc.identifier.issn1799-4934 (printed)
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/44382
dc.identifier.urnURN:ISBN:978-952-60-3873-5
dc.language.isoenen
dc.opnWensveen, Stephan, Prof., Eindhoven University of Technology, Netherlands
dc.publisherAalto Universityen
dc.publisherAalto-yliopistofi
dc.relation.haspart[Publication 1]: Barıs¸ Serim, Giulio Jacucci. Pointing while Looking Elsewhere: Designing for Varying Degrees of Visual Guidance during Manual Input. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5789-5800, May 2016. Full text is included in the PDF file of the dissertation. DOI: 10.1145/2858036.2858480
dc.relation.haspart[Publication 2]: Barıs¸ Serim, Khalil Klouche, Giulio Jacucci. Gaze-Adaptive Above and On-Surface Interaction. In Proceedings of the 2017 Conference on Designing Interactive Systems, 115-127, June 2017. Full text is included in the PDF file of the dissertation. DOI: 10.1145/3064663.3064744
dc.relation.haspart[Publication 3]: Barıs¸ Serim, Ken Pfeuffer, Hans Gellersen, Giulio Jacucci. Visual Attention- Based Access: Granting Access Based on Users’ Joint Attention on Shared Workspaces. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2, 3, Article No. 133, September 2018. Full text is included in the PDF file of the dissertation. DOI: 10.1145/3264943
dc.relation.haspart[Publication 4]: Barıs¸ Serim, Giulio Jacucci. Explicating “Implicit Interaction”: An Examination of the Concept and Challenges for Research. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Paper No. 417, May 2019. Full text is included in the PDF file of the dissertation. DOI: 10.1145/3290605.3300647
dc.relation.ispartofseriesAalto University publication series DOCTORAL DISSERTATIONSen
dc.relation.ispartofseries72/2020
dc.revGutwin, Carl, Prof., University of Saskatchewan, Canada
dc.revDachselt, Raimund, Prof., Technische Universität Dresden, Germany
dc.subject.keywordvisual attentionen
dc.subject.keywordinterface designen
dc.subject.keywordinformation systemsen
dc.subject.keywordhuman-computer interactionen
dc.subject.otherComputer scienceen
dc.titleAdapting Interaction Based on Users' Visual Attentionen
dc.typeG5 Artikkeliväitöskirjafi
dc.type.dcmitypetexten
dc.type.ontasotDoctoral dissertation (article-based)en
dc.type.ontasotVäitöskirja (artikkeli)fi
local.aalto.acrisexportstatuschecked 2020-08-27_1143
local.aalto.archiveyes
local.aalto.formfolder2020_05_28_klo_09_42
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
isbn9789526038735.pdf
Size:
13.26 MB
Format:
Adobe Portable Document Format
Description:
Download
Collections
[diss] Taiteiden ja suunnittelun korkeakoulu / ARTS