Visual communication in ubiquitous computing: from smartphones to pervasive displays

dc.contributorAalto Universityen
dc.contributor.advisorOulasvirta, Antti, Prof., Aalto University, Finland
dc.contributor.authorMontoya Freire, Maria L.
dc.contributor.departmentTietotekniikan laitosfi
dc.contributor.departmentDepartment of Computer Scienceen
dc.contributor.schoolPerustieteiden korkeakoulufi
dc.contributor.schoolSchool of Scienceen
dc.contributor.supervisorDi Francesco, Mario, Prof., Aalto University, Department of Computer Science, Finland
dc.descriptionDefence is held on 4.6.2021 12:00 – 16:00 Zoom:
dc.description.abstractRapid technological advances have enabled the integration of heterogeneous devices into the physical world to provide different kinds of services to users. This led to the emergence of ubiquitous systems that are available at any time and place. A key aspect of such systems is communication, not only among devices but also towards end users. This dissertation investigates several methods to enable visual communication in ubiquitous systems. Specifically, this research addresses visual communication broadly defined in the context of both device-to-device and device-to-people scenarios. In the first case, the main goal is to achieve reliable and effective communication between different devices. To this end, barcodes are leveraged to establish a visual communication channel by using the display and the camera of a smartphone. Accordingly, a mobile application framework is proposed for adaptive and bi-directional commu- nication through barcodes. Moreover, a novel barcode design is devised to provide different data depending on the scanning distance by means of color blending. This novel approach enables new use cases in mobile computing, including casual interactions with public displays and augmented reality for retail. As for the device-to-people scenario, research is carried out to address two important aspects involving how users obtain information from pervasive displays. First, display solutions should be able to reach users and provide meaningful content to them. This can be achieved by extending the coverage of target audience through replication of display content. The same approach allows to monitor the displays to ensure that they are properly functioning and actually showing the intended content. Accordingly, several methods to access display content from different devices are studied and evaluated. Second, user engagement with pervasive displays is particularly challenging as they are easily ignored, especially when they do not convey information relevant to the users. In this context, a novel approach is taken through models suitable to characterize user behavior in observing the content shown on a screen. In particular, the information foraging theory is applied to build several models with the goal of optimizing content selection in tiled display layouts. Accordingly, a display foraging model is devised to predict the time spent by users on a screen as a characterization of their interest. Across several studies, this approach is shown to be effective in characterizing user behavior in real conditions. Finally, inverse foraging models are proposed to infer users' interest from collected data. The models are accurate in predicting interest based on both synthetic and real user data. The obtained results demonstrate that modeling can be effectively applied to improve user engagement in pervasive displays.en
dc.format.extent92 + app. 74
dc.identifier.isbn978-952-64-0347-2 (electronic)
dc.identifier.isbn978-952-64-0346-5 (printed)
dc.identifier.issn1799-4942 (electronic)
dc.identifier.issn1799-4934 (printed)
dc.identifier.issn1799-4934 (ISSN-L)
dc.opnLangheinrich, Marc, Prof., Università della Svizzera italiana (USI), Switzerland
dc.publisherAalto Universityen
dc.relation.haspart[Publication 1]: Jacopo Bufalino, Maria L. Montoya Freire, Juho Kannala, Mario Di Francesco. MAMBA: Adaptive and Bi-directional Data Transfer for Reliable Camera-display Communication. In IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks, Cork, Ireland, pp, 1-7, September 2020. DOI: 10.1109/WoWMoM49955.2020.00059
dc.relation.haspart[Publication 2]: Roope Palomäki, Maria L. Montoya Freire, Mario Di Francesco. Distance- Dependent Barcodes for Context-Aware Mobile Applications. In International Conference on Human Computer Interaction with Mobile Devices and Services, Oldenburg, Germany, pp,1-11, October 2020. Full text in Acris/Aaltodoc: DOI: 10.1145/3379503.3403534
dc.relation.haspart[Publication 3]: Maria L. Montoya Freire, Venkata Praneeth Tatiraju, Mohit Sethi, Mario Di Francesco. Replication of web-based pervasive display applications. In ACM International Symposium on Pervasive Displays, Oulu, Finland, pp, 204-211, June 2016. DOI: 10.1145/2914920.2915013
dc.relation.haspart[Publication 4]: Maria L. Montoya Freire, Dominic Potts, Niraj Ramesh Dayama, Antti Oulasvirta, Mario Di Francesco. Foraging-based optimization of pervasive displays. In Pervasive and Mobile Computing, Volume, 55, pp, 45-58, April 2019. Full text in Acris/Aaltodoc: DOI: 10.1016/j.pmcj.2019.02.008
dc.relation.haspart[Publication 5]: Maria L. Montoya Freire, Antti Oulasvirta, Mario Di Francesco. Inverse Foraging: Inferring Users’ Interest in Pervasive Displays. Submitted, 2021
dc.relation.ispartofseriesAalto University publication series DOCTORAL DISSERTATIONSen
dc.revButz, Andreas, Prof., Ludwig-Maximilians-Universität München (LMU), Germany
dc.revSong, Junehwa, Prof., Korea Advanced Institute of Science and Technology (KAIST), Republic of Korea
dc.subject.keywordubiquitous computingen
dc.subject.keywordubiquitous devicesen
dc.subject.keywordvisual communicationen
dc.subject.otherComputer scienceen
dc.titleVisual communication in ubiquitous computing: from smartphones to pervasive displaysen
dc.typeG5 Artikkeliväitöskirjafi
dc.type.ontasotDoctoral dissertation (article-based)en
dc.type.ontasotVäitöskirja (artikkeli)fi
local.aalto.acrisexportstatuschecked 2021-06-08_0943
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
11.84 MB
Adobe Portable Document Format
No Thumbnail Available
29.65 KB
Adobe Portable Document Format