Learning Efficient Representations of Mouse Movements to Predict User Attention

Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)

Authors

Date

2020-07-25

Department

Department of Communications and Networking

Major/Subject

Mcode

Degree programme

Language

en

Pages

10

Series

SIGIR 2020 - Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1309-1318

Abstract

Tracking mouse cursor movements can be used to predict user attention on heterogeneous page layouts like SERPs. So far, previous work has relied heavily on handcrafted features, which is a time-consuming approach that often requires domain expertise. We investigate different representations of mouse cursor movements, including time series, heatmaps, and trajectory-based images, to build and contrast both recurrent and convolutional neural networks that can predict user attention to direct displays, such as SERP advertisements. Our models are trained over raw mouse cursor data and achieve competitive performance. We conclude that neural network models should be adopted for downstream tasks involving mouse cursor movements, since they can provide an invaluable implicit feedback signal for re-ranking and evaluation.

Description

Keywords

direct displays, mouse cursor, neural networks, online advertising, sponsored search, transfer learning, user attention

Other note

DOI

10.1145/3397271.3401031

Citation

Arapakis, I & Leiva, L A 2020, Learning Efficient Representations of Mouse Movements to Predict User Attention. in SIGIR 2020 - Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, pp. 1309-1318, International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual, Online, China, 25/07/2020. https://doi.org/10.1145/3397271.3401031

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202009255542

Collections

[article-cris] Sähkötekniikan korkeakoulu / ELEC