aalto1 untyped-item.component.html

WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor

Loading...
Thumbnail Image

Access rights

openAccess
publishedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

Major/Subject

Mcode

Degree programme

Language

en

Pages

Series

Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 3891-3902

Abstract

This paper contributes a novel sensing approach to support on- and above-skin finger input for interaction on the move. WatchSense uses a depth sensor embedded in a wearable device to expand the input space to neighboring areas of skin and the space above it. Our approach addresses challenging camera-based tracking conditions, such as oblique viewing angles and occlusions. It can accurately detect fingertips, their locations, and whether they are touching the skin or hovering above it. It extends previous work that supported either mid-air or multitouch input by simultaneously supporting both. We demonstrate feasibility with a compact, wearable prototype attached to a user’s forearm (simulating an integrated depth sensor). Our prototype—which runs in real-time on consumer mobile devices—enables a 3D input space on the back of the hand. We evaluated the accuracy and robustness of the approach in a user study. We also show how WatchSense increases the expressiveness of input by interweaving mid-air and multitouch for several interactive applications.

Description

| openaire: EC/H2020/637991/EU//COMPUTED | openaire: EC/FP7/335545/EU//CapReal | openaire: EC/H2020/648785/EU//BODY-UI

Other note

Citation

Sridhar, S, Markussen, A, Oulasvirta, A, Theobalt, C & Boring, S 2017, WatchSense : On- and Above-Skin Input Sensing through a Wearable Depth Sensor. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM SIGCHI, pp. 3891-3902, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Denver, Colorado, United States, 06/05/2017. https://doi.org/10.1145/3025453.3026005

Endorsement

Review

Supplemented By

Referenced By