Evaluation of prototypes and the problem of possible futures

Loading...
Thumbnail Image

Access rights

openAccess
publishedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2017

Major/Subject

Mcode

Degree programme

Language

en

Pages

Series

CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 2064-2077

Abstract

There is a blind spot in HCI’s evaluation methodology: we rarely consider the implications of the fact that a prototype can never be fully evaluated in a study. A prototype under study exists firmly in the present world, in the circumstances created in the study, but its real context of use is a partially unknown future state of affairs. This present–future gap is implicit in any evaluation of prototypes, be they usability tests, controlled experiments, or field trials. A carelessly designed evaluation may inadvertently evaluate the wrong futures, contexts, or user groups, thereby leading to false conclusions and expensive design failures. The essay analyses evaluation methodology from this perspective, illuminating how to mitigate the present–future gap.

Description

| openaire: EC/H2020/637991/EU//COMPUTED

Keywords

Evaluation methodology, Field trials, Experiments, Usability studies, Prototypes, Future

Other note

Citation

Salovaara, A, Oulasvirta, A & Jacucci, G 2017, Evaluation of prototypes and the problem of possible futures . in CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems . ACM SIGCHI, pp. 2064-2077, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Denver, Colorado, United States, 06/05/2017 . https://doi.org/10.1145/3025453.3025658