We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Loading...
Thumbnail Image

Access rights

© 2016 ACM.

URL

Journal Title

Journal ISSN

Volume Title

School of Science | A4 Artikkeli konferenssijulkaisussa

Authors

Tyllinen, Mari
Kaipio, Johanna
Lääveri, Tinja
Nieminen, Marko H.T.

Date

2016

Department

Tietotekniikan laitos
Department of Computer Science

Major/Subject

Mcode

Degree programme

Language

en

Pages

13

Series

Abstract

We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

Description

Keywords

usability evaluation, public procurement, summative evaluation, measuring usability, healthcare and social welfare information system, electronic health record, käytettävyyden arviointi, julkiset hankinnat, potilastietojärjestelmä, asiakastietojärjestelmä

Other note

Citation

Tyllinen, Mari & Kaipio, Johanna & Lääveri, Tinja & Nieminen, Marko H.T.. 2016. We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. CHI'16 Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems. 13. DOI: 10.1145/2858036.2858570.