We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Loading...
Thumbnail Image
Access rights
© 2016 ACM.
Journal Title
Journal ISSN
Volume Title
School of Science | A4 Artikkeli konferenssijulkaisussa
Date
2016
Major/Subject
Mcode
Degree programme
Language
en
Pages
13
Series
Abstract
We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.
Description
Keywords
usability evaluation, public procurement, summative evaluation, measuring usability, healthcare and social welfare information system, electronic health record, käytettävyyden arviointi, julkiset hankinnat, potilastietojärjestelmä, asiakastietojärjestelmä
Other note
Citation
Tyllinen, Mari & Kaipio, Johanna & Lääveri, Tinja & Nieminen, Marko H.T.. 2016. We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. CHI'16 Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems. 13. DOI: 10.1145/2858036.2858570.