Design framework for performance management systems : an ensemble approach

Thumbnail Image
Journal Title
Journal ISSN
Volume Title
School of Business | Doctoral thesis (article-based) | Defence date: 2013-06-14
Checking the digitized thesis and permission for publishing
Instructions for the author
Information Systems Science
Degree programme
193 s
Aalto University publication series. DOCTORAL DISSERTATIONS, 100/2013
Businesses and public sector organizations rely increasingly on fact-based management and decision making. Performance management systems enable these activities by helping organizations to derive “business intelligence” from a rapidly expanding amount of digital data. Moreover, performance management systems are designed to provide users with essential performance information through effective visualizations. To this end, the developers of performance management systems are faced with implementing increasingly complex technological solutions in organizational contexts that are governed by various information needs and often-conflicting interests of multiple stakeholders. The thesis focuses on these important questions to which the existing body of scientific knowledge on information systems design has not yet provided comprehensive explanations. To address the knowledge gap, the present thesis establishes a research framework to study the key design challenges and essential managerial issues in the development of performance management systems. To populate the framework, empirical evidence is drawn from multiple system development projects through qualitative inquiry. Participative action-based research and qualitative case study research are adopted as the main research methods to gain in-depth knowledge of the associated organizational phenomena. Overall, the thesis proposes that an “ensemble” approach is needed to uncover the complex interrelated organizational and technological factors that affect the design of performance management systems. Furthermore, guidance is given on how to overcome these issues to gain satisfactory outcomes in system implementations. To this end, the key findings point towards three essential design efforts: 1) designing the performance measurement model and metrics, 2) designing the procedures for capturing, storing, and processing data, and 3) designing the process and system for delivering performance information to the users. In addition, the results highlight that success in system development initiatives is heavily influenced by contextual factors and especially the interaction of essential stakeholders throughout the design process. The study contributes to the existing body of theoretical knowledge on information systems design. In addition, it provides empirical insight on the design of novel IT artifacts and the principles that are deemed effective for developing performance management systems. Furthermore, the study provides a better overall understanding of the relevant kernel theories that inform the design knowledge and help to explain the associated organizational phenomena. The practical contribution of the study builds upon the guidance provided to system designers and managers through several frameworks, IT artifacts, and management practices for information systems design processes.
Supervising professor
Tuunainen, Virpi, professor
Other note
  • Lempinen, H., Karjalainen, K. (2010) “Applying Average Revenue per User model to estimate contract usage rates in cases of low spend visibility”, In Towards New Horizons in Public Procurement, Khi V. Thai (Ed.), PrAcademics Press, Boca Raton, Florida, USA, pp. 273-300.
  • Lempinen, H., Tuunainen, V.K. (2011) “Redesigning the Supplier Reporting Process and System in Public Procurement – Case Hansel”, International Journal of Organisational Design and Engineering, 1(4), pp. 331-346. (Special Issue on “Organizational Design and Engineering Challenges for Inter-Organizational Collaboration and Competition”).
  • Lempinen, H. (2012) “Constructing a Design Framework for Performance Dashboards”, In Nordic Contributions in IS Research,LNBIP 124, C. Keller et al. (Eds.), Springer-Verlag, Berlin, Heidelberg, Germany, pp. 109–130. (*Best Student Paper award in the Scandinavian Conference on Information Systems (SCIS) 2012, Sigtuna, Sweden).
  • Lempinen, H. & Rajala, R. (Unpublished) “Multi-actor Interplay in IT Service Management”.