QoA4ML – A Framework for Supporting Contracts in Machine Learning Services

Loading...
Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Major/Subject

Mcode

Degree programme

Language

en

Pages

11

Series

2021 IEEE International Conference on Web Services (ICWS), pp. 465-475

Abstract

Important service-level constraints in machine learning (ML) services must be communicated and agreed among relevant stakeholders. Due to the lack of studies and support, it is unclear which and how ML-specific attributes and constraints should be specified and assured in service contracts for ML services. This paper examines service contracts in the three stakeholders engagement model of ML services. We identify key ML-specific attributes that should be specified and monitored for the ML service provider, ML consumer and ML infrastructure provider. Based on that, we propose QoA4ML (Quality of Analytics for ML) as a framework to support ML-specific service contracts. QoA4ML includes an ML-specific service contract specification, monitoring utilities and a contract observability service. To illustrate the usefulness of QoA4ML, we present real-world examples for contract terms and policies, monitoring and contract evaluation with dynamic ML services in predictive maintenance.

Description

Keywords

Other note

Citation

Truong, L & Nguyen, T 2021, QoA4ML – A Framework for Supporting Contracts in Machine Learning Services. in C K Chang, E Damiani, J Fan, P Ghodous, M Maximilien, Z Wang, R Ward & J Zhang (eds), 2021 IEEE International Conference on Web Services (ICWS). IEEE, pp. 465-475, IEEE International Conference on Web Services, Virtual, Online, 05/09/2021. https://doi.org/10.1109/ICWS53863.2021.00066