Mass customization with reinforcement learning: Automatic reconfiguration of a production line

This paper addresses the problem of efficient automation system configuration for mass customization in industrial manufacturing. Due to the various demands from customers, production lines need to adjust the process parameters of the machines based on specific quality parameters. Reinforcement learning, which learns from samples, can tackle the problem more efficiently than the currently used methods. Based on the proximal policy optimization and centralized training with decentralized execution, a multi-agent reinforcement learning method (MARL) is proposed to reconfigure process parameters of machines based on the changed specifications. The proposed method has the actor of each agent observing only its own state, the agents are made to collaborate by a centralized critic which observes all the states. To evaluate the method, a steel strip rolling line with six collaborating mills is studied. Simulation results show that the proposed method outperforms the existing methods and state-of-the-art multi-agent reinforcement learning methods in terms of accuracy and computing costs.

DOI

10.1016/j.asoc.2023.110547

Citation

Deng, J, Sierla, S, Sun, J & Vyatkin, V 2023, 'Mass customization with reinforcement learning: Automatic reconfiguration of a production line', Applied Soft Computing, vol. 145, 110547. https://doi.org/10.1016/j.asoc.2023.110547

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202308014559

Collections

[article-cris] Sähkötekniikan korkeakoulu / ELEC

Show all metadata

Mass customization with reinforcement learning: Automatic reconfiguration of a production line

Access rights

URL

Journal Title

Journal ISSN

Volume Title

Authors

Date

Department

Major/Subject

Mcode

Degree programme

Language

Pages

Series

Abstract

Description

Keywords

Other note

DOI

Citation

Permanent link to this item

Collections