Safe reinforcement learning based optimization of a cruise ship energy management system

Thumbnail Image

Files

master_Shahinas_Erald_2025.pdf (2.77 MB)

URL

Journal Title

Journal ISSN

Volume Title

School of Science | Master's thesis
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.

Authors

Date

2025-07-29

Department

Major/Subject

Machine Learning, Data Science and Artificial Intelligence

Mcode

Degree programme

Master's Programme in Computer, Communication and Information Sciences

Language

en

Pages

52

Series

Abstract

The cruise ship industry is a large emitter of greenhouse gases. Multiple aspects must be tackled to help make the industry more sustainable and adhere to the net-zero emission goal set by the International Maritime Organization (IMO). One aspect is the optimization of the energy management of the ship, which can lead to large gains in energy savings. Traditional optimization approaches, such as linear optimization struggle to scale to large stochastic problem spaces such as that of a ship energy system. Modern approaches, such as reinforcement learning, are shown to be more effective at the task at hand. However, these approaches often lack a direct focus on safety, thus making them impractical for real-world applications. This thesis presents work in the development of a safe reinforcement learning (RL) system for ship energy optimization. As part of the system, a ship's microgrid environment was developed alongside a reinforcement learning agent. The results showcase the potential of RL approaches for energy optimization as opposed to alternative approaches. The inclusion of safety-focused methods, such as utilizing a safety shield and a large language model-generated reward function, was shown to be effective at enhancing safety, reducing the number of safety violations by 87% when the agent was trained and tested in a surrogate model.

Description

Supervisor

Atmojo, Udayanto

Thesis advisor

King, Akira

Keywords

reinforcement learning, energy optimization, large language models, surrogate modeling, safety, ship micogrid

Other note

Citation

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202508196561

Collections

[dipl] Perustieteiden korkeakoulu / SCI