Building test automation pipelines for massive multiplayer online role-playing games

Abstract

Massive Multiplayer Online Role-Playing Games (MMORPGs) are one of the most recognized genres in the video gaming industry as they feature enormous worlds that are filled with content and persist even when players are offline. The complexity of these types of games poses additional challenges with regard to their quality assurance, thus, an effective MMORPGs testing strategy is critical. MMORPGs typically offer a feature-complete product during initial game launch and followed by frequent updates with new content and hot-fixes. This perpetual state of change increases the likelihood of quality control problems and unanticipated effects. Therefore, automated testing becomes crucial for the success of MMORPGs.

This thesis describes the design and implementation of the test automation pipeline within the framework of Continuous Integration/Continuous Deployment (CI/CD) for an MMORPG Pax Dei that was already published. It highlights the importance of multiple types of testing, including regression testing, smoke testing and stress testing, in maintaining game quality and presents the solution developed for Pax Dei. The primary focus of this thesis is on the complex technical challenges encountered, along with the lessons learned from hands-on experience in addressing those challenges in the context of a live game title.