Towards Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorBai, Yuen_US
dc.contributor.authorZhao, Huien_US
dc.contributor.authorZhang, Xinen_US
dc.contributor.authorChang, Zhengen_US
dc.contributor.authorJantti, Rikuen_US
dc.contributor.authorYang, Kunen_US
dc.contributor.departmentDepartment of Information and Communications Engineeringen
dc.contributor.groupauthorCommunication Engineeringen
dc.contributor.organizationUniversity of Electronic Science and Technology of Chinaen_US
dc.contributor.organizationUniversity of Essexen_US
dc.date.accessioned2024-01-04T09:01:49Z
dc.date.available2024-01-04T09:01:49Z
dc.date.issued2023en_US
dc.descriptionPublisher Copyright: Author
dc.description.abstractUnmanned aerial vehicle (UAV)-based wireless networks have received increasing research interest in recent years and are gradually being utilized in various aspects of our society. The growing complexity of UAV applications such as disaster management, plant protection, and environment monitoring, has resulted in escalating and stringent requirements for UAV networks that a single UAV cannot fulfill. To address this, multi-UAV wireless networks (MUWNs) have emerged, offering enhanced resource-carrying capacity and enabling collaborative mission completion by multiple UAVs. However, the effective operation of MUWNs necessitates a higher level of autonomy and intelligence, particularly in decision-making and multi-objective optimization under diverse environmental conditions. Reinforcement Learning (RL), an intelligent and goal-oriented decision-making approach, has emerged as a promising solution for addressing the intricate tasks associated with MUWNs. As one may notice, the literature still lacks a comprehensive survey of recent advancements in RL-based MUWNs. Thus, this paper aims to bridge this gap by providing a comprehensive review of RL-based approaches in the context of autonomous MUWNs. We present an informative overview of RL and demonstrate its application within the framework of MUWNs. Specifically, we summarize various applications of RL in MUWNs, including data access, sensing and collection, resource allocation for wireless connectivity, UAV-assisted mobile edge computing, localization, trajectory planning, and network security. Furthermore, we identify and discuss several open challenges based on the insights gained from our review.en
dc.description.versionPeer revieweden
dc.format.extent30
dc.format.extent3038-3067
dc.format.mimetypeapplication/pdfen_US
dc.identifier.citationBai, Y, Zhao, H, Zhang, X, Chang, Z, Jantti, R & Yang, K 2023, ' Towards Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches ', IEEE Communications Surveys and Tutorials, vol. 25, no. 4, pp. 3038-3067 . https://doi.org/10.1109/COMST.2023.3323344en
dc.identifier.doi10.1109/COMST.2023.3323344en_US
dc.identifier.issn1553-877X
dc.identifier.otherPURE UUID: 8e7b282b-7f25-403c-be32-132200124d4den_US
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/8e7b282b-7f25-403c-be32-132200124d4den_US
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85174839213&partnerID=8YFLogxKen_US
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/130752954/Toward_Autonomous_Multi-UAV_Wireless_Network_A_Survey_of_Reinforcement_Learning-Based_Approaches.pdfen_US
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/125467
dc.identifier.urnURN:NBN:fi:aalto-202401041156
dc.language.isoenen
dc.publisherIEEE
dc.relation.ispartofseriesIEEE Communications Surveys and Tutorialsen
dc.relation.ispartofseriesVolume 25, issue 4en
dc.rightsopenAccessen
dc.subject.keywordAutonomous aerial vehiclesen_US
dc.subject.keywordHeuristic algorithmsen_US
dc.subject.keywordMulti-UAV wireless networken_US
dc.subject.keywordOptimizationen_US
dc.subject.keywordreinforcement learningen_US
dc.subject.keywordResource managementen_US
dc.subject.keywordSurveysen_US
dc.subject.keywordTutorialsen_US
dc.subject.keywordUAV-assisted communication networken_US
dc.subject.keywordUAV-assisted mobile computingen_US
dc.subject.keywordUnmanned aerial vehicle (UAV)en_US
dc.subject.keywordWireless networksen_US
dc.titleTowards Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approachesen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion
Files