Joint Cache Placement and Delivery Design using Reinforcement Learning for Cellular Networks
Loading...
Access rights
openAccess
acceptedVersion
URL
Journal Title
Journal ISSN
Volume Title
A4 Artikkeli konferenssijulkaisussa
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Other link related to publication (opens in new window)
Date
2021-06-15
Major/Subject
Mcode
Degree programme
Language
en
Pages
6
Series
Proceedings of 93rd IEEE Vehicular Technology Conference, VTC 2021, IEEE Vehicular Technology Conference
Abstract
We consider a reinforcement learning (RL) based joint cache placement and delivery (CPD) policy for cellular networks with limited caching capacity at both Base Stations (BSs) and User Equipments (UEs). The dynamics of file preferences of users is modeled by a Markov process. User requests are based on current preferences, and on the content of the user's cache. We assume probabilistic models for the cache placement at both the UEs and the BSs. When the network receives a request for an un-cached file, it fetches the file from the core network via a backhaul link. File delivery is based on network-level orthogonal multipoint multicasting transmissions. For this, all BSs caching a specific file transmit collaboratively in a dedicated resource. File reception depends on the state of the wireless channels. We design the CPD policy while taking into account the user Quality of Service and the backhaul load, and using an Actor-Critic RL framework with two neural networks. Simulation results are used to show the merits of the devised CPD policy.Description
Keywords
Wireless caching, reinforcement learning, Actor-Critic
Other note
Citation
Amidzade, M, Al-Tous, H, Tirkkonen, O & Zhang, J 2021, Joint Cache Placement and Delivery Design using Reinforcement Learning for Cellular Networks . in Proceedings of 93rd IEEE Vehicular Technology Conference, VTC 2021 ., 9448674, IEEE Vehicular Technology Conference, IEEE, IEEE Vehicular Technology Conference, Helsinki, Finland, 25/04/2021 . https://doi.org/10.1109/VTC2021-Spring51267.2021.9448674