BeiDou Short-Message Satellite Resource Allocation Algorithm Based on Deep Reinforcement Learning

Entropy

Chao Yan¹  Kaiwen Xia¹  Jing Feng¹  Chaofan Duan¹ 

[1] Institute of Meteorology and Oceanography, National University of Defense Technology, Changsha 410005, China;

关键词: BeiDou short-message;    deep reinforcement learning;    resource allocation;    multi-objective optimization;   

DOI  :  10.3390/e23080932

来源: DOAJ

【 摘 要 】

The comprehensively completed BDS-3 short-message communication system, known as the short-message satellite communication system (SMSCS), will be widely used in traditional blind communication areas in the future. However, short-message processing resources for short-message satellites are relatively scarce. To improve the resource utilization of satellite systems and ensure the service quality of the short-message terminal is adequate, it is necessary to allocate and schedule short-message satellite processing resources in a multi-satellite coverage area. In order to solve the above problems, a short-message satellite resource allocation algorithm based on deep reinforcement learning (DRL-SRA) is proposed. First of all, using the characteristics of the SMSCS, a multi-objective joint optimization satellite resource allocation model is established to reduce short-message terminal path transmission loss, and achieve satellite load balancing and an adequate quality of service. Then, the number of input data dimensions is reduced using the region division strategy and a feature extraction network. The continuous spatial state is parameterized with a deep reinforcement learning algorithm based on the deep deterministic policy gradient (DDPG) framework. The simulation results show that the proposed algorithm can reduce the transmission loss of the short-message terminal path, improve the quality of service, and increase the resource utilization efficiency of the short-message satellite system while ensuring an appropriate satellite load balance.

【 授权许可】

Unknown