Deep Reinforcement Learning-Based Resource Allocation for Satellite Internet of Things with Diverse QoS Guarantee

Sensors

Yang Wu¹  Guyu Hu²  Yunbo Li²  Siqi Tang²  Zhisong Pan² 

[1] Beijing Information and Communications Technology Research Center, Beijing 100036, China;Command & Control Engineering College, Army Engineering University of PLA, Nanjing 210007, China;

关键词: channel allocation;    deep reinforcement learning;    power control;    various QoS;    Satellite Internet of Things;    transfer learning;   

DOI  :  10.3390/s22082979

来源: DOAJ

【 摘 要 】

Large-scale terminals’ various QoS requirements are key challenges confronting the resource allocation of Satellite Internet of Things (S-IoT). This paper presents a deep reinforcement learning-based online channel allocation and power control algorithm in an S-IoT uplink scenario. The intelligent agent determines the transmission channel and power simultaneously based on contextual information. Furthermore, the weighted normalized reward concerning success rate, power efficiency, and QoS requirement is adopted to balance the performance between increasing resource efficiency and meeting QoS requirements. Finally, a practical deployment mechanism based on transfer learning is proposed to promote onboard training efficiency and to reduce computation consumption of the training process. The simulation demonstrates that the proposed method can balance the success rate and power efficiency with QoS requirement guaranteed. For S-IoT’s normal operation condition, the proposed method can improve the power efficiency by 60.91% and 144.44% compared with GA and DRL_RA, while its power efficiency is only 4.55% lower than that of DRL-EERA. In addition, this method can be transferred and deployed to a space environment by merely 100 onboard training steps.

【 授权许可】

Unknown