Flexible Transmission Network Expansion Planning Based on DQN Algorithm

Energies

Lei Chen¹  Zongsheng Zheng¹  Yuhong Wang¹  Qi Zeng¹  Xu Zhou¹  Liang Lu²  Li Jiang²  Hong Zhou² 

[1] College of Electrical Engineering, Sichuan University, Chengdu 610065, China;State Grid Southwest China Branch, Chengdu 610041, China;

关键词: flexible transmission network expansion planning;    deep Q-network;    prioritized experience replay strategy;    construction sequence;   

DOI  :  10.3390/en14071944

来源: DOAJ

【 摘 要 】

Compared with static transmission network expansion planning (TNEP), multi-stage TNEP is more in line with the actual situation, but the modeling is also more complicated. This paper proposes a new multi-stage TNEP method based on the deep Q-network (DQN) algorithm, which can solve the multi-stage TNEP problem based on a static TNEP model. The main purpose of this research is to provide grid planners with a simple and effective multi-stage TNEP method, which is able to flexibly adjust the network expansion scheme without replanning. The proposed method takes into account the construction sequence of lines in the planning and completes the adaptive planning of lines by utilizing the interactive learning characteristics of the DQN algorithm. In order to speed up the learning efficiency of the algorithm and enable the agent to have a better judgment on the reward of the line-building action, the prioritized experience replay (PER) strategy is added to the DQN algorithm. In addition, the economy, reliability, and flexibility of the expansion scheme are considered in order to evaluate the scheme more comprehensively. The fault severity of equipment is considered on the basis of the Monte Carlo method to obtain a more comprehensive system state simulation. Finally, extensive studies are conducted with IEEE 24-bus reliability test system, and the computational results demonstrate the effectiveness and adaptability of the proposed flexible TNEP method.

【 授权许可】

Unknown