Imitation Reinforcement Learning-Based Remote Rotary Inverted Pendulum Control in OpenFlow Network

IEEE Access

Chan-Myung Kim¹  Ju-Bong Kim²  Youn-Hee Han²  Hyun-Kyo Lim³  Min-Suk Kim⁴  Yong-Geun Hong⁴ 

[1] Advanced Technology Research Institute, Cheonan, South Korea;Department of Computer Science Engineering, Korea University of Technology and Education, Cheonan, South Korea;Department of Interdisciplinary Program in Creative Engineering, Korea University of Technology and Education, Cheonan, South Korea;Department of Knowledge-Converged Super Brain Convergence Research, Electronics and Telecommunications Research Institute, Daejeon, South Korea;

关键词: Reinforcement learning;    remote control;    control engineering;    OpenFlow;    CPS;   

DOI  :  10.1109/ACCESS.2019.2905621

来源: DOAJ

【 摘 要 】

Rotary inverted pendulum is an unstable and highly nonlinear device and has been used as a common application model in nonlinear control engineering field. In this paper, we use a rotary inverted pendulum as a deep reinforcement learning environment. The real device is composed of a cyber environment and physical environment based on the OpenFlow network, and the MQTT protocol is used on the Ethernet connection to connect the cyber environment and the physical environment. The reinforcement learning agent is learned to control the real device located remotely from the controller, and the classical PID controller is also utilized to implement the imitation reinforcement learning and facilitate the learning process. From our CPS-based experimental system, we verify that a deep reinforcement learning agent can successfully control the real device located remotely from the agent, and our imitation learning strategy can make the learning time reduced effectively.

【 授权许可】

Unknown