Energy Storage Science and Technology ›› 2025, Vol. 14 ›› Issue (5): 1982-1990.doi: 10.19799/j.cnki.2095-4239.2024.1130

• Energy Storage System and Engineering • Previous Articles     Next Articles

A variable-parameter PID active power control strategy of inertial flywheel based on reinforcement learning

Rengaowa SA1(), Chaohui WU1, Zelong NI2, Yue ZHANG1, Xinjian JIANG2(), Jianyu TIAN2   

  1. 1.Inner Mongolia Electric Power (Group) Co. , Ltd. Inner Mongolia Electric Power Economic and Technological Research Institute Branch, Hohhot 010000, Inner Mongolia Autonomous Region, China
    2.Tsinghua University, Beijing 100084, China
  • Received:2024-11-27 Revised:2024-12-02 Online:2025-05-28 Published:2025-05-21
  • Contact: Xinjian JIANG E-mail:1764861384@qq.com;jiangxj@mail.tsinghua.edu.cn

Abstract:

This study investigates an inertial flywheel system based on electromagnetic couplers. The topological structure and principle of the inertial flywheel system are first introduced, and the advantages of using electromagnetic couplers are highlighted, followed by mathematical modeling of the system. The traditional fixed-parameter proportional-integral-derivative (PID) control mode exhibits significant output power fluctuations during sudden active command changes. To address this limitation, this study proposes a variable-parameter PID active power control strategy for inertial flywheels based on reinforcement learning (RL). The proposed method uses an RL algorithm without a model reference to train the neural network RL Agent, which dynamically adjusts the PID parameters. The neural network processes four input variables: active power deviation, differentiation of the active power, rotational speed, and acceleration, while outputting optimized parameters P, I, and D. The PID parameters dynamically adapt to the changes in the system state. To verify the feasibility of the control strategy and the advantages of the control performance, the control strategy was compared with the traditional fixed-parameter PID control method on the MATLAB/Simulink simulation platform. The simulation results demonstrate that the P and I parameters in the variable-parameter PID control strategy significantly change when the system receives an active power adjustment instruction, resulting in corresponding adjustments in the output torque reference values. As a result, the overshoot and fluctuation of the system power output are reduced, and the dynamic response performance is improved.

Key words: flywheel energy storage, electromagnetic coupler, reinforcement learning, vector control, PID control

CLC Number: