Reinforcement Learning Based Energy Dispatch Strategy and Control Optimization of Microgrid

doi:10.13190/j.jbupt.2019-040

Journal of Beijing University of Posts and Telecommunications ›› 2020, Vol. 43 ›› Issue (1): 28-34.doi: 10.13190/j.jbupt.2019-040

• Papers • Previous Articles Next Articles

Reinforcement Learning Based Energy Dispatch Strategy and Control Optimization of Microgrid

LIU Jin-hua¹, KE Zhong-ming^1,2, ZHOU Wen-hui¹

1. Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China;
2. School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China

Received:2019-03-18 Online:2020-02-28 Published:2020-03-27
Supported by:

Abstract

Abstract: Aiming at the economic benefit problem, charging efficiency optimization problem, system load fluctuation problem and carbon emissions problem of energy scheduling in microgrid, application of reinforcement learning to energy scheduling in microgrid is presented. By establishing a complete microgrid model and using reinforcement learning to obtain the optimal strategy in the continuous iterative process, economic benefits tended to be maximized, charging power is relatively stable, load fluctuation of the system is reduced, and carbon emissions is tended minimized. These four joint optimization objectives are reached. Simulations show that the control strategy used in this system can not only maximize the convergence of economic benefits and minimize carbon emissions, but also make the charging power relatively stable, and reduce the load of microgrid. The stability of this system will be improved greatly.

Key words: microgrid, economic benefits, system optimization, carbon emissions, reinforcement learning

CLC Number:

TP273

LIU Jin-hua, KE Zhong-ming, ZHOU Wen-hui. Reinforcement Learning Based Energy Dispatch Strategy and Control Optimization of Microgrid[J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(1): 28-34.

References

[1] 郑漳华, 艾芊. 微电网的研究现状及在我国的应用前景[J]. 电网技术, 2008, 32(16):27-31. Zheng Zhanghua, Ai Qian. Research status and application prospect of micro power grid in China[J]. Power Grid Technology, 2008, 32(16):27-31.
[2] 王成山, 李鹏. 分布式发电、微网与智能配电网的发展与挑战[J]. 电力系统自动化, 2010, 34(2):10-14. Wang Chengshan, Li Peng. Development and challenges of distributed generation, micro grid and intelligent distribution network[J]. Power System Automation, 2010, 34(2):10-14.
[3] 鞠平, 周孝信, 陈维江, 等. "智能电网+"研究综述[J]. 电力自动化设备, 2018, 38(5):2-11. Ju Ping, Zhou Xiaoxin, Chen Weijiang, et al. Research review of "smart grid +"[J]. Electric Power Automation Equipment, 2018, 38(5):2-11.
[4] 张素香. 智能小区的商业智能[J]. 北京邮电大学学报, 2012, 35(5):94-97. Zhang Suxiang. Business intelligence of intelligent community[J]. Journal of Beijing University of Posts and Telecommunications, 2012, 35(5):94-97.
[5] Thomas Strasser, Filip Andrén, Johannes Kathan, et al. A review of architectures and concepts for intelligence in future electric energy systems[J]. IEEE Transactions on Industrial Electronics, 2015, 62(4):2424-2438.
[6] Roberts B. Capturing grid power[J]. IEEE Power and Energy Magazine, 2009, 7(4):32-41.
[7] 徐丰. 微电网建模及其控制策略研究[D]. 南京:南京理工大学, 2013.
[8] 周围, 韩礼冬, 李钢, 等. 基于PSCAD/EMTDC的微电网永磁直驱风力发电系统建模与仿真研究[J]. 电气技术, 2016, 17(2):52-57. Zhou Wei, Han Lidong, Li Gang, et al. Modeling and simulation of PSCAD/EMTDC based micro grid permanent magnet direct drive wind power generation system[J]. Electrical Technology, 2016, 17(2):52-57.
[9] 刘国静, 韩学山, 王尚, 等. 基于强化学习方法的风储合作决策[J]. 电网技术, 2016, 40(9):2729-2736. Liu Guojing, Han Xueshan, Wang Shang, et al. Wind storage cooperative decision-making based on reinforcement learning[J]. Power Grid Technology, 2016, 40(9):2729-2736.
[10] 钟伟锋. 智能电网中V2G系统能量管理及应用研究[D]. 广东:广东工业大学, 2016.
[11] 周文辉, 钟伟锋, 吴杰, 等. 面向智能电网负荷调节的自适应储能系统控制[J]. 北京邮电大学学报, 2017, 40(1):32-35. Zhou Wenhui, Zhong Weifeng, Wu Jie, et al. Adaptive energy storage system control for smart grid load regulation[J]. Journal of Beijing University of Posts and Telecommunications, 2017, 40(1):32-35.
[12] Wei C, Zhang Z, Qiao W, et al. An adaptive network-based reinforcement learning method for MPPT control of PMSG wind energy conversion systems[J]. IEEE Transactions on Power Electronics, 2016, 31(11):7837-7848.
[13] Etemad S, Mozayani N. Using reinforcement learning to make smart energy storage sources in microgrid[C]//2015 30th International Power System Conference (PSC). Tehran:[s. n.], 2015:345-350.
[14] Wu Jingda, He Hongwen, Peng Jiankun, et al. Continuous reinforcement Jingda learning of energy management with deep Q network for a power split hybrid electric bus[J]. Applied Energy, 2018, 222(15):799-811.

[1]	LIU Yang, TENG Yinglei, NIU Tao, ZHI Jialin. Filter Pruning Algorithm Based on Deep Reinforcement Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 31-36.
[2]	TAN Weiqian, WU Binwei, WANG Shuo. Cross-Domain Deterministic Networking Architecture and DRL Flow Scheduling [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 37-42.
[3]	YANG Hua, GENG Xuan, KONG Ning. A MAC Protocol for Wireless Networks Using Dueling-DDQN Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 25-30.
[4]	. Deterministic Scheduling and Routing Joint Intelligent Optimization Scheme in Computing First Network [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 9-14.
[5]	. An Ensemble Learning-Aided DDPG Resource Optimization Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 29-36.
[6]	. Resource Allocation Based on Alternating Direction Multiplier Method and Deep Reinforcement Learning Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 126-130.
[7]	. Intent-driven Demand-aware Resource Service in Autonomous Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 85-91.
[8]	CHEN Chunlei, LIU Kaijun, DONG Chen, ZHOU Hongyuan. An Adaptive Bit Rate Algorithm Model Based on Wireless Network [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 115-120.
[9]	ZHI Jialin, WANG Nan, MAN Yi, TENG Yinglei. Hardware Model-Aware Joint Offloading and Resources Allocation Optimization [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 22-28.
[10]	DU Mei, ZHOU Junhua, LI Dunqiao, CHEN Shizhao, WEI Yifei. A Joint Intelligent Optimization Scheme of Computation Offloading and Resource Allocation for MEC [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 65-71.
[11]	YANG Can, LUO Tao, LIU Ying, LI Zexu, XU Yongqing. QoS Routing Algorithm in Clustered Self-Organizing Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(1): 1-6.
[12]	HUANG Hao, HU Zhi-qun, WANG Lu-han, LU Zhao-ming, WEN Xiang-ming. Intelligent Traffic Signal Control Algorithm Based on Sumtree DDPG [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 97-103.
[13]	GUAN Wan-qing, ZHANG Hai-jun, LU Zhao-ming. Intelligent Resource Allocation Algorithm for 6G Multi-Tenant Network Slicing Based on Deep Reinforcement Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 132-139.
[14]	MA Qing-liu, YU Peng, WU Jia-hui, XIONG Ao, YAN Yong. A Integrated Energy Service Channel Optimization Mechanism Based on Deep Reinforcement Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(2): 87-93.
[15]	CHENG Chao, TENG Jun-jie, ZHAO Yan-ling, SONG Mei. Traffic Distribution Algorithm Based on Multi-Agent Reinforcement Learning [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 43-48,57.

Reinforcement Learning Based Energy Dispatch Strategy and Control Optimization of Microgrid

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments