LAPSE:2023.31595
Published Article
LAPSE:2023.31595
Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning
Ying Ji, Jianhui Wang, Jiacan Xu, Donglin Li
April 19, 2023
The proliferation of distributed renewable energy resources (RESs) poses major challenges to the operation of microgrids due to uncertainty. Traditional online scheduling approaches relying on accurate forecasts become difficult to implement due to the increase of uncertain RESs. Although several data-driven methods have been proposed recently to overcome the challenge, they generally suffer from a scalability issue due to the limited ability to optimize high-dimensional continuous control variables. To address these issues, we propose a data-driven online scheduling method for microgrid energy optimization based on continuous-control deep reinforcement learning (DRL). We formulate the online scheduling problem as a Markov decision process (MDP). The objective is to minimize the operating cost of the microgrid considering the uncertainty of RESs generation, load demand, and electricity prices. To learn the optimal scheduling strategy, a Gated Recurrent Unit (GRU)-based network is designed to extract temporal features of uncertainty and generate the optimal scheduling decisions in an end-to-end manner. To optimize the policy with high-dimensional and continuous actions, proximal policy optimization (PPO) is employed to train the neural network-based policy in a data-driven fashion. The proposed method does not require any forecasting information on the uncertainty or a prior knowledge of the physical model of the microgrid. Simulation results using realistic power system data of California Independent System Operator (CAISO) demonstrate the effectiveness of the proposed method.
Keywords
data driven modeling, microgrid energy management, proximal policy optimization, recurrent neural network
Suggested Citation
Ji Y, Wang J, Xu J, Li D. Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning. (2023). LAPSE:2023.31595
Author Affiliations
Ji Y: College of Information Science and Engineering, Northeastern University, Shenyang 110819, China [ORCID]
Wang J: College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
Xu J: College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
Li D: College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
Journal Name
Energies
Volume
14
Issue
8
First Page
2120
Year
2021
Publication Date
2021-04-10
Published Version
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en14082120, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.31595
This Record
External Link

doi:10.3390/en14082120
Publisher Version
Download
Files
[Download 1v1.pdf] (944 kB)
Apr 19, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
62
Version History
[v1] (Original Submission)
Apr 19, 2023
 
Verified by curator on
Apr 19, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.31595
 
Original Submitter
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version