LAPSE:2023.32156
Published Article
LAPSE:2023.32156
Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach
Grace Muriithi, Sunetra Chowdhury
April 19, 2023
In the near future, microgrids will become more prevalent as they play a critical role in integrating distributed renewable energy resources into the main grid. Nevertheless, renewable energy sources, such as solar and wind energy can be extremely volatile as they are weather dependent. These resources coupled with demand can lead to random variations on both the generation and load sides, thus complicating optimal energy management. In this article, a reinforcement learning approach has been proposed to deal with this non-stationary scenario, in which the energy management system (EMS) is modelled as a Markov decision process (MDP). A novel modification of the control problem has been presented that improves the use of energy stored in the battery such that the dynamic demand is not subjected to future high grid tariffs. A comprehensive reward function has also been developed which decreases infeasible action explorations thus improving the performance of the data-driven technique. A Q-learning algorithm is then proposed to minimize the operational cost of the microgrid under unknown future information. To assess the performance of the proposed EMS, a comparison study between a trading EMS model and a non-trading case is performed using a typical commercial load curve and PV profile over a 24-h horizon. Numerical simulation results indicate that the agent learns to select an optimized energy schedule that minimizes energy cost (cost of power purchased from the utility and battery wear cost) in all the studied cases. However, comparing the non-trading EMS to the trading EMS model operational costs, the latter one was found to decrease costs by 4.033% in summer season and 2.199% in winter season.
Keywords
Markov decision process, microgrid, Q-learning, renewable energy resources, smart control policy
Suggested Citation
Muriithi G, Chowdhury S. Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach. (2023). LAPSE:2023.32156
Author Affiliations
Muriithi G: Department of Electrical Engineering, University of Cape Town, Cape Town 7701, South Africa
Chowdhury S: Department of Electrical Engineering, University of Cape Town, Cape Town 7701, South Africa
Journal Name
Energies
Volume
14
Issue
9
First Page
2700
Year
2021
Publication Date
2021-05-08
Published Version
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en14092700, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.32156
This Record
External Link

doi:10.3390/en14092700
Publisher Version
Download
Files
[Download 1v1.pdf] (5.9 MB)
Apr 19, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
74
Version History
[v1] (Original Submission)
Apr 19, 2023
 
Verified by curator on
Apr 19, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.32156
 
Original Submitter
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version