LAPSE:2023.9470
Published Article

LAPSE:2023.9470
Energy Management Simulation with Multi-Agent Reinforcement Learning: An Approach to Achieve Reliability and Resilience
February 27, 2023
Abstract
The share of energy produced by small-scale renewable energy sources, including photovoltaic panels and wind turbines, will significantly increase in the near future. These systems will be integrated in microgrids to strengthen the independence of energy consumers. This work deals with energy management in microgrids, taking into account the volatile nature of renewable energy sources. In the developed approach, Multi-Agent Reinforcement Learning is applied, where agents represent microgrid components. The individual agents are trained to make good decisions with respect to adapting to the energy load in the grid. Training of agents leverages the historic energy profile data for energy consumption and renewable energy production. The implemented energy management simulation shows good performance and balances the energy flows. The quantitative performance evaluation includes comparisons with the exact solutions from a linear program. The computational results demonstrate good generalisation capabilities of the trained agents and the impact of these capabilities on the reliability and resilience of energy management in microgrids.
The share of energy produced by small-scale renewable energy sources, including photovoltaic panels and wind turbines, will significantly increase in the near future. These systems will be integrated in microgrids to strengthen the independence of energy consumers. This work deals with energy management in microgrids, taking into account the volatile nature of renewable energy sources. In the developed approach, Multi-Agent Reinforcement Learning is applied, where agents represent microgrid components. The individual agents are trained to make good decisions with respect to adapting to the energy load in the grid. Training of agents leverages the historic energy profile data for energy consumption and renewable energy production. The implemented energy management simulation shows good performance and balances the energy flows. The quantitative performance evaluation includes comparisons with the exact solutions from a linear program. The computational results demonstrate good generalisation capabilities of the trained agents and the impact of these capabilities on the reliability and resilience of energy management in microgrids.
Record ID
Keywords
energy management, microgrid, multi-agent reinforcement learning, renewable energy systems
Subject
Suggested Citation
Deshpande K, Möhl P, Hämmerle A, Weichhart G, Zörrer H, Pichler A. Energy Management Simulation with Multi-Agent Reinforcement Learning: An Approach to Achieve Reliability and Resilience. (2023). LAPSE:2023.9470
Author Affiliations
Deshpande K: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Möhl P: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria
Hämmerle A: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria
Weichhart G: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Zörrer H: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Pichler A: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Möhl P: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria
Hämmerle A: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria
Weichhart G: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Zörrer H: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Pichler A: Profactor GmbH, Robotics and Automation Systems Department, 4407 Steyr, Austria [ORCID]
Journal Name
Energies
Volume
15
Issue
19
First Page
7381
Year
2022
Publication Date
2022-10-08
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15197381, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.9470
This Record
External Link

https://doi.org/10.3390/en15197381
Publisher Version
Download
Meta
Record Statistics
Record Views
171
Version History
[v1] (Original Submission)
Feb 27, 2023
Verified by curator on
Feb 27, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.9470
Record Owner
Auto Uploader for LAPSE
Links to Related Works
