LAPSE:2023.6378
Published Article
LAPSE:2023.6378
Reactive Power Control of a Converter in a Hardware-Based Environment Using Deep Reinforcement Learning
Ode Bokker, Henning Schlachter, Vanessa Beutel, Stefan Geißendörfer, Karsten von Maydell
February 23, 2023
Abstract
Due to the increasing penetration of the power grid with renewable, distributed energy resources, new strategies for voltage stabilization in low voltage distribution grids must be developed. One approach to autonomous voltage control is to apply reinforcement learning (RL) for reactive power injection by converters. In this work, to implement a secure test environment including real hardware influences for such intelligent algorithms, a power hardware-in-the-loop (PHIL) approach is used to combine a virtually simulated grid with real hardware devices to emulate as realistic grid states as possible. The PHIL environment is validated through the identification of system limits and analysis of deviations to a software model of the test grid. Finally, an adaptive volt−var control algorithm using RL is implemented to control reactive power injection of a real converter within the test environment. Despite facing more difficult conditions in the hardware than in the software environment, the algorithm is successfully integrated to control the voltage at a grid connection point in a low voltage grid. Thus, the proposed study underlines the potential to use RL in the voltage stabilization of future power grids.
Keywords
power grid, power hardware-in-the-loop, reactive power, voltage control
Suggested Citation
Bokker O, Schlachter H, Beutel V, Geißendörfer S, von Maydell K. Reactive Power Control of a Converter in a Hardware-Based Environment Using Deep Reinforcement Learning. (2023). LAPSE:2023.6378
Author Affiliations
Bokker O: German Aerospace Center (DLR), Institute of Networked Energy Systems, Carl-von-Ossietzky-Str. 15, 26129 Oldenburg, Germany [ORCID]
Schlachter H: German Aerospace Center (DLR), Institute of Networked Energy Systems, Carl-von-Ossietzky-Str. 15, 26129 Oldenburg, Germany [ORCID]
Beutel V: German Aerospace Center (DLR), Institute of Networked Energy Systems, Carl-von-Ossietzky-Str. 15, 26129 Oldenburg, Germany
Geißendörfer S: German Aerospace Center (DLR), Institute of Networked Energy Systems, Carl-von-Ossietzky-Str. 15, 26129 Oldenburg, Germany [ORCID]
von Maydell K: German Aerospace Center (DLR), Institute of Networked Energy Systems, Carl-von-Ossietzky-Str. 15, 26129 Oldenburg, Germany
Journal Name
Energies
Volume
16
Issue
1
First Page
78
Year
2022
Publication Date
2022-12-21
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en16010078, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.6378
This Record
External Link

https://doi.org/10.3390/en16010078
Publisher Version
Download
Files
Feb 23, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
295
Version History
[v1] (Original Submission)
Feb 23, 2023
 
Verified by curator on
Feb 23, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.6378
 
Record Owner
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version
(0.07 seconds)

[0.08 s]