LAPSE:2023.14876
Published Article

LAPSE:2023.14876
Automatic Verification Flow Shop Scheduling of Electric Energy Meters Based on an Improved Q-Learning Algorithm
March 2, 2023
Abstract
Considering the engineering problem of electric energy meter automatic verification and scheduling, this paper proposes a novel scheduling scheme based on an improved Q-learning algorithm. First, by introducing the state variables and behavior variables, the ranking problem of combinatorial optimization is transformed into a sequential decision problem. Then, a novel reward function is proposed to evaluate the pros and cons of the different strategies. In particular, this paper considers adopting the reinforcement learning algorithm to efficiently solve the problem. In addition, this paper also considers the ratio of exploration and utilization in the reinforcement learning process, and then provides reasonable exploration and utilization through an iterative updating scheme. Meanwhile, a decoupling strategy is introduced to address the restriction of over estimation. Finally, real time data from a provincial electric energy meter automatic verification center are used to verify the effectiveness of the proposed algorithm.
Considering the engineering problem of electric energy meter automatic verification and scheduling, this paper proposes a novel scheduling scheme based on an improved Q-learning algorithm. First, by introducing the state variables and behavior variables, the ranking problem of combinatorial optimization is transformed into a sequential decision problem. Then, a novel reward function is proposed to evaluate the pros and cons of the different strategies. In particular, this paper considers adopting the reinforcement learning algorithm to efficiently solve the problem. In addition, this paper also considers the ratio of exploration and utilization in the reinforcement learning process, and then provides reasonable exploration and utilization through an iterative updating scheme. Meanwhile, a decoupling strategy is introduced to address the restriction of over estimation. Finally, real time data from a provincial electric energy meter automatic verification center are used to verify the effectiveness of the proposed algorithm.
Record ID
Keywords
electric energy meters automatic verification, flow shop scheduling, Q-learning, reinforcement learning
Subject
Suggested Citation
Peng L, Li J, Zhao J, Dang S, Kong Z, Ding L. Automatic Verification Flow Shop Scheduling of Electric Energy Meters Based on an Improved Q-Learning Algorithm. (2023). LAPSE:2023.14876
Author Affiliations
Peng L: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Li J: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Zhao J: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Dang S: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Kong Z: School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China [ORCID]
Ding L: School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China [ORCID]
Li J: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Zhao J: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Dang S: Meteorology Center of Guangdong Power Grid Co., Ltd., Guangzhou 510600, China
Kong Z: School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China [ORCID]
Ding L: School of Electrical Engineering and Automation, Wuhan University, Wuhan 430072, China [ORCID]
Journal Name
Energies
Volume
15
Issue
5
First Page
1626
Year
2022
Publication Date
2022-02-22
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15051626, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.14876
This Record
External Link

https://doi.org/10.3390/en15051626
Publisher Version
Download
Meta
Record Statistics
Record Views
302
Version History
[v1] (Original Submission)
Mar 2, 2023
Verified by curator on
Mar 2, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.14876
Record Owner
Auto Uploader for LAPSE
Links to Related Works
(0.11 seconds)
[0.11 s]
