LAPSE:2023.1223
Published Article
LAPSE:2023.1223
Reinforcement Learning Control with Deep Deterministic Policy Gradient Algorithm for Multivariable pH Process
Chanin Panjapornpon, Patcharapol Chinchalongporn, Santi Bardeeniz, Ratthanita Makkayatorn, Witchaya Wongpunnawat
February 21, 2023
The pH treatment unit is widely used in various processes, such as wastewater treatment, pharmaceutical manufacturing, and fermentation. It is essential to get the on-specifications product. Thus, controlling pH is key management for accomplishing the manufacturing objective. However, the highly nonlinear pH characteristics of acid−base titration make pH regulation difficult. Applications of artificial intelligence for process control have progressed and gained popularity recently. The development of reinforcement learning (RL) control with a deep deterministic policy gradient (DDPG) algorithm to handle coupled pH and liquid level control in a continuous stirred tank reactor with a strong acid−base reaction is presented in this study. To validate the RL model, the reward functions are created individually for the level and pH controls. The grid search technique is deployed to optimize the hyperparameters of the RL controller models, including the number of nodes in the hidden layers and the number of episodes. The control performance of the proposed RL control system was compared with that of the proportional-integral controller in a servo-regulatory test. The simulation results show that the proposed RL controllers outperform the proportional-integral controllers in approaching setpoints faster, with better performance and less oscillation.
Keywords
Artificial Intelligence, deterministic deep policy gradient, grid search, pH control, reinforcement learning
Suggested Citation
Panjapornpon C, Chinchalongporn P, Bardeeniz S, Makkayatorn R, Wongpunnawat W. Reinforcement Learning Control with Deep Deterministic Policy Gradient Algorithm for Multivariable pH Process. (2023). LAPSE:2023.1223
Author Affiliations
Panjapornpon C: Department of Chemical Engineering, Center of Excellence on Petrochemicals and Materials Technology, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand [ORCID]
Chinchalongporn P: Department of Chemical Engineering, Center of Excellence on Petrochemicals and Materials Technology, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand
Bardeeniz S: Department of Chemical Engineering, Center of Excellence on Petrochemicals and Materials Technology, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand [ORCID]
Makkayatorn R: Department of Chemical Engineering, Center of Excellence on Petrochemicals and Materials Technology, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand
Wongpunnawat W: Department of Chemical Engineering, Center of Excellence on Petrochemicals and Materials Technology, Faculty of Engineering, Kasetsart University, Bangkok 10900, Thailand
Journal Name
Processes
Volume
10
Issue
12
First Page
2514
Year
2022
Publication Date
2022-11-26
Published Version
ISSN
2227-9717
Version Comments
Original Submission
Other Meta
PII: pr10122514, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.1223
This Record
External Link

doi:10.3390/pr10122514
Publisher Version
Download
Files
Feb 21, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
80
Version History
[v1] (Original Submission)
Feb 21, 2023
 
Verified by curator on
Feb 21, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.1223
 
Original Submitter
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version