LAPSE:2023.0840
Published Article
LAPSE:2023.0840
Where Reinforcement Learning Meets Process Control: Review and Guidelines
February 21, 2023
Abstract
This paper presents a literature review of reinforcement learning (RL) and its applications to process control and optimization. These applications were evaluated from a new perspective on simulation-based offline training and process demonstrations, policy deployment with transfer learning (TL) and the challenges of integrating it by proposing a feasible approach to online process control. The study elucidates how learning from demonstrations can be accomplished through imitation learning (IL) and reinforcement learning, and presents a hyperparameter-optimization framework to obtain a feasible algorithm and deep neural network (DNN). The study details a batch process control experiment using the deep-deterministic-policy-gradient (DDPG) algorithm modified with adversarial imitation learning.
Keywords
imitation learning, Markov decision process, process optimization, transfer learning
Suggested Citation
Faria RDR, Capron BDO, Secchi AR, de Souza MB Jr. Where Reinforcement Learning Meets Process Control: Review and Guidelines. (2023). LAPSE:2023.0840
Author Affiliations
Faria RDR: Escola de Química, EPQB, Universidade Federal do Rio de Janeiro, Rio de Janeiro 21941-909, Brazil [ORCID]
Capron BDO: Escola de Química, EPQB, Universidade Federal do Rio de Janeiro, Rio de Janeiro 21941-909, Brazil [ORCID]
Secchi AR: Programa de Engenharia Química, PEQ/COPPE, Universidade Federal do Rio de Janeiro, Rio de Janeiro 21941-972, Brazil [ORCID]
de Souza MB Jr: Escola de Química, EPQB, Universidade Federal do Rio de Janeiro, Rio de Janeiro 21941-909, Brazil; Programa de Engenharia Química, PEQ/COPPE, Universidade Federal do Rio de Janeiro, Rio de Janeiro 21941-972, Brazil [ORCID]
Journal Name
Processes
Volume
10
Issue
11
First Page
2311
Year
2022
Publication Date
2022-11-06
ISSN
2227-9717
Version Comments
Original Submission
Other Meta
PII: pr10112311, Publication Type: Review
Record Map
Published Article

LAPSE:2023.0840
This Record
External Link

https://doi.org/10.3390/pr10112311
Publisher Version
Download
Files
Feb 21, 2023
Main Article
License
CC BY 4.0
Meta
Record Statistics
Record Views
406
Version History
[v1] (Original Submission)
Feb 21, 2023
 
Verified by curator on
Feb 21, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
http://psecommunity.org/LAPSE:2023.0840
 
Record Owner
Auto Uploader for LAPSE
Links to Related Works
Directly Related to This Work
Publisher Version