LAPSE:2025.0166
Published Article

LAPSE:2025.0166
Reaction Pathway Optimization Using Reinforcement Learning in Steam Methane Reforming and Associated Parallel Reactions
June 27, 2025
Abstract
This study presents the application of a Q-learning algorithm to optimize the selection of chemical reactions for methane reforming processes. Starting with a set of 11 candidate reactions, the algorithm identified three key reactions. These reactions effectively represent the experimental data while aligning with the underlying physics of the process and previously reported findings. The algorithm employed an epsilon-greedy policy to balance exploration and exploitation during the training process. Furthermore, simulations based on the identified reactions revealed trends consistent with experimental data. This work highlights the efficiency and adaptability of Q-learning in modeling complex catalytic systems and provides a framework for further exploration and optimization of methane reforming processes.
This study presents the application of a Q-learning algorithm to optimize the selection of chemical reactions for methane reforming processes. Starting with a set of 11 candidate reactions, the algorithm identified three key reactions. These reactions effectively represent the experimental data while aligning with the underlying physics of the process and previously reported findings. The algorithm employed an epsilon-greedy policy to balance exploration and exploitation during the training process. Furthermore, simulations based on the identified reactions revealed trends consistent with experimental data. This work highlights the efficiency and adaptability of Q-learning in modeling complex catalytic systems and provides a framework for further exploration and optimization of methane reforming processes.
Record ID
Keywords
Subject
Suggested Citation
Rodríguez-Fragoso M, Elizalde-Solis O, Ramírez-Jiménez E. Reaction Pathway Optimization Using Reinforcement Learning in Steam Methane Reforming and Associated Parallel Reactions. Systems and Control Transactions 4:98-103 (2025) https://doi.org/10.69997/sct.128960
Author Affiliations
Rodríguez-Fragoso M: Department of Chemical Petroleum Engineering, ESIQIE, Instituto Politécnico Nacional, Mexico City, 07738, Mexico
Elizalde-Solis O: Department of Chemical Petroleum Engineering, ESIQIE, Instituto Politécnico Nacional, Mexico City, 07738, Mexico
Ramírez-Jiménez E: Department of Chemical Petroleum Engineering, ESIQIE, Instituto Politécnico Nacional, Mexico City, 07738, Mexico
Elizalde-Solis O: Department of Chemical Petroleum Engineering, ESIQIE, Instituto Politécnico Nacional, Mexico City, 07738, Mexico
Ramírez-Jiménez E: Department of Chemical Petroleum Engineering, ESIQIE, Instituto Politécnico Nacional, Mexico City, 07738, Mexico
Journal Name
Systems and Control Transactions
Volume
4
First Page
98
Last Page
103
Year
2025
Publication Date
2025-07-01
Version Comments
Original Submission
Other Meta
PII: 0098-0103-1267-SCT-4-2025, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2025.0166
This Record
External Link

https://doi.org/10.69997/sct.128960
Article DOI
Download
Meta
Record Statistics
Record Views
1060
Version History
[v1] (Original Submission)
Jun 27, 2025
Verified by curator on
Jun 27, 2025
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2025.0166
Record Owner
PSE Press
Links to Related Works
References Cited
- Chen K, Zhao Y, Feng D, Sun S. The intrinsic kinetics of methane steam reforming over a nickel-based catalyst in a micro fluidized bed reaction system. Int J Hydrogen Energy 45: 1615-1628 (2020) https://doi.org/10.1016/j.ijhydene.2019.11.080
- Sutton RS., Barto. AG. Reinforcement Learning: An Introduction. The MIT Press (2014)
- Akers WW, Camp DP. Kinetics of the methane-steam reaction. J AIChE 1:471-475 (1955) https://doi.org/10.1002/aic.690010415
- Allen DW , Gerhard ER, Likins MR. Kinetics of the Methane-Steam Reaction. Ind Eng Chem Process Des Dev 14:256-259 (1975) https://doi.org/10.1021/i260055a010
- Ross JR, Steel MC. Mechanism of the Steam Reforming of Methane over a Coprecipitated Nickel-Alumina Catalyst. J Chem Soc 69: 10-21(1973) https://doi.org/10.1039/f19736900010
- Dirksen HA, Riesz CH. Equilibrium in the Steam Reforming of Natural Gas. Ind Eng Chem 45:1562-1565 (1953) https://doi.org/10.1021/ie50523a053
- Jianguo X, Gilbert FF. Methane Steam Reforming, Methanation and Water-Gas Shift: 1. Intrinsic Kinetics. J AIChe 1: 88-96(1989) https://doi.org/10.1002/aic.690350109
- Hou K, Hughes R. The kinetics of methane steam reforming over a Ni/a-Al2O catalyst. J Chem Eng 82: 311-328 (2001 ) https://doi.org/10.1016/S1385-8947(00)00367-3
- Zhu C, Byrd RH, Lu P, Nocedal J. Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans Math Softw 23:550-560 (1997) https://doi.org/10.1145/279232.279236
- Byrd RH, Lu P, Nocedal J, Zhu C. A Limited Memory Algorithm for Bound Constrained Optimization. J SIAM Sci Comput 16:1190-1208 (1995) https://doi.org/10.1137/0916069
(0.09 seconds)
[0.09 s]

