Proceedings of ESCAPE 35ISSN: 2818-4734
Volume: 4 (2025)
Table of Contents
LAPSE:2025.0458
Published Article
LAPSE:2025.0458
Reinforcement learning for distillation process synthesis using transformer blocks
N. Slager, M.B. Franke
June 27, 2025
Abstract
A reinforcement learning framework is developed for the synthesis of distillation trains. The rigorous Naphtali-Sandholm algorithm for equilibrium separation modeling was implemented in JAX and coupled with the benchmarking Jumanji RL library. The vanilla actor-critic agent was successfully trained to build distillation trains for a seven-component hydrocarbon mixture. A transformer encoder structure was used to apply self-attention over the agent’s observation. The agent was trained on minimal data representation containing quantitative component flows and relative volatility parameters between present components. Training sessions involving 5·104 episodes (3·105 column designs) were typically run in under 60 minutes. While training was fast and reliable with appropriate tuning of the hyperparameters, further improvements are needed in the generalizability performance for similar separation problems.
Keywords
Suggested Citation
Slager N, Franke M. Reinforcement learning for distillation process synthesis using transformer blocks. Systems and Control Transactions 4:1902-1907 (2025) https://doi.org/10.69997/sct.115663
Author Affiliations
Slager N: Sustainable Process Technology Group, Department of Chemical Engineering, Faculty of Science and Technology,
Franke M: Sustainable Process Technology Group, Department of Chemical Engineering, Faculty of Science and Technology,
Journal Name
Systems and Control Transactions
Volume
4
First Page
1902
Last Page
1907
Year
2025
Publication Date
2025-07-01
Version Comments
Original Submission
Other Meta
PII: 1902-1907-1734-SCT-4-2025, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2025.0458
This Record
External Link

https://doi.org/10.69997/sct.115663
Article DOI
Download
Files
Jun 27, 2025
Main Article
License
CC BY-SA 4.0
Meta
Record Statistics
Record Views
760
Version History
[v1] (Original Submission)
Jun 27, 2025
 
Verified by curator on
Jun 27, 2025
This Version Number
v1
Citations
Most Recent
This Version
URL Here
http://psecommunity.org/LAPSE:2025.0458
 
Record Owner
PSE Press
Links to Related Works
Directly Related to This Work
Article DOI
References Cited
  1. Mowbray, M. et al. Industrial data science-a review of machine learning applications for chemical and process industries. React. Chem. Eng. 7:141-1509 (2022) https://doi.org/10.1039/D1RE00541C
  2. Midgley LI. Deep reinforcement learning for process synthesis. arXiv preprint (2020) arXiv:2009.13265
  3. van Kalmthout SC, Midgley LI, and Franke MB. Synthesis of separation processes with reinforcement learning. arXiv preprint 4:32-42 (2022) arXiv:2211.04327, 2022
  4. Göttl Q, et al. Automated Flowsheet Synthesis Using Hierarchical Reinforcement Learning: Proof of Concept. Chem. Ing. Tech. 4:32-42 (2020)
  5. Göttl Q, et al. Deep reinforcement learning uncovers processes for separating azeotropic mixtures without prior knowledge. arXiv preprint (2023) arXiv:2310.06415, 2023 https://doi.org/10.2139/ssrn.4776784
  6. Khan AA, Lapkin, AA. Designing the process designer: Hierarchical reinforcement learning for optimisation-based process design. Chem Eng Process Process. Intensif. 180:108885 (2022) https://doi.org/10.1016/j.cep.2022.108885
  7. Wang D, et al. A coupled reinforcement learning and IDAES process modeling framework for automated conceptual design of energy and chemical systems.. Energy Adv. 2:1735-1751 (2023) https://doi.org/10.1039/D3YA00310H
  8. Gao Q, et al. Transfer learning for process design with reinforcement learning. Comput. Aided Chem. Eng. 52:2005-2010 (2023) https://doi.org/10.1016/B978-0-443-15274-0.50319-X
  9. Reynoso-Donzelli S, Ricardez-Sandoval LA. A reinforcement learning approach with masked agents for chemical process flowsheet design. AIChE Journal 71:e18584 (2024) https://doi.org/10.1002/aic.18584
  10. Stops L, et al. Flowsheet generation through hierarchical reinforcement learning and graph neural networks. AIChE Journal 69:e17938 (2023) https://doi.org/10.1002/aic.17938
  11. Seidenberg JR, Khan AA, Lapkin, AA. Boosting autonomous process design and intensification with formalized domain knowledge. Comput. Chem. Eng. 169:108097 (2023) https://doi.org/10.1016/j.compchemeng.2022.108097
  12. Bonnet C, et al. Jumanji: a diverse suite of scalable reinforcement learning environments in JAX. arXiv preprint (2023) arXiv:2306.09884