LAPSE:2026.0394
Published Article

LAPSE:2026.0394
Optimal Stopping of Batch Processes with Stochastic Dynamics - A Study of When to Act under Uncertainty
July 6, 2026. Originally submitted on June 12, 2026
Abstract
Mathematical models in process systems engineering (PSE) are widely used to support decision-making in design and operation, but they are mostly limited to deterministic models. For biochemical systems, the biological variability can give rise to stochastic dynamics. This work addresses the question of when to act in such processes, as the stochastic dynamics affect the timing of important events. We consider the case of batch production of malic acid using Ustilago trichophora. The goal is to predict when the substrate concentration falls below a predefined threshold. We extend an existing deterministic model of the process to a stochastic differential equation (SDE) formulation by introducing a Monod-like noise term. Simulations of the SDE model reveal a distribution of substrate depletion times and a deviation between the mean of the stochastic trajectory and the deterministic solution due to nonlinear effects. To determine optimal intervention times under uncertainty, we formulate a finite-horizon optimal stopping problem and solve it using the Longstaff-Schwartz algorithm, also known as the Least-Squares Monte Carlo (LSMC). The resulting distribution of optimal stopping times from the LSMC algorithm is shown to closely match the actual first threshold hitting times obtained from a posteriori analysis of the stochastic simulations, as confirmed by a two-sample Kolmogorov-Smirnov test. The results demonstrate that optimal stopping provides a framework for decision-making in stochastic biochemical processes, enabling risk-aware operational strategies beyond deterministic optimisation.
Mathematical models in process systems engineering (PSE) are widely used to support decision-making in design and operation, but they are mostly limited to deterministic models. For biochemical systems, the biological variability can give rise to stochastic dynamics. This work addresses the question of when to act in such processes, as the stochastic dynamics affect the timing of important events. We consider the case of batch production of malic acid using Ustilago trichophora. The goal is to predict when the substrate concentration falls below a predefined threshold. We extend an existing deterministic model of the process to a stochastic differential equation (SDE) formulation by introducing a Monod-like noise term. Simulations of the SDE model reveal a distribution of substrate depletion times and a deviation between the mean of the stochastic trajectory and the deterministic solution due to nonlinear effects. To determine optimal intervention times under uncertainty, we formulate a finite-horizon optimal stopping problem and solve it using the Longstaff-Schwartz algorithm, also known as the Least-Squares Monte Carlo (LSMC). The resulting distribution of optimal stopping times from the LSMC algorithm is shown to closely match the actual first threshold hitting times obtained from a posteriori analysis of the stochastic simulations, as confirmed by a two-sample Kolmogorov-Smirnov test. The results demonstrate that optimal stopping provides a framework for decision-making in stochastic biochemical processes, enabling risk-aware operational strategies beyond deterministic optimisation.
Record ID
Keywords
decision-making under uncertainty, optimal stopping, Stochastic differential equations SDEs
Subject
Suggested Citation
Ramadhan RS, Grebe L, Maschmeier M, Pastoors J, Cramer E. Optimal Stopping of Batch Processes with Stochastic Dynamics - A Study of When to Act under Uncertainty. Systems and Control Transactions 5:1513-1519 (2026) https://doi.org/10.69997/sct.199257
Author Affiliations
Ramadhan RS: Davidson School of Chemical Engineering, Purdue University, West Lafayette, IN 47907, USA. RWTH Aachen University, Process Systems Engineering (AVT.SVT), Aachen 52074, Germany [ORCID]
Grebe L: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany [ORCID]
Maschmeier M: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany
Pastoors J: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany [ORCID]
Cramer E: RWTH Aachen University, Process Systems Engineering (AVT.SVT), Aachen 52074, Germany. University College London, Sargent Centre for Process Systems Engineering, Department of Chemical Engineering, London WC1E 7JE, United Kingdom [ORCID]
[Login] to see author email addresses.
Grebe L: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany [ORCID]
Maschmeier M: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany
Pastoors J: RWTH Aachen University, Biochemical Process Engineering (AVT.BioVT), Aachen 52074, Germany [ORCID]
Cramer E: RWTH Aachen University, Process Systems Engineering (AVT.SVT), Aachen 52074, Germany. University College London, Sargent Centre for Process Systems Engineering, Department of Chemical Engineering, London WC1E 7JE, United Kingdom [ORCID]
[Login] to see author email addresses.
Journal Name
Systems and Control Transactions
Volume
5
First Page
1513
Last Page
1519
Year
2026
Publication Date
2026-06-12
Version Comments
Corrected figure 1 caption
Other Meta
PII: 1513-1519-26-SCT-5-2026, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2026.0394
This Record
External Link

https://doi.org/10.69997/sct.199257
Publisher Version
Download
Meta
Links to Related Works
References Cited
- Almquist J, Cvijovic M, Hatzimanikatis V, Nielsen J, Jirstrand M. Kinetic models in industrial biotechnology - improving cell factory performance. Metabolic Engineering 24:38-60 (2014) https://doi.org/10.1016/j.ymben.2014.03.007
- M. D. Graham and J. B. Rawlings. Modeling and Analysis Principles for Chemical and Biological Engineers. Santa Barbara: Nob Hill Publishing, 2022. isbn:9780975937761.
- Pischel D, Sundmacher K, Flassig RJ. Efficient simulation of intrinsic, extrinsic and external noise in biochemical systems. Bioinformatics 33:i319-i324 (2017) https://doi.org/10.1093/bioinformatics/btx253
- Privault N. Introduction to stochastic finance with market examples. Chapman and Hall/CRC (2022) https://doi.org/10.1201/9781003298670
- Glasserman P. Monte carlo methods in financial engineering. Springer New York (2003) https://doi.org/10.1007/978-0-387-21617-1
- Longstaff FA, Schwartz ES. Valuing american options by simulation: a simple least-squares approach. Rev. Financ. Stud. 14:113-147 (2001) https://doi.org/10.1093/rfs/14.1.113
- , Diaz F, Sommerfeld M, , Hovestadt G, , Latacz D, , Friedrich B, . Lessons learned from attempts at minimising CO2 emissions in process metallurgy - pyrolysed secondary raw materials, bio-coke, and hydrogen as alternative reducing agents. 12th International Conference of Molten Slags, Fluxes and Salts (MOLTEN 2024) Proceedings :1519-1532 (2024) https://doi.org/10.62053/zkqg2762
- Thygesen UH. Stochastic differential equations for science and engineering. Chapman and Hall/CRC (2023) https://doi.org/10.1201/9781003277569
- Monod J. THE GROWTH OF BACTERIAL CULTURES. Annu. Rev. Microbiol. 3:371-394 (1949) https://doi.org/10.1146/annurev.mi.03.100149.002103
- A. Nobel. Convex Functions and Jensen's Inequality. Sept. 2024. url: https://nobel.web.unc.edu/teaching/stor- 555- theoretical- statistics/stor- 555-lecture-notes/
(0.1 seconds)
[0.1 s]

