LAPSE:2026.0401
Published Article

LAPSE:2026.0401
A Comparative Analysis of Sequential Active Learning Approaches: Statistical Design of Experiments versus Bayesian Optimisation
June 12, 2026
Abstract
As chemical processes become increasingly complex and costs of experimentation increase, understanding the practical effectiveness of Active Learning methodologies is essential. In this regard, an ongoing debate is occurring within the research community about the use of Design of Experiments (DOE) and Bayesian Optimisation (BO). However, this debate is limited by the scarcity of systematic comparative studies. Therefore, this work provides a comparative analysis of two widely adopted data-driven optimisation approaches: DOE and BO. The comparison is conducted across two distinct case studies reflecting different levels of complexity, regarding the quantity and variety of input variables involved. The first case study represents a realistic in silico experimental scenario, with multiple decision variables of different types (continuous, categorical and mixture), and two distinct single-objective optimisation goals, while the second one considers a simpler, well-known benchmark model with just two input continuous variables. Both studies were designed and analysed, while acknowledging the inherent conceptual and operational differences between DOE and BO. The results showed that a sequential DOE strategy, adapted here for optimisation purposes, consistently outperformed classical BO under the tested conditions. Particularly in terms of convergence towards the target response, robustness in identifying the optimal region, and overall experimental budget efficiency. Rather than asserting the superiority of one methodology over the other, this work highlights the need for case-specific adaptation when applying data-driven optimisation strategies in Chemical Engineering. The findings emphasise that theoretical guarantees alone under relatively strict assumptions are insufficient and must be complemented by problem-driven evaluation to support informed decision-making.
As chemical processes become increasingly complex and costs of experimentation increase, understanding the practical effectiveness of Active Learning methodologies is essential. In this regard, an ongoing debate is occurring within the research community about the use of Design of Experiments (DOE) and Bayesian Optimisation (BO). However, this debate is limited by the scarcity of systematic comparative studies. Therefore, this work provides a comparative analysis of two widely adopted data-driven optimisation approaches: DOE and BO. The comparison is conducted across two distinct case studies reflecting different levels of complexity, regarding the quantity and variety of input variables involved. The first case study represents a realistic in silico experimental scenario, with multiple decision variables of different types (continuous, categorical and mixture), and two distinct single-objective optimisation goals, while the second one considers a simpler, well-known benchmark model with just two input continuous variables. Both studies were designed and analysed, while acknowledging the inherent conceptual and operational differences between DOE and BO. The results showed that a sequential DOE strategy, adapted here for optimisation purposes, consistently outperformed classical BO under the tested conditions. Particularly in terms of convergence towards the target response, robustness in identifying the optimal region, and overall experimental budget efficiency. Rather than asserting the superiority of one methodology over the other, this work highlights the need for case-specific adaptation when applying data-driven optimisation strategies in Chemical Engineering. The findings emphasise that theoretical guarantees alone under relatively strict assumptions are insufficient and must be complemented by problem-driven evaluation to support informed decision-making.
Record ID
Keywords
Active Learning AL approaches, Bayesian Optimisation BO, Optimisation, Statistical Design of Experiments DOE
Subject
Suggested Citation
Batista DV, Reis MS. A Comparative Analysis of Sequential Active Learning Approaches: Statistical Design of Experiments versus Bayesian Optimisation. Systems and Control Transactions 5:1573-1581 (2026) https://doi.org/10.69997/sct.136396
Author Affiliations
Journal Name
Systems and Control Transactions
Volume
5
First Page
1573
Last Page
1581
Year
2026
Publication Date
2026-06-12
Version Comments
Original Submission
Other Meta
PII: 1573-1581-119-SCT-5-2026, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2026.0401
This Record
Data

LAPSE:2026.0009
Supplementary Material : A Comparat...
External Link

https://doi.org/10.69997/sct.136396
Publisher Version
Download
Meta
Record Statistics
Record Views
224
Version History
[v1] (Original Submission)
Jun 12, 2026
Verified by curator on
Jun 12, 2026
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2026.0401
Record Owner
PSE Press
Links to Related Works
Directly Related to This Work
Supplementary Material
Publisher Version
References Cited
- Wu CFJ, Hamada MS, Experiments - Planning, Analysis, and Optimization. John Wiley & Sons (2009).
- Santos CP, Rato TJ, Reis MS. Design of experiments: a comparison study from the non?expert user's perspective. Journal of Chemometrics 33: (2018) https://doi.org/10.1002/cem.3087
- Montgomery DC. Design and Analysis of Experiments.John Wiley & Sons(2013)
- Eggensperger K, Feurer M, Hutter F, Bergsta J, et al. Towards an empirical foundation for assessing bayesian optimization of hyperparameters. NIPS workshop on Bayesian Optimization in Theory and Practice (2013)
- Snoek J, Larochelle H, Adams RP.Practical Bayesian Optimization of Machine Learning Algorithms, Adv Neural Inf Process Syst 25(2012)
- Brochu E., Cora VM, Freitas N. A Tutorial on Bayesian Optimisation of Expensive Cost Functions, with Application to Active User Modelling and Hierarchical ReinforcementLearning.arXiv preprint arXiv:1012.2599 (2010)
- Greenhill S, Rana S, Gupta S, Vellanki P, Venkatesh S. Bayesian optimization for adaptive experimental design: a review. IEEE Access 8:13937-13948 (2020) https://doi.org/10.1109/access.2020.2966228
- Karl AT, Essex S, Wisnowski J, Rushing H. A workflow for lipid nanoparticle (LNP) formulation optimization using designed mixture-process experiments and self-validated ensemble models (SVEM). JoVE : (2023) https://doi.org/10.3791/65200
- Batista DV, Reis MS. Balancing modelling complexity and experimental effort for conducting qbd on lipid nanoparticles (lnps) systems. Systems and Control Transactions 4:2548-2553 (2025) https://doi.org/10.69997/sct.163183
- Wolpert DH, Macready WG. No free lunch theorems for optimization. IEEE Trans. Evol. Computat. 1:67-82 (1997) https://doi.org/10.1109/4235.585893
(0.1 seconds)
[0.11 s]

