Proceedings of ESCAPE 35ISSN: 2818-4734
Volume: 4 (2025)
Table of Contents
LAPSE:2025.0359
Published Article
LAPSE:2025.0359
Comparison of Multi-Fidelity Modelling Methods for Bayesian Optimization
Stefan Tönnis, Luise F. Kaven, Eike Cramer
June 27, 2025
Abstract
In process systems engineering (PSE), obtaining accurate process models for optimization can be expensive and time-consuming. Black-box Bayesian Optimization (BO) with Gaussian process (GP) surrogates offers a promising approach. However, full black-box optimization neglects valuable prior knowledge, which could otherwise improve the optimization process. This work explores methods of integrating prior knowledge in the form of low-fidelity data into BO by evaluating these methods on synthetic multi-fidelity test functions. Our results highlight possibilities for improved convergence of the BO optimization. However, our work further highlights potential pitfalls of these multi-fidelity models, such as bias, convergence to local optima, and overfitting on low-fidelity data. Hence, leveraging low-fidelity data in multi-fidelity models can improve BO convergence, but there are instances where the algorithms are more susceptible to failure.
Suggested Citation
Tönnis S, Kaven LF, Cramer E. Comparison of Multi-Fidelity Modelling Methods for Bayesian Optimization. Systems and Control Transactions 4:1294-1299 (2025) https://doi.org/10.69997/sct.198776
Author Affiliations
Tönnis S: Process Systems Engineering (AVT.SVT), RWTH Aachen University, 52074 Aachen, Germany
Kaven LF: Process Systems Engineering (AVT.SVT), RWTH Aachen University, 52074 Aachen, Germany
Cramer E: Process Systems Engineering (AVT.SVT), RWTH Aachen University, 52074 Aachen, Germany
Journal Name
Systems and Control Transactions
Volume
4
First Page
1294
Last Page
1299
Year
2025
Publication Date
2025-07-01
Version Comments
Original Submission
Other Meta
PII: 1294-1299-1138-SCT-4-2025, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2025.0359
This Record
External Link

https://doi.org/10.69997/sct.198776
Article DOI
Download
Files
Jun 27, 2025
Main Article
License
CC BY-SA 4.0
Meta
Record Statistics
Record Views
1108
Version History
[v1] (Original Submission)
Jun 27, 2025
 
Verified by curator on
Jun 27, 2025
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2025.0359
 
Record Owner
PSE Press
Links to Related Works
Directly Related to This Work
Article DOI
References Cited
  1. Garnett R. Bayesian optimization. Cambridge University Press, Cambridge, United Kingdom (2023)
  2. Astudillo R, Frazier PI. Bayesian Optimization of Composite Functions
  3. González LD, Zavala VM. BOIS: Bayesian Optimization of Interconnected Systems. IFAC-PapersOnLine 58(14), 446-451 (2024) https://doi.org/10.1016/j.ifacol.2024.08.377
  4. Chitre A, Cheng J, Ahamed S et al. pHbot: Self-Driven Robot for pH Adjustment of Viscous Formulations via Physics-informed-ML**. Chemistry Methods 4(2) (2024) https://doi.org/10.1002/cmtd.202300043
  5. Wu J, Frazier PI. Continuous-Fidelity Bayesian Optimization with Knowledge Gradient (2017)
  6. Kennedy M. Predicting the output from a complex computer code when fast approximations are available. Biometrika 87(1), 1-13 (2000) https://doi.org/10.1093/biomet/87.1.1
  7. Le Gratiet L, Garnier J (2012). Recursive Co-Kriging Model for Design of Computer Experiments with multiple Levles of Fidelity
  8. Ament S, Daulton S, Eriksson D, Balandat M, Bakshy E (2023). Unexpected Improvements to Expected Improvement for Bayesian Optimization
  9. Ath G de, Fieldsend JE, Everson RM. What do you mean? Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion. Presented at: GECCO '20: Genetic and Evolutionary Computation Conference. Cancún Mexico, 08 07 2020 12 07 2020
  10. Bonilla EV, Chai, Kian Ming A., Williams CKI. Multi-task Gaussian Process Prediction (2007)
  11. Wu J, Toscano-Palmerin S, Frazier PI, Wilson AG. Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuning. Proceedings of The 35th Uncertainty in Artificial Intelligence Conference
  12. Mainini L, Serani A, Rumpfkeil MP et al. (2022). Analytical Benchmark Problems for Multifidelity Optimization Methods
  13. Eriksson D, Pearce M, Gardner JR, Turner R, Poloczek M. Scalable Global Optimization via Local Bayesian Optimization
(0.08 seconds)

[0.09 s]