Proceedings of ESCAPE 36ISSN: 2818-4734
Volume: 5 (2026)
Table of Contents
LAPSE:2026.0428
Published Article
LAPSE:2026.0428
Using Active Learning to Efficiently Calibrate Foundation Models on Raman Spectra in Upstream Bioprocess Fermentations
June 12, 2026
Abstract
Real-time monitoring of metabolite concentrations is critical for optimising bioprocess performance. While Raman spectroscopy offers a non-invasive solution, translating spectra into metabolite concentration estimates requires robust machine learning models. Foundation models such as TabPFN demonstrate exceptional predictive performance but suffer from high inference complexity when trained on large calibration datasets, hindering their use in real-time laboratory settings. This study proposes a batch Active Learning (AL) strategy to efficiently calibrate TabPFN using a minimal subset of data. We employ a weighted K-means clustering strategy that balances model uncertainty and dataset diversity to select the most informative calibration samples. We evaluated this method on a dataset of nearly 7, 000 Raman spectra covering eight substances. Our AL strategy achieved a mean R² score greater than 0.95 with approximately 1, 000 samples, significantly outperforming random sampling. Notably, the method matched the accuracy of a model trained on the full dataset using only 20% of the data. This reduction lowers computational complexity by a factor of 25, enabling millisecond-scale inference times suitable for high-throughput bioprocess monitoring.
Suggested Citation
Lange C, Martínez E, Neubauer P, Bournazou MNC. Using Active Learning to Efficiently Calibrate Foundation Models on Raman Spectra in Upstream Bioprocess Fermentations. Systems and Control Transactions 5:1801-1808 (2026) https://doi.org/10.69997/sct.147199
Author Affiliations
Lange C: Technische Universität Berlin, Faculty III Process Sciences, Institute of Biotechnology, Chair of Bioprocess Engineering, Straße des 17. Juni 135, 10623 Berlin, Germany [ORCID]
Martínez E: Technische Universität Berlin, Faculty III Process Sciences, Institute of Biotechnology, Chair of Bioprocess Engineering, Straße des 17. Juni 135, 10623 Berlin, Germany. INGAR, (CONICET - UTN), Avellaneda 3657, Santa Fe, Argentina [ORCID]
Neubauer P: Technische Universität Berlin, Faculty III Process Sciences, Institute of Biotechnology, Chair of Bioprocess Engineering, Straße des 17. Juni 135, 10623 Berlin, Germany [ORCID]
Bournazou MNC: Technische Universität Berlin, Faculty III Process Sciences, Institute of Biotechnology, Chair of Bioprocess Engineering, Straße des 17. Juni 135, 10623 Berlin, Germany [ORCID]
[Login] to see author email addresses.
Journal Name
Systems and Control Transactions
Volume
5
First Page
1801
Last Page
1808
Year
2026
Publication Date
2026-06-12
Version Comments
Original Submission
Other Meta
PII: 1801-1808-499-SCT-5-2026, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2026.0428
This Record
External Link

https://doi.org/10.69997/sct.147199
Publisher Version
Download
Files
Jun 12, 2026
Main Article
License
CC BY-SA 4.0
Meta
Record Statistics
Record Views
289
Version History
[v1] (Original Submission)
Jun 12, 2026
 
Verified by curator on
Jun 12, 2026
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2026.0428
 
Record Owner
PSE Press
Links to Related Works
Directly Related to This Work
Publisher Version
References Cited
  1. Lange C, Seidel S, Altmann M, Stors D, Kemmer A, Cai L, Born S, Neubauer P, Bournazou MNC. A setup for automatic raman measurements in high?throughput experimentation. Biotech & Bioengineering 122:2751-2769 (2025) https://doi.org/10.1002/bit.70006
  2. R. C. Rowland-Jones et al., "Spectroscopy integration to miniature bioreactors and large scale production bioreactors-Increasing current capabilities and model transfer, " Biotechnol. Prog., vol. 37, no. 1, p. e3074, Jan. 2021, doi: 10.1002/btpr.3074.
  3. Wold S, Sjöström M, Eriksson L. Pls-regression: a basic tool of chemometrics. Chemometrics and Intelligent Laboratory Systems 58:109-130 (2001) https://doi.org/10.1016/s0169-7439(01)00155-1
  4. Lange C, Borisyak M, Kögler M, Born S, Ziehe A, Neubauer P, Bournazou MNC. Comparing machine learning methods on raman spectra from eight different spectrometers. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy 334:125861 (2025) https://doi.org/10.1016/j.saa.2025.125861
  5. Hollmann N, Müller S, Purucker L, Krishnakumar A, Körfer M, Hoo SB, Schirrmeister RT, Hutter F. Accurate predictions on small data with a tabular foundation model. Nature 637:319-326 (2025) https://doi.org/10.1038/s41586-024-08328-6
  6. Lange C, Altmann M, Stors D, Seidel S, Moynahan K, Cai L, Born S, Neubauer P, Bournazou MNC. Deep learning for raman spectroscopy: benchmarking models for upstream bioprocess monitoring. Measurement 258:118884 (2026) https://doi.org/10.1016/j.measurement.2025.118884
  7. A. Vaswani et al., "Attention Is All You Need, " Aug. 02, 2023, arXiv: arXiv:1706.03762. doi: 10.48550/arXiv.1706.03762.
  8. B. Settles, "Active learning literature survey, " University of Wisconsin-Madison Department of Computer Sciences, 2009. [Online]. Available: https://minds.wisconsin.edu/handle/1793/60660
  9. G. Citovsky et al., "Batch Active Learning at Scale, " July 29, 2021, arXiv: arXiv:2107.14263. doi: 10.48550/arXiv.2107.14263.
  10. J. T. Ash, C. Zhang, A. Krishnamurthy, J. Langford, and A. Agarwal, "Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds, " Feb. 24, 2020, arXiv: arXiv:1906.03671. doi: 10.48550/arXiv.1906.03671.
  11. F. Zhdanov, "Diverse mini-batch Active Learning, " Jan. 17, 2019, arXiv: arXiv:1901.05954. doi: 10.48550/arXiv.1901.05954.
  12. Bensch M, Schulze Wierling P, von Lieres E, Hubbuch J. High throughput screening of chromatographic phases for rapid process development. Chem Eng & Technol 28:1274-1284 (2005) https://doi.org/10.1002/ceat.200500153
  13. L. Grinsztajn et al., "TabPFN-2.5: Advancing the State of the Art in Tabular Foundation Models, " Nov. 11, 2025, arXiv: arXiv:2511.08667. doi: 10.48550/arXiv.2511.08667.
  14. N. Hollmann, S. Müller, K. Eggensperger, and F. Hutter, "TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second, " Sept. 16, 2023, arXiv: arXiv:2207.01848. doi: 10.48550/arXiv.2207.01848.
  15. S. Müller, N. Hollmann, S. P. Arango, J. Grabocka, and F. Hutter, "Transformers Can Do Bayesian Inference, " Aug. 13, 2024, arXiv: arXiv:2112.10510. doi: 10.48550/arXiv.2112.10510.
  16. Scheffer T, Decomain C, Wrobel S. Active hidden markov models for information extraction. Lecture Notes in Computer Science :309-318 (2001) https://doi.org/10.1007/3-540-44816-0_31
  17. Shannon CE. A mathematical theory of communication. Bell System Technical Journal 27:379-423 (2013) https://doi.org/10.1002/j.1538-7305.1948.tb01338.x
  18. O. Sener and S. Savarese, "Active Learning for Convolutional Neural Networks: A Core-Set Approach, " June 01, 2018, arXiv: arXiv:1708.00489. doi: 10.48550/arXiv.1708.00489.
(0.1 seconds)

[0.1 s]