LAPSE:2025.0447
Published Article

LAPSE:2025.0447
Selection of Fitness Criteria for Learning Interpretable PDE Solutions via Symbolic Regression
June 27, 2025
Abstract
Physics-Informed Symbolic Regression (PISR) offers a pathway to discover human-interpretable solutions to partial differential equations (PDEs). This work investigates three fitness metrics within a PISR framework: PDE fitness, Bayesian Information Criterion (BIC), and a fitness metric proportional to the probability of a model given the data. Through experiments with Laplaces equation, Burgers equation, and a nonlinear wave equation, we demonstrate that incorporating information theoretic criteria like BIC can yield higher fidelity models while maintaining interpretability. Our results show that BIC-based PISR achieved the best performance, identifying an exact solution to Laplaces equation and finding solutions with R2-values of 0.998 for Burgers equation and 0.957 for the nonlinear wave equation. The inclusion of the Bayes D-optimality criterion in estimating model probability strongly constrained solution complexity, limiting models to 3-4 parameters and reducing accuracy. These findings suggest that a two-stage approach-using simpler complexity metrics during initial solution discovery followed by a post-hoc identifiability analysis may be optimal for discovering interpretable and mathematically identifiable PDE solutions.
Physics-Informed Symbolic Regression (PISR) offers a pathway to discover human-interpretable solutions to partial differential equations (PDEs). This work investigates three fitness metrics within a PISR framework: PDE fitness, Bayesian Information Criterion (BIC), and a fitness metric proportional to the probability of a model given the data. Through experiments with Laplaces equation, Burgers equation, and a nonlinear wave equation, we demonstrate that incorporating information theoretic criteria like BIC can yield higher fidelity models while maintaining interpretability. Our results show that BIC-based PISR achieved the best performance, identifying an exact solution to Laplaces equation and finding solutions with R2-values of 0.998 for Burgers equation and 0.957 for the nonlinear wave equation. The inclusion of the Bayes D-optimality criterion in estimating model probability strongly constrained solution complexity, limiting models to 3-4 parameters and reducing accuracy. These findings suggest that a two-stage approach-using simpler complexity metrics during initial solution discovery followed by a post-hoc identifiability analysis may be optimal for discovering interpretable and mathematically identifiable PDE solutions.
Record ID
Subject
Suggested Citation
Cohen BG, Beykal B, Bollas GM. Selection of Fitness Criteria for Learning Interpretable PDE Solutions via Symbolic Regression. Systems and Control Transactions 4:1837-1842 (2025) https://doi.org/10.69997/sct.199083
Author Affiliations
Cohen BG: University of Connecticut, Department of Chemical and Biomolecular Engineering, Storrs, CT, USA; University of Connecticut, Pratt & Whitney Institute for Advanced Systems Engineering, Storrs, CT, USA
Beykal B: University of Connecticut, Department of Chemical and Biomolecular Engineering, Storrs, CT, USA; University of Connecticut, Center for Clean Energy Engineering, Storrs, CT, USA
Bollas GM: University of Connecticut, Department of Chemical and Biomolecular Engineering, Storrs, CT, USA; University of Connecticut, Pratt & Whitney Institute for Advanced Systems Engineering, Storrs, CT, USA
Beykal B: University of Connecticut, Department of Chemical and Biomolecular Engineering, Storrs, CT, USA; University of Connecticut, Center for Clean Energy Engineering, Storrs, CT, USA
Bollas GM: University of Connecticut, Department of Chemical and Biomolecular Engineering, Storrs, CT, USA; University of Connecticut, Pratt & Whitney Institute for Advanced Systems Engineering, Storrs, CT, USA
Journal Name
Systems and Control Transactions
Volume
4
First Page
1837
Last Page
1842
Year
2025
Publication Date
2025-07-01
Version Comments
Original Submission
Other Meta
PII: 1837-1842-1548-SCT-4-2025, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2025.0447
This Record
External Link

https://doi.org/10.69997/sct.199083
Article DOI
Download
Meta
Record Statistics
Record Views
859
Version History
[v1] (Original Submission)
Jun 27, 2025
Verified by curator on
Jun 27, 2025
This Version Number
v1
Citations
Most Recent
This Version
URL Here
http://psecommunity.org/LAPSE:2025.0447
Record Owner
PSE Press
Links to Related Works
References Cited
- F.-G. Wieland, A.L. Hauber, M. Rosenblatt, C. Tönsing, J. Timmer. On structural and practical identifiability. Curr Opin Syst Biol 25:60-69 (2021) https://doi.org/10.1016/j.coisb.2021.03.005
- A. Adadi, M. Berrada. Peeking Inside the Black-Box: A survey on Explainable Artificial Intelligence (XAI). IEEE Access 6:52138-52160 (2018) https://doi.org/10.1109/ACCESS.2018.2870052
- J. Guckenheimer, P. Holmes. Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields. Spring New York (1983) https://doi.org/10.1007/978-1-4612-1140-2
- S.J. Farlow. Introduction to Partial Differential Equations. Dover Publications (1993)
- Z. Liu, M. Tegmark. Machine Learning Hidden Symmetries. Phys Rev Lett 128(18):180201 (2022) https://doi.org/10.1103/PhysRevLett.128.180201
- B.G. Cohen, B. Beykal, G.M. Bollas. Physics-informed genetic programming for discovery of partial differential equations from scarce and noisy data. J Comput Phys 514:113261 (2024) https://doi.org/10.1016/j.jcp.2024.113261
- S.L. Brunton, J.N. Kutz. Promising directions of machine learning for partial differential equations. Nat Comput Sci 4(7):483-494 (2024) https://doi.org/10.1038/s43588-024-00643-2
- L. Lu, P. Jin, G. Pang, Z. Zhang, G.E. Karniadakis. Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nat Mach Intell 3(3):218-229 (2021) https://doi.org/10.1038/s42256-021-00302-5
- M. Raissi, P. Perdikaris, G.E. Karniadakis. Physic-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J Comput Phys 378:686-707 (2019) https://doi.org/10.1016/j.jcp.2018.10.045
- M. Pförtner, I. Steinwart, P. Henning, J. Wenger. Physics-Informed Gaussian Process Regression Generalizes Linear PDE Solvers. ArXiv (2022)
- I.G. Tsoulos, I.E. Lagaris. Solving differential equations with genetic programming. Genet Program evolvable Mach 7(1):33-54 (2006) https://doi.org/10.1007/s10710-006-7009-y
- B.G. Cohen, B. Beykal, G.M. Bollas. Physics-Informed Symbolic Regression for Partial Differential Equations: The Forward and Inverse Problem. J Comut Phys (Submitted)
- F.A. Fortin, F.M. De Rainville, M.A.G. Gardner, M. Parizeau, C. Cagné. DEAP: Evolutionary Algorithms Made Easy. J. Mach. Learn. Res. 31(1):2171-2175 (2012)
- J.A.E. Andersson, J. Gillis, G. Horn, J.B. Rawlings, M. Diehl. CasADi: a software framework for nonlinear optimization and optimal control. Math Program Comput 11(1):1-36 (2019) https://doi.org/10.1007/s12532-018-0139-4
- G. Schwarz. Estimating the Dimension of a Model. Ann. Stat. 6(2):461-464 (1978) https://doi.org/10.1214/aos/1176344136
- L. Han, Z. Zhou, G.M. Bollas. Model-Based Analysis of Chemical-Looping Combustion Experiments. Part I: Structural Identifiability of Kinetic Models for NiO Reduction. AIChE J 62:2419-2431 (2016) https://doi.org/10.1002/aic.15225

