LAPSE:2026.0317
Published Article

LAPSE:2026.0317
Exploring Molecular Pretraining and Mechanism-Aware Modeling for Reaction Yield Prediction
June 12, 2026
Abstract
Accurately predicting chemical reaction yields can accelerate reaction optimization by prioritizing promising conditions; however, the complexity of multicomponent reactions and the limited availability of high-quality datasets remain significant challenges. While machine learning has achieved substantial progress in molecular property prediction, reaction-level modeling requires representations that capture three-dimensional structures, intercomponent interactions, and mechanistically critical features. In this study, we investigate the effective extension of molecular pretraining to reaction yield prediction from two complementary perspectives. First, we apply a reaction-aware architectural design based on molecular representation models pretrained via partial denoising to multicomponent reactions. Each reaction component is encoded as a three-dimensional stereoisomer embedding and concatenated into a reaction-level representation, with multi-head attention modeling intercomponent dependencies. We show that this approach achieves robust performance and generalizes well to reactions involving previously unseen components. Second, we design an architecture that extracts intermolecular relational embeddings through mechanistically meaningful pre-supervised learning using electron source-sink annotations derived from reaction mechanisms, followed by an active fine-tuning process. This mechanism-aware extension leverages large-scale reaction data to provide informative inductive bias and improves performance in data-constrained settings. We further confirm that this approach outperforms models that simply combine individual molecular embeddings, as it directly captures chemically meaningful information relevant to reaction outcomes. These results suggest promising directions for developing machine-learning models for reaction yield prediction that are more closely aligned with underlying chemical mechanisms.
Accurately predicting chemical reaction yields can accelerate reaction optimization by prioritizing promising conditions; however, the complexity of multicomponent reactions and the limited availability of high-quality datasets remain significant challenges. While machine learning has achieved substantial progress in molecular property prediction, reaction-level modeling requires representations that capture three-dimensional structures, intercomponent interactions, and mechanistically critical features. In this study, we investigate the effective extension of molecular pretraining to reaction yield prediction from two complementary perspectives. First, we apply a reaction-aware architectural design based on molecular representation models pretrained via partial denoising to multicomponent reactions. Each reaction component is encoded as a three-dimensional stereoisomer embedding and concatenated into a reaction-level representation, with multi-head attention modeling intercomponent dependencies. We show that this approach achieves robust performance and generalizes well to reactions involving previously unseen components. Second, we design an architecture that extracts intermolecular relational embeddings through mechanistically meaningful pre-supervised learning using electron source-sink annotations derived from reaction mechanisms, followed by an active fine-tuning process. This mechanism-aware extension leverages large-scale reaction data to provide informative inductive bias and improves performance in data-constrained settings. We further confirm that this approach outperforms models that simply combine individual molecular embeddings, as it directly captures chemically meaningful information relevant to reaction outcomes. These results suggest promising directions for developing machine-learning models for reaction yield prediction that are more closely aligned with underlying chemical mechanisms.
Record ID
Keywords
Deep learning, Reaction yield, Transfer learning
Subject
Suggested Citation
Lee Y, Lee WB, Lee LYS. Exploring Molecular Pretraining and Mechanism-Aware Modeling for Reaction Yield Prediction. Systems and Control Transactions 5:919-926 (2026) https://doi.org/10.69997/sct.195165
Author Affiliations
Lee Y: Department of Chemical Engineering, University College London, Torrington Place, London, WC1E 7JE, United Kingdom Torrington Place, London, WC1E. Seoul National University, Department of Chemical and Biological Engineering, Gwanak-ro 1, Gwanak-gu, Seoul 0 [ORCID]
Lee WB: Seoul National University, Department of Chemical and Biological Engineering, Gwanak-ro 1, Gwanak-gu, Seoul 08826, Republic of Korea [ORCID]
Lee LYS: Department of Chemical Engineering, University College London, Torrington Place, London, WC1E 7JE, United Kingdom Torrington Place, London, WC1E [ORCID]
[Login] to see author email addresses.
Lee WB: Seoul National University, Department of Chemical and Biological Engineering, Gwanak-ro 1, Gwanak-gu, Seoul 08826, Republic of Korea [ORCID]
Lee LYS: Department of Chemical Engineering, University College London, Torrington Place, London, WC1E 7JE, United Kingdom Torrington Place, London, WC1E [ORCID]
[Login] to see author email addresses.
Journal Name
Systems and Control Transactions
Volume
5
First Page
919
Last Page
926
Year
2026
Publication Date
2026-06-12
Version Comments
Original Submission
Other Meta
PII: 0919-0926-70-SCT-5-2026, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2026.0317
This Record
External Link

https://doi.org/10.69997/sct.195165
Publisher Version
Download
Meta
Record Statistics
Record Views
200
Version History
[v1] (Original Submission)
Jun 12, 2026
Verified by curator on
Jun 12, 2026
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2026.0317
Record Owner
PSE Press
Links to Related Works
References Cited
- Jiang J, Ke L, Chen L, Dou B, Zhu Y, Liu J, Zhang B, Zhou T, Wei G. Transformer technology in molecular science. WIREs Comput Mol Sci 14: (2024) https://doi.org/10.1002/wcms.1725
- Ni Y, Feng S, Hong X, Sun Y, Ma WY, Ma ZM, Ye Q, Lan Y. Pre-training with fractional denoising to enhance molecular property prediction. Nat Mach Intell 6:1169-1178 (2024) https://doi.org/10.1038/s42256-024-00900-z
- Ahneman DT, Estrada JG, Lin S, Dreher SD, Doyle AG. Predicting reaction performance in C-N cross-coupling using machine learning. Science 360:186-190 (2018) https://doi.org/10.1126/science.aar5169
- Pistachio (Nextmove Software). http://www.nextmovesoftware.com/pistachio.html.
- Lowe DM. Extraction of chemical structures and reactions from the literature. In: University of Cambridge, editor.; 2012.
- Schwaller P, Vaucher AC, Laino T, Reymond JL. Prediction of chemical reaction yields using deep learning. Mach. Learn.: Sci. Technol. 2:015016 (2021) https://doi.org/10.1088/2632-2153/abc81d
- King-Smith E. Transfer learning for a foundational chemistry model. Chem. Sci. 15:5143-5151 (2024) https://doi.org/10.1039/d3sc04928k
- Fang X, Liu L, Lei J, He D, Zhang S, Zhou J, Wang F, Wu H, Wang H. Geometry-enhanced molecular representation learning for property prediction. Nat Mach Intell 4:127-134 (2022) https://doi.org/10.1038/s42256-021-00438-4
- Singh J, Singh C. Learning invariant representations for equivariant neural networks using orthogonal moments. 2022 International Joint Conference on Neural Networks (IJCNN) :1-8 (2022) https://doi.org/10.1109/ijcnn55064.2022.9892412
- Chen S, Babazade R, Kim T, Han S, Jung Y. A large-scale reaction dataset of mechanistic pathways of organic reactions. Sci Data 11: (2024) https://doi.org/10.1038/s41597-024-03709-y
- Zang X, Zhao X, Tang B. Hierarchical molecular graph self-supervised learning for property prediction. Commun Chem 6: (2023) https://doi.org/10.1038/s42004-023-00825-5
- Yang K, Swanson K, Jin W, Coley C, Eiden P, Gao H, Guzman-Perez A, Hopper T, Kelley B, Mathea M, Palmer A, Settels V, Jaakkola T, Jensen K, Barzilay R. Analyzing learned molecular representations for property prediction. J. Chem. Inf. Model. 59:3370-3388 (2019) https://doi.org/10.1021/acs.jcim.9b00237
- Zhang C, Lin Q, Yang C, Kong Y, Yu Z, Liao K. Intermediate knowledge enhanced the performance of the amide coupling yield prediction model. Chem. Sci. 16:11809-11822 (2025) https://doi.org/10.1039/d5sc03364k
(0.1 seconds)
[0.1 s]

