Browse
Keywords
Records with Keyword: Machine Learning
DIGITAL SUPPLEMENTARY MATERIAL: Comparative Analysis of PharmHGT, GCN, and GAT Models for Predicting LogCMC in Surfactants.
March 13, 2025 (v1)
Subject: Modelling and Simulations
Keywords: Critical Micelle Concentration, Graph Neural Networks, Machine Learning, Property Prediction
Predicting the critical micelle concentration (CMC) of surfactants is essential for optimizing their applications in various industries, including pharmaceuticals, detergents, and emulsions. In this study, we investigate the per-formance of graph-based machine learning models, specifically Graph Convolutional Networks (GCN), Graph At-tention Networks (GAT), and a graph-transformer model, PharmHGT, for predicting CMC values. We aim to de-termine the most effective model for capturing the structural and physicochemical properties of surfactants. Our results provide insights into the relative strengths of each approach, highlighting the potential advantages of transformer-based architectures like PharmHGT in handling molecular graph representations compared to traditional graph neural networks. This comparative study serves as a step towards enhancing the accuracy of CMC predictions, contributing to the efficient design of surfactants for targeted applications.
Supplementary Material - Synthesis of Distillation Flowsheets with Reinforcement Learning using Transformer Blocks
January 31, 2025 (v1)
Subject: Process Design
Supplementary Material for the contribution "Synthesis of Distillation Flowsheets with Reinforcement Learning using Transformer Blocks" by Niklas Slager and Meik Franke (UTwente) for ESCAPE 35
Application of Artificial Intelligence in process simulation tool
January 30, 2025 (v1)
Subject: Modelling and Simulations
Keywords: Artificial Intelligence, ChatBot, Machine Learning, Process Design
The document is the digital supplementary material for the article titled "Application of Artificial Intelligence in process simulation tool", submitted to the ESCAPE 35 conference. It contains additional information and figures.
Artificial Intelligence, Machine Learning, & Data Science in Chemical Engineering
October 29, 2024 (v2)
Subject: Intelligent Systems
Keywords: Artificial Intelligence, Machine Learning
Overview presenation by Prof. Alexander Dowling at the Public Affairs & Information Committee (PAIC) Town Hall at AIChE Annual Meeting in 2024.
Towards Reliable Prediction of Performance for Polymer Electrolyte Membrane Fuel Cells via Machine Learning-Integrated Hybrid Numerical Simulations
August 28, 2024 (v1)
Subject: Energy Systems
Keywords: electrochemical, fuel cell, limitations, Machine Learning, mass transfer, numerical modeling, PEMFC, progress
For mitigating global warming, polymer electrolyte membrane fuel cells have become promising, clean, and sustainable alternatives to existing energy sources. To increase the energy density and efficiency of polymer electrolyte membrane fuel cells (PEMFC), a comprehensive numerical modeling approach that can adequately predict the multiphysics and performance relative to the actual test such as an acceptable depiction of the electrochemistry, mass/species transfer, thermal management, and water generation/transportation is required. However, existing models suffer from reliability issues due to their dependency on several assumptions made for the sake of modeling simplification, as well as poor choices and approximations in material characterization and electrochemical parameters. In this regard, data-driven machine learning models could provide the missing and more appropriate parameters in conventional computational fluid dynamics models. The purpose of the present overview is to expl... [more]
Optimization of Twist Winglets−Cross-Section Twist Tape in Heat Exchangers Using Machine Learning and Non-Dominated Sorting Genetic Algorithm II Technique
August 23, 2024 (v1)
Subject: Optimization
Keywords: heat transfer optimization, Machine Learning, multi-objective optimization, twist winglets–cross-section twist tape
This research delves into the impact of Twist Winglets−Cross-Section Twist Tape (TWs-CSTT) structures within heat exchangers on thermal performance. Utilizing Computational Fluid Dynamics (CFD) and machine learning methodologies, optimal geometrical parameters for the TWs-CSTT configuration were examined. The outcomes demonstrate that fluid undergoing a rotational motion within tubes featuring this structure leads to more effective secondary flows, intensified mixing, and improved thermal boundary layer disturbance. Moreover, by integrating machine learning with multi-objective optimization techniques, the performance of heat exchangers can be accurately predicted and optimized, facilitating enhanced heat exchanger design. Through the application of the multi-objective optimization algorithm Non-dominated Sorting Genetic Algorithm II (NSGA-II), the ideal configurations for TWs-CSTT were ascertained: L1 is the cross-sectional length of the Twisted Wings, L2 is the radius of the Central... [more]
Modeling Study on Heat Capacity, Viscosity, and Density of Ionic Liquid−Organic Solvent−Organic Solvent Ternary Mixtures via Machine Learning
August 23, 2024 (v1)
Subject: Modelling and Simulations
Keywords: density, group contribution method, heat capacity, IL-organic solvent–organic solvent ternary systems, Machine Learning, viscosity
Physicochemical properties of ionic liquids (ILs) are essential in solvent screening and process design. However, due to their vast diversity, acquiring IL properties through experimentation alone is both time-consuming and costly. For this reason, the creation of prediction models that can accurately forecast the characteristics of IL and its mixtures is crucial to their application. This study proposes a model for predicting the three important parameters of the IL-organic solvent−organic solvent ternary system: density, viscosity, and heat capacity. The model incorporates group contribution (GC) and machine learning (ML) methods. A link between variables such as temperature, pressure, and molecular structure is established by the model. We gathered 2775 viscosity, 6515 density, and 1057 heat capacity data points to compare the prediction accuracy of three machine learning methods, namely, artificial neural networks (ANNs), extreme gradient boosting (XGBoost), and light gradient boos... [more]
Predicting the Liquid Steel End-Point Temperature during the Vacuum Tank Degassing Process Using Machine Learning Modeling
August 23, 2024 (v1)
Subject: Numerical Methods and Statistics
Keywords: Machine Learning, model stability, predictive performance, secondary metallurgy, statistical modeling, temperature prediction, vacuum tank degasser
The present work focuses on predicting the steel melt temperature following the vacuum treatment step in a vacuum tank degasser (VTD). The primary objective is to establish a comprehensive methodology for developing and validating machine learning (ML) models within this context. Another objective is to evaluate the model by analyzing the alignment of the SHAP values with metallurgical domain expectations, thereby validating the model’s predictions from a metallurgical perspective. The proposed methodology employs a Random Forest model, incorporating a grid search with domain-informed variables grouped into batches, and a robust model-selection criterion that ensures optimal predictive performance, while keeping the model as simple and stable as possible. Furthermore, the Shapley Additive Explanations (SHAP) algorithm is employed to interpret the model’s predictions. The selected model achieved a mean adjusted R2 of 0.631 and a hit ratio of 75.3% for a prediction error within ±5 °C. De... [more]
Laying the foundations of Machine Learning in Undergraduate Education through Engineering Mathematics
August 16, 2024 (v2)
Subject: Education
Some educators place an emphasis on the commonalities between engineering mathematics with process control, among others and this helps students see the bigger picture of what is being taught. Traditionally, some of the concepts such as diffusion and heat transfer are taught with a mathematical point of view. Now-a-days, Machine Learning (ML) has emerged as topic of greater interest to both educators and learners and new and disparate modules are sometimes introduced to teach the same. With the emergence of these new topics, some students (falsely) believe that ML is a new field that is somehow different and not linked to engineering mathematics. In this work, we show the link between the different topics from engineering mathematics, that are traditionally taught in UG education, with ML. We hope that educators and learners will appreciate the treatise and think differently, and we further hope that this will further increase the interest to improve ML models.
10. LAPSE:2024.1597
Opportunities for Process Intensification with Membranes to Promote Circular Economy Development for Critical Minerals
August 16, 2024 (v2)
Subject: Process Design
Keywords: Machine Learning, Membranes, Multiscale Modelling, Process Intensification, Renewable and Sustainable Energy, Supply Chain
Critical minerals are essential to the future of clean energy, especially energy storage, electric vehicles, and advanced electronics. In this paper, we argue that process systems engineering (PSE) paradigms provide essential frameworks for enhancing the sustainability and efficiency of critical mineral processing pathways. As a concrete example, we review challenges and opportunities across material-to-infrastructure scales for process intensification (PI) with membranes. Within critical mineral processing, there is a need to reduce environmental impact, especially concerning chemical reagent usage. Feed concentrations and product demand variability require flexible, intensified processes. Further, unique feedstocks require unique processes (i.e., no one-size-fits-all recycling or refining system exists). Membrane materials span a vast design space that allows significant optimization. Therefore, there is a need to rapidly identify the best opportunities for membrane implementation, t... [more]
11. LAPSE:2024.1585
Machine Learning Methods for the Forecasting of Environmental Impacts in Early-stage Process Design
August 16, 2024 (v2)
Subject: Process Design
Initial design stages are inherently complex and often lack comprehensive information, posing challenges in evaluating sustainability metrics. Machine Learning (ML) emerges as a valuable solution to address these challenges. ML algorithms, particularly effective in predicting environmental impacts of new chemicals with limited data, enable more informed decisions in sustainable design. This study focuses on employing ML for predicting the environmental impacts related to human health, ecosystem quality, climate change, and resource utilization to aid in early-stage environmental impact assessment of chemical processes. The effectiveness of the ML algorithm, eXtreme Gradient Boosting (XGBoost) tested using a dataset of 350 points, divided into training, testing, and validation sets. The study also includes a practical application of the model in a cradle-to-cradle LCA of N-Methylpyrrolidone (NMP), demonstrating its utility in sustainable chemical process design. This approach signifies... [more]
12. LAPSE:2024.1559
Conceptual Design of Integrated Energy Systems with Market Interaction Surrogate Models
August 16, 2024 (v2)
Subject: Energy Systems
Keywords: additional keywords separated by commas, Integrated Energy System, Machine Learning, Optimization, Surrogate Models, Time Series Clustering
Most integrated energy system (IES) optimization frameworks employ the price-taker approximation, which ignores important interactions with the market and can result in overestimated economic values. In this work, we propose a machine learning surrogate-assisted optimization framework to quantify IES/market interactions and thus go beyond price-taker. We use time series clustering to generate representative IES operation profiles for the optimization problem and use machine learning surrogate models to predict the IES/market interaction. We quantify the accuracy of the time series clustering and surrogate models in a case study to optimally retrofit a nuclear power plant with a polymer electrolyte membrane electrolyzer to co-produce electricity and hydrogen.
13. LAPSE:2024.1553
Reinforcement Learning-Driven Process Design: A Hydrodealkylation Example
August 16, 2024 (v2)
Subject: Process Design
In this work, we present a follow-up work of reinforcement learning (RL)-driven process design using the Institute for Design of Advanced Energy Systems Process Systems Engineering (IDAES-PSE) Framework. Herein, process designs are generated as stream inlet-outlet matrices and optimized using the IDAES platform, the objective function value of which is the reward to RL agent. Deep Q-Network is employed as the RL agent including a series of convolutional neural network layers and fully connected layers to compute the actions of adding or removing any stream connections, thus creating a new process design. The process design is then informed back to the RL agent to refine its learning. The iteration continues until the maximum number of steps is reached with feasible process designs generated. To further expedite the RL search of the design space which can comprise the selection of any candidate unit(s) with arbitrary stream connections, we investigate the role of RL reward function and... [more]
14. LAPSE:2024.1543
Machine Learning-Aided Process Design for Microwave-Assisted Ammonia Production
August 16, 2024 (v2)
Subject: Process Design
Keywords: Ammonia Production, Machine Learning, Neural Networks, Process Design, Process Intensification
Machine learning (ML) has become a powerful tool to analyze complex relationships between multiple variables and to unravel valuable information from big datasets. However, an open research question lies in how ML can accelerate the design and optimization of processes in the early experimental development stages with limited data. In this work, we investigate the ML-aided process design of a microwave reactor for ammonia production with exceedingly little experimental data. We propose an integrated approach of synthetic minority oversampling technique (SMOTE) regression combined with neural networks to quantitatively design and optimize the microwave reactor. To address the limited data challenge, SMOTE is applied to generate synthetic data based on experimental data at different reaction conditions. Neural network has been demonstrated to effectively capture the nonlinear relationships between input features and target outputs. The softplus activation function is used for a smoother... [more]
15. LAPSE:2024.1541
Learning Hybrid Extraction and Distillation using Phenomena-based String Representation
August 16, 2024 (v2)
Subject: Process Design
We present a string representation for hybrid extraction and distillation using symbols representing phenomena building blocks. Unlike the conventional equipment-based string representation, the proposed representation captures the design details of liquid-liquid extraction and distillation. We generate a set of samples through the procedure of input parameter sampling and superstructure optimization that minimizes separation cost. We convert these generated samples into a set of string representations based on pre-defined rules. We use these string representations as descriptors and connect them with conditional variational encoder. The trained conditional variational encoder shows good prediction accuracy. We further use the trained conditional variational encoder to screen designs of hybrid extraction and distillation with desired cost investment.
16. LAPSE:2024.1538
Improving Mechanistic Model Accuracy with Machine Learning Informed Physics
August 16, 2024 (v2)
Subject: System Identification
Keywords: Batch Process, Dynamic Modelling, Machine Learning, Surrogate Model, System Identification
Machine learning presents opportunities to improve the scale-specific accuracy of mechanistic models in a data-driven manner. Here we demonstrate the use of a machine learning technique called Sparse Identification of Nonlinear Dynamics (SINDy) to improve a simple mechanistic model of algal growth. Time-series measurements of the microalga Chlorella Vulgaris were generated under controlled photobioreactor conditions at the University of Technology Sydney. A simple mechanistic growth model based on intensity of light and temperature was integrated over time and compared to the time-series data. While the mechanistic model broadly captured the overall growth trend, discrepancies remained between the model and data due to the model's simplicity and non-ideal behavior of real-world measurement. SINDy was applied to model the residual error by identifying an error derivative correction term. Addition of this SINDy-informed error dynamics term shows improvement to model accuracy while maint... [more]
17. LAPSE:2024.1537
Neural Networks for Prediction of Complex Chemistry in Water Treatment Process Optimization
August 16, 2024 (v2)
Subject: Numerical Methods and Statistics
Water chemistry plays a critical role in the design and operation of water treatment processes. Detailed chemistry modeling tools use a combination of advanced thermodynamic models and extensive databases to predict phase equilibria and reaction phenomena. The complexity and formulation of these models preclude their direct integration in equation-oriented modeling platforms, making it difficult to use their capabilities for rigorous water treatment process optimization. Neural networks (NN) can provide a pathway for integrating the predictive capability of chemistry software into equation-oriented models and enable optimization of complex water treatment processes across a broad range of conditions and process designs. Herein, we assess how NN architecture and training data impact their accuracy and use in equation-oriented water treatment models. We generate training data using PhreeqC software and determine how data generation and sample size impact the accuracy of trained NNs. The... [more]
18. LAPSE:2024.1534
Learn-To-Design: Reinforcement Learning-Assisted Chemical Process Optimization
August 15, 2024 (v2)
Subject: Optimization
Keywords: Artificial Intelligence, Carbon Capture, Machine Learning, Optimization, Process Design, Reinforcement Learning, Simulation-based Optimization
This paper proposes an AI-assisted approach aimed at accelerating chemical process design through causal incremental reinforcement learning (CIRL) where an intelligent agent is interacting iteratively with a process simulation environment (e.g., Aspen HYSYS, DWSIM, etc.). The proposed approach is based on an incremental learnable optimizer capable of guiding multi-objective optimization towards optimal design variable configurations, depending on several factors including the problem complexity, selected RL algorithm and hyperparameters tuning. One advantage of this approach is that the agent-simulator interaction significantly reduces the vast search space of design variables, leading to an accelerated and optimized design process. This is a generic causal approach that enables the exploration of new process configurations and provides actionable insights to designers to improve not only the process design but also the design process across various applications. The approach was valid... [more]
19. LAPSE:2024.1533
A GRASP Heuristic for Solving an Acquisition Function Embedded in a Parallel Bayesian Optimization Framework
August 15, 2024 (v2)
Subject: Optimization
Keywords: Derivative Free Optimization, Machine Learning, Optimization, Parallelization, Surrogate Model
Design problems for process systems engineering applications often require multi-scale modeling integrating detailed process models. Consequently, black-box optimization and surrogate modeling have continued to play a fundamental role in mission-critical design applications. Inherent in surrogate modeling applications, particularly those constrained by expensive function evaluations, are the questions of how to properly balance exploration and exploitation and how to do so while harnessing parallel computing in techniques. We devise and investigate a one-step look-ahead GRASP heuristic for balancing exploration and exploitation in a parallel environment. Computational results reveal that our approach can yield equivalent or superior surrogate quality with near linear scaling in the number of parallel samples.
20. LAPSE:2024.1516
Process Flowsheet Optimization with Surrogate and Implicit Formulations of a Gibbs Reactor
August 15, 2024 (v2)
Subject: Process Design
Keywords: Chemical process design, Chemical process optimization, Machine Learning, Nonlinear optimization, Surrogate modeling
Alternative formulations for the optimization of chemical process flowsheets are presented that leverage surrogate models and implicit functions to replace and remove, respectively, the algebraic equations that describe a difficult-to-converge Gibbs reactor unit operation. Convergence reliability, solve time, and solution quality of an optimization problem are compared among full-space, ALAMO surrogate, neural network surrogate, and implicit function formulations. Both surrogate and implicit formulations lead to better convergence reliability, with low sensitivity to process parameters. The surrogate formulations are faster at the cost of minor solution error, while the implicit formulation provides exact solutions with similar solve time. In a parameter sweep on the autothermal reformer flowsheet optimization problem, the full-space formulation solves 33 out of 64 instances, while the implicit function formulation solves 52 out of 64 instances, the ALAMO polynomial formulation solves... [more]
21. LAPSE:2024.1514
Development of Mass/Energy Constrained Sparse Bayesian Surrogate Models from Noisy Data
August 15, 2024 (v2)
Subject: System Identification
Keywords: Algorithms, Design Under Uncertainty, Machine Learning, Optimization, System Identification
This paper presents an algorithm for developing sparse surrogate models that satisfy mass/energy conservation even when the training data are noisy and violate the conservation laws. In the first step, we employ the Bayesian Identification of Dynamic Sparse Algebraic Model (BIDSAM) algorithm proposed in our previous work to obtain a set of hierarchically ranked sparse models which approximate system behaviors with linear combinations of a set of well-defined basis functions. Although the model building algorithm was shown to be robust to noisy data, conservation laws may not be satisfied by the surrogate models. In this work we propose an algorithm that augments a data reconciliation step with the BIDSAM model for satisfaction of conservation laws. This method relies only on known boundary conditions and hence is generic for any chemical system. Two case studies are considered-one focused on mass conservation and another on energy conservation. Results show that models with minimum bia... [more]
22. LAPSE:2024.1511
Towards 3-fold sustainability in biopharmaceutical process development and product distribution
August 15, 2024 (v2)
Subject: Process Design
Keywords: Biosystems, Dynamic Modelling, Industry 40, Machine Learning, Process Design, Renewable and Sustainable Energy, Supply Chain
The (bio-)pharmaceutical industry is facing crossroads in an effort to ramp up its global capacity, while working to meet net-zero targets and to ensure continuous drug supply. Beyond geopolitical challenges faced worldwide, (bio-)pharmaceutical processes have been historically very complex to design, optimise and integrate in a global distribution network that is resilient and adaptable to changes. In this paper we offer a perspective of how Process Systems Engineering (PSE) tools can support and advance (bio-)pharma practices with an outlook towards 3-fold sustainability. The latter is considering three main pillars, namely social (drug supply), economical and environmental sustainability. We discuss PSE contributions that have revolutionised process design in this space, as well as the optimisation of distributions networks in pharmaceuticals. We do this by means of example cases: one on model-based unit operation design and a second one on sustainable supply chain networks in the... [more]
23. LAPSE:2024.1509
Life Cycle and Sustainability Analyses for Designing Chemical Circular Economy
August 15, 2024 (v2)
Subject: Environment
Sustainability and circular economy enclose initiatives to achieve economic systems and industrial value chains by improving resource use, productivity, reuse, recycling, pollution prevention, and minimizing disposed material. However, shifting from the traditional linear economic production system to a circular economy is challenging. One of the most significant hurdles is the absence of sustainable end-of-life (EoL)/manufacturing loops for recycling and recovering material while minimizing negative impacts on human health and the environment. Overcoming these challenges is critical in returning materials to upstream life cycle stage facilities such as manufacturing. Chemical flow analysis (CFA), sustainability evaluation, and process systems engineering (PSE) can supply chemical products and processes performances from environmental, economic, material efficiency, energy footprint, and technology perspectives. These holistic evaluation techniques can improve productivity, source mate... [more]
24. LAPSE:2024.1504
Artificial Intelligence and Machine Learning for Sustainable Molecular-to-Systems Engineering
August 15, 2024 (v2)
Subject: Energy Systems
Keywords: Artificial Intelligence, Interdisciplinary, Machine Learning, Multiscale Modelling, Optimization
Sustainability encompasses many wicked problems involving complex interdependencies across social, natural, and engineered systems. We argue holistic multiscale modeling and decision-support frameworks are needed to address multifaceted interdisciplinary aspects of these wicked problems. This review highlights three emerging research areas for artificial intelligence (AI) and machine learning (ML) in molecular-to-systems engineering for sustainability: (1) molecular discovery and materials design, (2) automation and self-driving laboratories, (3) process and systems-of-systems optimization. Recent advances in AI and ML are highlighted in four contemporary application areas in chemical engineering design: (1) equitable energy systems, (2) decarbonizing the power sector, (3) circular economies for critical materials, and (4) next-generation heating and cooling. These examples illustrate how AI and ML enable more sophisticated interdisciplinary multiscale models, faster optimization algor... [more]
25. LAPSE:2024.1288
Predictive Quality Analytics of Surface Roughness in Turning Operation Using Polynomial and Artificial Neural Network Models
June 21, 2024 (v1)
Subject: Materials
Keywords: AISI 304, AISI 304L, artificial neural network, finish turning, food processing equipment, Machine Learning, predictive quality, small batch, surface roughness
The variability of the material properties of steel from different suppliers causes problems in achieving the required surface quality after turning. Therefore, the manufacturer needs to estimate the resulting quality before starting production, especially if it is an expensive, small-batch production from stainless steel. Predictive models will make it possible to estimate the surface roughness from the mechanical properties of steel and thus support decision making about supplier selection or acceptance of a material supply. This research presents a step-by-step decision-making procedure, which enables the trained staff to make quick decisions based on commonly available information in the Mill Test Certificate (MTC). A new multivariate second-order polynomial model and feedforward backpropagation artificial neural network (ANN) models have been developed using input variables from the MTC: Tensile Strength, Yield Strength, Elongation, and Hardness. Models were used to enhance the me... [more]