This paper addresses the challenge of minimizing training time for the control of Heating, Ventilation, and Air-conditioning (HVAC) systems with online Reinforcement Learning (RL). This is done by developing a novel approach to Multi-Agent Reinforcement Learning (MARL) to HVAC systems. In this paper, the environment formed by the HVAC system is formulated as a Markov Game (MG) in a general sum setting. The MARL algorithm is designed in a decentralized structure, where only relevant states are shared between agents, and actions are shared in a sequence, which are sensible from a system’s point of view. The simulation environment is a domestic house located in Denmark and designed to resemble an average house. The heat source in the house is an air-to-water heat pump, and the HVAC system is an Underfloor Heating system (UFH). The house is subjected to weather changes from a data set collected in Copenhagen in 2006, spanning the entire year except for June, July, and August, where heat is... [more]

Parafoil trajectory directly affects the power generation of a high-altitude wind power generation (HAWPG) device. Therefore, it is particularly important to optimize the parafoil trajectory and then to track it effectively. In this paper, the trajectory of the parafoil at high altitudes is optimized and tracked in a comprehensively parameterized manner. Both the complex dynamic characteristics of the parafoil and the dexterous demand of the high-altitude controller are considered. Firstly, the trajectory variables and control signals are parameterized as Lagrange polynomials in terms of the corresponding values at the selected nodes. Then, the Radau pseudospectral method (PSM) is employed to reformulate the original dynamic trajectory optimization problem into a static nonlinear programming (NLP) problem. By doing so, the parameterized optimal trajectory, which has the maximum net power generation, can be obtained. To attenuate the strong nonlinear, multivariable and coupling characte... [more]

Through the integration of multiple energy carriers with related technologies, multi-energy systems (MES) can exploit the synergies coming from their interplay for several benefits towards decarbonization. In such a context, inclusion of Power-to-X technologies in periods of excess renewable electricity supply, removes the need for curtailment of renewable electricity generation. In order to achieve the environmental benefits of MES without neglecting their economic feasibility, the optimal design problem is as crucial as challenging and requires the adoption of a multi-objective approach. This paper extends the results of a previous work, by investigating hydrogen-based non-conventional storage for PV power in the eco-energetic optimization of an MES. The system under study consists of a reversible fuel cell (r-SOC), photovoltaic (PV), electric heat pump, absorption chiller and thermal storage, and allows satisfying the multi-energy needs of a residential end-user. A multi-objective l... [more]

The advent of the new millennium, with the promises of the digital age and space technology, favors humankind in every perspective. The technology provides us with electric power and has infinite use in multiple electronic accessories. The electric power produced by different sources is distributed to consumers by the transmission line and grid stations. During the electric transmission from primary sources, there are various methods by which to commit energy theft. Energy theft is a universal electric problem in many countries, with a possible loss of billions of dollars for electric companies. This energy contention is deep rooted, having so many root causes and rugged solutions of a technical nature. Advanced Metering Infrastructure (AMI) is introduced with no adequate results to control and minimize electric theft. Until now, so many techniques have been applied to overcome this grave problem of electric power theft. Many researchers nowadays use machine learning algorithms, trying... [more]

Window design affects the overall performance of a building. It is important to include window design during the initial stages of a project since it influences the performance of daylight and thermal comfort as well as the energy demand for heating and cooling. The Norwegian building code facilitates two alternative methods for achieving a sufficient daylight, and only guidelines for adequate indoor thermal comfort. In this study, a typical Norwegian residential building was modeled to investigate whether the criteria and methods facilitate consistent and good performance through different scenario changes and furthermore, how the national regulations compare to European standards. A better insulated and more air-tight building has usually a lower annual heating demand, with only a marginal decrease in the daylight performance when the window design is unchanged. A more air-tight construction increases the risk of overheating, even in cold climates. This study confirms that a revision... [more]

Unit commitment problem (UCP) is classified as a mixed-integer, large combinatorial, high-dimensional and nonlinear optimization problem. This paper suggests solving the UCP under deterministic and stochastic load demand using a hybrid technique that includes the modified particle swarm optimization (MPSO) along with equilibrium optimizer (EO), termed as MPSO-EO. The proposed approach is tested firstly on 15 benchmark test functions, and then it is implemented to solve the UCP under two test systems. The results are basically compared to that of standard EO and previously applied optimization techniques in solving the UCP. In test system 1, the load demand is deterministic. The proposed technique is in the best three solutions for the 10-unit system with cost savings of 309.95 USD over standard EO and for the 20-unit system it shows the best results over all algorithms in comparison with cost savings of 1951.5 USD over standard EO. In test system 2, the load demand is considered stocha... [more]

The aim of the ISORC/OPTIMISER project is to increase and improve the use of solar thermal energy in district heating networks. One of the main tasks of the project is to develop an optimization tool for the sizing and operation of a solar district heating network. This is the first optimization tool using an open-source interface (Julia, JuMP) and solver (Ipopt) to solve nonlinear problems. This paper presents the multi-period optimization problem which is implemented to consider the dynamic variations in a year, represented by four typical days, with an hourly resolution. The optimum is calculated for a total duration of 20 years. First, this paper presents the modeling of the different components of a solar district heating network production plant: district network demand, storage and three sources, i.e., a fossil (gas) and two renewable (solar and biomass) sources. In order to avoid prohibitive computational time, the modeling of sources and storage has to be fairly simple. The mu... [more]

The growing demand for electricity runs counter to European-level goals, which include activities aimed at sustainable development and environmental protection. In this context, efficient consumption of electricity attracts much research interest nowadays. One environment friendly solution to meet increased demand lies in the deployment of Renewable Energy Sources (RES) in the network and in mobilizing the active participation of consumers in reducing the peak of demand, thus smoothing the overall load curve. This paper addresses the issue of efficient and economical use of electricity from the Demand Side Management (DSM) perspective and presents an implementation of a fully-parameterized and explicitly constrained incentive-based demand response program The program uses the Particle Swarm Optimization algorithm and demonstrates the potential advantages of integrating RES while supporting two-way communication between energy production and consumption and two-way power exchange betwee... [more]

The Hechuan gas field is one of the tight gas reservoirs with the highest formation water salinity in China. The content of metal ions, such as calcium, magnesium, iron, and barium, is as high as 20 g/L. Severe scales in near-wellbore reservoir blocks the gas and liquid flow paths, affecting the normal production of gas wells. The analysis of scale samples shows that the scale compositions in the Hechuan gas field are complex, which are composed of calcium carbonate, calcium sulfate, barium sulfate, iron salt, silicate, and other inorganic scales. To dissolve these scales, 14 kinds of laboratory self-made chelating acids named AST-01 to AST-14, sequentially, were evaluated by the descaling rate, in which the chelating acid AST-01 was selected with a dissolution rate of 77.7%. Meanwhile, the optimal concentration and reaction time of AST-01 were investigated, and the concentrations of the corrosion inhibitor, the iron ion stabilizer, and surfactants were also optimized. Then, a chelatin... [more]

The generation of energy by conventional systems leads to several environmental issues. Fuel Cell (FC), being a new renewable energy source, has emerged as one of the promising alternatives to obtain clean and efficient energy generation. This paper highlights the power quality enhancement of the grid connected FC through a boost converter and 25 level Cascaded H-Bridge (CHB) Multi-Level Inverter (MLI) using the classical PID controller. To drive the MLI connected to the grid for governing the Point of Common Coupling (PCC) voltage between the FC and the grid, two PID controllers have been utilized. The conventional evolutionary techniques such as Particle Swarm Optimization (PSO) and Squirrel Search Algorithm (SSA) are implemented to tune the PID controllers for dynamic operations. To further enhance the convergence speed of computation and precision of the classical techniques used, an Improved Squirrel Search Algorithm (ISSA) has been proposed in this work. The grid connected power... [more]

Real-time energy management strategy (EMS) plays an important role in reducing fuel consumption and maintaining power for the hybrid electric vehicle. However, real-time optimization control is difficult to implement due to the computational load in an instantaneous moment. In this paper, an Approximate equivalent consumption minimization strategy (Approximate-ECMS) is presented for real-time optimization control based on single-shaft parallel hybrid powertrain. The quadratic fitting of the engine fuel consumption rate and the single-axle structure characteristics of the vehicle make the fitness function transformed into a cubic function based on ECMS for solving. The candidate solutions are thus obtained to distribute torque and the optimal distribution is got from the candidate solutions. The results show that the equivalent fuel consumption of Approximate-ECMS was 7.135 L/km by 17.55% improvement compared with Rule-ECMS in the New European Driving Cycle (NEDC). To compensate for the... [more]

Particle Swarm Optimization (PSO) is a member of the swarm intelligence-based on a metaheuristic approach which is inspired by the natural deeds of bird flocking and fish schooling. In comparison to other traditional methods, the model of PSO is widely recognized as a simple algorithm and easy to implement. However, the traditional PSO’s have two primary issues: premature convergence and loss of diversity. These problems arise at the latter stages of the evolution process when dealing with high-dimensional, complex and electromagnetic inverse problems. To address these types of issues in the PSO approach, we proposed an Improved PSO (IPSO) which employs a dynamic control parameter as well as an adaptive mutation mechanism. The main proposal of the novel adaptive mutation operator is to prevent the diversity loss of the optimization process while the dynamic factor comprises the balance between exploration and exploitation in the search domain. The experimental outcomes achieved by solv... [more]

In this paper, we proposed a home energy management system (HEMS) that includes photovoltaic (PV), electric vehicle (EV), and energy storage systems (ESS). The proposed HEMS fully utilizes the PV power in operating domestic appliances and charging EV/ESS. The surplus power is fed back to the grid to achieve economic benefits. A novel charging and discharging scheme of EV/ESS is presented to minimize the energy cost, control the maximum load demand, increase the battery life, and satisfy the user’s-traveling needs. The EV/ESS charges during low pricing periods and discharges in high pricing periods. In the proposed method, a multi-objective problem is formulated, which simultaneously minimizes the energy cost, peak to average ratio (PAR), and customer dissatisfaction. The multi-objective optimization is solved using binary particle swarm optimization (BPSO). The results clearly show that it minimizes the operating cost from 402.89 cents to 191.46 cents, so that a reduction of 52.47% is... [more]

Fabrication tolerances, as well as uncertainties of other kinds, e.g., concerning material parameters or operating conditions, are detrimental to the performance of microwave circuits. Mitigating their impact requires accounting for possible parameter deviations already at the design stage. This involves optimization of appropriately defined statistical figures of merit such as yield. Although important, robust (or tolerance-aware) design is an intricate endeavor because manufacturing inaccuracies are normally described using probability distributions, and their quantification has to be based on statistical analysis. The major bottleneck here is high computational cost: for reliability reasons, miniaturized microwave components are evaluated using full-wave electromagnetic (EM) models, whereas conventionally utilized analysis methods (e.g., Monte Carlo simulation) are associated with massive circuit evaluations. A practical approach that allows for circumventing the aforementioned obst... [more]

Microgrid (MG) is a small-scale grid that consists of multiple distributed energy resources and load demand. The microgrid energy management system (M-EMS) is the decision-making centre of the MG. An M-EMS is composed of four modules which are known as forecasting, scheduling, data acquisition, and human-machine interface. However, the forecasting and scheduling modules are considered the major modules from among the four of them. Therefore, this paper proposed an advanced microgrid energy management system (M-EMS) for grid-connected residential microgrid (MG) based on an ensemble forecasting strategy and grey wolf optimization (GWO) based scheduling strategy. In the forecasting module of M-EMS, the ensemble forecasting strategy is proposed to perform the short-term forecasting of PV power and load demand. The GWO based scheduling strategy has been proposed in scheduling module of M-EMS to minimize the operating cost of grid-connected residential MG. A small-scale experiment is conduct... [more]

Global optimization of industrial plant configurations using organic Rankine cycles (ORC) to recover heat is becoming attractive nowadays. This kind of optimization requires structural and parametric decisions to be made; the number of variables is usually high, and some of them generate disruptive responses. Surrogate models can be developed to replace the main components of the complex models reducing the computational requirements. This paper aims to create, evaluate, and compare surrogates built to replace a complex thermodynamic-economic code used to indicate the specific cost (US$/kWe) and efficiency of optimized ORCs. The ORCs are optimized under different heat sources conditions in respect to their operational state, configuration, working fluid and thermal fluid, aiming at a minimal specific cost. The costs of 1449.05, 1045.24, and 638.80 US$/kWe and energy efficiencies of 11.1%, 10.9%, and 10.4% were found for 100, 1000, and 50,000 kWt of heat transfer rate at average tempera... [more]

In this study, the Taguchi experimental design method using an L16 orthogonal array was attempted in order to investigate the optimal operating conditions for the CO2 methanation process in Ni-based catalysts. The relative influence of the main factors affecting CO2 conversion and CH4 yield was ranked as follows: reactor pressure > space velocity > reaction temperature. The optimal combination of operating conditions was a reactor temperature of 315 °C, a pressure of 19 bar, and a space velocity of 6000 h−1. The effect of the H2/CO2 ratio on CO2 conversion and CH4 yield was further considered under these optimal operating conditions. Moreover, the catalyst was characterized in order to investigate the production of coke through Brunauer−Emmett−Teller analysis, thermogravimetric analysis, and scanning electron microscopy. The amount of coke produced after the reaction for approximately 24 h was ~2 wt.%. Therefore, the desired CH4 yield and long-term operational stability were successful... [more]

The non-structural model of a heat exchanger network randomly selects a position of a node on hot and cold streams to generate a heat exchanger and an existing heat exchanger to participate in the evolution. Despite the model being more random and flexible, this selection method cannot easily find a good solution. In addition, the heat exchangers participating in the evolution might not be involved in all streams in each evolutionary process. A stream that does not participate in the evolution will have no significance to the current iteration. Therefore, many iterations are required to make each stream participate in the evolution, which limits the evolution efficiency of the optimization algorithm. In view of this shortcoming, this study proposes a participatory evolutionary strategy for streams based on hot streams. The proposed strategy reorders the existing heat exchangers on hot and cold streams and takes the corresponding measures to ensure that a heat exchanger is selected for... [more]

Vuilleumier refrigerators provide cooling power by utilizing a heat source at temperatures above the ambient. This is particularly helpful in situations where waste heat is available and other power sources are limited. Vuilleumier refrigerators come in different technical configurations; here we analyze the thermodynamic performance of a configuration utilizing two displacer pistons with integrated regenerators. More specifically, we optimize the cooling power by optimizing the piston movement for a range of operation speeds. The optimization is based on the AS motion class for cyclic dynamics and uses an endoreversible model for the refrigerator. Our focus is on the influence of the regeneration extent present, and we find performance gains of about 17% for high regeneration extent and of about 28% for lower regeneration extent.

The effective stress coefficient for permeability is a significant index for characterizing the variation in permeability with effective stress. The realization of its accuracy is essential for studying the stress sensitivity of oil and gas reservoirs. The determination of the effective stress coefficient for permeability can be mainly evaluated using the cross-plotting or response surface method. Both methods preprocess experimental data and preset a specific function relation, resulting in deviation in the calculation results. To improve the calculation accuracy of the effective stress coefficient for permeability, a 3D surface fitting calculation method was proposed according to the linear effective stress law and continuity hypothesis. The statistical parameters of the aforementioned three methods were compared, and the results showed that the three-dimensional (3D) surface fitting method had the advantages of a high correlation coefficient, low root mean square error, and low resi... [more]

Hydrogen produced without carbon emissions could be a useful fuel as nations look to decarbonize their electricity, transport, and industry sectors. Using the iodine−sulfur (IS) cycle coupled with a nuclear heat source is one method for producing hydrogen without the use of fossil fuels. An economic dispatch model was developed for a nuclear-driven IS system to determine hydrogen sale prices that would make such a system profitable. The system studied is the HTTR-GT/H2, a design for power and hydrogen cogeneration at the Japan Atomic Energy Agency’s High Temperature Engineering Test Reactor. This study focuses on the development of the economic model and the role that input data plays in the final calculated values. Using a historical price duration curve shows that the levelized cost of hydrogen (LCOH) or breakeven sale price of hydrogen would need to be 98.1 JPY/m3 or greater. Synthetic time histories were also used and found the LCOH to be 67.5 JPY/m3. The price duration input was f... [more]

(1) Background: considering multiple, and somehow conflicting, design objectives can potentially make achieving a high-performance design a complex task to perform. For instance, shading devices can dramatically affect the building performance in various ways, such as energy consumption and daylight. This paper introduces a novel procedure for designing shading devices as an integral part of daylightophil architecture for office buildings by considering daylight and energy performance as objectives to be optimal. (2) Methods: to address the topic, a three-step research method was used. Firstly, three different window shades (fixed and dynamic) were modeled, one of which was inspired by traditional Iranian structures, as the main options for evaluation. Secondly, each option was evaluated for energy performance and daylight-related variables in critical days throughout the year in terms of climatic conditions and daylight situations (equinoxes and solstices including 20 March, 21 June,... [more]

The impact of multimedia in day-to-day life and its applications will be increased greatly with the proposed model (MSVPC)−5G Multicast SDN network eminence video transmission obtained using PSO and cross layer progress in wireless nodes. The drone inspection and analysis in a solar farm requires a very high number of transmissions of various videos, data, animations, along with all sets of audio, text and visuals. Thus, it is necessary to regulate the transmissions of various videos due to a huge amount of bandwidth requirement for videos. A software-defined network (SDN) enables forwarder selection through particle swarm optimization (PSO) mode for streaming video packets through multicast routing transmissions. Transmission delay and packet errors are the main factors in selecting a forwarder. The nodes that transfer the videos with the shortest delay and the lowest errors have been calculated and sent to the destination through the forwarder. This method involves streaming to be in... [more]

In the power and heat sectors, the uncertainty of energy and carbon prices plays a decisive role in the rationale for decommissioning/repurposing coal-fired CHP (combined heat and power) systems and on investment decisions of energy storage units. Therefore, there is a growing need for advanced methods that incorporate the stochastic disturbances of energy and carbon emission prices into the optimization process of an energy system. In this context, this paper proposes an integrated method for investigating the effects of uncertain energy and carbon prices on the operational patterns and financial results of CHP systems with thermal energy storage units. The approach combines mathematical programming and Monte Carlo simulation. The computational process generates feasible solutions for profit maximization considering the technical constraints of the CHP system and the variation of energy and carbon emission prices. Four scenarios are established to compare the operational patterns and... [more]

Multi-microgrids have gained interest in academics and industry in recent years. Multi-microgrid (MG) allows the integration of different distributed energy resources (DERs), including intermittent renewables and controllable local generators, and provides a more flexible, reliable, and efficient power grid. This research formulates and proposes a solution for finding optimal location and operation of mobile energy storage (MES) in multi-MG power distribution systems (PDS) with different resources during extreme events to maximize system resiliency. For this purpose, a multi-stage event-based system resiliency index is defined and the impact of the Internet of things (IoT) application in MES operation in multi-MG systems is investigated. Moreover, the demand and price uncertainty impact on multi-MG operational performance indices is presented. This research uses a popular PG & E 69-bus multi-MG power distribution network for simulation and case studies. A new hybrid PSO-TS optimization... [more]