• Proceedings of the Korea Water Resources Association Conference
• /
• 2023.05a
• /
• pp.171-171
• /
• 2023

This study investigates the capability of Physics-Informed Neural Networks (PINNs) for solving the solution of partial differential equations. Particularly, the 1D Saint-Venant Equations (SVEs) were considered, which describe the movement of water in a domain with shallow depth compared to its horizontal extent, and are widely adopted in hydrodynamics, river, and coastal engineering. The core contribution of this work is to combine the robustness of neural networks with the physical constraints of the SVEs. The PINNs method utilized a neural network to approximate the solutions of SVEs, while also enforcing the underlying physical principles of the equations. This allows for a more effective and reliable solution, especially in areas with complex geometry and varying bathymetry. To validate the robustness of the PINNs method, numerical experiments were conducted on several benchmark problems. The results show that the PINNs could be achieved high accuracy when compared with the solution from the numerical solution. Overall, this study demonstrates the potential of using PINNs and highlights the benefits of integrating neural network and physics information for improved efficiency and accuracy in solving SVEs.

• The Journal of the Acoustical Society of Korea
• /
• v.42 no.4
• /
• pp.305-312
• /
• 2023

Physics-Informed Neural Network (PINN) is used to invert bubble size distributions from attenuation losses. By considering a linear system for the bubble population inversion, Adaptive Learned Iterative Shrinkage Thresholding Algorithm (Ada-LISTA), which has been solved linear systems in image processing, is used as a neural network architecture in PINN. Furthermore, a regularization based on the linear system is added to a loss function of PINN and it makes a PINN have better generalization by a solution satisfying the bubble physics. To evaluate an uncertainty of bubble estimation, deep ensemble is adopted. 20 Ada-LISTAs with different initial values are trained using the same training dataset. During test with attenuation losses different from those in the training dataset, the bubble size distribution and corresponding uncertainty are indicated by average and variance of 20 estimations, respectively. Deep ensemble Ada-LISTA demonstrate superior performance in inverting bubble size distributions than the conventional convex optimization solver of CVX.

• Nuclear Engineering and Technology
• /
• v.55 no.6
• /
• pp.2305-2314
• /
• 2023

The governing equations of atmospheric dispersion most often taking the form of a second-order partial differential equation (PDE). Currently, typical computational codes for predicting atmospheric dispersion use the Gaussian plume model that is an analytic solution. A Gaussian model is simple and enables rapid simulations, but it can be difficult to apply to situations with complex model parameters. Recently, a method of solving PDEs using artificial neural networks called physics-informed neural network (PINN) has been proposed. The PINN assumes the latent (hidden) solution of a PDE as an arbitrary neural network model and approximates the solution by optimizing the model. Unlike a Gaussian model, the PINN is intuitive in that it does not require special assumptions and uses the original equation without modifications. In this paper, we describe an approach to atmospheric dispersion modeling using the PINN and show its applicability through simple case studies. The results are compared with analytic and fundamental numerical methods to assess the accuracy and other features. The proposed PINN approximates the solution with reasonable accuracy. Considering that its procedure is divided into training and prediction steps, the PINN also offers the advantage of rapid simulations once the training is over.

• Journal of the Korean Society of Visualization
• /
• v.21 no.1
• /
• pp.119-126
• /
• 2023

Acquiring experimental data for PIV verification or machine learning training data is resource-demanding, leading to an increasing interest in synthetic particle images as simulation data. Conventional synthetic particle image generation algorithms do not follow physical laws, and the use of CFD is time-consuming and requires computing resources. In this study, we propose a new method for synthetic particle image generation, based on a Physics-Informed Neural Networks(PINN). The PINN is utilized to infer the flow fields, enabling the generation of synthetic particle images that follow physical laws with reduced computation time and have no constraints on spatial resolution compared to CFD. The proposed method is expected to contribute to the verification of PIV algorithms.

• Geophysics and Geophysical Exploration
• /
• v.26 no.3
• /
• pp.114-125
• /
• 2023

The physics-informed neural network (PINN) has been proposed to overcome the limitations of various numerical methods used to solve partial differential equations (PDEs) and the drawbacks of purely data-driven machine learning. The PINN directly applies PDEs to the construction of the loss function, introducing physical constraints to machine learning training. This technique can also be applied to wave equation modeling. However, to solve the wave equation using the PINN, second-order differentiations with respect to input data must be performed during neural network training, and the resulting wavefields contain complex dynamical phenomena, requiring careful strategies. This tutorial elucidates the fundamental concepts of the PINN and discusses considerations for wave equation modeling using the PINN approach. These considerations include spatial coordinate normalization, the selection of activation functions, and strategies for incorporating physics loss. Our experimental results demonstrated that normalizing the spatial coordinates of the training data leads to a more accurate reflection of initial conditions in neural network training for wave equation modeling. Furthermore, the characteristics of various functions were compared to select an appropriate activation function for wavefield prediction using neural networks. These comparisons focused on their differentiation with respect to input data and their convergence properties. Finally, the results of two scenarios for incorporating physics loss into the loss function during neural network training were compared. Through numerical experiments, a curriculum-based learning strategy, applying physics loss after the initial training steps, was more effective than utilizing physics loss from the early training steps. In addition, the effectiveness of the PINN technique was confirmed by comparing these results with those of training without any use of physics loss.

• Nuclear Engineering and Technology
• /
• v.55 no.9
• /
• pp.3409-3416
• /
• 2023

Licensing the next-generation of nuclear reactor designs requires extensive use of Modeling and Simulation (M&S) to investigate system response to many operational conditions, identify possible accidental scenarios and predict their evolution to undesirable consequences that are to be prevented or mitigated via the deployment of adequate safety barriers. Deep Learning (DL) and Artificial Intelligence (AI) can support M&S computationally by providing surrogates of the complex multi-physics high-fidelity models used for design. However, DL and AI are, generally, low-fidelity 'black-box' models that do not assure any structure based on physical laws and constraints, and may, thus, lack interpretability and accuracy of the results. This poses limitations on their credibility and doubts about their adoption for the safety assessment and licensing of novel reactor designs. In this regard, Physics Informed Neural Networks (PINNs) are receiving growing attention for their ability to integrate fundamental physics laws and domain knowledge in the neural networks, thus assuring credible generalization capabilities and credible predictions. This paper presents the use of PINNs as surrogate models for accidental scenarios simulation in Nuclear Power Plants (NPPs). A case study of a Loss of Heat Sink (LOHS) accidental scenario in a Nuclear Battery (NB), a unique class of transportable, plug-and-play microreactors, is considered. A PINN is developed and compared with a Deep Neural Network (DNN). The results show the advantages of PINNs in providing accurate solutions, avoiding overfitting, underfitting and intrinsically ensuring physics-consistent results.

• Journal of Korea Water Resources Association
• /
• v.56 no.12
• /
• pp.939-953
• /
• 2023

Shallow water equations (SWE) serve as fundamental equations governing the movement of the water. Traditional numerical approaches for solving these equations generally face various challenges, such as sensitivity to mesh generation, and numerical oscillation, or become more computationally unstable around shock and discontinuities regions. In this study, we present a novel approach that leverages the power of physics-informed neural networks (PINNs) to approximate the solution of the SWE. PINNs integrate physical law directly into the neural network architecture, enabling the accurate approximation of solutions to the SWE. We provide a comprehensive methodology for formulating the SWE within the PINNs framework, encompassing network architecture, training strategy, and data generation techniques. Through the results obtained from experiments, we found that PINNs could be an accurate output solution of SWE when its results were compared with the analytical method. In addition, PINNs also present better performance over the Artificial Neural Network. This study highlights the transformative potential of PINNs in revolutionizing water resources research, offering a new paradigm for accurate and efficient solutions to the SVE.

• Journal of the Semiconductor & Display Technology
• /
• v.19 no.4
• /
• pp.88-93
• /
• 2020

Based on the capture-emission energy (CEE) maps of CMOS devices, a physics-informed machine learning model for the bias temperature instability (BTI)-induced threshold voltage shifts and low frequency noise is presented. In order to incorporate physics theories into the machine learning model, the integration of artificial neural network (IANN) is employed for the computation of the threshold voltage shifts and low frequency noise. The model combines the computational efficiency of IANN with the optimal estimation of Gaussian mixture model (GMM) with soft clustering. It enables full lifetime prediction of BTI under various stress and recovery conditions and provides accurate prediction of the dynamic behavior of the original measured data.

• Geophysics and Geophysical Exploration
• /
• v.25 no.4
• /
• pp.227-241
• /
• 2022

Full waveform inversion (FWI) in the field of seismic data processing is an inversion technique that is used to estimate the velocity model of the subsurface for oil and gas exploration. Recently, deep learning (DL) technology has been increasingly used for seismic data processing, and its combination with FWI has attracted remarkable research efforts. For example, DL-based data processing techniques have been utilized for preprocessing input data for FWI, enabling the direct implementation of FWI through DL technology. DL-based FWI can be divided into the following methods: pure data-based, physics-based neural network, encoder-decoder, reparameterized FWI, and physics-informed neural network. In this review, we describe the theory and characteristics of the methods by systematizing them in the order of advancements. In the early days of DL-based FWI, the DL model predicted the velocity model by preparing a large training data set to adopt faithfully the basic principles of data science and apply a pure data-based prediction model. The current research trend is to supplement the shortcomings of the pure data-based approach using the loss function consisting of seismic data or physical information from the wave equation itself in deep neural networks. Based on these developments, DL-based FWI has evolved to not require a large amount of learning data, alleviating the cycle-skipping problem, which is an intrinsic limitation of FWI, and reducing computation times dramatically. The value of DL-based FWI is expected to increase continually in the processing of seismic data.