• The Journal of the Korea institute of electronic communication sciences
• /
• v.17 no.1
• /
• pp.41-48
• /
• 2022

This paper presents the unified Bayesian Tikhonov regularization method as a solution to total variation regularization. The integrated method presents a formula for obtaining the regularization parameter by transforming the total variation term into a weighted Tikhonov regularization term. It repeats until the reconstructed image converges to obtain a regularization parameter and a new weighting factor based on it. The experimental results show the effectiveness of the proposed method for the image restoration problem.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.11 no.11
• /
• pp.1129-1134
• /
• 2016

This paper suggests a new method of finding regularization parameter for image restoration problems. If the prior information is not available, separate optimization functions for Tikhonov regularization parameter are suggested in the literature such as generalized cross validation and L-curve criterion. In this paper, unified Bayesian interpretation of Tikhonov regularization is introduced and applied to the image restoration problems. The relationship between Tikhonov regularization parameter and Bayesian hyper-parameters is established. Update formular for the regularization parameter using both maximum a posteriori(: MAP) and evidence frameworks is suggested. Experimental results show the effectiveness of the proposed method.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.15 no.1
• /
• pp.161-166
• /
• 2020

This paper suggests an extension of the unified Bayesian Tikhonov regularization method. The unified method establishes the relationship between Tikhonov regularization parameter and Bayesian hyper-parameters, and presents a formula for obtaining the regularization parameter using the maximum posterior probability and the evidence framework. When the dimension of the data matrix is m by n (m >= n), we derive that the total misfit has the range of m ± n instead of m. Thus the search range is extended from one to 2n + 1 integer points. Golden section search rather than linear one is applied to reduce the time. A new benchmark for optimizing relative error and new model selection criteria to target it are suggested. The experimental results show the effectiveness of the proposed method in the image restoration problem.

• Journal of Biomedical Engineering Research
• /
• v.22 no.4
• /
• pp.311-319
• /
• 2001

Statistical reconstruction methods in the context of a Bayesian framework have played an important role in emission tomography since they allow to incorporate a priori information into the reconstruction algorithm. Given the ill-posed nature of tomographic inversion and the poor quality of projection data, the Bayesian approach uses regularizers to stabilize solutions by incorporating suitable prior models. In this work we show that, while the quantitative performance of the standard filtered backprojection (FBP) algorithm is not as good as that of Bayesian methods, the application of spline-regularized smoothing to the sinogram space can make the FBP algorithm improve its performance by inheriting the advantages of using the spline priors in Bayesian methods. We first show how to implement the spline-regularized smoothing filter by deriving mathematical relationship between the regularization and the lowpass filtering. We then compare quantitative performance of our new FBP algorithms using the quantitation of bias/variance and the total squared error (TSE) measured over noise trials. Our numerical results show that the second-order spline filter applied to FBP yields the best results in terms of TSE among the three different spline orders considered in our experiments.

• IEIE Transactions on Smart Processing and Computing
• /
• v.3 no.5
• /
• pp.271-274
• /
• 2014

Bayesian based Multi-Frame Super-Resolution (MF-SR) has been used as a popular and effective SR model. On the other hand, the texture region is not reconstructed sufficiently because it works on the spatial domain. In this study, the MF-SR method was extended to operate on the frequency domain to improve HF information as much as possible. For this, a spatially weighted bilateral total variation model was proposed as a regularization term for a Bayesian estimation. The experimental results showed that the proposed method can recover the texture region more realistically with reduced noise, compared to conventional methods.

• Smart Structures and Systems
• /
• v.15 no.4
• /
• pp.1103-1120
• /
• 2015

A self-sensing magnetorheological (MR) damper with embedded piezoelectric force sensor has recently been devised to facilitate real-time close-looped control of structural vibration in a simple and reliable manner. The development and characterization of the self-sensing MR damper are presented based on experimental work, which demonstrates its reliable force sensing and controllable damping capabilities. With the use of experimental data acquired under harmonic loading, a nonparametric dynamic model is formulated to portray the nonlinear behaviors of the self-sensing MR damper based on NARX modeling and neural network techniques. The Bayesian regularization is adopted in the network training procedure to eschew overfitting problem and enhance generalization. Verification results indicate that the developed NARX network model accurately describes the forward dynamics of the self-sensing MR damper and has superior prediction performance and generalization capability over a Bouc-Wen parametric model.

• International Journal of Naval Architecture and Ocean Engineering
• /
• v.13 no.1
• /
• pp.321-339
• /
• 2021

Response Surface Method (RSM) has been widely used for flammable cloud size prediction as it can reduce computational intensity for further Explosion Risk Analysis (ERA) especially during the early design phase of offshore platforms. However, RSM encounters the overfitting problem under very limited simulations. In order to overcome the disadvantage of RSM, Bayesian Regularization Artificial Neural (BRANN)-based model has been recently developed and its robustness and efficiency have been widely verified. However, for ERA during the early design phase, there seems to be room to further reduce the computational intensity while ensuring the model's acceptable accuracy. This study aims to develop an integrated method, namely the combination of Center Composite Design (CCD) method with Bayesian Regularization Artificial Neural Network (BRANN), for flammable cloud size prediction. A case study with constant and transient leakages is conducted to illustrate the feasibility and advantage of this hybrid method. Additionally, the performance of CCD-BRANN is compared with that of RSM. It is concluded that the newly developed hybrid method is more robust and computational efficient for ERAs during early design phase.

• Nuclear Engineering and Technology
• /
• v.54 no.11
• /
• pp.4209-4214
• /
• 2022

Precise modelling of the interaction of ions with materials is important for many applications including material characterization, ion implantation in devices, thermonuclear fusion, hadron therapy, secondary particle production (e.g. neutron), etc. In this study, a new approach using the Geant4 toolkit in combination with the Bayesian regularization (BR) learning algorithm of the feed-forward neural network (FFNN) is developed to estimate the range of ions in materials accurately and quickly. The different incident ions at different energies are interacted with the target materials. The Geant4 is utilized to model the interactions and to calculate the range of the ions. Afterward, the appropriate architecture of the FFNN-BR with the relevant input features is utilized to learn the modelled ranges and to estimate the new ranges for the new cases. The notable achievements of the proposed approach are: 1- The range of ions in different materials is given as quickly as possible and the time required for estimating the ranges can be neglected (i.e. less than 0.01 s by a typical personal computer). 2- The proposed approach can generalize its ability for estimating the new untrained cases. 3- There is no need for a pre-made lookup table for the estimation of the range values.

• Structural Engineering and Mechanics
• /
• v.81 no.1
• /
• pp.103-115
• /
• 2022

The prediction error variances for frequencies are usually considered as unknown in the Bayesian system identification process. However, the error variances for mode shapes are taken as known to reduce the dimension of an identification problem. The present study attempts to explore the effectiveness of Bayesian approach of model parameters updating using Markov Chain Monte Carlo (MCMC) technique considering the prediction error variances for both the frequencies and mode shapes. To remove the ergodicity of Markov Chain, the posterior distribution is obtained by Gaussian Random walk over the proposal distribution. The prior distributions of prediction error variances of modal evidences are implemented through inverse gamma distribution to assess the effectiveness of estimation of posterior values of model parameters. The issue of incomplete data that makes the problem ill-conditioned and the associated singularity problem is prudently dealt in by adopting a regularization technique. The proposed approach is demonstrated numerically by considering an eight-storey frame model with both complete and incomplete modal data sets. Further, to study the effectiveness of the proposed approach, a comparative study with regard to accuracy and computational efficacy of the proposed approach is made with the Sequential Monte Carlo approach of model parameter updating.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.6
• /
• pp.209-220
• /
• 2014

Compressive Sensing (CS) is a new signal acquisition paradigm which enables sampling under Nyquist rate for a special kind of signal called sparse signal. There are plenty of CS recovery methods but their performance are still challenging, especially at a low sub-rate. For CS recovery of natural images, regularizations exploiting some prior information can be used in order to enhance CS performance. In this context, this paper addresses improving quality of reconstructed natural images based on Dantzig selector and smooth filters (i.e., Gaussian filter and nonlocal means filter) to generate a new regularization called smooth residual error regularization. Moreover, total variation has been proved for its success in preserving edge objects and boundary of reconstructed images. Therefore, effectiveness of the proposed regularization is verified by experimenting it using augmented Lagrangian total variation minimization. This framework is considered as a new CS recovery seeking smoothness in residual images. Experimental results demonstrate significant improvement of the proposed framework over some other CS recoveries both in subjective and objective qualities. In the best case, our algorithm gains up to 9.14 dB compared with the CS recovery using Bayesian framework.