• Title/Summary/Keyword: $l_1$-norm regularization

Search Result 16, Processing Time 0.024 seconds

lp-norm regularization for impact force identification from highly incomplete measurements

  • Yanan Wang;Baijie Qiao;Jinxin Liu;Junjiang Liu;Xuefeng Chen
    • Smart Structures and Systems
    • /
    • v.34 no.2
    • /
    • pp.97-116
    • /
    • 2024
  • The standard l1-norm regularization is recently introduced for impact force identification, but generally underestimates the peak force. Compared to l1-norm regularization, lp-norm (0 ≤ p < 1) regularization, with a nonconvex penalty function, has some promising properties such as enforcing sparsity. In the framework of sparse regularization, if the desired solution is sparse in the time domain or other domains, the under-determined problem with fewer measurements than candidate excitations may obtain the unique solution, i.e., the sparsest solution. Considering the joint sparse structure of impact force in temporal and spatial domains, we propose a general lp-norm (0 ≤ p < 1) regularization methodology for simultaneous identification of the impact location and force time-history from highly incomplete measurements. Firstly, a nonconvex optimization model based on lp-norm penalty is developed for regularizing the highly under-determined problem of impact force identification. Secondly, an iteratively reweighed l1-norm algorithm is introduced to solve such an under-determined and unconditioned regularization model through transforming it into a series of l1-norm regularization problems. Finally, numerical simulation and experimental validation including single-source and two-source cases of impact force identification are conducted on plate structures to evaluate the performance of lp-norm (0 ≤ p < 1) regularization. Both numerical and experimental results demonstrate that the proposed lp-norm regularization method, merely using a single accelerometer, can locate the actual impacts from nine fixed candidate sources and simultaneously reconstruct the impact force time-history; compared to the state-of-the-art l1-norm regularization, lp-norm (0 ≤ p < 1) regularization procures sufficiently sparse and more accurate estimates; although the peak relative error of the identified impact force using lp-norm regularization has a decreasing tendency as p is approaching 0, the results of lp-norm regularization with 0 ≤ p ≤ 1/2 have no significant differences.

Performance Comparison of Regularization Methods in Electrical Resistance Tomography (전기 저항 단층촬영법에서의 조정기법 성능비교)

  • Kang, Suk-In;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.20 no.3
    • /
    • pp.226-234
    • /
    • 2016
  • Electrical resistance tomography (ERT) is an imaging technique where the internal resistivity distribution inside an object is reconstructed. The ERT image reconstruction is a highly nonlinear ill-posed problem, so regularization methods are used to achieve desired image. The reconstruction outcome is dependent on the type of regularization method employed such as l2-norm, l1-norm, and total variation regularization method. That is, use of an appropriate regularization method considering the flow characteristics is necessary to attain good reconstruction performance. Therefore, in this paper, regularization methods are tested through numerical simulations with different flow conditions and the performance is compared.

L1-norm Regularization for State Vector Adaptation of Subspace Gaussian Mixture Model (L1-norm regularization을 통한 SGMM의 state vector 적응)

  • Goo, Jahyun;Kim, Younggwan;Kim, Hoirin
    • Phonetics and Speech Sciences
    • /
    • v.7 no.3
    • /
    • pp.131-138
    • /
    • 2015
  • In this paper, we propose L1-norm regularization for state vector adaptation of subspace Gaussian mixture model (SGMM). When you design a speaker adaptation system with GMM-HMM acoustic model, MAP is the most typical technique to be considered. However, in MAP adaptation procedure, large number of parameters should be updated simultaneously. We can adopt sparse adaptation such as L1-norm regularization or sparse MAP to cope with that, but the performance of sparse adaptation is not good as MAP adaptation. However, SGMM does not suffer a lot from sparse adaptation as GMM-HMM because each Gaussian mean vector in SGMM is defined as a weighted sum of basis vectors, which is much robust to the fluctuation of parameters. Since there are only a few adaptation techniques appropriate for SGMM, our proposed method could be powerful especially when the number of adaptation data is limited. Experimental results show that error reduction rate of the proposed method is better than the result of MAP adaptation of SGMM, even with small adaptation data.

Resistivity Image Reconstruction Using Interacting Dual-Mode Regularization (상호작용 이중-모드 조정방법을 이용한 저항률 영상 복원)

  • Kang, Suk-In;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.20 no.2
    • /
    • pp.152-162
    • /
    • 2016
  • Electrical resistivity tomography (ERT) is a technique to reconstruct the internal resistivity distribution using the measured voltages on the surface electrodes. ERT inverse problem suffers from ill-posedness nature, so regularization methods are used to mitigate ill-posedness. The reconstruction performance varies depending on the type of regularization method. In this paper, an interacting dual-mode regularization method is proposed with two different regularization methods, L1-norm regularization and total variation (TV) regularization, to achieve robust reconstruction performance. The interacting dual-mode regularization method selects the suitable regularization method and combines the regularization methods based on computed mode probabilities depending on the actual conditions. The proposed method is tested with numerical simulations and the results demonstrate an improved reconstruction performance.

Two Dimensional Slow Feature Discriminant Analysis via L2,1 Norm Minimization for Feature Extraction

  • Gu, Xingjian;Shu, Xiangbo;Ren, Shougang;Xu, Huanliang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.7
    • /
    • pp.3194-3216
    • /
    • 2018
  • Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

Signomial Classification Method with 0-regularization (L0-정규화를 이용한 Signomial 분류 기법)

  • Lee, Kyung-Sik
    • IE interfaces
    • /
    • v.24 no.2
    • /
    • pp.151-155
    • /
    • 2011
  • In this study, we propose a signomial classification method with 0-regularization (0-)which seeks a sparse signomial function by solving a mixed-integer program to minimize the weighted sum of the 0-norm of the coefficient vector of the resulting function and the $L_1$-norm of loss caused by the function. $SC_0$ gives an explicit description of the resulting function with a small number of terms in the original input space, which can be used for prediction purposes as well as interpretation purposes. We present a practical implementation of $SC_0$ based on the mixed-integer programming and the column generation procedure previously proposed for the signomial classification method with $SL_1$-regularization. Computational study shows that $SC_0$ gives competitive performance compared to other widely used learning methods for classification.

An Unified Bayesian Total Variation Regularization Method and Application to Image Restoration (통합 베이즈 총변이 정규화 방법과 영상복원에 대한 응용)

  • Yoo, Jae-Hung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.1
    • /
    • pp.41-48
    • /
    • 2022
  • This paper presents the unified Bayesian Tikhonov regularization method as a solution to total variation regularization. The integrated method presents a formula for obtaining the regularization parameter by transforming the total variation term into a weighted Tikhonov regularization term. It repeats until the reconstructed image converges to obtain a regularization parameter and a new weighting factor based on it. The experimental results show the effectiveness of the proposed method for the image restoration problem.

Application of Matrix Adaptive Regularization Method for Human Thorax Image Reconstruction (인체 흉부 영상 복원을 위한 행렬 적응 조정 방법의 적용)

  • Jeon, Min-Ho;Kim, Kyung-Youn
    • Journal of IKEEE
    • /
    • v.19 no.1
    • /
    • pp.33-40
    • /
    • 2015
  • Inverse problem in electrical impedance tomography (EIT) is highly ill-posed therefore prior information is used to mitigate the ill-posedness. Regularization methods are often adopted in solving EIT inverse problem to have satisfactory reconstruction performance. In solving the EIT inverse problem, iterative Gauss-Newton method is generally used due to its accuracy and fast convergence. However, its performance is still suboptimal and mainly depends on the selection of regularization parameter. Although, there are few methods available to determine the regularization parameter such as L-curve method they are sometimes not applicable for all cases. Moreover, regularization parameter is a scalar and it is fixed during iteration process. Therefore, in this paper, a novel method is used to determine the regularization parameter to improve reconstruction performance. Conductivity norm is calculated at each iteration step and it used to obtain the regularization parameter which is a diagonal matrix in this case. The proposed method is applied to human thorax imaging and the reconstruction performance is compared with traditional methods. From numerical results, improved performance of proposed method is seen as compared to conventional methods.

A hybrid-separate strategy for force identification of the nonlinear structure under impact excitation

  • Jinsong Yang;Jie Liu;Jingsong Xie
    • Structural Engineering and Mechanics
    • /
    • v.85 no.1
    • /
    • pp.119-133
    • /
    • 2023
  • Impact event is the key factor influencing the operational state of the mechanical equipment. Additionally, nonlinear factors existing in the complex mechanical equipment which are currently attracting more and more attention. Therefore, this paper proposes a novel hybrid-separate identification strategy to solve the force identification problem of the nonlinear structure under impact excitation. The 'hybrid' means that the identification strategy contains both l1-norm (sparse) and l2-norm regularization methods. The 'separate' means that the nonlinear response part only generated by nonlinear force needs to be separated from measured response. First, the state-of-the-art two-step iterative shrinkage/thresholding (TwIST) algorithm and sparse representation with the cubic B-spline function are developed to solve established normalized sparse regularization model to identify the accurate impact force and accurate peak value of the nonlinear force. Then, the identified impact force is substituted into the nonlinear response separation equation to obtain the nonlinear response part. Finally, a reduced transfer equation is established and solved by the classical Tikhonove regularization method to obtain the wave profile (variation trend) of the nonlinear force. Numerical and experimental identification results demonstrate that the novel hybrid-separate strategy can accurately and efficiently obtain the nonlinear force and impact force for the nonlinear structure.

MULTIGRID METHOD FOR TOTAL VARIATION IMAGE DENOISING

  • HAN, MUN S.;LEE, JUN S.
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.6 no.2
    • /
    • pp.9-24
    • /
    • 2002
  • Total Variation(TV) regularization method is effective for reconstructing "blocky", discontinuous images from contaminated image with noise. But TV is represented by highly nonlinear integro-differential equation that is hard to solve. There have been much effort to obtain stable and fast methods. C. Vogel introduced "the Fixed Point Lagged Diffusivity Iteration", which solves the nonlinear equation by linearizing. In this paper, we apply multigrid(MG) method for cell centered finite difference (CCFD) to solve system arise at each step of this fixed point iteration. In numerical simulation, we test various images varying noises and regularization parameter $\alpha$ and smoothness $\beta$ which appear in TV method. Numerical tests show that the parameter ${\beta}$ does not affect the solution if it is sufficiently small. We compute optimal $\alpha$ that minimizes the error with respect to $L^2$ norm and $H^1$ norm and compare reconstructed images.

  • PDF