• Title/Summary/Keyword: total least squares method

Search Result 129, Processing Time 0.031 seconds

EFFICIENT ESTIMATION OF THE REGULARIZATION PARAMETERS VIA L-CURVE METHOD FOR TOTAL LEAST SQUARES PROBLEMS

  • Lee, Geunseop
    • Journal of the Korean Mathematical Society
    • /
    • v.54 no.5
    • /
    • pp.1557-1571
    • /
    • 2017
  • The L-curve method is a parametric plot of interrelation between the residual norm of the least squares problem and the solution norm. However, the L-curve method may be hard to apply to the total least squares problem due to its no closed form solution of the regularized total least squares problems. Thus the sequence of the solution norm under the fixed regularization parameter and its corresponding residual need to be found with an efficient manner. In this paper, we suggest an efficient algorithm to find the sequence of the solutions and its residual in order to plot the L-curve for the total least squares problems. In the numerical experiments, we present that the proposed algorithm successfully and efficiently plots fairly 'L' like shape for some practical regularized total least squares problems.

DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM

  • Lee, Geunseop
    • Journal of the Korean Mathematical Society
    • /
    • v.54 no.2
    • /
    • pp.613-626
    • /
    • 2017
  • For the overdetermined linear system, when both the data matrix and the observed data are contaminated by noise, Total Least Squares method is an appropriate approach. Since an ill-conditioned data matrix with noise causes a large perturbation in the solution, some kind of regularization technique is required to filter out such noise. In this paper, we consider a Dual regularized Total Least Squares problem. Unlike the Tikhonov regularization which constrains the size of the solution, a Dual regularized Total Least Squares problem considers two constraints; one constrains the size of the error in the data matrix, the other constrains the size of the error in the observed data. Our method derives two nonlinear equations to construct the iterative method. However, since the Jacobian matrix of two nonlinear equations is not guaranteed to be nonsingular, we adopt a trust-region based iteration method to obtain the solution.

Comparison between the General Least Squares method and the Total Least Squares method through coordinate transformation (좌표변환을 통한 일반최소제곱법과 토탈최소제곱법 비교연구)

  • 박영무;김병국
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2004.11a
    • /
    • pp.9-16
    • /
    • 2004
  • Performing adjustments where the observation equations involve more than a single measurement are General Least Squares(GLS) and Total Least Squares(TLS). This paper introduces theory of the GLS and TLS and compared experimentally accuracy and efficiency of those through 2D conformal coordinate transformation and 2D affine coordinate transformation. In conclusion, in case of 2D coordinate transformation, GLS can produce a little more accurate and efficient than TLS. In survey fields, The GLS and TLS can be used cooperatively for adjusting the actual coordinate measurements.

  • PDF

FIR System Identification Method Using Collaboration Between RLS (Recursive Least Squares) and RTLS (Recursive Total Least Squares) (RLS (Recursive Least Squares)와 RTLS (Recursive Total Least Squares)의 결합을 이용한 새로운 FIR 시스템 인식 방법)

  • Lim, Jun-Seok;Pyeon, Yong-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.6
    • /
    • pp.374-380
    • /
    • 2010
  • It is known that the problem of FIR filtering with noisy input and output data can be solved by a total least squares (TLS) estimation. It is also known that the performance of the TLS estimation is very sensitive to the ratio between the variances of the input and output noises. In this paper, we propose a convex combination algorithm between the ordinary recursive LS based TLS (RTLS) and the ordinary recursive LS (RLS). This combined algorithm is robust to the noise variance ratio and has almost the same complexity as the RTLS. Simulation results show that the proposed algorithm performs near TLS in noise variance ratio ${\gamma}{\approx}1$ and that it outperforms TLS and LS in the rage of 2 < $\gamma$ < 20. Consequently, the practical workability of the TLS method applied to noisy data has been significantly broadened.

A Comparison Study on Total Least Squares and Least Squares (토털최소제곱법과 최소제곱법의 비교연구)

  • 이임평;최윤수;권재현
    • Proceedings of the Korean Society of Surveying, Geodesy, Photogrammetry, and Cartography Conference
    • /
    • 2003.10a
    • /
    • pp.15-19
    • /
    • 2003
  • The Total Least Squares (TLS) method is introduced in comparison with the conventional Least Squares (LS) method. The principles and mathematical models for both methods are summarized and the comparison results from their applications to a simple geometric example, fitting a straight line to a set of 2D points are presented. As conceptually reasoned, the results clearly indicate that LS is more susceptible of producing wrong parameters with worse precision rather than TLS. For many applications in surveying, can adjustment computation and parameter estimation based on TLS provide better results.

  • PDF

A study on robust recursive total least squares algorithm based on iterative Wiener filter method (반복형 위너 필터 방법에 기반한 재귀적 완전 최소 자승 알고리즘의 견실화 연구)

  • Lim, Jun Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.40 no.3
    • /
    • pp.213-218
    • /
    • 2021
  • It is known that total least-squares method shows better estimation performance than least-squares method when noise is present at the input and output at the same time. When total least squares method is applied to data with time series characteristics, Recursive Total Least Squares (RTS) algorithm has been proposed to improve the real-time performance. However, RTLS has numerical instability in calculating the inverse matrix. In this paper, we propose an algorithm for reducing numerical instability as well as having similar convergence to RTLS. For this algorithm, we propose a new RTLS using Iterative Wiener Filter (IWF). Through the simulation, it is shown that the convergence of the proposed algorithm is similar to that of the RTLS, and the numerical robustness is superior to the RTLS.

The Geolocation Based on Total Least Squares Algorithm Using Satellites (위성을 이용한 Total Least Squares 기반 신호원 측위 알고리즘)

  • 박영미;조상우;전주환
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.2C
    • /
    • pp.255-261
    • /
    • 2004
  • The problem of geolocation using multiple satellites is to determine the position of a transmitter located on the Earth by processing received signals. The specific problem addressed in this paper is that of estimating the position of a stationary transmitter located on or above the Earth's surface from measured time difference of arrivals (TDOA) by a geostationary orbiting (GSO) satellite and a low earth orbiting (LEO) satellite. The proposed geolocation method is based on the total least squares (TLS) algorithm. Under erroneous positions of the satellites together with noisy TDOA measurements, the TLS algorithm provides a better solution. By running Monte-Carlo simulations, the proposed method is compared with the ordinary least squares (LS) approach.

A Coupled Recursive Total Least Squares-Based Online Parameter Estimation for PMSM

  • Wang, Yangding;Xu, Shen;Huang, Hai;Guo, Yiping;Jin, Hai
    • Journal of Electrical Engineering and Technology
    • /
    • v.13 no.6
    • /
    • pp.2344-2353
    • /
    • 2018
  • A coupled recursive total least squares (CRTLS) algorithm is proposed for parameter estimation of permanent magnet synchronous machines (PMSMs). TLS considers the errors of both input variables and output ones, and thus achieves more accurate estimates than standard least squares method does. The proposed algorithm consists of two recursive total least squares (RTLS) algorithms for the d-axis subsystem and q-axis subsystem respectively. The incremental singular value decomposition (SVD) for the RTLS obtained by an approximate calculation with less computation. The performance of the CRTLS is demonstrated by simulation and experimental results.

Robust Total Least Squares Method and its Applications to System Identifications (견인한 완전최소자승법과 시스템 식별에의 적용)

  • Kim, Jin-Young;Choi, Seung-Ho
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.4
    • /
    • pp.93-97
    • /
    • 1996
  • The Total Least Squares(TLS) method is an unbiased estimator for solving overdetermined sets of linear equations Ax${\simeq}$b when errors occur in all data. However, as well as Least Squares(LS) method it doesn't show robustness while the errors have a heavy tailed probability density function. In this paper we proposed a robust method of TLS (Robust TLS, ROTLS) based on the characteristics of TLS solution. And the ROTLS is verified by applying it to system identification problems.

  • PDF

A Study on the ALS Method of System Identification (시스템동정의 ALS법에 관한 연구)

  • Lee, D.C.
    • Journal of Power System Engineering
    • /
    • v.7 no.1
    • /
    • pp.74-81
    • /
    • 2003
  • A system identification is to estimate the mathematical model on the base of input output data and to measure the output in the presence of adequate input for the controlled system. In the traditional system control field, most identification problems have been thought as estimating the unknown modeling parameters on the assumption that the model structures are fixed. In the system identification, it is possible to estimate the true parameter values by the adjusted least squares method in the input output case of no observed noise, and it is possible to estimate the true parameter values by the total least squares method in the input output case with the observed noise. We suggest the adjusted least squares method as a consistent estimation method in the system identification in the case where there is observed noise only in the output. In this paper the adjusted least squares method has been developed from the least squares method and the efficiency of the estimating results was confirmed by the generating data with the computer simulations.

  • PDF