• Title/Summary/Keyword: Total Least Squares

Search Result 282, Processing Time 0.024 seconds

An Efficient Recursive Total Least Squares Algorithm for Training Multilayer Feedforward Neural Networks

  • Choi Nakjin;Lim Jun-Seok;Sung Koeng-Mo
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • autumn
    • /
    • pp.527-530
    • /
    • 2004
  • We present a recursive total least squares (RTLS) algorithm for multilayer feedforward neural networks. So far, recursive least squares (RLS) has been successfully applied to training multilayer feedforward neural networks. But, when input data contain additive noise, the results from RLS could be biased. Such biased results can be avoided by using the recursive total least squares (RTLS) algorithm. The RTLS algorithm described in this paper gives better performance than RLS algorithm over a wide range of SNRs and involves approximately the same computational complexity of $O(N^{2})$.

  • PDF

Robust Total Least Squares Method and its Applications to System Identifications (견인한 완전최소자승법과 시스템 식별에의 적용)

  • Kim, Jin-Young;Choi, Seung-Ho
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.4
    • /
    • pp.93-97
    • /
    • 1996
  • The Total Least Squares(TLS) method is an unbiased estimator for solving overdetermined sets of linear equations Ax${\simeq}$b when errors occur in all data. However, as well as Least Squares(LS) method it doesn't show robustness while the errors have a heavy tailed probability density function. In this paper we proposed a robust method of TLS (Robust TLS, ROTLS) based on the characteristics of TLS solution. And the ROTLS is verified by applying it to system identification problems.

  • PDF

Adaptive Inverse Modelling of Noisy System by Total Least Squares (완전최소자승법을 이용한 잡음환경하에서 시스템의 적응 역 모델링)

  • 황재섭
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1991.06a
    • /
    • pp.23-27
    • /
    • 1991
  • RLS(Recursive Least Squares)나 LMS(Least mean square)등은 알고리듬 고유의 성질상 잡음이 섞인 시스템에 있어서는 올바른 역 모델링을 할 수 없다. 따라서, 잡음의 영향을 받지않는 견실한(robust) 모델 추정 알고리듬이 필요하다. 본 논문에서는 잡음환경하에 있는 시스템을역 모델링하는데 있어서, 잡음의 영향을 줄이기위해 완전최소자승법을 도입하고 기존의 최소자승법과 비교 실험하였다. 그리고, 이 방법의 적응 알고리듬을 제안하였으며, RLS(Recursive least squares)와 그 성능을 비교하여 타당성을 검토하였다.

  • PDF

A Study on the ALS Method of System Identification (시스템동정의 ALS법에 관한 연구)

  • Lee, D.C.
    • Journal of Power System Engineering
    • /
    • v.7 no.1
    • /
    • pp.74-81
    • /
    • 2003
  • A system identification is to estimate the mathematical model on the base of input output data and to measure the output in the presence of adequate input for the controlled system. In the traditional system control field, most identification problems have been thought as estimating the unknown modeling parameters on the assumption that the model structures are fixed. In the system identification, it is possible to estimate the true parameter values by the adjusted least squares method in the input output case of no observed noise, and it is possible to estimate the true parameter values by the total least squares method in the input output case with the observed noise. We suggest the adjusted least squares method as a consistent estimation method in the system identification in the case where there is observed noise only in the output. In this paper the adjusted least squares method has been developed from the least squares method and the efficiency of the estimating results was confirmed by the generating data with the computer simulations.

  • PDF

Comparison between Total Least Squares and Ordinary Least Squares for Linear Relationship of Stable Water Isotopes (완전최소자승법과 보통최소자승법을 이용한 물안정동위원소의 선형관계식 비교)

  • Lee, Jeonghoon;Choi, Hye-Bin;Lee, Won Sang;Lee, Seung-Gu
    • Economic and Environmental Geology
    • /
    • v.50 no.6
    • /
    • pp.517-523
    • /
    • 2017
  • A linear relationship between two stable water isotopes, oxygen and hydrogen, has been used to understand the water cycle as a basic tool. A slope and intercept from the linear relationship indicates what kind of physical processes occur during movement of water. Traditionally, ordinary least squares (OLS) method has been utilized for the linear relationship, but total least squares (TLS) method provides more accurate slope and intercept theoretically because isotopic compositions of both oxygen and hydrogen have uncertainties. In this work, OLS and TLS were compared with isotopic compositions of snow and snowmelt collected from the King Sejong Station, Antarctica and isotopic compositions of water vapor observed by Lee et al. (2013) in the western part of Korea. The slopes from the linear relationship of isotopic compositions of snow and snowmelt at the King Sejong Station were estimated to be 7.00 (OLS) and 7.16(TLS) and the slopes of stable water vapor isotopes were 7.75(OLS) and 7.87(TLS). There was a melting process in the snow near the King Sejong Station and the water vapor was directly transported from the ocean to the study area based on the slope calculations. There is no significant difference in two slopes to interpret the physical processes. However, it is necessary to evaluate the slope differences from the two methods for studies for example, groundwater recharge processes, using the absolute slope values.

System Identification by Adjusted Least Squares Method (ALS법에 의한 시스템동정)

  • Lee, Dong-Cheol;Bae, Jong-Il;Chung, Hwung-Hwan;Jo, Bong-Hwan
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2216-2218
    • /
    • 2002
  • A system identification is to measure the output in the presence of a adequate input for the controlled system and to estimate the mathematical model in the basic of input output data. In the system identification, it is possible to estimate the true parameter values by the adjusted least squares method in the input-output case of no observed noise, and it is possible to estimate the true parameter values by the total least squares method in the input-output case with the observed noise. In recent the adjusted least squares method is suggested as a consistent estimation method in the system identification not with the observed noise input but with the observed noise output. In this paper we have developed the adjusted least squares method from the least squares method and have made certain of the efficiency in comparing the estimating results with the generating data by the computer simulations.

  • PDF

Influencing factors and prediction of carbon dioxide emissions using factor analysis and optimized least squares support vector machine

  • Wei, Siwei;Wang, Ting;Li, Yanbin
    • Environmental Engineering Research
    • /
    • v.22 no.2
    • /
    • pp.175-185
    • /
    • 2017
  • As the energy and environmental problems are increasingly severe, researches about carbon dioxide emissions has aroused widespread concern. The accurate prediction of carbon dioxide emissions is essential for carbon emissions controlling. In this paper, we analyze the relationship between carbon dioxide emissions and influencing factors in a comprehensive way through correlation analysis and regression analysis, achieving the effective screening of key factors from 16 preliminary selected factors including GDP, total population, total energy consumption, power generation, steel production coal consumption, private owned automobile quantity, etc. Then fruit fly algorithm is used to optimize the parameters of least squares support vector machine. And the optimized model is used for prediction, overcoming the blindness of parameter selection in least squares support vector machine and maximizing the training speed and global searching ability accordingly. The results show that the prediction accuracy of carbon dioxide emissions is improved effectively. Besides, we conclude economic and environmental policy implications on the basis of analysis and calculation.

Performance Analysis of the Robust Least Squares Target Localization Scheme using RDOA Measurements

  • Choi, Ka-Hyung;Ra, Won-Sang;Park, Jin-Bae;Yoon, Tae-Sung
    • Journal of Electrical Engineering and Technology
    • /
    • v.7 no.4
    • /
    • pp.606-614
    • /
    • 2012
  • A practical recursive linear robust estimation scheme is proposed for target localization in the sensor network which provides range difference of arrival (RDOA) measurements. In order to radically solve the known practical difficulties such as sensitivity for initial guess and heavy computational burden caused by intrinsic nonlinearity of the RDOA based target localization problem, an uncertain linear measurement model is newly derived. In the suggested problem setting, the target localization performance of the conventional linear estimation schemes might be severely degraded under the low SNR condition and be affected by the target position in the sensor network. This motivates us to devise a new sensor network localization algorithm within the framework of the recently developed robust least squares estimation theory. Provided that the statistical information regarding RDOA measurements are available, the estimate of the proposition method shows the convergence in probability to the true target position. Through the computer simulations, the omnidirectional target localization performance and consistency of the proposed algorithm are compared to those of the existing ones. It is shown that the proposed method is more reliable than the total least squares method and the linear correction least squares method.

TOTAL LEAST SQUARES FITTING WITH QUADRICS

  • Spath, Helmuth
    • The Pure and Applied Mathematics
    • /
    • v.11 no.2
    • /
    • pp.103-115
    • /
    • 2004
  • A computational algorithm is developed for fitting given data in the plane or in 3-space by implicitly defined quadrics. Implicity implies that the type of the quadric is part of the model and need not be known in advance. Starting with some estimate for the coefficients of the quadric the method will alternatively determine the shortest distances from the given points onto the quadric and adapt the coefficients such as to reduce the sum of those squared distances. Numerical examples are given.

  • PDF