• Title/Summary/Keyword: The Least Squares Method

Search Result 1,469, Processing Time 0.029 seconds

Weighted Least Absolute Deviation Lasso Estimator

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.6
    • /
    • pp.733-739
    • /
    • 2011
  • The linear absolute shrinkage and selection operator(Lasso) method improves the low prediction accuracy and poor interpretation of the ordinary least squares(OLS) estimate through the use of $L_1$ regularization on the regression coefficients. However, the Lasso is not robust to outliers, because the Lasso method minimizes the sum of squared residual errors. Even though the least absolute deviation(LAD) estimator is an alternative to the OLS estimate, it is sensitive to leverage points. We propose a robust Lasso estimator that is not sensitive to outliers, heavy-tailed errors or leverage points.

A Time Domain Modal Parameter Estimation Method for Multiple Input-Output Systems (시간영역에서의 다중 입력-출력시스템의 모드매개변수 추정방법)

  • 이건명
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.18 no.8
    • /
    • pp.1997-2004
    • /
    • 1994
  • A model analysis method has been developed in the paper. The method estimates the modal parameters of multiple input-output systems, assesses their quality, and seperates structural modes form computation ones. The modal parameter extraction algorithm is the least squares method with a finite difference model relating input and output time data. The quality of the estimated system model can be assessed in narrow frequency bands by comparing the measured and model predicted responses in time domain with the aid of digital filters. Structural modes can be effectively separated from computational ones using the convergence factor which represents the pole convergence rate. The modal analysis method has been applied to simulated and experimental vibration data to evaluate its utility and limitations.

Steering Beam Pattern Synthesis of Line Array SONAR using Modified Two Step Least Squares Method (개선된 2단 최소자승법을 이용한 선배열 소나의 조향 빔 형성)

  • Park, Kyung-Min;Lee, Seok-Jin;Chung, Suk-Moon
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.6
    • /
    • pp.228-236
    • /
    • 2014
  • Towed array SONAR is deformed because it operates in fluid such as an ocean. It especially undergoes significant change in shape as a towing vessel takes a turn. In this case, beam pattern synthesis of the line array is limited, resulting in degradation in quality such as signal-to-noise ratio. This paper presents a modified two-step least squares algorithm based on the two-step least squares method. The shape of the sea-operated line array formation with the towing vessel changing course(angle) was modeled and the algorithm was subsequently applied. While changing course and location of the main lobe in beam pattern was altered, signal-to-noise ratio of steering beam pattern synthesis was analyzed by algorithm (proposed and others). As a result, the proposed algorithm presented improvement in performance by 2dB compared to other algorithms while forming relatively constant beam pattern.

Estimation of Spatial Dependence by Quasi-likelihood Method (의사우도법을 이용한 공간 종속 모형의 추정)

  • 이윤동;최혜미
    • The Korean Journal of Applied Statistics
    • /
    • v.17 no.3
    • /
    • pp.519-533
    • /
    • 2004
  • In this paper, we suggest quasi-likelihood estimation (QLE) method and its robust version in estimating spatial dependence modelled through variogram used for spatial data modelling. We compare the statistical characteristics of the estimators with other popular least squares estimators of parameters for variogram model by simulation study. The QLE method for estimating spatial dependence has the advantages that it does not need the concept of lags commonly required for least squares estimation methods as well as its statistical superiority. The QLE method also shows the statistical superiority to the other methods for the tested Gaussian and non-Gaussian spatial processes.

A Recursive Data Least Square Algorithm and Its Channel Equalization Application

  • Lim, Jun-Seok;Kim, Jae-Soo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.25 no.2E
    • /
    • pp.43-48
    • /
    • 2006
  • Abstract-Using the recursive generalized eigendecomposition method, we develop a recursive form solution to the data least squares (DLS) problem, in which the error is assumed to lie in the data matrix only. Simulations demonstrate that DLS outperforms ordinary least square for certain types of deconvolution problems.

Estimating the Term Structure of Interest Rates Using Mixture of Weighted Least Squares Support Vector Machines (가중 최소제곱 서포트벡터기계의 혼합모형을 이용한 수익률 기간구조 추정)

  • Nau, Sung-Kyun;Shim, Joo-Yong;Hwang, Chang-Ha
    • The Korean Journal of Applied Statistics
    • /
    • v.21 no.1
    • /
    • pp.159-168
    • /
    • 2008
  • Since the term structure of interest rates (TSIR) has longitudinal data, we should consider as input variables both time left to maturity and time simultaneously to get a more useful and more efficient function estimation. However, since the resulting data set becomes very large, we need to develop a fast and reliable estimation method for large data set. Furthermore, it tends to overestimate TSIR because data are correlated. To solve these problems we propose a mixture of weighted least squares support vector machines. We recognize that the estimate is well smoothed and well explains effects of the third stock market crash in USA through applying the proposed method to the US Treasury bonds data.

Comparison of Algorithms for Generating Parametric Image of Cerebral Blood Flow Using ${H_2}^{15}O$ PET Positron Emission Tomography (${H_2}^{15}O$ PET을 이용한 뇌혈류 파라메트릭 영상 구성을 위한 알고리즘 비교)

  • Lee, Jae-Sung;Lee, Dong-Soo;Park, Kwang-Suk;Chung, June-Key;Lee, Myung-Chul
    • The Korean Journal of Nuclear Medicine
    • /
    • v.37 no.5
    • /
    • pp.288-300
    • /
    • 2003
  • Purpose: To obtain regional blood flow and tissue-blood partition coefficient with time-activity curves from ${H_2}^{15}O$ PET, fitting of some parameters in the Kety model is conventionally accomplished by nonlinear least squares (NLS) analysis. However, NLS requires considerable compuation time then is impractical for pixel-by-pixel analysis to generate parametric images of these parameters. In this study, we investigated several fast parameter estimation methods for the parametric image generation and compared their statistical reliability and computational efficiency. Materials and Methods: These methods included linear least squres (LLS), linear weighted least squares (LWLS), linear generalized least squares (GLS), linear generalized weighted least squares (GWLS), weighted Integration (WI), and model-based clustering method (CAKS). ${H_2}^{15}O$ dynamic brain PET with Poisson noise component was simulated using numerical Zubal brain phantom. Error and bias in the estimation of rCBF and partition coefficient, and computation time in various noise environments was estimated and compared. In audition, parametric images from ${H_2}^{15}O$ dynamic brain PET data peformed on 16 healthy volunteers under various physiological conditions was compared to examine the utility of these methods for real human data. Results: These fast algorithms produced parametric images with similar image qualify and statistical reliability. When CAKS and LLS methods were used combinedly, computation time was significantly reduced and less than 30 seconds for $128{\times}128{\times}46$ images on Pentium III processor. Conclusion: Parametric images of rCBF and partition coefficient with good statistical properties can be generated with short computation time which is acceptable in clinical situation.

A Study for the Roundness Estimation (진원도 형상 추정 연구)

  • Kim, Soo-Kwang;Jun, Jae-Uhk
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.10 no.2
    • /
    • pp.38-45
    • /
    • 2011
  • The criteria for determining the elements are the minimum zone method(MZM) and the least squares method(LSM). The LSM is deterministic and simple but is limited at the measurements whose errors are significant compared with form errors. For the precise condition, minimum zone method(MZM) has been selected to determine the elements. The roundness is the fundamental problem in the evaluating form errors. In this paper, anew approach adapting the genius education concept is proposed to obtain an accurate results for the MZM and the LSM of the roundness. Its computational algorithm is studied on a set of measured sample data. To be of almost no account of the specification(the number and the standard deviation etc.) of the sanple data, the results shoqs excellent reliability and high accuracy in estimating the roundness.

Extension and Appication of Total Least Squares Method for the Identification of Bilinear Systems

  • Han, Seok-Won;Kim, Jin-Young;Sung, Koeng-Mo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.1E
    • /
    • pp.59-64
    • /
    • 1996
  • When the input-output record is available, the identification of a bilinear system is considered. It is assumed that the input is noise free and the output is contaminated by an additive noise. It is further assumed that the covariance matrix of the noise is known up to a factor of proportionality. The extended generalized total least squares (e-GTLS) method is proposed as one of the consistent estimators of the bilinear system parameters. Considering that the input is noise-free and that bilinear system equation is linear with respect to the system parameters, we extend the GTLS problem. The extended GTLS problem is reduced to an unconstrained minimization problem, and is solved by the Newton-Raphson method. We compare the GTLS method and the e-GTLS method in the point of the accuracy of the estimated system parameters.

  • PDF

Minimum Zone Evaluation of Straightness Using the Genius Education Concept (영재 교육 개념을 응용한 직선도의 최소영역 평가)

  • Kim, Soo-Kwang;Cho, Dong-Woo;Lee, Kahng-In
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.16 no.8
    • /
    • pp.130-137
    • /
    • 1999
  • The criteria for determining the elements are the minimum zone method(MZM) and the least squares method(LSM). The LSM is deterministic and simple but is limited at the measurements whose errors are significant compared with form errors. For the precise condition, minimum zone method(MZM) has been selected to determine the elements. It is not deterministic and nonlinear so that a optimizing procedure is needed. The Straightness is the fundamental problem in the evaluating form error. In this paper, a new approach adapting the genius education concept is proposed to obtain an accurate results for the minimum zone problem of the straightness. Its computational algorithm is studied on a set of randomly generated data. To be of almost no account of the specification(the number and the standard devistion etc.) of the sample data, the results shows excellent reliability and high accuracy in estimating the straightness.

  • PDF