• 제목/요약/키워드: Least-squares Regression

검색결과 566건 처리시간 0.022초

The Strong Consistency of Nonlinear Least Squares Estimators

  • Kim, Hae-Kyung
    • Journal of the Korean Statistical Society
    • /
    • 제18권2호
    • /
    • pp.85-96
    • /
    • 1989
  • This paper is concerned with the strong consistency of the least squares estimators for the nonlinear regression models. A simple and practical sufficient condition for the strong consistency of the least squares estimators is given. It is also discussed that the extension of the strong consistency to a wide class of regression functions can be established by imposing some condition on the input values. Some examples are given to illustrate the application of main result.

  • PDF

몬테칼로 시뮬레이션을 이용한 비선형회귀추정량들의 비교 분석 (The Comparison Analysis of an Estimators of Nonlinear Regression Model using Monte Carlo Simulation)

  • 김태수;이영해
    • 한국시뮬레이션학회논문지
    • /
    • 제9권3호
    • /
    • pp.43-51
    • /
    • 2000
  • In regression model, we estimate the unknown parameters by using various methods. There are the least squares method which is the most general, the least absolute deviation method, the regression quantile method and the asymmetric least squares method. In this paper, we will compare each others with two cases: firstly the theoretical comparison in the asymptotic sense and then the practical comparison using Monte Carlo simulation for a small sample size.

  • PDF

비선형 회귀모형 추정량들의 몬데칼로 시뮬레이션에 의한 비교 (Monte Carlo simulation of the estimators for nonlinear regression model)

  • 김태수;이영해
    • 한국시뮬레이션학회:학술대회논문집
    • /
    • 한국시뮬레이션학회 2000년도 추계학술대회 논문집
    • /
    • pp.6-10
    • /
    • 2000
  • In regression model we estimate the unknown parameters using various methods. There are the least squares method which is the most general, the least absolute deviation, the regression quantile and the asymmetric least squares method. In this paper, we will compare each others with two case: to begin with the theoretical comparison in the asymptotic sense, and then the practical comparison using Monte Carlo simulation for a small sample size.

  • PDF

THE STRONG CONSISTENCY OF THE ASYMMETRIC LEAST SQUARES ESTIMATORS IN NONLINEAR CENSORED REGRESSION MODELS

  • Choi, Seung-Hoe;Kim, Hae-Kyung
    • 대한수학회논문집
    • /
    • 제18권4호
    • /
    • pp.703-712
    • /
    • 2003
  • This paper deals with the strong consistency of the asymmetric least squares for the nonlinear censored regression models which includes dependent variables cut off midway by any of external conditions, and provide the sufficient conditions which ensure the strong consistency of proposed estimators of the censored regression models. One example is given to illustrate the application of the main result.

Fuzzy c-Regression Using Weighted LS-SVM

  • Hwang, Chang-Ha
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 한국데이터정보과학회 2005년도 추계학술대회
    • /
    • pp.161-169
    • /
    • 2005
  • In this paper we propose a fuzzy c-regression model based on weighted least squares support vector machine(LS-SVM), which can be used to detect outliers in the switching regression model while preserving simultaneous yielding the estimates of outputs together with a fuzzy c-partitions of data. It can be applied to the nonlinear regression which does not have an explicit form of the regression function. We illustrate the new algorithm with examples which indicate how it can be used to detect outliers and fit the mixed data to the nonlinear regression models.

  • PDF

A Study on the Several Robust Regression Estimators

  • Kim, Jee-Yun;Roh, Kyung-Mi;Hwang, Jin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • 제15권2호
    • /
    • pp.307-316
    • /
    • 2004
  • Principal Component Regression(PCR) and Partial Least Squares Regression(PLSR) are the two most popular regression techniques in chemometrics. In the field of chemometrics usually the number of regressor variables greatly exceeds the number of observation. So we have to reduce the number of regressors to avoid the identifiability problem. In this paper we compare PCR and PLSR techniques combined with various robust regression methods including regression depth estimation. We compare the efficiency, goodness-of-fit and robustness of each estimators under several contamination schemes.

  • PDF

유전알고리즘과 커널 부분최소제곱회귀를 이용한 반도체 공정의 가상계측 모델 개발 (Development of Virtual Metrology Models in Semiconductor Manufacturing Using Genetic Algorithm and Kernel Partial Least Squares Regression)

  • 김보건;염봉진
    • 산업공학
    • /
    • 제23권3호
    • /
    • pp.229-238
    • /
    • 2010
  • Virtual metrology (VM), a critical component of semiconductor manufacturing, is an efficient way of assessing the quality of wafers not actually measured. This is done based on a model between equipment sensor data (obtained for all wafers) and the quality characteristics of wafers actually measured. This paper considers principal component regression (PCR), partial least squares regression (PLSR), kernel PCR (KPCR), and kernel PLSR (KPLSR) as VM models. For each regression model, two cases are considered. One utilizes all explanatory variables in developing a model, and the other selects significant variables using the genetic algorithm (GA). The prediction performances of 8 regression models are compared for the short- and long-term etch process data. It is found among others that the GA-KPLSR model performs best for both types of data. Especially, its prediction ability is within the requirement for the short-term data implying that it can be used to implement VM for real etch processes.

Estimation of Ridge Regression Under the Integrate Mean Square Error Cirterion

  • Yong B. Lim;Park, Chi H.;Park, Sung H.
    • Journal of the Korean Statistical Society
    • /
    • 제9권1호
    • /
    • pp.61-77
    • /
    • 1980
  • In response surface experiments, a polynomial model is often used to fit the response surface by the method of least squares. However, if the vectors of predictor variables are multicollinear, least squares estimates of the regression parameters have a high probability of being unsatisfactory. Hoerland Kennard have demonstrated that these undesirable effects of multicollinearity can be reduced by using "ridge" estimates in place of the least squares estimates. Ridge regrssion theory in literature has been mainly concerned with selection of k for the first order polynomial regression model and the precision of $\hat{\beta}(k)$, the ridge estimator of regression parameters. The problem considered in this paper is that of selecting k of ridge regression for a given polynomial regression model with an arbitrary order. A criterion is proposed for selection of k in the context of integrated mean square error of fitted responses, and illustrated with an example. Also, a type of admissibility condition is established and proved for the propose criterion.criterion.

  • PDF

Influence Assessment in Robust Regression

  • Sohn, Bang-Yong;Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • 제4권1호
    • /
    • pp.21-32
    • /
    • 1997
  • Robust regression based on M-estimator reduces and/or bounds the influence of outliers in the y-direction only. Therefore, when several influential observations exist, diagnostics in the robust regression is required in order to detect them. In this paper, we propose influence diagnostics in the robust regression based on M-estimator and its one-step version. Noting that M-estimator can be obtained through iterative weighted least squares regression by using internal weights, we apply the weighted least squares (WLS) regression diagnostics to robust regression.

  • PDF

Weighted Least Absolute Error Estimation of Regression Parameters

  • Song, Moon-Sup
    • Journal of the Korean Statistical Society
    • /
    • 제8권1호
    • /
    • pp.23-36
    • /
    • 1979
  • In the multiple linear regression model a class of weighted least absolute error estimaters, which minimize the sum of weighted absolute residuals, is proposed. It is shown that the weighted least absolute error estimators with Wilcoxon scores are equivalent to the Koul's Wilcoxon type estimator. Therefore, the asymptotic efficiency of the proposed estimator with Wilcoxon scores relative to the least squares estimator is the same as the Pitman efficiency of the Wilcoxon test relative to the Student's t-test. To find the estimates the iterative weighted least squares method suggested by Schlossmacher is applicable.

  • PDF