• 제목/요약/키워드: Robust Least Squares Regression

검색결과 48건 처리시간 0.028초

Robust inference for linear regression model based on weighted least squares

  • 박진표
    • Journal of the Korean Data and Information Science Society
    • /
    • 제13권2호
    • /
    • pp.271-284
    • /
    • 2002
  • In this paper we consider the robust inference for the parameter of linear regression model based on weighted least squares. First we consider the sequential test of multiple outliers. Next we suggest the way to assign a weight to each observation $(x_i,\;y_i)$ and recommend the robust inference for linear model. Finally, to check the performance of confidence interval for the slope using proposed method, we conducted a Monte Carlo simulation and presented some numerical results and examples.

  • PDF

Influence Assessment in Robust Regression

  • Sohn, Bang-Yong;Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • 제4권1호
    • /
    • pp.21-32
    • /
    • 1997
  • Robust regression based on M-estimator reduces and/or bounds the influence of outliers in the y-direction only. Therefore, when several influential observations exist, diagnostics in the robust regression is required in order to detect them. In this paper, we propose influence diagnostics in the robust regression based on M-estimator and its one-step version. Noting that M-estimator can be obtained through iterative weighted least squares regression by using internal weights, we apply the weighted least squares (WLS) regression diagnostics to robust regression.

  • PDF

ROBUST CROSS VALIDATIONS IN RIDGE REGRESSION

  • Jung, Kang-Mo
    • Journal of applied mathematics & informatics
    • /
    • 제27권3_4호
    • /
    • pp.903-908
    • /
    • 2009
  • The shrink parameter in ridge regression may be contaminated by outlying points. We propose robust cross validation scores in ridge regression instead of classical cross validation. We use robust location estimators such as median, least trimmed squares, absolute mean for robust cross validation scores. The robust scores have global robustness. Simulations are performed to show the effectiveness of the proposed estimators.

  • PDF

An Equivariant and Robust Estimator in Multivariate Regression Based on Least Trimmed Squares

  • Jung, Kang-Mo
    • Communications for Statistical Applications and Methods
    • /
    • 제10권3호
    • /
    • pp.1037-1046
    • /
    • 2003
  • We propose an equivariant and robust estimator in multivariate regression model based on the least trimmed squares (LTS) estimator in univariate regression. We call this estimator as multivariate least trimmed squares (MLTS) estimator. The MLTS estimator considers correlations among response variables and it can be shown that the proposed estimator has the appropriate equivariance properties defined in multivariate regression. The MLTS estimator has high breakdown point as does LTS estimator in univariate case. We develop an algorithm for MLTS estimate. Simulation are performed to compare the efficiencies of MLTS estimate with coordinatewise LTS estimate and a numerical example is given to illustrate the effectiveness of MLTS estimate in multivariate regression.

The Identification Of Multiple Outliers

  • Park, Jin-Pyo
    • Journal of the Korean Data and Information Science Society
    • /
    • 제11권2호
    • /
    • pp.201-215
    • /
    • 2000
  • The classical method for regression analysis is the least squares method. However, if the data contain significant outliers, the least squares estimator can be broken down by outliers. To remedy this problem, the robust methods are important complement to the least squares method. Robust methods down weighs or completely ignore the outliers. This is not always best because the outliers can contain some very important information about the population. If they can be detected, the outliers can be further inspected and appropriate action can be taken based on the results. In this paper, I propose a sequential outlier test to identify outliers. It is based on the nonrobust estimate and the robust estimate of scatter of a robust regression residuals and is applied in forward procedure, removing the most extreme data at each step, until the test fails to detect outliers. Unlike other forward procedures, the present one is unaffected by swamping or masking effects because the statistics is based on the robust regression residuals. I show the asymptotic distribution of the test statistics and apply the test to several real data and simulated data for the test to be shown to perform fairly well.

  • PDF

A Study on the Several Robust Regression Estimators

  • Kim, Jee-Yun;Roh, Kyung-Mi;Hwang, Jin-Soo
    • Journal of the Korean Data and Information Science Society
    • /
    • 제15권2호
    • /
    • pp.307-316
    • /
    • 2004
  • Principal Component Regression(PCR) and Partial Least Squares Regression(PLSR) are the two most popular regression techniques in chemometrics. In the field of chemometrics usually the number of regressor variables greatly exceeds the number of observation. So we have to reduce the number of regressors to avoid the identifiability problem. In this paper we compare PCR and PLSR techniques combined with various robust regression methods including regression depth estimation. We compare the efficiency, goodness-of-fit and robustness of each estimators under several contamination schemes.

  • PDF

스트랩다운 적외선 영상센서를 위한 관성센서 기반 강인최소자승 움직임 훼손영상 복원 기법 (Robust Least Squares Motion Deblurring Using Inertial Sensor for Strapdown Image IR Sensors)

  • 김기승;나성웅
    • 제어로봇시스템학회논문지
    • /
    • 제18권4호
    • /
    • pp.314-320
    • /
    • 2012
  • This paper proposes a new robust motion deblurring filter using the inertial sensor measurements for strapdown image IR applications. With taking the PSF measurement error into account, the motion blurred image is modeled by the linear uncertain state space equation with the noise corrupted measurement matrix and the stochastic parameter uncertainty. This motivates us to solve the motion deblurring problem based on the recently developed robust least squares estimation theory. In order to suppress the ringing effect on the deblurred image, the robust least squares estimator is slightly modified by adoping the ridge-regression concept. Through the computer simulations using the actual IR scenes, it is demonstrated that the proposed algorithm shows superior and reliable motion deblurring performance even in the presence of time-varying motion artifact.

Unified Non-iterative Algorithm for Principal Component Regression, Partial Least Squares and Ordinary Least Squares

  • Kim, Jong-Duk
    • Journal of the Korean Data and Information Science Society
    • /
    • 제14권2호
    • /
    • pp.355-366
    • /
    • 2003
  • A unified procedure for principal component regression (PCR), partial least squares (PLS) and ordinary least squares (OLS) is proposed. The process gives solutions for PCR, PLS and OLS in a unified and non-iterative way. This enables us to see the interrelationships among the three regression coefficient vectors, and it is seen that the so-called E-matrix in the solution expression plays the key role in differentiating the methods. In addition to setting out the procedure, the paper also supplies a robust numerical algorithm for its implementation, which is used to show how the procedure performs on a real world data set.

  • PDF

로버스트 회귀추정에 의한 신뢰구간 구축 (On Confidence Intervals of Robust Regression Estimators)

  • 이동희;박유성;김기환
    • 응용통계연구
    • /
    • 제19권1호
    • /
    • pp.97-110
    • /
    • 2006
  • 대부분의 자료는 여러가지 원인으로 인한 특이치로 오염되어 있으며, 이러한 상황에서 신뢰성 있는 추정량을 얻어내고 이에 대한 통계적 추론을 시행하는 것은 중요한 문제이다. 그러나 이제까지 제안된 로버스트 회귀추정량들은 계산상의 어려움과 정규오차모형에서 최소제곱추정량에 비하여 떨어지는 효율성때문에 통계적 추론의 정확성을 확신할 수 없었다. 최근 제안된 Lee(2004)의 가중자기조율회귀추정량(weighted self-tuning estimator, WSTE)은 다른 로버스트 회귀추정량에 비하여 정확한 계산과정과 그에 따른 추정량의 점근적 정규성 및 고붕괴점을 갖는다. 그러나 통계적 추론을 위하여 이제까지 널리 사용해왔던 로버스트 추정량에 기반한 가중최소제곱추정방법(weighted least squares estimator)은 WSTE에서조차 정규오차모형하에서 최소제곱추정량과 동일한 수준의 효율성을 제공해주지 는 못한다. 본 논문에서는 WSTE에 기반한 또다른 통계적 추론 방법을 제안하고, 이 방법을 사용함으로써 정규오차모형 및 대표본에서 보다 정확한 결과를 얻을 수 있음을 몬테칼로 모의실험을 통해 제시하였다.

The Effect of COVID-19 Pandemic on the Philippine Stock Exchange, Peso-Dollar Rate and Retail Price of Diesel

  • CAMBA, Aileen L.;CAMBA, Abraham C. Jr.
    • The Journal of Asian Finance, Economics and Business
    • /
    • 제7권10호
    • /
    • pp.543-553
    • /
    • 2020
  • This paper examines the effect of COVID-19 pandemic on the Philippine stock exchange, peso-dollar rate and retail price of diesel using robust least squares regression and vector autoregression (VAR). The robust least squares regression using MM-estimation method concluded that COVID-19 daily infection has negative and statistically significant effect on the Philippine stock exchange index, peso-dollar exchange rate and retail pump price of diesel. This is consistent with the results of correlation diagnostics. As for the VAR model, the lag values of the independent variable disclose significance in explaining the Philippine stock exchange index, peso-dollar exchange rate and retail pump price of diesel. Moreover, in the short run, the impulse response function confirmed relative effect of COVID-19 daily infections and the variance decomposition divulge that COVID-19 daily infections have accounted for only minor portion in explaining fluctuations of the Philippine stock exchange index, peso-dollar exchange and retail pump price of diesel. In the long term, the influence levels off. The Granger causality test suggests that COVID-19 daily infections cause changes in the Philippine stock exchange index and peso-dollar exchange rate in the short run. However, COVID-19 infection has no causal link with retail pump price of diesel.