• Title/Summary/Keyword: least squares linear regression

Search Result 133, Processing Time 0.021 seconds

Robust inference for linear regression model based on weighted least squares

  • Park, Jin-Pyo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.13 no.2
    • /
    • pp.271-284
    • /
    • 2002
  • In this paper we consider the robust inference for the parameter of linear regression model based on weighted least squares. First we consider the sequential test of multiple outliers. Next we suggest the way to assign a weight to each observation $(x_i,\;y_i)$ and recommend the robust inference for linear model. Finally, to check the performance of confidence interval for the slope using proposed method, we conducted a Monte Carlo simulation and presented some numerical results and examples.

  • PDF

DETECTION OF OUTLIERS IN WEIGHTED LEAST SQUARES REGRESSION

  • Shon, Bang-Yong;Kim, Guk-Boh
    • Journal of applied mathematics & informatics
    • /
    • v.4 no.2
    • /
    • pp.501-512
    • /
    • 1997
  • In multiple linear regression model we have presupposed assumptions (independence normality variance homogeneity and so on) on error term. When case weights are given because of variance heterogeneity we can estimate efficiently regression parameter using weighted least squares estimator. Unfortunately this estimator is sen-sitive to outliers like ordinary least squares estimator. Thus in this paper we proposed some statistics for detection of outliers in weighted least squares regression.

Various Models of Fuzzy Least-Squares Linear Regression for Load Forecasting (전력수요예측을 위한 다양한 퍼지 최소자승 선형회귀 모델)

  • Song, Kyung-Bin
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.7
    • /
    • pp.61-67
    • /
    • 2007
  • The load forecasting has been an important part of power system Accordingly, it has been proposed various methods for the load forecasting. The load patterns of the special days is quite different than those of ordinary weekdays. It is difficult to accurately forecast the load of special days due to the insufficiency of the load patterns compared with ordinary weekdays, so we have proposed fuzzy least squares linear regression algorithm for the load forecasting. In this paper we proposed four models for fuzzy least squares linear regression. It is separated by coefficients of fuzzy least squares linear regression equation. we compared model of H1 with H4 and prove it H4 has accurately forecast better than H1.

Load Forecasting for Holidays Using a Fuzzy Least Squares Linear Regression Algorithm (퍼지 최소 자승 선형회귀분석 알고리즘을 이용한 특수일 전력수요예측)

  • Song Kyung-Bin;Ku Bon-Suk;Baek Young-Sik
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.4
    • /
    • pp.233-237
    • /
    • 2003
  • An accurate load forecasting is essential for economics and stability power system operation. Due to high relationship between the electric power load and the electric power price, the participants of the competitive power market are very interested in load forecasting. The percentage errors of load forecasting for holidays is relatively large. In order to improve the accuarcy of load forecasting for holidays, this paper proposed load forecasting method for holidays using a fuzzy least squares linear regression algorithm. The proposed algorithm is tested for load forecasting for holidays in 1996, 1997, and 2000. The test results show that the proposed algorithm is better than the algorithm using fuzzy linear regression.

LEAST ABSOLUTE DEVIATION ESTIMATOR IN FUZZY REGRESSION

  • KIM KYUNG JOONG;KIM DONG HO;CHOI SEUNG HOE
    • Journal of applied mathematics & informatics
    • /
    • v.18 no.1_2
    • /
    • pp.649-656
    • /
    • 2005
  • In this paper we consider a fuzzy least absolute deviation method in order to construct fuzzy linear regression model with fuzzy input and fuzzy output. We also consider two numerical examples to evaluate an effectiveness of the fuzzy least absolute deviation method and the fuzzy least squares method.

LMS and LTS-type Alternatives to Classical Principal Component Analysis

  • Huh, Myung-Hoe;Lee, Yong-Goo
    • Communications for Statistical Applications and Methods
    • /
    • v.13 no.2
    • /
    • pp.233-241
    • /
    • 2006
  • Classical principal component analysis (PCA) can be formulated as finding the linear subspace that best accommodates multidimensional data points in the sense that the sum of squared residual distances is minimized. As alternatives to such LS (least squares) fitting approach, we produce LMS (least median of squares) and LTS (least trimmed squares)-type PCA by minimizing the median of squared residual distances and the trimmed sum of squares, in a similar fashion to Rousseeuw (1984)'s alternative approaches to LS linear regression. Proposed methods adopt the data-driven optimization algorithm of Croux and Ruiz-Gazen (1996, 2005) that is conceptually simple and computationally practical. Numerical examples are given.

GACV for partially linear support vector regression

  • Shim, Jooyong;Seok, Kyungha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.2
    • /
    • pp.391-399
    • /
    • 2013
  • Partially linear regression is capable of providing more complete description of the linear and nonlinear relationships among random variables. In support vector regression (SVR) the hyper-parameters are known to affect the performance of regression. In this paper we propose an iterative reweighted least squares (IRWLS) procedure to solve the quadratic problem of partially linear support vector regression with a modified loss function, which enables us to use the generalized approximate cross validation function to select the hyper-parameters. Experimental results are then presented which illustrate the performance of the partially linear SVR using IRWLS procedure.

Comparison of linear and non-linear equation for the calibration of roxithromycin analysis using liquid chromatography/mass spectrometry

  • Lim, Jong-Hwan;Yun, Hyo-In
    • Korean Journal of Veterinary Research
    • /
    • v.50 no.1
    • /
    • pp.11-17
    • /
    • 2010
  • Linear and non-linear regressions were used to derive the calibration function for the measurement of roxithromycin plasma concentration. Their results were compared with weighted least squares regression by usual weight factors. In this paper the performance of a non-linear calibration equation with the capacity to account empirically for the curvature, y = ax$^{b}$ + c (b $\neq$ 1) is compared with the commonly used linear equation, y = ax + b, as well as the quadratic equation, y = ax$^{2}$+ bx + c. In the calibration curve (range of 0.01 to 10 ${\mu}g/mL$) of roxithromycin, both heteroscedasticity and nonlinearity were present therefore linear least squares regression methods could result in large errors in the determination of roxithromycin concentration. By the non-linear and weighted least squares regression, the accuracy of the analytical method was improved at the lower end of the calibration curve. This study suggests that the non-linear calibration equation should be considered when a curve is required to be fitted to low dose calibration data which exhibit slight curvature.

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

Multiple Structural Change-Point Estimation in Linear Regression Models

  • Kim, Jae-Hee
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.3
    • /
    • pp.423-432
    • /
    • 2012
  • This paper is concerned with the detection of multiple change-points in linear regression models. The proposed procedure relies on the local estimation for global change-point estimation. We propose a multiple change-point estimator based on the local least squares estimators for the regression coefficients and the split measure when the number of change-points is unknown. Its statistical properties are shown and its performance is assessed by simulations and real data applications.