• Journal of the Korean Data and Information Science Society
• /
• v.13 no.2
• /
• pp.271-284
• /
• 2002

In this paper we consider the robust inference for the parameter of linear regression model based on weighted least squares. First we consider the sequential test of multiple outliers. Next we suggest the way to assign a weight to each observation $(x_i,\;y_i)$ and recommend the robust inference for linear model. Finally, to check the performance of confidence interval for the slope using proposed method, we conducted a Monte Carlo simulation and presented some numerical results and examples.

• Journal of the Korean Data and Information Science Society
• /
• v.17 no.4
• /
• pp.1169-1180
• /
• 2006

Partial least squares regression (PLS) is a biased, non-least squares regression method and is an alternative to the ordinary least squares regression (OLS) when predictors are highly collinear or predictors outnumber observations. One way to understand the properties of biased regression methods is to know how the estimators shrink the OLS estimator. In this paper, we introduce an expression for the shrinkage factor of PLS and develop a new shrinkage expression, and then prove the equivalence of the two representations. We use two near-infrared (NIR) data sets to show general behavior of the shrinkage and in particular for what eigendirections PLS expands the OLS coefficients.

• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.21 no.7
• /
• pp.61-67
• /
• 2007

The load forecasting has been an important part of power system Accordingly, it has been proposed various methods for the load forecasting. The load patterns of the special days is quite different than those of ordinary weekdays. It is difficult to accurately forecast the load of special days due to the insufficiency of the load patterns compared with ordinary weekdays, so we have proposed fuzzy least squares linear regression algorithm for the load forecasting. In this paper we proposed four models for fuzzy least squares linear regression. It is separated by coefficients of fuzzy least squares linear regression equation. we compared model of H1 with H4 and prove it H4 has accurately forecast better than H1.

• The Korean Journal of Applied Statistics
• /
• v.21 no.2
• /
• pp.275-290
• /
• 2008

The size of microarray gene expression data is very big and its observation process is also very complex. Thus missing values are frequently occurred. In this paper we propose the sequential partial least squares(SPLS) regression fitting method to estimate missing values for time course gene expression data that has correlations among observations over time points. The SPLS method is to combine the sequential technique with the partial least squares(PLS) regression fitting method. The usefulness of method proposed is evaluated through some simulation study for three yeast time course data.

• Journal of the Korean Data and Information Science Society
• /
• v.15 no.2
• /
• pp.507-513
• /
• 2004

Least-squares support vector machine (LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. In this paper, we propose LS-SVM approach to evaluating fuzzy regression model with multiple crisp inputs and a Gaussian fuzzy output. The proposed algorithm here is model-free method in the sense that we do not need assume the underlying model function. Experimental result is then presented which indicate the performance of this algorithm.

• Journal of the Korean Data and Information Science Society
• /
• v.25 no.5
• /
• pp.1151-1160
• /
• 2014

In DNA microarray studies, the number of genes far exceeds the number of samples and the gene expression measures are highly correlated. Partial least squares regression (PLSR) is one of the popular methods for dimensional reduction and known to be useful for the classifications of microarray data by several studies. In this study, we suggest a modified version of the partial least squares regression to analyze gene expression data with survival information. The method is designed as a new gene selection method using PLSR with an iterative procedure of imputing censored survival time. Mean square error of prediction criterion is used to determine the dimension of the model. To visualize the data, plot for variables superimposed with samples are used. The method is applied to two microarray data sets, both containing survival time. The results show that the proposed method works well for interpreting gene expression microarray data.

• Journal of the Korean Data and Information Science Society
• /
• v.18 no.1
• /
• pp.51-61
• /
• 2007

Ridge regression (RR), principal component regression (PCR) and partial least squares regression (PLS) are among popular regression methods for collinear data. While RR adds a small quantity called ridge constant to the diagonal of X'X to stabilize the matrix inversion and regression coefficients, PCR and PLS use latent variables derived from original variables to circumvent the collinearity problem. One problem of PCR and PLS is that they are very sensitive to overfitting. A new regression method is presented by combining RR and PCR and PLS, respectively, in a unified manner. It is intended to provide better predictive ability and improved stability for regression models. A real-world data from NIR spectroscopy is used to investigate the performance of the newly developed regression method.

• Journal of applied mathematics & informatics
• /
• v.18 no.1_2
• /
• pp.649-656
• /
• 2005

In this paper we consider a fuzzy least absolute deviation method in order to construct fuzzy linear regression model with fuzzy input and fuzzy output. We also consider two numerical examples to evaluate an effectiveness of the fuzzy least absolute deviation method and the fuzzy least squares method.

• International Journal of Aeronautical and Space Sciences
• /
• v.14 no.1
• /
• pp.85-90
• /
• 2013

This paper presents a study on terrain referenced navigation (TRN). The extended Kalman filter (EKF) is adopted as a filter method. A Jacobian matrix of measurement equations in the EKF consists of terrain slope terms, and accurate slope estimation is essential to keep filter stability. Two slope estimation methods are proposed in this study. Both methods are based on the least-squares approach. One is planar regression searching the best plane, in the least-squares sense, representing the terrain map over the region, determined by position error covariance. It is shown that the method could provide a more accurate solution than the previously developed linear regression approach, which uses lines rather than a plane in the least-squares measure. The other proposed method is weighted planar regression. Additional weights formed by Gaussian pdf are multiplied in the planar regression, to reflect the actual pdf of the position estimate of EKF. Monte Carlo simulations are conducted, to compare the performance between the previous and two proposed methods, by analyzing the filter properties of divergence probability and convergence speed. It is expected that one of the slope estimation methods could be implemented, after determining which of the filter properties is more significant at each mission.

• Communications for Statistical Applications and Methods
• /
• v.15 no.6
• /
• pp.799-813
• /
• 2008

This paper deals with the properties of the fuzzy least squares estimators for fuzzy linear regression model. Especially fuzzy triangular input-output model including error term is proposed. The error term is considered as a fuzzy random variable. The asymptotic unbiasedness and the consistency of the estimators are proved using a suitable metric.