• 제목/요약/키워드: Least Square Regression

Search Result 421, Processing Time 0.02 seconds

Design-based Properties of Least Square Estimators in Panel Regression Model (패널회귀모형에서 회귀계수 추정량의 설계기반 성질)

  • Kim, Kyu-Seong
    • Survey Research
    • /
    • v.12 no.3
    • /
    • pp.49-62
    • /
    • 2011
  • In this paper we investigate design-based properties of both the ordinary least square estimator and the weighted least square estimator for regression coefficients in panel regression model. We derive formulas of approximate bias, variance and mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator after linearization of least square estimators. Also we compare their magnitudes each other numerically through a simulation study. We consider a three years data of Korean Welfare Panel Study as a finite population and take household income as a dependent variable and choose 7 exploratory variables related household as independent variables in panel regression model. Then we calculate approximate bias, variance, mean square error for the ordinary least square estimator and approximate variance for the weighted least square estimator based on several sample sizes from 50 to 1,000 by 50. Through the simulation study we found some tendencies as follows. First, the mean square error of the ordinary least square estimator is getting larger than the variance of the weighted least square estimator as sample sizes increase. Next, the magnitude of mean square error of the ordinary least square estimator is depending on the magnitude of the bias of the estimator, which is large when the bias is large. Finally, with regard to approximate variance, variances of the ordinary least square estimator are smaller than those of the weighted least square estimator in many cases in the simulation.

  • PDF

Asymmetric Least Squares Estimation for A Nonlinear Time Series Regression Model

  • Kim, Tae Soo;Kim, Hae Kyoung;Yoon, Jin Hee
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.3
    • /
    • pp.633-641
    • /
    • 2001
  • The least squares method is usually applied when estimating the parameters in the regression models. However the least square estimator is not very efficient when the distribution of the error is skewed. In this paper, we propose the asymmetric least square estimator for a particular nonlinear time series regression model, and give the simple and practical sufficient conditions for the strong consistency of the estimators.

  • PDF

Reexamination of Estimating Beta Coecient as a Risk Measure in CAPM

  • Phuoc, Le Tan;Kim, Kee S.;Su, Yingcai
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.1
    • /
    • pp.11-16
    • /
    • 2018
  • This research examines the alternative ways of estimating the coefficient of non-diversifiable risk, namely beta coefficient, in Capital Asset Pricing Model (CAPM) introduced by Sharpe (1964) that is an essential element of assessing the value of diverse assets. The non-parametric methods used in this research are the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator). The Jackknife, the resampling technique, is also employed to validate the results. According to finance literature and common practices, these coecients have often been estimated using Ordinary Least Square (LS) regression method and monthly return data set. The empirical results of this research pointed out that the robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) performed much better than Ordinary Least Square (LS) in terms of eciency for large-cap stocks trading actively in the United States markets. Interestingly, the empirical results also showed that daily return data would give more accurate estimation than monthly return data in both Ordinary Least Square (LS) and robust Least Trimmed Square (LTS) and Maximum likelihood type of M-estimator (MM-estimator) regressions.

Approximate Variance of Least Square Estimators for Regression Coefficient under Inclusion Probability Proportional to Size Sampling (포함확률비례추출에서 회귀계수 최소제곱추정량의 근사분산)

  • Kim, Kyu-Seong
    • Communications for Statistical Applications and Methods
    • /
    • v.19 no.1
    • /
    • pp.23-32
    • /
    • 2012
  • This paper deals with the bias and variance of regression coefficient estimators in a finite population. We derive approximate formulas for the bias, variance and mean square error of two estimators when we select a fixed-size inclusion probability proportional to the size sample and then estimate regression coefficients by the ordinary least square estimator as well as the weighted least square estimator based on the selected sample data. Necessary and sufficient conditions for the comparison of the two estimators in terms of variance and mean square error are suggested. In addition, a simple example is introduced to numerically compare the variance and mean square error of the two estimators.

Analysis of Partial Least Square Regression on Textural Data from Back Extrusion Test for Commercial Instant Noodles (시중 즉석 조리 면의 Back Extrusion 텍스처 데이터에 대한 Partial Least Square Regression 분석)

  • Kim, Su kyoung;Lee, Seung Ju
    • Food Engineering Progress
    • /
    • v.14 no.1
    • /
    • pp.75-79
    • /
    • 2010
  • Partial least square regression (PLSR) was executed on curve data of force-deformation from back extrusion test and sensory data for commercial instant noodles. Sensory attributes considered were hardness (A), springiness (B), roughness (C), adhesiveness to teeth (D), and thickness (E). Eight and two kinds of fried and non-fried instant noodles respectively were used in the tests. Changes in weighted regression coefficients were characterized as three stages: compaction, yielding, and extrusion. Correlation coefficients appeared in the order of E>D>A>B>C, root mean square error of prediction D>C>E>B>A, and relative ability of prediction D>C>E>B>A. Overall, 'D' was the best in the correlation and prediction. 'A' with poor prediction ability but high correlation was considered good when determining the order of magnitude.

Fuzzy Linear Regression Model Using the Least Hausdorf-distance Square Method

  • Choi, Sang-Sun;Hong, Dug-Hun;Kim, Dal-Ho
    • Communications for Statistical Applications and Methods
    • /
    • v.7 no.3
    • /
    • pp.643-654
    • /
    • 2000
  • In this paper, we review some class of t-norms on which fuzzy arithmetic operations preserve the shapes of fuzzy numbers and the Hausdorff-distance between fuzzy numbers as the measure of distance between fuzzy numbers. And we suggest the least Hausdorff-distance square method for fuzzy linear regression model using shape preserving fuzzy arithmetic operations.

  • PDF

Exact Confidence Intervals on the Regression Coeffcients in Multiple Regression Model with Nested Error Structure

  • Park, Dong-Joon
    • Communications for Statistical Applications and Methods
    • /
    • v.4 no.2
    • /
    • pp.541-548
    • /
    • 1997
  • In regression model with nested error structure interval estimations on regression coefficients in different stages are proposed. Ordinary least square estimators and generalized least square estimators of the regression coefficients in this model are derived for between and within group model. The confidence intervals are dervied by using independent idstributional properties between regression coefficient estimators and quadratic froms obtained from the model.

  • PDF

A Development of Statistical Model for Pavement Response Model (도로포장 반응모형에 대한 통계모형 개발)

  • Lee, Moon Sup;Park, Hee Mun;Kim, Boo Il;Heo, Tae-Young
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.17 no.5
    • /
    • pp.89-96
    • /
    • 2012
  • The Falling Weight Deflectormeter has been widely used in evaluating the structural adequacy of pavement structures. The deflections measured from the FWD are capable of estimating the stiffness of pavement layers and measuring the pavement responses in the pavement structure. The objective of paper is to develop the pavement response model using a partial least square regression technique based on the FWD deflection data. The partial least square regression method enables to solve the multicollinearity problem occurred in multiple regression model. It is also found that the pavement response model can be developed using the raw data when a partial least square regression was used.

Modeling and Comparison for Auto-association using Support Vector Regression (SVR) and Partial Least Square Regression (PLSR) in Online Monitoring Techniques (상시감시기술에서 SVR과 PLSR을 이용한 Auto-association 모델링 및 성능비교)

  • Kim, Seong-Jun;Seo, In-Yong
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.20 no.4
    • /
    • pp.483-488
    • /
    • 2010
  • An online monitoring based upon sensor system is essential to assure both efficient operation and safety in the power plant. Of great importance is modeling for auto-association (AA) in online monitoring technique. The objective of auto-associative models lies in predicting true values of plant operation parameters from sensor signals transmitted. This paper presents two AA models using Support Vector Regression (SVR) and Partial Least Square Regression (PLSR). The presented models are useful, in particular, when there are many parameters to monitor in the power plant. Illustrative examples are given by using a real-world plant dataset. AA performances of SVR and PLSR are finally summarized in terms of accuracy and sensitivity. According to our results, SVR shows much higher accuracy and, however, its sensitivity is relatively degraded.

A modified partial least squares regression for the analysis of gene expression data with survival information

  • Lee, So-Yoon;Huh, Myung-Hoe;Park, Mira
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.5
    • /
    • pp.1151-1160
    • /
    • 2014
  • In DNA microarray studies, the number of genes far exceeds the number of samples and the gene expression measures are highly correlated. Partial least squares regression (PLSR) is one of the popular methods for dimensional reduction and known to be useful for the classifications of microarray data by several studies. In this study, we suggest a modified version of the partial least squares regression to analyze gene expression data with survival information. The method is designed as a new gene selection method using PLSR with an iterative procedure of imputing censored survival time. Mean square error of prediction criterion is used to determine the dimension of the model. To visualize the data, plot for variables superimposed with samples are used. The method is applied to two microarray data sets, both containing survival time. The results show that the proposed method works well for interpreting gene expression microarray data.