• Title/Summary/Keyword: Least square estimator

Search Result 133, Processing Time 0.027 seconds

Estimation of Ridge Regression Under the Integrate Mean Square Error Cirterion

  • Yong B. Lim;Park, Chi H.;Park, Sung H.
    • Journal of the Korean Statistical Society
    • /
    • v.9 no.1
    • /
    • pp.61-77
    • /
    • 1980
  • In response surface experiments, a polynomial model is often used to fit the response surface by the method of least squares. However, if the vectors of predictor variables are multicollinear, least squares estimates of the regression parameters have a high probability of being unsatisfactory. Hoerland Kennard have demonstrated that these undesirable effects of multicollinearity can be reduced by using "ridge" estimates in place of the least squares estimates. Ridge regrssion theory in literature has been mainly concerned with selection of k for the first order polynomial regression model and the precision of $\hat{\beta}(k)$, the ridge estimator of regression parameters. The problem considered in this paper is that of selecting k of ridge regression for a given polynomial regression model with an arbitrary order. A criterion is proposed for selection of k in the context of integrated mean square error of fitted responses, and illustrated with an example. Also, a type of admissibility condition is established and proved for the propose criterion.criterion.

  • PDF

Optimization of FCM-based Radial Basis Function Neural Network Using Particle Swarm Optimization (PSO를 이용한 FCM 기반 RBF 뉴럴 네트워크의 최적화)

  • Choi, Jeoung-Nae;Kim, Hyun-Ki;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.57 no.11
    • /
    • pp.2108-2116
    • /
    • 2008
  • The paper concerns Fuzzy C-Means clustering based Radial Basis Function neural networks (FCM-RBFNN) and the optimization of the network is carried out by means of Particle Swarm Optimization(PSO). FCM-RBFNN is the extended architecture of Radial Basis Function Neural Network(RBFNN). In the proposed network, the membership functions of the premise part of fuzzy rules do not assume any explicit functional forms such as Gaussian, ellipsoidal, triangular, etc., so its resulting fitness values directly rely on the computation of the relevant distance between data points by means of FCM. Also, as the consequent part of fuzzy rules extracted by the FCM - RBFNN model, the order of four types of polynomials can be considered such as constant, linear, quadratic and modified quadratic. Weighted Least Square Estimator(WLSE) are used to estimates the coefficients of polynomial. Since the performance of FCM-RBFNN is affected by some parameters of FCM-RBFNN such as a specific subset of input variables, fuzzification coefficient of FCM, the number of rules and the order of polynomials of consequent part of fuzzy rule, we need the structural as well as parametric optimization of the network. In this study, the PSO is exploited to carry out the structural as well as parametric optimization of FCM-RBFNN. Moreover The proposed model is demonstrated with the use of numerical example and gas furnace data set.

Performance Analysis of DVB-T2 Turbo Equalization with LDPC and MAP Detector (LDPC 복호와 MAP 등화기를 결합한 DVB-T2 터보 등화기법의 성능분석)

  • Tai, Qing Song;Han, Dong-Seog
    • Journal of Broadcast Engineering
    • /
    • v.15 no.5
    • /
    • pp.665-671
    • /
    • 2010
  • In this paper, a turbo equalizer is proposed for the digital video broadcasting for terrestrial - 2nd generation (DVB-T2) system. The proposed turbo equalizer is consisted with the maximum a posteriori (MAP) and low density parity check (LDPC) decoder. The channel information for the soft-input-soft-output (SISO) MAP equalizer is based on the least square (LS) channel estimator. The performance is analyzed through computer simulations in terms of the iteration number.

A comparison study on regression with stationary nonparametric autoregressive errors (정상 비모수 자기상관 오차항을 갖는 회귀분석에 대한 비교 연구)

  • Yu, Kyusang
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.1
    • /
    • pp.157-169
    • /
    • 2016
  • We compare four methods to estimate a regression coefficient under linear regression models with serially correlated errors. We assume that regression errors are generated with nonlinear autoregressive models. The four methods are: ordinary least square estimator, general least square estimator, parametric regression error correction method, and nonparametric regression error correction method. We also discuss some properties of nonlinear autoregressive models by presenting numerical studies with typical examples. Our numerical study suggests that no method dominates; however, the nonparametric regression error correction method works quite well.

Inverse active wind load inputs estimation of the multilayer shearing stress structure

  • Chen, Tsung-Chien;Lee, Ming-Hui
    • Wind and Structures
    • /
    • v.11 no.1
    • /
    • pp.19-33
    • /
    • 2008
  • This research investigates the adaptive input estimation method applied to the multilayer shearing stress structure. This method is to estimate the values of wind load inputs by analyzing the active reaction of the system. The Kalman filter without the input term and the adaptive weighted recursive least square estimator are two main portions of this method. The innovation vector can be produced by the Kalman filter, and be applied to the adaptive weighted recursive least square estimator to estimate the wind load input over time. This combined method can effectively estimate the wind loads to the structure system to enhance the reliability of the system active performance analysis. The forms of the simulated inputs (loads) in this paper include the periodic sinusoidal wave, the decaying exponent, the random combination of the sinusoidal wave and the decaying exponent, etc. The active reaction computed plus the simulation error is regard as the simulated measurement and is applied to the input estimation algorithm to implement the numerical simulation of the inverse input estimation process. The availability and the precision of the input estimation method proposed in this research can be verified by comparing the actual value and the one obtained by numerical simulation.

Improvement of Accuracy for Least Square Estimator Combining Analytic Solution - Application to Reactor Protection System (해석적 자료를 이용한 최소자승 추정법의 성능 개선 - 원자로보호계통에의 응용 -)

  • 최유선;박문규;차균호;이창섭
    • Proceedings of the Korea Society for Energy Engineering kosee Conference
    • /
    • 2000.11a
    • /
    • pp.111-114
    • /
    • 2000
  • 본 논문은 선형모델의 모델 계수의 결정방법으로 사용되는 최소자승법 (Least Squares Method, LSM)의 단점을 해결하기 위해 해석적으로 계산된 자료를 함께 적용하는 방법과 원자로의 출력분포 측정을 위한 SAM (Shape Annealing Matrix) 결정에 적용한 결과를 기술하고 있다. 해석적 자료를 함께 적용할 경우 연료 연소에 따른 원자로 특성변화를 적절히 반영하여 LSM 추정치의 정확도를 크게 개선할 수 있음을 확인하였다.

  • PDF

Consistency and Bounds on the Bias of $S^2$ in the Linear Regression Model with Moving Average Disturbances

  • Song, Seuck-Heun
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.2
    • /
    • pp.507-518
    • /
    • 1995
  • The ordinary least squares based estiamte $S^2$ of the disturbance variance is considered in the linear regression model when the disturbances follow the first-order moving-average process. It is shown that $S^2$ is weakly consistent estimate for the disturbance varaince without any restriction on the regressor matrix X. Also, simple exact bounds on the relative bias of $S^2$ are given in finite sample sizes.

  • PDF

Jensen's Alpha Estimation Models in Capital Asset Pricing Model

  • Phuoc, Le Tan
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.5 no.3
    • /
    • pp.19-29
    • /
    • 2018
  • This research examined the alternatives of Jensen's alpha (α) estimation models in the Capital Asset Pricing Model, discussed by Treynor (1961), Sharpe (1964), and Lintner (1965), using the robust maximum likelihood type m-estimator (MM estimator) and Bayes estimator with conjugate prior. According to finance literature and practices, alpha has often been estimated using ordinary least square (OLS) regression method and monthly return data set. A sample of 50 securities is randomly selected from the list of the S&P 500 index. Their daily and monthly returns were collected over a period of the last five years. This research showed that the robust MM estimator performed well better than the OLS and Bayes estimators in terms of efficiency. The Bayes estimator did not perform better than the OLS estimator as expected. Interestingly, we also found that daily return data set would give more accurate alpha estimation than monthly return data set in all three MM, OLS, and Bayes estimators. We also proposed an alternative market efficiency test with the hypothesis testing Ho: α = 0 and was able to prove the S&P 500 index is efficient, but not perfect. More important, those findings above are checked with and validated by Jackknife resampling results.

Development of The Robust State Estimator using Linear Programming (선형계획법을 이용한 견실한 상태추정기의 개발에 관한 연구)

  • Lim, Jae-Sup;Kwon, Hyung-Seok;Kim, Hong-Rae
    • Proceedings of the KIEE Conference
    • /
    • 2001.07a
    • /
    • pp.181-183
    • /
    • 2001
  • This paper presents a robust power system state estimator using linear programming(LP). LP state estimators minimize the weighted sum of the absolute values of the measurement residuals. In this paper, WLS(weighted least square) and WLAV(weighted least absolute value) state estimators are run with same measurement sets including bad data in order to compare the robustness to bad data and convergence characteristics of the two methods. Simulations with three test cases are performed and the results are presented, using IEEE 14 bus system.

  • PDF

Vehicle Mass and Road Grade Estimation for Longitudinal Acceleration Controller of an Automated Bus (자율주행 버스의 종방향 제어를 위한 질량 및 종 경사 추정기 개발)

  • Jo, Ara;Jeong, Yonghwan;Lim, Hyungho;Yi, Kyongsu
    • Journal of Auto-vehicle Safety Association
    • /
    • v.12 no.2
    • /
    • pp.14-20
    • /
    • 2020
  • This paper presents a vehicle mass and road grade estimator for developing an automated bus. To consider the dynamic characteristics of a bus varying with the number of passengers, the longitudinal controller needs the estimation of the vehicle's mass and road grade in real-time and utilizes the information to adjust the control gains. Discrete Kalman filter is applied to estimate the time-varying road grade, and the recursive least squares algorithm is adopted to account for the constant mass estimation. After being implemented in MATLAB/Simulink, the estimators are evaluated with the dynamic model and experimental data of the target bus. The proposed estimators will be applied to complement the algorithm of the longitudinal controller and proceed with algorithm verification.