• 제목/요약/키워드: generalized least squares

검색결과 158건 처리시간 0.021초

Two-step LS-SVR for censored regression

  • Bae, Jong-Sig;Hwang, Chang-Ha;Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제23권2호
    • /
    • pp.393-401
    • /
    • 2012
  • This paper deals with the estimations of the least squares support vector regression when the responses are subject to randomly right censoring. The estimation is performed via two steps - the ordinary least squares support vector regression and the least squares support vector regression with censored data. We use the empirical fact that the estimated regression functions subject to randomly right censoring are close to the true regression functions than the observed failure times subject to randomly right censoring. The hyper-parameters of model which affect the performance of the proposed procedure are selected by a generalized cross validation function. Experimental results are then presented which indicate the performance of the proposed procedure.

A Generalized Partly-Parametric Additive Risk Model

  • Park, Cheol-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제17권2호
    • /
    • pp.401-409
    • /
    • 2006
  • We consider a generalized partly-parametric additive risk model which generalizes the partly parametric additive risk model suggested by McKeague and Sasieni (1994). As an estimation method of this model, we propose to use the weighted least square estimation, suggested by Huffer and McKeague (1991), for Aalen's additive risk model by a piecewise constant risk. We provide an illustrative example as well as a simulation study that compares the performance of our method with the ordinary least squares method.

  • PDF

Cox proportional hazard model with L1 penalty

  • Hwang, Chang-Ha;Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제22권3호
    • /
    • pp.613-618
    • /
    • 2011
  • The proposed method is based on a penalized log partial likelihood of Cox proportional hazard model with L1-penalty. We use the iteratively reweighted least squares procedure to solve L1 penalized log partial likelihood function of Cox proportional hazard model. It provide the ecient computation including variable selection and leads to the generalized cross validation function for the model selection. Experimental results are then presented to indicate the performance of the proposed procedure.

Kernel Ridge Regression with Randomly Right Censored Data

  • Shim, Joo-Yong;Seok, Kyung-Ha
    • Communications for Statistical Applications and Methods
    • /
    • 제15권2호
    • /
    • pp.205-211
    • /
    • 2008
  • This paper deals with the estimations of kernel ridge regression when the responses are subject to randomly right censoring. The iterative reweighted least squares(IRWLS) procedure is employed to treat censored observations. The hyperparameters of model which affect the performance of the proposed procedure are selected by a generalized cross validation(GCV) function. Experimental results are then presented which indicate the performance of the proposed procedure.

e-SVR using IRWLS Procedure

  • Shim, Joo-Yong
    • Journal of the Korean Data and Information Science Society
    • /
    • 제16권4호
    • /
    • pp.1087-1094
    • /
    • 2005
  • e-insensitive support vector regression(e-SVR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. In this paper we propose an iterative reweighted least squares(IRWLS) procedure to solve the quadratic problem of e-SVR with a modified loss function. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of e-SVR. Experimental results are then presented which illustrate the performance of the IRWLS procedure for e-SVR.

  • PDF

EXTENSION OF FACTORING LIKELIHOOD APPROACH TO NON-MONOTONE MISSING DATA

  • Kim, Jae-Kwang
    • Journal of the Korean Statistical Society
    • /
    • 제33권4호
    • /
    • pp.401-410
    • /
    • 2004
  • We address the problem of parameter estimation in multivariate distributions under ignorable non-monotone missing data. The factoring likelihood method for monotone missing data, termed by Rubin (1974), is extended to a more general case of non-monotone missing data. The proposed method is algebraically equivalent to the Newton-Raphson method for the observed likelihood, but avoids the burden of computing the first and the second partial derivatives of the observed likelihood. Instead, the maximum likelihood estimates and their information matrices for each partition of the data set are computed separately and combined naturally using the generalized least squares method.

일반화된 유한차분법을 이용한 균열해석 (A Generalized Finite Difference Method for Crack Analysis)

  • 윤영철;김동조;이상호
    • 한국전산구조공학회:학술대회논문집
    • /
    • 한국전산구조공학회 2007년도 정기 학술대회 논문집
    • /
    • pp.501-506
    • /
    • 2007
  • A generalized finite difference method for solving solid mechanics problems such as elasticity and crack problems is presented. The method is constructed in framework of Taylor polynomial based on the Moving Least Squares method and collocation scheme based on the diffuse derivative approximation. The governing equations are discretized into the difference equations and the nodal solutions are obtained by solving the system of equations. Numerical examples successfully demonstrate the robustness and efficiency of the proposed method.

  • PDF

Mixed-effects LS-SVR for longitudinal dat

  • Cho, Dae-Hyeon
    • Journal of the Korean Data and Information Science Society
    • /
    • 제21권2호
    • /
    • pp.363-369
    • /
    • 2010
  • In this paper we propose a mixed-effects least squares support vector regression (LS-SVR) for longitudinal data. We add a random-effect term in the optimization function of LS-SVR to take random effects into LS-SVR for analyzing longitudinal data. We also present the model selection method that employs generalized cross validation function for choosing the hyper-parameters which affect the performance of the mixed-effects LS-SVR. A simulated example is provided to indicate the usefulness of mixed-effect method for analyzing longitudinal data.

Lagged Unstable Regressor Models and Asymptotic Efficiency of the Ordinary Least Squares Estimator

  • Shin, Dong-Wan;Oh, Man-Suk
    • Journal of the Korean Statistical Society
    • /
    • 제31권2호
    • /
    • pp.251-259
    • /
    • 2002
  • Lagged regressor models with general stationary errors independent of the regressors are considered. The regressor process is unstable having characteristic roots on the unit circle. If the order of the lag matches the number of roots on the unit circle, the ordinary least squares estimator (OLSE) is asymptotically efficient in that it has the same limiting distribution as the generalized least squares estimator (GLSE) under the same normalization. This result extends the well-known result of Grenander and Rosenblatt (1957) for asymptotic efficiency of the OLSE in deterministic polynomial and/or trigonometric regressor models to a class of models with stochastic regressors.

One-step Least Squares Fitting of Variogram

  • Choi, Hye-Mi
    • Communications for Statistical Applications and Methods
    • /
    • 제12권2호
    • /
    • pp.539-544
    • /
    • 2005
  • In this paper, we propose the one-step least squares method based on the squared differences to estimate the parameters of the variogram used for spatial data modelling, and discuss its asymptotic efficiency. The proposed method does not require to specify lags of interest and partition lags, so that we can delete the subjectiveness and ambiguity originated from the lag selection in estimating spatial dependence.