• Title/Summary/Keyword: regression function

Search Result 2,138, Processing Time 0.024 seconds

Support vector quantile regression ensemble with bagging

  • Shim, Jooyong;Hwang, Changha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.3
    • /
    • pp.677-684
    • /
    • 2014
  • Support vector quantile regression (SVQR) is capable of providing more complete description of the linear and nonlinear relationships among random variables. To improve the estimation performance of SVQR we propose to use SVQR ensemble with bagging (bootstrap aggregating), in which SVQRs are trained independently using the training data sets sampled randomly via a bootstrap method. Then, they are aggregated to obtain the estimator of the quantile regression function using the penalized objective function composed of check functions. Experimental results are then presented, which illustrate the performance of SVQR ensemble with bagging.

The Weight Function in the Bounded Influence Regression Quantile Estimator for the AR(1) Model with Additive Outliers

  • Jung Byoung Cheol;Han Sang Moon
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.1
    • /
    • pp.169-179
    • /
    • 2005
  • In this study, we investigate the effects of the weight function in the bounded influence regression quantile (BIRQ) estimator for the AR(l) model with additive outliers. In order to down-weight the outliers of X -axis, the Mallows' (1973) weight function has been commonly used in the BIRQ estimator. However, in our Monte Carlo study, the BIRQ estimator using the Tukey's bisquare weight function shows less MSE and bias than that of using the Mallows' weight function or Huber's weight function. Thus, the use of the Tukey's weight function is recommended in the BIRQ estimator for our model.

The Weight Function in BIRQ Estimator for the AR(1) Model with Additive Outliers

  • Jung Byoung Cheol;Han Sang Moon
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2004.11a
    • /
    • pp.129-134
    • /
    • 2004
  • In this study, we investigate the effects of the weight function in the bounded influence regression quantile (BIRQ) estimator for the AR(1) model with additive outliers. In order to down-weight the outliers of X-axis, the Mallows' (1973) weight function has been commonly used in the BIRQ estimator. However, in our Monte Carlo study, the BIRQ estimator using the Tukey's bisquare weight function shows less MSE and bias than that of using the Mallows' weight function or Huber's weight function.

  • PDF

Iterative Support Vector Quantile Regression for Censored Data

  • Shim, Joo-Yong;Hong, Dug-Hun;Kim, Dal-Ho;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.1
    • /
    • pp.195-203
    • /
    • 2007
  • In this paper we propose support vector quantile regression (SVQR) for randomly right censored data. The proposed procedure basically utilizes iterative method based on the empirical distribution functions of the censored times and the sample quantiles of the observed variables, and applies support vector regression for the estimation of the quantile function. Experimental results we then presented to indicate the performance of the proposed procedure.

Kernel Poisson regression for mixed input variables

  • Shim, Jooyong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.6
    • /
    • pp.1231-1239
    • /
    • 2012
  • An estimating procedure is introduced for kernel Poisson regression when the input variables consist of numerical and categorical variables, which is based on the penalized negative log-likelihood and the component-wise product of two different types of kernel functions. The proposed procedure provides the estimates of the mean function of the response variables, where the canonical parameter is linearly and/or nonlinearly related to the input variables. Experimental results are then presented which indicate the performance of the proposed kernel Poisson regression.

Hybrid Fuzzy Least Squares Support Vector Machine Regression for Crisp Input and Fuzzy Output

  • Shim, Joo-Yong;Seok, Kyung-Ha;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.17 no.2
    • /
    • pp.141-151
    • /
    • 2010
  • Hybrid fuzzy regression analysis is used for integrating randomness and fuzziness into a regression model. Least squares support vector machine(LS-SVM) has been very successful in pattern recognition and function estimation problems for crisp data. This paper proposes a new method to evaluate hybrid fuzzy linear and nonlinear regression models with crisp inputs and fuzzy output using weighted fuzzy arithmetic(WFA) and LS-SVM. LS-SVM allows us to perform fuzzy nonlinear regression analysis by constructing a fuzzy linear regression function in a high dimensional feature space. The proposed method is not computationally expensive since its solution is obtained from a simple linear equation system. In particular, this method is a very attractive approach to modeling nonlinear data, and is nonparametric method in the sense that we do not have to assume the underlying model function for fuzzy nonlinear regression model with crisp inputs and fuzzy output. Experimental results are then presented which indicate the performance of this method.

ASYMPTOTIC NORMALITY OF WAVELET ESTIMATOR OF REGRESSION FUNCTION UNDER NA ASSUMPTIONS

  • Liang, Han-Ying;Qi, Yan-Yan
    • Bulletin of the Korean Mathematical Society
    • /
    • v.44 no.2
    • /
    • pp.247-257
    • /
    • 2007
  • Consider the heteroscedastic regression model $Y_i=g(x_i)+{\sigma}_i\;{\epsilon}_i=(1{\leq}i{\leq}n)$, where ${\sigma}^2_i=f(u_i)$, the design points $(x_i,\;u_i)$ are known and nonrandom, and g and f are unknown functions defined on closed interval [0, 1]. Under the random errors $\epsilon_i$ form a sequence of NA random variables, we study the asymptotic normality of wavelet estimators of g when f is a known or unknown function.

Kernel method for autoregressive data

  • Shim, Joo-Yong;Lee, Jang-Taek
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.5
    • /
    • pp.949-954
    • /
    • 2009
  • The autoregressive process is applied in this paper to kernel regression in order to infer nonlinear models for predicting responses. We propose a kernel method for the autoregressive data which estimates the mean function by kernel machines. We also present the model selection method which employs the cross validation techniques for choosing the hyper-parameters which affect the performance of kernel regression. Artificial and real examples are provided to indicate the usefulness of the proposed method for the estimation of mean function in the presence of autocorrelation between data.

  • PDF

Fuzzy Test for the Fuzzy Regression Coefficient (퍼지회귀계수에 관한 퍼지검정)

  • 강만기;정지영;최규탁
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.05a
    • /
    • pp.29-33
    • /
    • 2001
  • We propose fuzzy least-squares regression analysis by few error term data and test the slop by fuzzy hypotheses membership function for fuzzy number data with agreement index. Finding the agreement index by area for fuzzy hypotheses membership function and membership function of confidence interval, we obtain the results to acceptance or reject for the test of fuzzy hypotheses.

  • PDF

Support vector quantile regression for longitudinal data

  • Hwang, Chang-Ha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.309-316
    • /
    • 2010
  • Support vector quantile regression (SVQR) is capable of providing more complete description of the linear and nonlinear relationships among response and input variables. In this paper we propose a weighted SVQR for the longitudinal data. Furthermore, we introduce the generalized approximate cross validation function to select the hyperparameters which affect the performance of SVQR. Experimental results are the presented, which illustrate the performance of the proposed SVQR.