• 제목/요약/키워드: Nonparametric Regression Estimation

검색결과 60건 처리시간 0.025초

A Comparison Study on the Error Criteria in Nonparametric Regression Estimators

  • Chung, Sung-S.
    • Journal of the Korean Data and Information Science Society
    • /
    • 제11권2호
    • /
    • pp.335-345
    • /
    • 2000
  • Most context use the classical norms on function spaces as the error criteria. Since these norms are all based on the vertical distances between the curves, these can be quite inappropriate from a visual notion of distance. Visual errors in Marron and Tsybakov(1995) correspond more closely to "what the eye sees". Simulation is performed to compare the performance of the regression smoothers in view of MISE and the visual error. It shows that the visual error can be used as a possible candidate of error criteria in the kernel regression estimation.

  • PDF

Estimation of long memory parameter in nonparametric regression

  • Cho, Yeoyoung;Baek, Changryong
    • Communications for Statistical Applications and Methods
    • /
    • 제26권6호
    • /
    • pp.611-622
    • /
    • 2019
  • This paper considers the estimation of the long memory parameter in nonparametric regression with strongly correlated errors. The key idea is to minimize a unified mean squared error of long memory parameter to select both kernel bandwidth and the number of frequencies used in exact local Whittle estimation. A unified mean squared error framework is more natural because it provides both goodness of fit and measure of strong dependence. The block bootstrap is applied to evaluate the mean squared error. Finite sample performance using Monte Carlo simulations shows the closest performance to the oracle. The proposed method outperforms existing methods especially when dependency and sample size increase. The proposed method is also illustreated to the volatility of exchange rate between Korean Won for US dollar.

평률 회귀분석을 위한 추정 방법의 비교 (Comparison of estimation methods for expectile regression)

  • 김종민;강기훈
    • 응용통계연구
    • /
    • 제31권3호
    • /
    • pp.343-352
    • /
    • 2018
  • 설명변수가 주어졌을 때 반응변수의 평균적인 추세뿐만 아니라 극단적인 지역에서의 추세에 대해서 추정하고 싶거나 반응변수 분포의 일반적인 탐색을 위해서는 분위수 회귀분석과 평률 회귀분석을 사용할 수 있다. 본 논문에서는 평률 회귀모형의 추정을 위한 모수적 방법과 비모수적 방법의 성능을 비교하고자 한다. 이를 위해 각 추정 방법을 소개하고 여러 상황의 모의실험 및 실제자료에의 적용을 통해 비교 분석을 실시하였다. 모형에 따라 성능 차이가 있는데 자료의 형태가 복잡하여 변수 간의 관계를 유추하기 힘들 경우 비모수적으로 추정한 평률 회귀분석모형이 더욱 좋은 결과를 보였다. 일반적인 회귀분석의 경우와 달리 평률의 경우 후보가 되는 모수 모형을 상정하기 어렵다는 측면에서 볼 때, 비모수적 방법의 사용이 추천될 수 있다.

Local Bandwidth Selection for Nonparametric Regression

  • Lee, Seong-Woo;Cha, Kyung-Joon
    • Communications for Statistical Applications and Methods
    • /
    • 제4권2호
    • /
    • pp.453-463
    • /
    • 1997
  • Nonparametric kernel regression has recently gained widespread acceptance as an attractive method for the nonparametric estimation of the mean function from noisy regression data. Also, the practical implementation of kernel method is enhanced by the availability of reliable rule for automatic selection of the bandwidth. In this article, we propose a method for automatic selection of the bandwidth that minimizes the asymptotic mean square error. Then, the estimated bandwidth by the proposed method is compared with the theoretical optimal bandwidth and a bandwidth by plug-in method. Simulation study is performed and shows satisfactory behavior of the proposed method.

  • PDF

Variable Bandwidth Selection for Kernel Regression

  • Kim, Dae-Hak
    • Journal of the Korean Data and Information Science Society
    • /
    • 제5권1호
    • /
    • pp.11-20
    • /
    • 1994
  • In recent years, nonparametric kernel estimation of regresion function are abundant and widely applicable to many areas of statistics. Most of modern researches concerned with the fixed global bandwidth selection which can be used in the estimation of regression function with all the same value for all x. In this paper, we propose a method for selecting locally varing bandwidth based on bootstrap method in kernel estimation of fixed design regression. Performance of proposed bandwidth selection method for finite sample case is conducted via Monte Carlo simulation study.

  • PDF

Kernel Regression Estimation Under Dependence

  • Kim, Tae-Yoon;Kim, Donghoh
    • Journal of the Korean Statistical Society
    • /
    • 제31권3호
    • /
    • pp.359-368
    • /
    • 2002
  • Nonparametric kernel regression problem is considered for a stationary dependent sequence {(Xi, Yj) 1 j $\geq$ 1 }. In particular consistency and rates of convergence are discussed, which gives some useful insight for the effect of dependence for stationary $\alpha$-mixing sequences.

Estimation of error variance in nonparametric regression under a finite sample using ridge regression

  • Park, Chun-Gun
    • Journal of the Korean Data and Information Science Society
    • /
    • 제22권6호
    • /
    • pp.1223-1232
    • /
    • 2011
  • Tong and Wang's estimator (2005) is a new approach to estimate the error variance using least squares method such that a simple linear regression is asymptotically derived from Rice's lag- estimator (1984). Their estimator highly depends on the setting of a regressor and weights in small sample sizes. In this article, we propose a new approach via a local quadratic approximation to set regressors in a small sample case. We estimate the error variance as the intercept using a ridge regression because the regressors have the problem of multicollinearity. From the small simulation study, the performance of our approach with some existing methods is better in small sample cases and comparable in large cases. More research is required on unequally spaced points.

A SIMPLE VARIANCE ESTIMATOR IN NONPARAMETRIC REGRESSION MODELS WITH MULTIVARIATE PREDICTORS

  • Lee Young-Kyung;Kim Tae-Yoon;Park Byeong-U.
    • Journal of the Korean Statistical Society
    • /
    • 제35권1호
    • /
    • pp.105-114
    • /
    • 2006
  • In this paper we propose a simple and computationally attractive difference-based variance estimator in nonparametric regression models with multivariate predictors. We show that the estimator achieves $n^{-1/2}$ rate of convergence for regression functions with only a first derivative when d, the dimension of the predictor, is less than or equal to 4. When d > 4, the rate turns out to be $n^{-4/(d+4)}$ under the first derivative condition for the regression functions. A numerical study suggests that the proposed estimator has a good finite sample performance.

Kernel Regression Estimation for Permutation Fixed Design Additive Models

  • Baek, Jangsun;Wehrly, Thomas E.
    • Journal of the Korean Statistical Society
    • /
    • 제25권4호
    • /
    • pp.499-514
    • /
    • 1996
  • Consider an additive regression model of Y on X = (X$_1$,X$_2$,. . .,$X_p$), Y = $sum_{j=1}^pf_j(X_j) + $\varepsilon$$, where $f_j$s are smooth functions to be estimated and $\varepsilon$ is a random error. If $X_j$s are fixed design points, we call it the fixed design additive model. Since the response variable Y is observed at fixed p-dimensional design points, the behavior of the nonparametric regression estimator depends on the design. We propose a fixed design called permutation fixed design, and fit the regression function by the kernel method. The estimator in the permutation fixed design achieves the univariate optimal rate of convergence in mean squared error for any p $\geq$ 2.

  • PDF

Comparison of Nonparametric Function Estimation Methods for Discontinuous Regression Functions

  • Park, Dong-Ryeon
    • 응용통계연구
    • /
    • 제23권6호
    • /
    • pp.1245-1253
    • /
    • 2010
  • There are two main approaches for estimating the discontinuous regression function nonparametrically. One is the direct approach, the other is the indirect approach. The major goal of the two approaches are different. The direct approach focuses on the overall good estimation of the regression function itself, whereas the indirect approach focuses on the good estimation of jump locations. Apparently, the two approaches are quite different in nature. Gijbels et al. (2007) argue that the comparison of two approaches does not make much sense and that it is even difficult to choose an appropriate criterion for comparisons. However, it is obvious that the indirect approach also has the regression curve estimate as the subsidiary result. Therefore it is necessary to verify the appropriateness of the indirect approach as the estimator of the discontinuous regression function itself. Park (2009a) compared the performance of two approaches through a simulation study. In this paper, we consider a more general case and draw some useful conclusions.