• Title/Summary/Keyword: Nonparametric Estimation

Search Result 211, Processing Time 0.021 seconds

On Practical Choice of Smoothing Parameter in Nonparametric Classification (베이즈 리스크를 이용한 커널형 분류에서 평활모수의 선택)

  • Kim, Rae-Sang;Kang, Kee-Hoon
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.2
    • /
    • pp.283-292
    • /
    • 2008
  • Smoothing parameter or bandwidth plays a key role in nonparametric classification based on kernel density estimation. We consider choosing smoothing parameter in nonparametric classification, which optimize the Bayes risk. Hall and Kang (2005) clarified the theoretical properties of smoothing parameter in terms of minimizing Bayes risk and derived the optimal order of it. Bootstrap method was used in their exploring numerical properties. We compare cross-validation and bootstrap method numerically in terms of optimal order of bandwidth. Effects on misclassification rate are also examined. We confirm that bootstrap method is superior to cross-validation in both cases.

Identification and Robust $H_\infty$ Control of the Rotational/Translational Actuator System

  • Tavakoli Mahdi;Taghirad Hamid D.;Abrishamchian Mehdi
    • International Journal of Control, Automation, and Systems
    • /
    • v.3 no.3
    • /
    • pp.387-396
    • /
    • 2005
  • The Rotational/Translational Actuator (RTAC) benchmark problem considers a fourth-order dynamical system involving the nonlinear interaction of a translational oscillator and an eccentric rotational proof mass. This problem has been posed to investigate the utility of a rotational actuator for stabilizing translational motion. In order to experimentally implement any of the model-based controllers proposed in the literature, the values of model parameters are required which are generally difficult to determine rigorously. In this paper, an approach to the least-squares estimation of the parameters of a system is formulated and practically applied to the RTAC system. On the other hand, this paper shows how to model a nonlinear system as a linear uncertain system via nonparametric system identification, in order to provide the information required for linear robust $H_\infty$ control design. This method is also applied to the RTAC system, which demonstrates severe nonlinearities, due to the coupling from the rotational motion to the translational motion. Experimental results confirm that this approach can effectively condense the whole nonlinearities, uncertainties, and disturbances within the system into a favorable perturbation block.

A Study On Variance Estimation in Smoothing Goodness-of-Fit Tests (평활 적합도 검정에서의 분산추정의 영향)

  • Yoon, Yong-Hwa;Kim, Jong-Tae;Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.9 no.2
    • /
    • pp.189-202
    • /
    • 1998
  • The goat of this paper is to study on variance estimation - Rice variance estimation, Gasser, Sroka and Jennen-Steinmetz's varince estimation - in smoothing goodness-of-fit tests. The comparisons of powers on test statistics are conducted by the change of variance, the number of oscillations, the amplitude of the alternative sample distribution.

  • PDF

Nonparametric Estimation of Mean Residual Life Function under Random Censorship

  • Park, Byung-Gu;Sohn, Joong-Kweon;Lee, Sang-Bock
    • Journal of the Korean Statistical Society
    • /
    • v.22 no.2
    • /
    • pp.147-157
    • /
    • 1993
  • In the survivla analysis the problem of estimating mean residual life function (MRLF) under random censoring is very important. In this paper we propose and study a nonparametric estimator of MRLF, which is a functional form based on the estimator of the survival function due to Susarla and Van Ryzin (1980). The proposed estimator is shown to be better than some other estimators in terms of mean square errors for the exponential and Weibull cases via Monte Carlo simulation studies.

  • PDF

Bayesian Methods for Wavelet Series in Single-Index Models

  • Park, Chun-Gun;Vannucci, Marina;Hart, Jeffrey D.
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 2005.04a
    • /
    • pp.83-126
    • /
    • 2005
  • Single-index models have found applications in econometrics and biometrics, where multidimensional regression models are often encountered. Here we propose a nonparametric estimation approach that combines wavelet methods for non-equispaced designs with Bayesian models. We consider a wavelet series expansion of the unknown regression function and set prior distributions for the wavelet coefficients and the other model parameters. To ensure model identifiability, the direction parameter is represented via its polar coordinates. We employ ad hoc hierarchical mixture priors that perform shrinkage on wavelet coefficients and use Markov chain Monte Carlo methods for a posteriori inference. We investigate an independence-type Metropolis-Hastings algorithm to produce samples for the direction parameter. Our method leads to simultaneous estimates of the link function and of the index parameters. We present results on both simulated and real data, where we look at comparisons with other methods.

  • PDF

Nonparametric estimation of the derivative of function via the Bezier curve (베지에 곡선을 이용한 함수의 미분에 대한 비모수적 추정)

  • 김충락;정미선;김형순
    • The Korean Journal of Applied Statistics
    • /
    • v.11 no.1
    • /
    • pp.193-204
    • /
    • 1998
  • It is quite that we have to estimate the derivative of the regression function. The Bezier curve, rarely known to statisticians, is very popular in computer graphics area. In this paper, we use nonparametric method via the Bezier curve, and apply this method to real data set. This method seems to be very easy to compute and can be easily applied to other smoothing techniques.

  • PDF

A SIMPLE VARIANCE ESTIMATOR IN NONPARAMETRIC REGRESSION MODELS WITH MULTIVARIATE PREDICTORS

  • Lee Young-Kyung;Kim Tae-Yoon;Park Byeong-U.
    • Journal of the Korean Statistical Society
    • /
    • v.35 no.1
    • /
    • pp.105-114
    • /
    • 2006
  • In this paper we propose a simple and computationally attractive difference-based variance estimator in nonparametric regression models with multivariate predictors. We show that the estimator achieves $n^{-1/2}$ rate of convergence for regression functions with only a first derivative when d, the dimension of the predictor, is less than or equal to 4. When d > 4, the rate turns out to be $n^{-4/(d+4)}$ under the first derivative condition for the regression functions. A numerical study suggests that the proposed estimator has a good finite sample performance.

Kernel Regression Estimation for Permutation Fixed Design Additive Models

  • Baek, Jangsun;Wehrly, Thomas E.
    • Journal of the Korean Statistical Society
    • /
    • v.25 no.4
    • /
    • pp.499-514
    • /
    • 1996
  • Consider an additive regression model of Y on X = (X$_1$,X$_2$,. . .,$X_p$), Y = $sum_{j=1}^pf_j(X_j) + $\varepsilon$$, where $f_j$s are smooth functions to be estimated and $\varepsilon$ is a random error. If $X_j$s are fixed design points, we call it the fixed design additive model. Since the response variable Y is observed at fixed p-dimensional design points, the behavior of the nonparametric regression estimator depends on the design. We propose a fixed design called permutation fixed design, and fit the regression function by the kernel method. The estimator in the permutation fixed design achieves the univariate optimal rate of convergence in mean squared error for any p $\geq$ 2.

  • PDF

On Choice of Kautz functions Pole and its Relation with Accuracy in System Identification

  • Bae, Chul-Min;Wada, Kiyoshi;Imai, Jun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1999.10a
    • /
    • pp.125-128
    • /
    • 1999
  • A linear time-invariant model can be described either by a parametric model or by a nonparametric model. Nonparametric models, for which a priori information is not necessary, are basically the response of the dynamic system such as impulse response model and frequency models. Parametric models, such as transfer function models, can be easily described by a small number of parameters. In this paper aiming to take benefit from both types of models, we will use linear-combination of basis fuctions in an impulse response using a few parameters. We will expand and generalize the Kautz functions as basis functions for dynamical system representations and we will consider estimation problem of transfer functions using Kautz function. And so we will present the influences of poles settings of Kautz function on the identification accuracy.

  • PDF

Direct Nonparametric Estimation of State Price Density with Regularized Mixture

  • Jeon, Yong-Ho
    • The Korean Journal of Applied Statistics
    • /
    • v.24 no.4
    • /
    • pp.721-733
    • /
    • 2011
  • We consider the state price densities that are implicit in financial asset prices. In the pricing of an option, the state price density is proportional to the second derivative of the option pricing function and this relationship together with no arbitrage principle imposes restrictions on the pricing function such as monotonicity and convexity. Since the state price density is a proper density function and most of the shape constraints are caused by this, we propose to estimate the state price density directly by specifying candidate densities in a flexible nonparametric way and applying methods of regularization under extra constraints. The problem is easy to solve and the resulting state price density estimates satisfy all the restrictions required by economic theory.