• 제목/요약/키워드: Kernel Approximation

검색결과 57건 처리시간 0.023초

Function Approximation Based on a Network with Kernel Functions of Bounds and Locality : an Approach of Non-Parametric Estimation

  • Kil, Rhee-M.
    • ETRI Journal
    • /
    • 제15권2호
    • /
    • pp.35-51
    • /
    • 1993
  • This paper presents function approximation based on nonparametric estimation. As an estimation model of function approximation, a three layered network composed of input, hidden and output layers is considered. The input and output layers have linear activation units while the hidden layer has nonlinear activation units or kernel functions which have the characteristics of bounds and locality. Using this type of network, a many-to-one function is synthesized over the domain of the input space by a number of kernel functions. In this network, we have to estimate the necessary number of kernel functions as well as the parameters associated with kernel functions. For this purpose, a new method of parameter estimation in which linear learning rule is applied between hidden and output layers while nonlinear (piecewise-linear) learning rule is applied between input and hidden layers, is considered. The linear learning rule updates the output weights between hidden and output layers based on the Linear Minimization of Mean Square Error (LMMSE) sense in the space of kernel functions while the nonlinear learning rule updates the parameters of kernel functions based on the gradient of the actual output of network with respect to the parameters (especially, the shape) of kernel functions. This approach of parameter adaptation provides near optimal values of the parameters associated with kernel functions in the sense of minimizing mean square error. As a result, the suggested nonparametric estimation provides an efficient way of function approximation from the view point of the number of kernel functions as well as learning speed.

  • PDF

A study on convergence and complexity of reproducing kernel collocation method

  • Hu, Hsin-Yun;Lai, Chiu-Kai;Chen, Jiun-Shyan
    • Interaction and multiscale mechanics
    • /
    • 제2권3호
    • /
    • pp.295-319
    • /
    • 2009
  • In this work, we discuss a reproducing kernel collocation method (RKCM) for solving $2^{nd}$ order PDE based on strong formulation, where the reproducing kernel shape functions with compact support are used as approximation functions. The method based on strong form collocation avoids the domain integration, and leads to well-conditioned discrete system of equations. We investigate the convergence and the computational complexity for this proposed method. An important result obtained from the analysis is that the degree of basis in the reproducing kernel approximation has to be greater than one for the method to converge. Some numerical experiments are provided to validate the error analysis. The complexity of RKCM is also analyzed, and the complexity comparison with the weak formulation using reproducing kernel approximation is presented.

ASYMPTOTIC APPROXIMATION OF KERNEL-TYPE ESTIMATORS WITH ITS APPLICATION

  • Kim, Sung-Kyun;Kim, Sung-Lai;Jang, Yu-Seon
    • Journal of applied mathematics & informatics
    • /
    • 제15권1_2호
    • /
    • pp.147-158
    • /
    • 2004
  • Sufficient conditions are given under which a generalized class of kernel-type estimators allows asymptotic approximation on the modulus of continuity. This generalized class includes sample distribution function, kernel-type estimator of density function, and an estimator that may apply to the censored case. In addition, an application is given to asymptotic normality of recursive density estimators of density function at an unknown point.

Asymptotic Approximation of Kernel-Type Estimators with Its Application

  • 장유선;김성래;김성균
    • 한국전산응용수학회:학술대회논문집
    • /
    • 한국전산응용수학회 2003년도 KSCAM 학술발표회 프로그램 및 초록집
    • /
    • pp.12.1-12
    • /
    • 2003
  • Sufficient conditions are given under which a generalized class of kernel-type estimators allows asymptotic approximation On the modulus of continuity This generalized class includes sample distribution function, kernel-type estimator of density function, and an estimator that may apply to the censored case. In addition, an application is given to asymptotic normality of recursive density estimators of density function at an unknown point.

  • PDF

Reproducing kernel based evaluation of incompatibility tensor in field theory of plasticity

  • Aoyagi, Y.;Hasebe, T.;Guan, P.C.;Chen, J.S.
    • Interaction and multiscale mechanics
    • /
    • 제1권4호
    • /
    • pp.423-435
    • /
    • 2008
  • This paper employs the reproducing kernel (RK) approximation for evaluation of field theory-based incompatibility tensor in a polycrystalline plasticity simulation. The modulation patterns, which is interpreted as mimicking geometrical-type dislocation substructures, are obtained based on the proposed method. Comparisons are made using FEM and RK based approximation methods among different support sizes and other evaluation conditions of the strain gradients. It is demonstrated that the evolution of the modulation patterns needs to be accurately calculated at each time step to yield a correct physical interpretation. The effect of the higher order strain derivative processing zone on the predicted modulation patterns is also discussed.

Localized particle boundary condition enforcements for the state-based peridynamics

  • Wu, C.T.;Ren, Bo
    • Coupled systems mechanics
    • /
    • 제4권1호
    • /
    • pp.1-18
    • /
    • 2015
  • The state-based peridynamics is considered a nonlocal method in which the equations of motion utilize integral form as opposed to the partial differential equations in the classical continuum mechanics. As a result, the enforcement of boundary conditions in solid mechanics analyses cannot follow the standard way as in a classical continuum theory. In this paper, a new approach for the boundary condition enforcement in the state-based peridynamic formulation is presented. The new method is first formulated based on a convex kernel approximation to restore the Kronecker-delta property on the boundary in 1-D case. The convex kernel approximation is further localized near the boundary to meet the condition that recovers the correct boundary particle forces. The new formulation is extended to the two-dimensional problem and is shown to reserve the conservation of linear momentum and angular momentum. Three numerical benchmarks are provided to demonstrate the effectiveness and accuracy of the proposed approach.

Localized particle boundary condition enforcements for the state-based peridynamics

  • Wu, C.T.;Ren, Bo
    • Interaction and multiscale mechanics
    • /
    • 제7권1호
    • /
    • pp.525-542
    • /
    • 2014
  • The state-based peridynamics is considered a nonlocal method in which the equations of motion utilize integral form as opposed to the partial differential equations in the classical continuum mechanics. As a result, the enforcement of boundary conditions in solid mechanics analyses cannot follow the standard way as in a classical continuum theory. In this paper, a new approach for the boundary condition enforcement in the state-based peridynamic formulation is presented. The new method is first formulated based on a convex kernel approximation to restore the Kronecker-delta property on the boundary in 1-D case. The convex kernel approximation is further localized near the boundary to meet the condition that recovers the correct boundary particle forces. The new formulation is extended to the two-dimensional problem and is shown to reserve the conservation of linear momentum and angular momentum. Three numerical benchmarks are provided to demonstrate the effectiveness and accuracy of the proposed approach.

함수근사를 위한 서포트 벡터 기계의 커널 애더트론 알고리즘 (Kernel Adatron Algorithm of Support Vector Machine for Function Approximation)

  • 석경하;황창하
    • 한국정보처리학회논문지
    • /
    • 제7권6호
    • /
    • pp.1867-1873
    • /
    • 2000
  • 함수근사는 과학과 고학부야에서 공범위하게 응용된다. 시포트 벡터 기계(support vector machine, SVM)는 원래 분류를 위해 계안되어져 문자인식, 얼굴인식 등의 응용분야에서 좋은 결과를 보여주고 있다. 최근 SVM이론 함수근사로 확장되어 많이 활용되려 하고 있다. 그러나 함수근사를 위한 SVM 알고리즘은 QP(quadratic proramming)문제와 관련되어있어 계산에 시간이 걸리며 QP를 위한 패키지가 있어야 한다. 본 논문에서는 함수근사를 위해 커널-애더트론 알고리즘을 이용한 SVM을 제안하고 QP를 이용한 SVM과 성능을 비교하고자 한다.

  • PDF

A Comparison on the Differential Entropy

  • Kim, Dae-Hak
    • Journal of the Korean Data and Information Science Society
    • /
    • 제16권3호
    • /
    • pp.705-712
    • /
    • 2005
  • Entropy is the basic concept of information theory. It is well defined for random varibles with known probability density function(pdf). For given data with unknown pdf, entropy should be estimated. Usually, estimation of entropy is based on the approximations. In this paper, we consider a kernel based approximation and compare it to the cumulant approximation method for several distributions. Monte carlo simulation for various sample size is conducted.

  • PDF

The Region of Positivity and Unimodality in the Truncated Series of a Nonparametric Kernel Density Estimator

  • Gupta, A.K.;Im, B.K.K.
    • Journal of the Korean Statistical Society
    • /
    • 제10권
    • /
    • pp.140-144
    • /
    • 1981
  • This paper approximates to a kernel density estimate by a truncated series of expansion involving Hermite polynomials, since this could ease the computing burden involved in the kernel-based density estimation. However, this truncated series may give a multimodal estimate when we are estiamting unimodal density. In this paper we will show a way to insure the truncated series to be positive and unimodal so that the approximation to a kernel density estimator would be maeningful.

  • PDF