• Title/Summary/Keyword: Density estimation function

Search Result 303, Processing Time 0.031 seconds

Online Probability Density Estimation of Nonstationary Random Signal using Dynamic Bayesian Networks

  • Cho, Hyun-Cheol;Fadali, M. Sami;Lee, Kwon-Soon
    • International Journal of Control, Automation, and Systems
    • /
    • v.6 no.1
    • /
    • pp.109-118
    • /
    • 2008
  • We present two estimators for discrete non-Gaussian and nonstationary probability density estimation based on a dynamic Bayesian network (DBN). The first estimator is for off line computation and consists of a DBN whose transition distribution is represented in terms of kernel functions. The estimator parameters are the weights and shifts of the kernel functions. The parameters are determined through a recursive learning algorithm using maximum likelihood (ML) estimation. The second estimator is a DBN whose parameters form the transition probabilities. We use an asymptotically convergent, recursive, on-line algorithm to update the parameters using observation data. The DBN calculates the state probabilities using the estimated parameters. We provide examples that demonstrate the usefulness and simplicity of the two proposed estimators.

Multidimensional Spectral Estimation by Modal Decomposition

  • Ping, Liu-Wei
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.33.5-33
    • /
    • 2001
  • We consider here the problem of spectral estimation of multidimensional wide sense stationary (WSS) random process. A method, employing a special difference equation of correlation function, is proposed to solve the problem of multidimensional spectral estimation. In this approach, the special difference equation of correlation function is derived by modal decomposition method. Maximum likelihood estimator and Kalman filter are used to estimate the model parameters of the difference equation and the decomposed spectral residues. An algorithm is presented to estimate the multidimensional spectral density. According to the result of the simulation, these methods are feasible to estimate the spectral density of WSS process, which is realized by finite dimensional multivariable lineal system driven by white noise.

  • PDF

Moment of the ratio and approximate MLEs of parameters in a bivariate Pareto distribution

  • Kim, Jungdae
    • Journal of the Korean Data and Information Science Society
    • /
    • v.23 no.6
    • /
    • pp.1213-1222
    • /
    • 2012
  • We shall derive the moment of the ratio Y/(X + Y) and the reliability P(X < Y ), and then observe the skewness of the ratio in a bivariate Pareto density function of (X, Y). And we shall consider an approximate MLE of parameters in the bivariate Pareto density function.

On the Selection of Bezier Points in Bezier Curve Smoothing

  • Kim, Choongrak;Park, Jin-Hee
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.6
    • /
    • pp.1049-1058
    • /
    • 2012
  • Nonparametric methods are often used as an alternative to parametric methods to estimate density function and regression function. In this paper we consider improved methods to select the Bezier points in Bezier curve smoothing that is shown to have the same asymptotic properties as the kernel methods. We show that the proposed methods are better than the existing methods through numerical studies.

Wakeby Distribution and the Maximum Likelihood Estimation Algorithm in Which Probability Density Function Is Not Explicitly Expressed

  • Park Jeong-Soo
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.443-451
    • /
    • 2005
  • The studied in this paper is a new algorithm for searching the maximum likelihood estimate(MLE) in which probability density function is not explicitly expressed. Newton-Raphson's root-finding routine and a nonlinear numerical optimization algorithm with constraint (so-called feasible sequential quadratic programming) are used. This algorithm is applied to the Wakeby distribution which is importantly used in hydrology and water resource research for analysis of extreme rainfall. The performance comparison between maximum likelihood estimates and method of L-moment estimates (L-ME) is studied by Monte-carlo simulation. The recommended methods are L-ME for up to 300 observations and MLE for over the sample size, respectively. Methods for speeding up the algorithm and for computing variances of estimates are discussed.

Improving Sample Entropy Based on Nonparametric Quantile Estimation

  • Park, Sang-Un;Park, Dong-Ryeon
    • Communications for Statistical Applications and Methods
    • /
    • v.18 no.4
    • /
    • pp.457-465
    • /
    • 2011
  • Sample entropy (Vasicek, 1976) has poor performance, and several nonparametric entropy estimators have been proposed as alternatives. In this paper, we consider a piecewise uniform density function based on quantiles, which enables us to evaluate entropy in each interval, and study the poor performance of the sample entropy in terms of the poor estimation of lower and upper quantiles. Then we propose some improved entropy estimators by simply modifying the quantile estimators, and compare their performances with some existing estimators.

The Exponentiated Weibull-Geometric Distribution: Properties and Estimations

  • Chung, Younshik;Kang, Yongbeen
    • Communications for Statistical Applications and Methods
    • /
    • v.21 no.2
    • /
    • pp.147-160
    • /
    • 2014
  • In this paper, we introduce the exponentiated Weibull-geometric (EWG) distribution which generalizes two-parameter exponentiated Weibull (EW) distribution introduced by Mudholkar et al. (1995). This proposed distribution is obtained by compounding the exponentiated Weibull with geometric distribution. We derive its cumulative distribution function (CDF), hazard function and the density of the order statistics and calculate expressions for its moments and the moments of the order statistics. The hazard function of the EWG distribution can be decreasing, increasing or bathtub-shaped among others. Also, we give expressions for the Renyi and Shannon entropies. The maximum likelihood estimation is obtained by using EM-algorithm (Dempster et al., 1977; McLachlan and Krishnan, 1997). We can obtain the Bayesian estimation by using Gibbs sampler with Metropolis-Hastings algorithm. Also, we give application with real data set to show the flexibility of the EWG distribution. Finally, summary and discussion are mentioned.

Kernel Inference on the Inverse Weibull Distribution

  • Maswadah, M.
    • Communications for Statistical Applications and Methods
    • /
    • v.13 no.3
    • /
    • pp.503-512
    • /
    • 2006
  • In this paper, the Inverse Weibull distribution parameters have been estimated using a new estimation technique based on the non-parametric kernel density function that introduced as an alternative and reliable technique for estimation in life testing models. This technique will require bootstrapping from a set of sample observations for constructing the density functions of pivotal quantities and thus the confidence intervals for the distribution parameters. The performances of this technique have been studied comparing to the conditional inference on the basis of the mean lengths and the covering percentage of the confidence intervals, via Monte Carlo simulations. The simulation results indicated the robustness of the proposed method that yield reasonably accurate inferences even with fewer bootstrap replications and it is easy to be used than the conditional approach. Finally, a numerical example is given to illustrate the densities and the inferential methods developed in this paper.

A Study of Establishment of Parameter and Modeling for Yield Estimation (수율 예측을 위한 변수 설정과 모델링에 대한 연구)

  • 김흥식;김진수;김태각;최민성
    • Journal of the Korean Institute of Telematics and Electronics A
    • /
    • v.30A no.2
    • /
    • pp.46-52
    • /
    • 1993
  • The estimation of yield for semiconductor devices requires not only establishment of critical area but also a new parameter of process defect density that contains inspection mean defect density related cleanness of manufacure process line, minimum feature size and the total number of mask process. We estimate the repaired yield of memory devide, leads the semiconductor technique, repaired by redundancy scheme in relation with defect density distribution function, and we confirm the repaired yield for different devices as this model. This shows the possibility of the yield estimation as statistical analysis for the condition of device related cleanness of manufacture process line, design and manufacture process.

  • PDF

Lagged Cross-Correlation of Probability Density Functions and Application to Blind Equalization

  • Kim, Namyong;Kwon, Ki-Hyeon;You, Young-Hwan
    • Journal of Communications and Networks
    • /
    • v.14 no.5
    • /
    • pp.540-545
    • /
    • 2012
  • In this paper, the lagged cross-correlation of two probability density functions constructed by kernel density estimation is proposed, and by maximizing the proposed function, adaptive filtering algorithms for supervised and unsupervised training are also introduced. From the results of simulation for blind equalization applications in multipath channels with impulsive and slowly varying direct current (DC) bias noise, it is observed that Gaussian kernel of the proposed algorithm cuts out the large errors due to impulsive noise, and the output affected by the DC bias noise can be effectively controlled by the lag ${\tau}$ intrinsically embedded in the proposed function.