• Title/Summary/Keyword: Bayesian Predictive Likelihood Estimation

Search Result 4, Processing Time 0.019 seconds

Integration of Multi-spectral Remote Sensing Images and GIS Thematic Data for Supervised Land Cover Classification

  • Jang Dong-Ho;Chung Chang-Jo F
    • Korean Journal of Remote Sensing
    • /
    • v.20 no.5
    • /
    • pp.315-327
    • /
    • 2004
  • Nowadays, interests in land cover classification using not only multi-sensor images but also thematic GIS information are increasing. Often, although useful GIS information for the classification is available, the traditional MLE (maximum likelihood estimation techniques) does not allow us to use the information, due to the fact that it cannot handle the GIS data properly. This paper propose two extended MLE algorithms that can integrate both remote sensing images and GIS thematic data for land-cover classification. They include modified MLE and Bayesian predictive likelihood estimation technique (BPLE) techniques that can handle both categorical GIS thematic data and remote sensing images in an integrated manner. The proposed algorithms were evaluated through supervised land-cover classification with Landsat ETM+ images and an existing land-use map in the Gongju area, Korea. As a result, the proposed method showed considerable improvements in classification accuracy, when compared with other multi-spectral classification techniques. The integration of remote sensing images and the land-use map showed that overall accuracy indicated an improvement in classification accuracy of 10.8% when using MLE, and 9.6% for the BPLE. The case study also showed that the proposed algorithms enable the extraction of the area with land-cover change. In conclusion, land cover classification results produced through the integration of various GIS spatial data and multi-spectral images, will be useful to involve complementary data to make more accurate decisions.

Statistical Inference in Non-Identifiable and Singular Statistical Models

  • Amari, Shun-ichi;Amari, Shun-ichi;Tomoko Ozeki
    • Journal of the Korean Statistical Society
    • /
    • v.30 no.2
    • /
    • pp.179-192
    • /
    • 2001
  • When a statistical model has a hierarchical structure such as multilayer perceptrons in neural networks or Gaussian mixture density representation, the model includes distribution with unidentifiable parameters when the structure becomes redundant. Since the exact structure is unknown, we need to carry out statistical estimation or learning of parameters in such a model. From the geometrical point of view, distributions specified by unidentifiable parameters become a singular point in the parameter space. The problem has been remarked in many statistical models, and strange behaviors of the likelihood ratio statistics, when the null hypothesis is at a singular point, have been analyzed so far. The present paper studies asymptotic behaviors of the maximum likelihood estimator and the Bayesian predictive estimator, by using a simple cone model, and show that they are completely different from regular statistical models where the Cramer-Rao paradigm holds. At singularities, the Fisher information metric degenerates, implying that the cramer-Rao paradigm does no more hold, and that he classical model selection theory such as AIC and MDL cannot be applied. This paper is a first step to establish a new theory for analyzing the accuracy of estimation or learning at around singularities.

  • PDF

Hazard Rate Estimation from Bayesian Approach (베이지안 확률 모형을 이용한 위험률 함수의 추론)

  • Kim, Hyun-Mook;Ahn, Seon-Eung
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.28 no.3
    • /
    • pp.26-35
    • /
    • 2005
  • This paper is intended to compare the hazard rate estimations from Bayesian approach and maximum likelihood estimate(MLE) method. Hazard rate frequently involves unknown parameters and it is common that those parameters are estimated from observed data by using MLE method. Such estimated parameters are appropriate as long as there are sufficient data. Due to various reasons, however, we frequently cannot obtain sufficient data so that the result of MLE method may be unreliable. In order to resolve such a problem we need to rely on the judgement about the unknown parameters. We do this by adopting the Bayesian approach. The first one is to use a predictive distribution and the second one is a method called Bayesian estimate. In addition, in the Bayesian approach, the prior distribution has a critical effect on the result of analysis, so we introduce the method using computerized-simulation to elicit an effective prior distribution. For the simplicity, we use exponential and gamma distributions as a likelihood distribution and its natural conjugate prior distribution, respectively. Finally, numerical examples are given to illustrate the potential benefits of the Bayesian approach.

Bayesian analysis of an exponentiated half-logistic distribution under progressively type-II censoring

  • Kang, Suk Bok;Seo, Jung In;Kim, Yongku
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.6
    • /
    • pp.1455-1464
    • /
    • 2013
  • This paper develops maximum likelihood estimators (MLEs) of unknown parameters in an exponentiated half-logistic distribution based on a progressively type-II censored sample. We obtain approximate confidence intervals for the MLEs by using asymptotic variance and covariance matrices. Using importance sampling, we obtain Bayes estimators and corresponding credible intervals with the highest posterior density and Bayes predictive intervals for unknown parameters based on progressively type-II censored data from an exponentiated half logistic distribution. For illustration purposes, we examine the validity of the proposed estimation method by using real and simulated data.