• Title/Summary/Keyword: Maximum Entropy

Search Result 335, Processing Time 0.022 seconds

A Study on Power Spectral Estimation of Background EEG with Pisarenko Harmonic Decomposition (Pisarenko Harmonic Decomposition에 의한 배경 뇌파 파워 스팩트럼 추정에 관한 연구)

  • Jeong, Myeong-Jin;Hwang, Su-Yong;Choe, Gap-Seok
    • Journal of Biomedical Engineering Research
    • /
    • v.8 no.1
    • /
    • pp.69-74
    • /
    • 1987
  • The power spectrum of background EEG is estimated by the Plsarenko Harmonic Decomposition with the stochastic process whlch consists of the nonhamonic sinus Bid and the white nosie. The estimation results are examined and compared with the results from the maximum entropy spectral extimation, and the optimal order of this from the maximum entropy spectral extimation, and the optimal order of this model can be determined from the eigen value's fluctuation of autocorrelation of background EEG. From the comparing results, this method is possible to estimate the power spectrum of background EEG.

  • PDF

Classification Learning Data using Maximum Entropy Theory (최대 엔트로피 이론을 이용한 학습 데이터 분류)

  • Kim, Min-Woo;Kim, Dong-Hyun;Lee, Byung-Jun;Kim, Kyung-Tae;Youn, Hee-Yong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2018.07a
    • /
    • pp.213-214
    • /
    • 2018
  • 빅 데이터 활용의 증가로 인해 효율적으로 데이터를 분류하는 것은 머신러닝의 주요 과제이다. 제한적인 자원을 가지고 이에 맞는 처리능력을 갖기 위해서는 단일 기기의 자원 관리능력을 향상시키는 방향의 연구가 필요하다. 본 논문에서는 머신러닝을 위한 학습 데이터를 최대 엔트로피 이론을 적용시켜 효과적으로 분류하는 방법을 제안한다. 최대 엔트로피에 대한 간단한 설명과 최대 엔트로피 이론을 적용시키기 위한 간단한 사전 작업들의 방향 등에 대한 설명을 토대로 기술하였다. 또한 본 연구를 통해 얻게 된 문제점들과 향후 연구에 필요한 피드백을 갖는다.

  • PDF

Maximum Entropy Power Spectral Estimation of Two-Dimensional Signal (2차원 신호의 최대 정보량을 갖는 전력 스펙트럼 추정)

  • Sho, Sang-Ho;Kim, Chong-Kyo;Lee, Moon-Ho
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.34 no.3
    • /
    • pp.107-114
    • /
    • 1985
  • This paper presents the iterative algorithm for obtaining the ME PSE(Maximum Entropy Power Spectral Estimation) of 2-dimensional signals. This problem involves a correction matching power spectral estimate that can be represented as the reciprocal of the spectral of 2-dimensional signals. This requires two matrix inversion every iterations. Thus, we compensate the matrix to be constantly positive definite with relaxational parameters. Using Row/Column decomposition Discrete Fourier Transform, we can decrease a calculation quantity. Using Lincoln data and white noise, this paper examines ME PSE algorithms. Finally, the results output at the graphic display device. The 2-dimensional data have the 3-dimensional axis components, and, this paper develops 3-dimensional graphic output algorithms using 2-dimensional DGL(Device Independent Graphic Library) which is prepared for HP-1000 F-series computer.

  • PDF

Design of High Speed Binary Arithmetic Encoder for CABAC Encoder (CABAC 부호화기를 위한 고속 이진 산술 부호화기의 설계)

  • Park, Seungyong;Jo, Hyungu;Ryoo, Kwangki
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.4
    • /
    • pp.774-780
    • /
    • 2017
  • This paper proposes an efficient binary arithmetic encoder hardware architecture for CABAC encoding, which is an entropy coding method of HEVC. CABAC is an entropy coding method that is used in HEVC standard. Entropy coding removes statistical redundancy and supports a high compression ratio of images. However, the binary arithmetic encoder causes a delay in real time processing and parallel processing is difficult because of the high dependency between data. The operation of the proposed CABAC BAE hardware structure is to separate the renormalization and process the conventional iterative algorithm in parallel. The new scheme was designed as a four-stage pipeline structure that can reduce critical path optimally. The proposed CABAC BAE hardware architecture was designed with Verilog HDL and implemented in 65nm technology. Its gate count is 8.07K and maximum operating speed of 769MHz. It processes the four bin per clock cycle. Maximum processing speed increased by 26% from existing hardware architectures.

A Goodness of Fit Tests Based on the Partial Kullback-Leibler Information with the Type II Censored Data

  • Park, Sang-Un;Lim, Jong-Gun
    • Proceedings of the Korean Statistical Society Conference
    • /
    • 2003.10a
    • /
    • pp.233-238
    • /
    • 2003
  • Goodness of fit test statistics based on the information discrepancy have been shown to perform very well (Vasicek 1976, Dudewicz and van der Meulen 1981, Chandra et al 1982, Gohkale 1983, Arizona and Ohta 1989, Ebrahimi et al 1992, etc). Although the test is well defined for the non-censored case, censored case has not been discussed in the literature. Therefore we consider a goodness of fit test based on the partial Kullback-Leibler(KL) information with the type II censored data. We derive the partial KL information of the null distribution function and a nonparametric distribution function, and establish a goodness of fit test statistic. We consider the exponential and normal distributions and made Monte Calro simulations to compare the test statistics with some existing tests.

  • PDF

SAMPLE ENTROPY IN ESTIMATING THE BOX-COX TRANSFORMATION

  • Rahman, Mezbahur;Pearson, Larry M.
    • Journal of the Korean Data and Information Science Society
    • /
    • v.12 no.1
    • /
    • pp.103-125
    • /
    • 2001
  • The Box-Cox transformation is a well known family of power transformation that brings a set of data into agreement with the normality assumption of the residuals and hence the response variable of a postulated model in regression analysis. This paper proposes a new method for estimating the Box-Cox transformation using maximization of the Sample Entropy statistic which forces the data to get closer to normal as much as possible. A comparative study of the proposed procedure with the maximum likelihood procedure, the procedure via artificial regression estimation, and the recently introduced maximization of the Shapiro-Francia W' statistic procedure is given. In addition, we generate a table for the optimal spacings parameter in computing the Sample Entropy statistic.

  • PDF

MAXIMUM POWER ENTROPY METHOD FOR LOW CONTRAST IMAGES

  • CHAE JONG-CHUL;YUN HONG SIK
    • Journal of The Korean Astronomical Society
    • /
    • v.27 no.2
    • /
    • pp.191-201
    • /
    • 1994
  • We propose to use the entropy of power spectra defined in the frequency domain for the deconvolution of extended images. Spatial correlations requisite for extended sources may be insured by increasing the role of power entropy because the power is just a representation of spatial correlations in the frequency domain. We have derived a semi-analytical solution which is found to severely reduce computing time compared with other iteration schemes. Even though the solution is very similar to the well-known Wiener filter, the regularizingng term in the new expression is so insensitive to the noise characteristics as to assure a stable solution. Applications have been made to the IRAS $60{\mu}m\;and\;100{\mu}m$ images of the dark cloud B34 and the optical CCD image of a solar active region containing a circular sunspot and a small pore.

  • PDF

Probability Distribution of Nonlinear Random Wave Heights Using Maximum Entropy Method (최대 엔트로피 방법을 이용한 비선형 불규칙 파고의 확률분포함수)

  • 안경모
    • Journal of Korean Society of Coastal and Ocean Engineers
    • /
    • v.10 no.4
    • /
    • pp.204-210
    • /
    • 1998
  • This paper presents the development of the probability density function applicable for wave heights (peak-to-trough excursions) in finite water depth including shallow water depth. The probability distribution applicable to wave heights of a non-Gaussian random process is derived based on the concept of the maximum entropy method. When wave heights are limited by breaking wave heights (or water depth) and only first and second moments of wave heights are given, the probability density function developed is closed form and expressed in terms of wave parameters such as $H_m$(mean wave height), $H_{rms}$(root-mean-square wave height), $H_b$(breaking wave height). When higher than third moment of wave heights are given, it is necessary to solve the system of nonlinear integral equations numerically using Newton-Raphson method to obtain the parameters of probability density function which is maximizing the entropy function. The probability density function thusly derived agrees very well with the histogram of wave heights in finite water depth obtained during storm. The probability density function of wave heights developed using maximum entropy method appears to be useful in estimating extreme values and statistical properties of wave heights for the design of coastal structures.

  • PDF