• Title/Summary/Keyword: entropy method

Search Result 858, Processing Time 0.034 seconds

Analysis of an Inverse Heat Conduction Problem Using Maximum Entropy Method (최대엔트로피법을 이용한 역열전도문제의 해석)

  • Kim, Sun-Kyoung;Lee, Woo-Il
    • Proceedings of the KSME Conference
    • /
    • 2000.04b
    • /
    • pp.144-147
    • /
    • 2000
  • A numerical method for the solution of one-dimensional inverse heat conduction problem is established and its performance is demonstrated with computational results. The present work introduces the maximum entropy method in order to build a robust formulation of the inverse problem. The maximum entropy method finds the solution that maximizes the entropy functional under given temperature measurement. The philosophy of the method is to seek the most likely inverse solution. The maximum entropy method converts the inverse problem to a non-linear constrained optimization problem of which constraint is the statistical consistency between the measured temperature and the estimated temperature. The successive quadratic programming facilitates the maximum entropy estimation. The gradient required fur the optimization procedure is provided by solving the adjoint problem. The characteristic feature of the maximum entropy method is discussed with the illustrated results. The presented results show considerable resolution enhancement and bias reduction in comparison with the conventional methods.

  • PDF

Voice Activity Detection Based on Entropy in Noisy Car Environment (차량 잡음 환경에서 엔트로피 기반의 음성 구간 검출)

  • Roh, Yong-Wan;Lee, Kue-Bum;Lee, Woo-Seok;Hong, Kwang-Seok
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.9 no.2
    • /
    • pp.121-128
    • /
    • 2008
  • Accurate voice activity detection have a great impact on performance of speech applications including speech recognition, speech coding, and speech communication. In this paper, we propose methods for voice activity detection that can adapt to various car noise situations during driving. Existing voice activity detection used various method such as time energy, frequency energy, zero crossing rate, and spectral entropy that have a weak point of rapid. decline performance in noisy environments. In this paper, the approach is based on existing spectral entropy for VAD that we propose voice activity detection method using MFB(Met-frequency filter banks) spectral entropy, gradient FFT(Fast Fourier Transform) spectral entropy. and gradient MFB spectral entropy. FFT multiplied by Mel-scale is MFB and Mel-scale is non linear scale when human sound perception reflects characteristic of speech. Proposed MFB spectral entropy method clearly improve the ability to discriminate between speech and non-speech for various in noisy car environments that achieves 93.21% accuracy as a result of experiments. Compared to the spectral entropy method, the proposed voice activity detection gives an average improvement in the correct detection rate of more than 3.2%.

  • PDF

An Improved Cross Entropy-Based Frequency-Domain Spectrum Sensing (Cross Entropy 기반의 주파수 영역에서 스펙트럼 센싱 성능 개선)

  • Ahmed, Tasmia;Gu, Junrong;Jang, Sung-Jeen;Kim, Jae-Moung
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.48 no.3
    • /
    • pp.50-59
    • /
    • 2011
  • In this paper, we present a spectrum sensing method by exploiting the relationship of previous and current detected data sets in frequency domain. Most of the traditional spectrum sensing methods only consider the current detected data sets of Primary User (PU). Previous state of PU is a kind of conditional probability that strengthens the reliability of the detector. By considering the relationship of the previous and current spectrum sensing, cross entropy-based spectrum sensing is proposed to detect PU signal more effectively, which has a strengthened performance and is robust. When previous detected signal is noise, the discriminating ability of cross entropy-based spectrum sensing is no better than conventional entropy-based spectrum sensing. To address this problem, we propose an improved cross entropy-based frequency-domain spectrum sensing. Regarding the spectrum sensing scheme, we have derived that the proposed method is superior to the cross entropy-based spectrum sensing. We proceed a comparison of the proposed method with the up-to-date entropy-based spectrum sensing in frequency-domain. The simulation results demonstrate the performance improvement of the proposed spectrum sensing method.

A Study on the Entropy Evaluation Method for Time-Dependent Noise Sources of Windows Operating System and It's Applications (윈도우 운영체제의 시간 종속 잡음원에 대한 엔트로피 평가 방법 연구)

  • Kim, Yewon;Yeom, Yongjin
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.28 no.4
    • /
    • pp.809-826
    • /
    • 2018
  • The entropy evaluation method for noise sources is one of the evaluation methods for the random number generator that is the essential element of modern cryptographic systems and cryptographic modules. The primary entropy evaluation methods outside of the country are more suitable to apply to hardware noise sources than software noise sources, and there is a difficulty in quantitative evaluation of entropy by software noise source. In this paper, we propose an entropy evaluation method that is suitable for software noise sources, considering characteristics of software noise sources. We select time-dependent noise sources that are software noise sources of Windows OS, and the heuristic analysis and experimental analysis are performed considering the characteristics of each time-dependent noise source. Based on these analyses, we propose an entropy harvest method from the noise source and the min-entropy estimation method as the entropy evaluation method for time-dependent noise sources. We also show how to use our entropy evaluation method in the Conditioning Component described in SP 800-90B of NIST(USA).

A Study on the Macro-Scopic Spray Characteristic of Homogeneous Degree for the GDI Injector According to Mixture(Gasoline-Diesel) Ratio Using Mie-Scattering Method and the Entropy Analysis (Mie 산란 방법과 엔트로피 해석 방법을 이용한 혼합연료비에 따른 분무 균질도 특성에 관한 연구)

  • Lee, Chang-Hee;Lee, Ki-Hyung;Lee, Chang-Sik;;Bae, Jae-Il
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.27 no.1
    • /
    • pp.69-75
    • /
    • 2003
  • In this study, his technique was applied to a GDI spray in order to investigate the mixture distribution. In addition, the homogeneity degree and diffusion effect according to ambient temperature in the high pressure chamber were analyzed by using an entropy analysis method. From this experiment, we could find that entropy analysis is very effective method for the analysis of mixture formation, and the entropy values increase with the progress of uniformity in diffusion Process. we tried to provide the fundamental data for parameter which effects on the spray macroscopic characteristics with mixture ratio of diesel and gasoline. In addition, the mixture formation was analyzed by using entropy analysis. The entropy analysis is based on the concept of statistical entropy, and it identifies the degree of homogeneity in the fuel concentration. From the entropy analysis results we could find that the direct diffusion phenomena is a dominant factor in the formation of a homogeneous mixture at downstream of GDI spray especially in vaporizing conditions. As to increasing ambient temperature and increasing gasoline rate, the entropy intensity using the statistic thermodynamics method is increased because evaporation rate is higher gasoline than diesel.

A Consideration on Easter Convergence and Higher Reliability of The New Blind Equalization Algorithm using The Minimum Entropy Method

  • Matsumoto, Hiroki;Kusakari, Shinya;Furukawa, Toshihiro
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1467-1470
    • /
    • 2002
  • The minimum entropy method is one of blind equalization method. A conventional algorithm using the minimum entropy method has two problems : slower convergence and lower reliability of recovered signals. We propose a new algorithm using the minimum entropy method for solving the two problems. Pina31y, we confirm the validity of the proposed algorithm through computer simulation.

  • PDF

Reliability evaluation of water distribution network considering mechanical characteristics using informational entropy

  • Kashani, Mostafa Ghanbari;Hosseini, Mahmood;Aziminejad, Armin
    • Structural Engineering and Mechanics
    • /
    • v.58 no.1
    • /
    • pp.21-38
    • /
    • 2016
  • Many studies have been carried out to investigate the important factors in calculating the realistic entropy amount of water distribution networks, but none of them have considered both mechanical and hydraulic characteristics of the networks. Also, the entropy difference in various networks has not been calculated exactly. Therefore, this study suggested a modified entropy function to calculate the informational entropy of water distribution networks so that the order of demand nodes and entropy difference among various networks could be calculated by taking into account both mechanical and hydraulic characteristics of the network. This modification was performed through defining a coefficient in the entropy function as the amount of outflow at each node to all dissipated power in the network. Hence, a more realistic method for calculating entropy was presented by considering both mechanical and hydraulic characteristics of network while keeping simplicity. The efficiency of the suggested method was evaluated by calculating the entropy of some sample water networks using the modified function.

Entropy-Constrained Temporal Decomposition (엔트로피 제한 조건을 갖는 시간축 분할)

  • Lee Ki-Seung
    • The Journal of the Acoustical Society of Korea
    • /
    • v.24 no.5
    • /
    • pp.262-270
    • /
    • 2005
  • In this paper, a new temporal decomposition method is proposed. where not oniy distortion but also entropy are involved in segmentation. The interpolation functions and the target feature vectors are determined by a dynamic Programing technique. where both distortion and entropy are simultaneously minimized. The interpolation functions are built by using a training speech corpus. An iterative method. where segmentation and estimation are iteratively performed. finds the locally optimum Points in the sense of minimizing both distortion and entropy. Simulation results -3how that in terms of both distortion and entropy. the Proposed temporal decomposition method Produced superior results to the conventional split vector-quantization method which is widely employed in the current speech coding methods. According to the results from the subjective listening test, the Proposed method reveals superior Performance in terms of qualify. comparing to the Previous vector quantization method.

Entropy and AMBE-based Threshold Selection (엔트로피 및 평균밝기오차의 절대값에 기반한 임계값 결정)

  • Kwon, Soon-H.
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.3
    • /
    • pp.347-352
    • /
    • 2011
  • Entropy used for measuring the richness in details of the image and absolute mean brightness error(AMBE) providing a change in the image global appearance are two quantitative measures generally used for measuring quality of images. In this paper, we propose an entropy and AMBE-based thresholding method to binalize a given image. The effectiveness of the proposed method is demonstrated by thresholding experiments on nine test images and comparison with other conventional thresholding methods, that is, Otsu method and entropy-based method.

A Comparison on the Differential Entropy

  • Kim, Dae-Hak
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.3
    • /
    • pp.705-712
    • /
    • 2005
  • Entropy is the basic concept of information theory. It is well defined for random varibles with known probability density function(pdf). For given data with unknown pdf, entropy should be estimated. Usually, estimation of entropy is based on the approximations. In this paper, we consider a kernel based approximation and compare it to the cumulant approximation method for several distributions. Monte carlo simulation for various sample size is conducted.

  • PDF