• Title/Summary/Keyword: entropy theory

Search Result 184, Processing Time 0.024 seconds

A Study on the Presentation of Idea in Information and Entropy Theory in Vegetation Data (식피 Data 에 대한 Information 과 Entropy 이론의 실용연구)

  • Park, Seung Tai
    • The Korean Journal of Ecology
    • /
    • v.10 no.2
    • /
    • pp.91-107
    • /
    • 1987
  • This study is concerned with some methods and applications, used as a basis on information and entropy analysis of vegetation data. These methods are adopted for the evaluating the effect of sampling intensity on information, which repersnets the departure of observed variable from standard component. Classes on the data matrix are caluculated by using marginal dispersion array for rank and weighting information program. Finally the information and entropy are computed by applying seven options. On the application of vegetation studies, two models for cluster analysis and analysis of concentration are explained in detail. Cluster analysis is based on use of equivocation information and Rajski's metrics. The analysis of concentration utilizes coherence coefficience being transformed values, which has been adjusted from blocks and entropy values. The relationship btween three begetation clusters and four stands of Naejangsan data is highly significant in 79% of total variance. Cluster A relatively tends to prefer north side, and cluster C south side.

  • PDF

Entropy-based Correlation Clustering for Wireless Sensor Networks in Multi-Correlated Regional Environments

  • Nga, Nguyen Thi Thanh;Khanh, Nguyen Kim;Hong, Son Ngo
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.5 no.2
    • /
    • pp.85-93
    • /
    • 2016
  • The existence of correlation characteristics brings significant potential advantages to the development of efficient routing protocols in wireless sensor networks. This research proposes a new simple method of clustering sensor nodes into correlation groups in multiple-correlation areas. At first, the evaluation of joint entropy for multiple-sensed data is considered. Based on the evaluation, the definition of correlation region, based on entropy theory, is proposed. Following that, a correlation clustering scheme with less computation is developed. The results are validated with a real data set.

Determination of Optimal Pressure Monitoring Locations for Water Distribution Systems using Entropy Theory (엔트로피 이론을 이용한 상수관망의 최적 압력 계측 위치 결정)

  • Chung, Gun-Hui;Chang, Dong-Eil;Yoo, Do-Guen;Jun, Hwan-Don;Kim, Joong-Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.42 no.7
    • /
    • pp.537-546
    • /
    • 2009
  • Determination of optimal pressure monitoring location is essential to manage water distribution system efficiently and safely. In this study, entropy theory is applied to overcome defects of previous researches about determining the optimal sensor location. The previous studies required the calibration using historical data, therefore, it was difficult to apply the proposed method in the place where the enough data were not available. Also, most researches have focused on the locations to minimize cost and maximize accuracy of the model, which is not appropriate for the purpose of maintenance of the water distribution system. The proposed method in this study quantify the entropy which is defined as the amount of information calculated from the pressure change due to the variation of discharge. When abnormal condition is occurred in a node, the effect on the entire network is presented by the entropy, and the emitter is used to reproduce actual pressure change pattern in EPANET. The optimal location to install pressure sensors in water distribution system is the nodes having the maximum information from other nodes. The looped and branched networks are evaluated using the proposed model. As a result, entropy theory provides general guideline to select the locations to install pressure sensors and the results can be used to help decision makers.

A note on entropy defined by Choquet integral on interval-valued fuzzy sets (구간치 퍼지집합상에서 쇼케이적분에 의해 정의된 엔트로피에 관한 연구)

  • Jang, Lee-Chae
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.17 no.2
    • /
    • pp.149-153
    • /
    • 2007
  • In this paper, we consider interval-valued fuzzy sets which were suggested by Wang and Li(1998) and Turksen(1986) and investigate entropy defined by Choquet integral on interval-valued fuzzy sets. Furthermore, we discuss some properties of them and give some examples related this entropy. This tool has drawn much attention due to numerous applications areas, such as decision making and information theory on interval-valued fuzzy sets.

The Weather Representativeness in Changma Period Established by the Weather Entropy and Information Ratio - Focused on Seoul, Taegu, Gwangju, Chungju, Puyo - (일기엔트로피 및 정보비에 의한 장마기의 일기대표성 설정 - 서울, 대구, 광주, 충주, 부여를 중심으로 -)

  • 박현욱;문병채
    • Journal of Environmental Science International
    • /
    • v.12 no.4
    • /
    • pp.399-417
    • /
    • 2003
  • The seasonal variation and frequency of rainfalls of Korea peninsula in Changma period show strong local weather phenomenon because of it's topographical and geographical factors in Northeast side of Asia. Based on weather entropy(statistical parameter)-the amount of average weather information-and information ratio, we can define each area's weather representativeness, which can show us more constant form included topographical and geographical factors and seasonal variation. The data used for this study are the daily precipitation and cloudiness during the recent ten years(1990-1999) at the 73 stations in Korea. To synthesize weather Entropy, information ratio of decaying tendency and half$.$decay distance, Seoul's weather representativeness has the smallest in Summer Changma period. And Puyo has the largest value in September.

Effect of Nonlinear Transformations on Entropy of Hidden Nodes

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.10 no.1
    • /
    • pp.18-22
    • /
    • 2014
  • Hidden nodes have a key role in the information processing of feed-forward neural networks in which inputs are processed through a series of weighted sums and nonlinear activation functions. In order to understand the role of hidden nodes, we must analyze the effect of the nonlinear activation functions on the weighted sums to hidden nodes. In this paper, we focus on the effect of nonlinear functions in a viewpoint of information theory. Under the assumption that the nonlinear activation function can be approximated piece-wise linearly, we prove that the entropy of weighted sums to hidden nodes decreases after piece-wise linear functions. Therefore, we argue that the nonlinear activation function decreases the uncertainty among hidden nodes. Furthermore, the more the hidden nodes are saturated, the more the entropy of hidden nodes decreases. Based on this result, we can say that, after successful training of feed-forward neural networks, hidden nodes tend not to be in linear regions but to be in saturated regions of activation function with the effect of uncertainty reduction.

Selecting on the Preferred Alternatives of the MADM Problems using the Entropy Measure (엔트로피 척도를 이용한 MADM 문제의 선호대안 선정)

  • 이강인
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.26 no.2
    • /
    • pp.55-61
    • /
    • 2003
  • The purpose of this paper is to propose a method for selecting the preferred alternatives of Multiple- Attribute Decision-Making(MADM) problem using the Entropy measure. A decision-maker who wants to estimate exactly the weight to be applied to her/his MADM problem is usually confronted with the embarrassing situation where, although there exist a variety of weighting methods, it is hard to find a right procedure to choose a pertinent value To remedy this uncomfortable situation, the Entropy measure commonly used in information theory, Is proposed as a tool that can be used by decision-makers to more efficiently select the preferred alternatives. As a result, the method proposed in the paper can be significant in that relatively easy to understand by decision-makers.

Robust Entropy Based Voice Activity Detection Using Parameter Reconstruction in Noisy Environment

  • Han, Hag-Yong;Lee, Kwang-Seok;Koh, Si-Young;Hur, Kang-In
    • Journal of information and communication convergence engineering
    • /
    • v.1 no.4
    • /
    • pp.205-208
    • /
    • 2003
  • Voice activity detection is a important problem in the speech recognition and speech communication. This paper introduces new feature parameter which are reconstructed by spectral entropy of information theory for robust voice activity detection in the noise environment, then analyzes and compares it with energy method of voice activity detection and performance. In experiments, we confirmed that spectral entropy and its reconstructed parameter are superior than the energy method for robust voice activity detection in the various noise environment.

A Study on the Analysis of Part Commonality and Redundancy in a Product Line by Entropy Measure (엔트로피 척도(尺度)를 이용(利用)한 제품(製品)라인의 부품 (部品) 공통성(共通性) 및 중복성(重複性) 분석(分析)에 관(關)한 연구(硏究))

  • Ro, Jae-Ho
    • Journal of Industrial Technology
    • /
    • v.3
    • /
    • pp.39-46
    • /
    • 1983
  • This paper presents a quantitative measure of the degree of part commonality and redundancy in a product line based on entropy measure of information theory. The several possible methods of analysis are discussed and the use of the entropy measure is discussed. These commonality and redundancy measure can be applied to analyze the usage pattern of part across a product line and to determine which parts have the broadest usage across the firm's product lines. An analysis of the results by entropy statistics is compared with the practical part usage in a simulation of several types of part usage's distributions.

  • PDF

Evaluation of Raingauge Networks in the Soyanggang Dam River Basin (소양강댐 유역의 강우관측망 적정성 평가)

  • Kim, Jae-Bok;Bae, Young-Dae;Park, Bong-Jin;Kim, Jae-Han
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2007.05a
    • /
    • pp.178-182
    • /
    • 2007
  • In this study, we evaluated current raingauge network of Soyanggang dam region applying spatial-correlation analysis and Entropy theory to recommend an optimized raingauge network. In the process of analysis, correlation distance of raingauge stations is estimated and evaluated via spatial-correlation method and entropy method. From this correlation distances, respective influencing radii of each dataset and each methods is assessed. The result of correlation and entropy analysis has estimated correlation distance of 25.546km and influence radius of 7.206km, deducing a decrease of network density from $224.53km^2$ to $122.47km^2$ which satisfy the recommended minimum densities of $250km^2$ in mountainous regions(WMO, 1994) and an increase of basin coverage from 59.3% to 86.8%. As for the elevation analysis the relative evaluation ratio increased from 0.59(current) to 0.92(optimized) resulting an obvious improvement.

  • PDF