• Title/Summary/Keyword: Kohonen's self-organizing map (SOM)

Search Result 9, Processing Time 0.022 seconds

Principal Components Self-Organizing Map PC-SOM (주성분 자기조직화 지도 PC-SOM)

  • 허명회
    • The Korean Journal of Applied Statistics
    • /
    • v.16 no.2
    • /
    • pp.321-333
    • /
    • 2003
  • Self-organizing map (SOM), a unsupervised learning neural network, has been developed by T. Kohonen since 1980's. Main application areas were pattern recognition and text retrieval. Because of that, it has not been spread to statisticians until late. Recently, SOM's are frequently drawn in data mining fields. Kohonen's SOM, however, needs improvements to become a statistician's standard tool. First, there should be a good guideline as for the size of map. Second, an enhanced visualization mode is wanted. In this study, principal components self-organizing map (PC-SOM), a modification of Kohonen's SOM, is proposed to meet such needs. PC-SOM performs one-dimensional SOM during the first stage to decompose input units into node weights and residuals. At the second stage, another one-dimensional SOM is applied to the residuals of the first stage. Finally, by putting together two stages, one obtains two-dimensional SOM. Such procedure can be easily expanded to construct three or more dimensional maps. The number of grid lines along the second axis is determined automatically, once that of the first axis is given by the data analyst. Furthermore, PC-SOM provides easily interpretable map axes. Such merits of PC-SOM are demonstrated with well-known Fisher's iris data and a simulated data set.

Validity Study of Kohonen Self-Organizing Maps

  • Huh, Myung-Hoe
    • Communications for Statistical Applications and Methods
    • /
    • v.10 no.2
    • /
    • pp.507-517
    • /
    • 2003
  • Self-organizing map (SOM) has been developed mainly by T. Kohonen and his colleagues as a unsupervised learning neural network. Because of its topological ordering property, SOM is known to be very useful in pattern recognition and text information retrieval areas. Recently, data miners use Kohonen´s mapping method frequently in exploratory analyses of large data sets. One problem facing SOM builder is that there exists no sensible criterion for evaluating goodness-of-fit of the map at hand. In this short communication, we propose valid evaluation procedures for the Kohonen SOM of any size. The methods can be used in selecting the best map among several candidates.

Enhancing Visualization in Self-Organizing Maps (SOM에서 개체의 시각화)

  • Um Ick-Hyun;Huh Myung-Hoe
    • The Korean Journal of Applied Statistics
    • /
    • v.18 no.1
    • /
    • pp.83-98
    • /
    • 2005
  • Exploring distributional patterns of multivariate data is very essential in understanding the characteristics of given data set, as well as in building plausible models for the data. For that purpose, low-dimensional visualization methods have been developed by many researchers along various directions. As one of methods, Kohonen's SOM (Self-Organizing Map) is prominent. SOM compresses the volume of the data, yields abstraction from the data and offers visual display on low-dimensional grids. Although it is proven quite effective, it has one undesirable property: SOM's display is discrete. In this study, we propose two techniques for enhancing quality of SOM's display, so that SOM's display becomes continuous. The proposed methods are demonstrated in two numerical examples.

Perceptron-like SOM : Generalization of SOM (퍼셉트론 형태의 SOM : SOM의 일반화)

  • Song, Geun-Bae;Lee, Haing-Sei
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.10
    • /
    • pp.3098-3104
    • /
    • 2000
  • This paper defiens a perceptron-like self-organizing map(PSOM) and show that PSOM is equivalent to Kohonen's self-organizing map(SOM) if target values of output neurons of PSOM are selected properly. This fact imphes that PSOM is a generalized SOM algorithm. This paper also show that if clustering is restricted to vector sets distributed on hypersphere with unit radius, SOM and dot-product SOM(DOSM) are equivalent algorithms. Therefore we conclude that DSOM is a special case of SOM, which in turn a special, case of PSOM.

  • PDF

A New Self-Organizing Map based on Kernel Concepts (자가 조직화 지도의 커널 공간 해석에 관한 연구)

  • Cheong Sung-Moon;Kim Ki-Bom;Hong Soon-Jwa
    • The KIPS Transactions:PartB
    • /
    • v.13B no.4 s.107
    • /
    • pp.439-448
    • /
    • 2006
  • Previous recognition/clustering algorithms such as Kohonen SOM(Self-Organizing Map), MLP(Multi-Layer Percecptron) and SVM(Support Vector Machine) might not adapt to unexpected input pattern. And it's recognition rate depends highly on the complexity of own training patterns. We could make up for and improve the weak points with lowering complexity of original problem without losing original characteristics. There are so many ways to lower complexity of the problem, and we chose a kernel concepts as an approach to do it. In this paper, using a kernel concepts, original data are mapped to hyper-dimension space which is near infinite dimension. Therefore, transferred data into the hyper-dimension are distributed spasely rather than originally distributed so as to guarantee the rate to be risen. Estimating ratio of recognition is based on a new similarity-probing and learning method that are proposed in this paper. Using CEDAR DB which data is written in cursive letters, 0 to 9, we compare a recognition/clustering performance of kSOM that is proposed in this paper with previous SOM.

A Comparative Study on Statistical Clustering Methods and Kohonen Self-Organizing Maps for Highway Characteristic Classification of National Highway (일반국도 도로특성분류를 위한 통계적 군집분석과 Kohonen Self-Organizing Maps의 비교연구)

  • Cho, Jun Han;Kim, Seong Ho
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.29 no.3D
    • /
    • pp.347-356
    • /
    • 2009
  • This paper is described clustering analysis of traffic characteristics-based highway classification in order to deviate from methodologies of existing highway functional classification. This research focuses on comparing the clustering techniques performance based on the total within-group errors and deriving the optimal number of cluster. This research analyzed statistical clustering method (Hierarchical Ward's minimum-variance method, Nonhierarchical K-means method) and Kohonen self-organizing maps clustering method for highway characteristic classification. The outcomes of cluster techniques compared for the number of samples and traffic characteristics from subsets derived by the optimal number of cluster. As a comprehensive result, the k-means method is superior result to other methods less than 12. For a cluster of more than 20, Kohonen self-organizing maps is the best result in the cluster method. The main contribution of this research is expected to use important the basic road attribution information that produced the highway characteristic classification.

Application of Self-Organizing Map for the Analysis of Rainfall-Runoff Characteristics (강우-유출특성 분석을 위한 자기조직화방법의 적용)

  • Kim, Yong Gu;Jin, Young Hoon;Park, Sung Chun
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.1B
    • /
    • pp.61-67
    • /
    • 2006
  • Various methods have been applied for the research to model the relationship between rainfall-runoff, which shows a strong nonlinearity. In particular, most researches to model the relationship between rainfall-runoff using artificial neural networks have used back propagation algorithm (BPA), Levenberg Marquardt (LV) and radial basis function (RBF). and They have been proved to be superior in representing the relationship between input and output showing strong nonlinearity and to be highly adaptable to rapid or significant changes in data. The theory of artificial neural networks is utilized not only for prediction but also for classifying the patterns of data and analyzing the characteristics of the patterns. Thus, the present study applied self?organizing map (SOM) based on Kohonen's network theory in order to classify the patterns of rainfall-runoff process and analyze the patterns. The results from the method proposed in the present study revealed that the method could classify the patterns of rainfall in consideration of irregular changes of temporal and spatial distribution of rainfall. In addition, according to the results from the analysis the patterns between rainfall-runoff, seven patterns of rainfall-runoff relationship with strong nonlinearity were identified by SOM.

Peach & Pit Volume Measurement and 3D Visualization using Magnetic Resonance Imaging Data (자기공명영상을 이용한 복숭아 및 씨의 부피 측정과 3차원 가시화)

  • 김철수
    • Journal of Biosystems Engineering
    • /
    • v.27 no.3
    • /
    • pp.227-234
    • /
    • 2002
  • This study was conducted to nondestructively estimate the volumetric information of peach and pit and to visualize the 3D information of internal structure from magnetic resonance imaging(MRI) data. Bruker Biospec 7T spectrometer operating at a proton reosonant frequency of 300 MHz was used for acquisition of MRI data of peach. Image processing algorithms and visualization techniques were implemented by using MATLAB (Mathworks) and Visualization Toolkit(Kitware), respectively. Thresholding algorithm and Kohonen's self organizing map(SOM) were applied to MRI data fur region segmentation. Volumetric information were estimated from segemented images and compared to the actual measurements. The average prediction errors of peach and pit volumes were 4.5%, 26.1%, respectively for the thresholding algorithm. and were 2.1%, 19.9%. respectively for the SOM. Although we couldn't get the statistically meaningful results with the limited number of samples, the average prediction errors were lower when the region segmentation was done by SOM rather than thresholding. The 3D visualization techniques such as isosurface construction and volume rendering were successfully implemented, by which we could nondestructively obtain the useful information of internal structures of peach.

Speech Visualization of Korean Vowels Based on the Distances Among Acoustic Features (음성특징의 거리 개념에 기반한 한국어 모음 음성의 시각화)

  • Pok, Gouchol
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.12 no.5
    • /
    • pp.512-520
    • /
    • 2019
  • It is quite useful to represent speeches visually for learners who study foreign languages as well as the hearing impaired who cannot directly hear speeches, and a number of researches have been presented in the literature. They remain, however, at the level of representing the characteristics of speeches using colors or showing the changing shape of lips and mouth using the animation-based representation. As a result of such approaches, those methods cannot tell the users how far their pronunciations are away from the standard ones, and moreover they make it technically difficult to develop such a system in which users can correct their pronunciation in an interactive manner. In order to address these kind of drawbacks, this paper proposes a speech visualization model based on the relative distance between the user's speech and the standard one, furthermore suggests actual implementation directions by applying the proposed model to the visualization of Korean vowels. The method extract three formants F1, F2, and F3 from speech signals and feed them into the Kohonen's SOM to map the results into 2-D screen and represent each speech as a pint on the screen. We have presented a real system implemented using the open source formant analysis software on the speech of a Korean instructor and several foreign students studying Korean language, in which the user interface was built using the Javascript for the screen display.