• 제목/요약/키워드: Neural Network. Clustering

검색결과 317건 처리시간 0.027초

비대칭 퍼지 학습률을 이용한 퍼지 신경회로망 모델 (Fuzzy Neural Network Model Using Asymmetric Fuzzy Learning Rates)

  • 김용수
    • 한국지능시스템학회논문지
    • /
    • 제15권7호
    • /
    • pp.800-804
    • /
    • 2005
  • 본 논문에서는 LVQ(Learning )rector Quantization)을 퍼지화한 새로운 퍼지 학습 법칙을 제안하였다. 퍼지 학습 법칙 3은 기존의 학습률 대신에 퍼지 학습률을 사용하였는데, 기존의 LVQ와는 달리 비대칭인 학습률을 사용하였다. 기존의 LVQ에서는 분류가 맞거나 틀렸을 때 같은 학습률을 사용하고 부호만 달랐으나, 새로운 퍼지 학습 법칙에서는 분류가 맞거나 틀렸을 때 부호가 다를 뿐만 아니라 학습률도 다르다. 이 새로운 퍼지 학습 법칙을 무감독 신경회로망인 improved IAFC (Integrated Adaptive Fuzzy Clustering) 신경회로망에 적용하여 감독 신경회로망으로 변형하였다. Improved IAFC 신경회로망은 유연성이 있으면서도 안정성이 있다. 제안한 supervised IAFC 신경회로망 3의 성능과 오류 역전파 신경회로망의 성능을 비교하기 위하여 iris 데이터를 사용하였는데, supervised IAFC 신경회로망 3가 오류 역전파 신경회로망보다 성능이 우수하였다.

Polynomial Fuzzy Radial Basis Function Neural Network Classifiers Realized with the Aid of Boundary Area Decision

  • Roh, Seok-Beom;Oh, Sung-Kwun
    • Journal of Electrical Engineering and Technology
    • /
    • 제9권6호
    • /
    • pp.2098-2106
    • /
    • 2014
  • In the area of clustering, there are numerous approaches to construct clusters in the input space. For regression problem, when forming clusters being a part of the overall model, the relationships between the input space and the output space are essential and have to be taken into consideration. Conditional Fuzzy C-Means (c-FCM) clustering offers an opportunity to analyze the structure in the input space with the mechanism of supervision implied by the distribution of data present in the output space. However, like other clustering methods, c-FCM focuses on the distribution of the data. In this paper, we introduce a new method, which by making use of the ambiguity index focuses on the boundaries of the clusters whose determination is essential to the quality of the ensuing classification procedures. The introduced design is illustrated with the aid of numeric examples that provide a detailed insight into the performance of the fuzzy classifiers and quantify several essentials design aspects.

PSO를 이용한 FCM 기반 RBF 뉴럴 네트워크의 최적화 (Optimization of FCM-based Radial Basis Function Neural Network Using Particle Swarm Optimization)

  • 최정내;김현기;오성권
    • 전기학회논문지
    • /
    • 제57권11호
    • /
    • pp.2108-2116
    • /
    • 2008
  • The paper concerns Fuzzy C-Means clustering based Radial Basis Function neural networks (FCM-RBFNN) and the optimization of the network is carried out by means of Particle Swarm Optimization(PSO). FCM-RBFNN is the extended architecture of Radial Basis Function Neural Network(RBFNN). In the proposed network, the membership functions of the premise part of fuzzy rules do not assume any explicit functional forms such as Gaussian, ellipsoidal, triangular, etc., so its resulting fitness values directly rely on the computation of the relevant distance between data points by means of FCM. Also, as the consequent part of fuzzy rules extracted by the FCM - RBFNN model, the order of four types of polynomials can be considered such as constant, linear, quadratic and modified quadratic. Weighted Least Square Estimator(WLSE) are used to estimates the coefficients of polynomial. Since the performance of FCM-RBFNN is affected by some parameters of FCM-RBFNN such as a specific subset of input variables, fuzzification coefficient of FCM, the number of rules and the order of polynomials of consequent part of fuzzy rule, we need the structural as well as parametric optimization of the network. In this study, the PSO is exploited to carry out the structural as well as parametric optimization of FCM-RBFNN. Moreover The proposed model is demonstrated with the use of numerical example and gas furnace data set.

Facial Expression Recognition with Fuzzy C-Means Clusstering Algorithm and Neural Network Based on Gabor Wavelets

  • Youngsuk Shin;Chansup Chung;Lee, Yillbyung
    • 한국감성과학회:학술대회논문집
    • /
    • 한국감성과학회 2000년도 춘계 학술대회 및 국제 감성공학 심포지움 논문집 Proceeding of the 2000 Spring Conference of KOSES and International Sensibility Ergonomics Symposium
    • /
    • pp.126-132
    • /
    • 2000
  • This paper presents a facial expression recognition based on Gabor wavelets that uses a fuzzy C-means(FCM) clustering algorithm and neural network. Features of facial expressions are extracted to two steps. In the first step, Gabor wavelet representation can provide edges extraction of major face components using the average value of the image's 2-D Gabor wavelet coefficient histogram. In the next step, we extract sparse features of facial expressions from the extracted edge information using FCM clustering algorithm. The result of facial expression recognition is compared with dimensional values of internal stated derived from semantic ratings of words related to emotion. The dimensional model can recognize not only six facial expressions related to Ekman's basic emotions, but also expressions of various internal states.

  • PDF

그룹 데크놀로지 기법을 이용한 폐제품의 리싸이클링 셀 형성 (Recycling Cell Formation using Group Technology for Disposal Products)

  • 서광규;김형준
    • 대한안전경영과학회:학술대회논문집
    • /
    • 대한안전경영과학회 2000년도 춘계학술대회
    • /
    • pp.111-123
    • /
    • 2000
  • The recycling cell formation problem means that disposal products are classified into recycling part families using group technology in their end of life phase. Disposal products have the uncertainties of product status by usage influences. Recycling cells are formed considering design, process and usage attributes. In this paper, a novel approach to the design of cellular recycling system is proposed, which deals with the recycling cell formation and assignment of identical products concurrently. Fuzzy clustering algorithm and Fuzzy-ART neural network are applied to describe the states of disposal product with the membership functions and to make recycling cell formation. This approach leads to recycling and reuse of the materials, components, and subassemblies and can evaluate the value at each cell of disposal products. Application examples are illustrated by disposal refrigerators, compared fuzzy clustering with Fuzzy-ART neural network performance in cell formation.

  • PDF

K-means Clustering for Environmental Indicator Survey Data

  • Park, Hee-Chang;Cho, Kwang-Hyun
    • 한국데이터정보과학회:학술대회논문집
    • /
    • 한국데이터정보과학회 2005년도 춘계학술대회
    • /
    • pp.185-192
    • /
    • 2005
  • There are many data mining techniques such as association rule, decision tree, neural network analysis, clustering, genetic algorithm, bayesian network, memory-based reasoning, etc. We analyze 2003 Gyeongnam social indicator survey data using k-means clustering technique for environmental information. Clustering is the process of grouping the data into clusters so that objects within a cluster have high similarity in comparison to one another. In this paper, we used k-means clustering of several clustering techniques. The k-means clustering is classified as a partitional clustering method. We can apply k-means clustering outputs to environmental preservation and environmental improvement.

  • PDF

방사형 기저 함수 기반 다항식 뉴럴네트워크 설계 (Design of RBF-based Polynomial Neural Network)

  • 김기상;진용하;오성권;김현기
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2009년도 정보 및 제어 심포지움 논문집
    • /
    • pp.261-263
    • /
    • 2009
  • 본 연구에서는 복잡한 비선형 모델링 방법인 RBF 뉴럴 네트워크(Radial Basis Function Neural Network)와 PNN(Polynomial Neural Network)을 접목한 새로운 형태의 Radial Basis Function Polynomial Neural Network(RPNN)를 제안한다. RBF 뉴럴 네트워크는 빠른 학습 시간, 일반화 그리고 단순화의 특징으로 비선형 시스템 모델링 등에 적용되고 있으며, PNN은 생성된 노드들 중에서 우수한 결과값을 가진 노드들을 선택함으로써 모델의 근사화 및 일반화에 탁월한 효과를 가진 비선형 모델링 방법이다. 제안된 RPNN모델의 기본적인 구조는 PNN의 형태를 이루고 있으며, 각각의 노드는 RBF 뉴럴 네트워크로 구성하였다. 사용된 RBF 뉴럴 네트워크에서의 커널 함수로는 FCM 클러스터링을 사용하였으며, 각 노드의 후반부는 다항식 구조로 표현하였다. 또한 각 노드의 후반부 파라미터들은 최소자승법을 이용하여 최적화 하였다. 제안한 모델의 적용 및 유용성을 비교 평가하기 위하여 비선형 데이터를 이용하여 그 우수성을 보인다.

  • PDF

클래스간의 거리를 고려한 학습법칙을 사용한 퍼지 신경회로망 모델 (Fuzzy Neural Network Model Using A Learning Rule Considering the Distances Between Classes)

  • 김용수;백용선;이세열
    • 한국지능시스템학회논문지
    • /
    • 제16권4호
    • /
    • pp.460-465
    • /
    • 2006
  • 본 논문은 입력 벡터와 클래스들의 대표값들간의 유클리디안 거리들을 사용한 새로운 퍼지 학습법칙을 제안한다. 이 새로운 퍼지 학습을 supervised IAFC(Integrated Adaptive Fuzzy Clustering) 신경회로망 4에 적용하였다. 이 신경회로망은 안정성을 유지하면서도 유연성을 가지고 있다. iris 데이터를 사용하여 테스트한 결과 supervised IAFC 신경회로망 4는 오류역전파 신경회로망과 LVQ 알고리듬보다 성능이 우수하였다.

불확실성을 고려한 퍼지 클러스터링 기반 퍼지뉴럴네트워크 설계 (Design of Fuzzy Neural Networks Based on Fuzzy Clustering with Uncertainty)

  • 박건준;김용갑;황근창
    • 한국인터넷방송통신학회논문지
    • /
    • 제17권1호
    • /
    • pp.173-181
    • /
    • 2017
  • 산업이 발달함에 따라서 빅데이터가 무수히 생산되고 있으며 이에 따라서 데이터에 내재된 불확실성도 증가하고 있다. 본 논문에서는 데이터에 내재된 불확실성을 다루기 위해 interval type-2 퍼지 클러스터링 방법을 제안하고 이를 이용하여 퍼지뉴럴네트워크를 설계하고 최적화한다. 제안한 클러스터링 방법을 이용하여 퍼지 규칙을 설계하고 학습을 수행한다. 최적화하는 방법으로서 유전자 알고리즘을 이용하고 모델 파라미터들을 최적 탐색한다. 실험에서는 두 가지 패턴 분류를 시행하였으며 두 가지 실험 모두 우수한 패턴 인식 결과를 보여준다. 제안한 네트워크는 증가하는 불확실성을 다룰 수 있는 방법을 제공할 수 있을 것이다.

Speaker Adaptation Using i-Vector Based Clustering

  • Kim, Minsoo;Jang, Gil-Jin;Kim, Ji-Hwan;Lee, Minho
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권7호
    • /
    • pp.2785-2799
    • /
    • 2020
  • We propose a novel speaker adaptation method using acoustic model clustering. The similarity of different speakers is defined by the cosine distance between their i-vectors (intermediate vectors), and various efficient clustering algorithms are applied to obtain a number of speaker subsets with different characteristics. The speaker-independent model is then retrained with the training data of the individual speaker subsets grouped by the clustering results, and an unknown speech is recognized by the retrained model of the closest cluster. The proposed method is applied to a large-scale speech recognition system implemented by a hybrid hidden Markov model and deep neural network framework. An experiment was conducted to evaluate the word error rates using Resource Management database. When the proposed speaker adaptation method using i-vector based clustering was applied, the performance, as compared to that of the conventional speaker-independent speech recognition model, was improved relatively by as much as 12.2% for the conventional fully neural network, and by as much as 10.5% for the bidirectional long short-term memory.