DOI QR코드

DOI QR Code

Neuro-Fuzzy Modeling based on Self-Organizing Clustering

자기구성 클러스터링 기반 뉴로-퍼지 모델링

  • Kim Sung-Suk (Chungbuk National University School of Electrical and Electronic Engineering Research Institute for Computer and Information , Communication) ;
  • Ryu Jeong-Woong (Chungbuk National University School of Electrical and Electronic Engineering Research Institute for Computer and Information , Communication) ;
  • Kim Yong-Tae (Department of Information & Control Engineering, Hankyong National University)
  • 김승석 (충북대학교 전기전자공학부, 컴퓨터 정보통신 연구소) ;
  • 유정웅 (충북대학교 전기전자공학부, 컴퓨터 정보통신 연구소) ;
  • 김용태 (한경대학교 정보제어공학과, 전자기술종합연구소)
  • Published : 2005.12.01

Abstract

In this Paper, we Propose a new neuro-fuzzy modeling using clustering-based learning method. In the proposed clustering method, number of clusters is automatically inferred and its parameters are optimized simultaneously, Also, a neuro-fuzzy model is learned based on clustering information at same time. In the previous modelling method, clustering and model learning are performed independently and have no exchange of its informations. However, in the proposed method, overall neuro-fuzzy model is generated by using both clustering and model learning, and the information of modelling output is used to clustering of input. The proposed method improve the computational load of modeling using Subtractive clustering method. Simulation results show that the proposed method has an effectiveness compared with the previous methods.

본 논문에서는 클러스터링을 뉴로-퍼지 모델에 직접 적용하여 모델을 최적화하는 방법을 제안하였다. 기존의 오차미분기반 학습을 통한 뉴로-퍼지 모델의 최적화 과정과는 달리 제안된 방법은 클러스터링 학습과 연계하여 모델을 구성하며 자율적으로 클러스터의 수를 추정하며 동시에 최적화를 수행한다. 순차적인 학습 기법에서는 각각의 학습 기법을 따로 적용하여 모델링을 실시하였으나 제안된 기법에서는 하나의 클러스터링 학습으로 전체 모델의 학습을 실시하였다. 또한 제안된 방법에서는 클러스터링이 수렴하는 만큼 전체 모델의 연산량이 감소하여 학습과정에서 발생하는 연산량 문제를 개선하였다. 시뮬레이션을 통하여 기존의 연구 결과들과 비교하여 제안된 기법의 유용성을 보였다.

Keywords

References

  1. C. T. Lin, C. S. G. Lee, ;Neural fuzzy Systems : A Neuro-Fuzzy Synergism to Intelligent Systems', Prentice Hall, 1996
  2. J. S. R. Jang, C. T. Sun, E. Mizutani, 'Neuro-Fuzzy and Soft Computing : A Computational Approach to Learning and Machine Intelligence', Prentice Hall, 1997
  3. Kazuo Tanaka and Hua O. Wang, Fuzzy Control Systems Design and Analysis : A Linear Matrix Inequality Approach, John Wiley & Sons, 2001
  4. 김승석, 곽근창, 유정웅, 전명근,'계층적 클러스터링 과 Gaussian Mixture Model을 이용한 뉴로-퍼지 모 델링,' 한국퍼지및지능시스템학회 논문지, Vol. 13, No. 5, pp. 512-519, 2003
  5. J. S. R. Jang, 'ANFIS : Adaptive Network-based Fuzzy Inference System', IEEE Trans on System, Man, and Cybernetics, Vol.23, No. 3, pp. 665-685, 1993 https://doi.org/10.1109/21.256541
  6. R. R. Yager and D. P. Filev,,'Generation of Fuzzy Rules by Mountain Clustering', Jounal of Intelligent and Fuzzy System, Vol.2, pp. 209-219, 1994
  7. G. Xuan, W. Zhang, and P. Chai, 'EM algorithm of Gaussian Mixture Model and Hidden Markov Model', International Conference on Image Processing Proceeding, Vol. 1, pp. 145-148. 2001
  8. Jeff Bilms, 'A Gentle Tutorial of the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models', ICSI TR-97-021, April 1998
  9. Ching-Chang Wong, Chia-Chong Chen, and Mu-Chun Su, 'A novel algorithm for data clustering', Pattern Recognition, Vol. 34, Issue. 2, pp. 425-442, 2001 https://doi.org/10.1016/S0031-3203(00)00002-9
  10. Ching-Chang Wong and Chia-Chong Chen, 'A Hybrid Clustering and Gradient Descent Approach for Fuzzy Modeling', IEEE Trans on Systems, Man, and Cybernetics-Part B : Cybernetics, Vol. 29, No.6, pp. 686-693, 1999
  11. Witold Pedrycz, 'An Identification Algorithm in Fuzzy Relational Systems', Fuzzy Sets and Systems, Vol. 13, No. 2, pp. 153-167, 1984 https://doi.org/10.1016/0165-0114(84)90015-0
  12. C. Xu and L. Lu, Fuzzy model Identification and Self-Learning for Dynamic Systems, IEEE Trans on Systems, Man and Cybernetics, Vol. SMC-17, pp. 683-689, 1987
  13. M. Sugeno and K. Tanaka,'Successive Identification of a Fuzzy Model and Its Application to Prediction of a Complex System', Fuzzy Sets and Systems, Vol. 42, pp. 315-334, 1991 https://doi.org/10.1016/0165-0114(91)90110-C
  14. J. Abonyi, L. Nagy, and F. Szeifert, 'Adaptive Fuzzy Inference Systems and Its Application in Modeling Based Control', Chemical Engineering Research and Design, Trans IChemE, Vol. 77A, pp. 281-290, 1999
  15. Janos Abonyi, Robert Babuska, and Ferenc Szeifert, 'Fuzzy Modeling With Multivariate Membership Functions : Gray-Box Identification and Control Design', IEEE Trans on. Systems,Man, and Cybernetics-Part B : Cybernetics, Vol. 31, No. 5, pp. 755-767, 2001 https://doi.org/10.1109/3477.956037
  16. S. R. Jang, 'Input Selection for ANFIS Learning', Proceeding of Fifth IEEE International Conference on Fuzzy Systems, Vol. 2, pp. 8-11, 1996
  17. S. K. Oh and Witold Pedrycz, 'Identification of Fuzzy System by Means of an Auto-Tuning Algorithm and Its Application to Nonlinear Systems', Fuzzy Sets and Systems, Vol. 115, No. 2, pp. 205-230, 2000 https://doi.org/10.1016/S0165-0114(98)00174-2
  18. 김승석, 김성수, 유정웅, '새로운 클러스터링 알고리즘을 적용한 향상된 뉴로-퍼지 모델링', 대한전기학 회 논문지, Vol. 53D, No. 7, pp. 536-543, 2004