Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Application of a Neuro-Fuzzy System Trained by Evolution Strategy to Nonlinear System Identification

진화전략으로 학습되는 뉴로퍼지 시스템의 비선형 시스템 동정에의 응용

  • Jeong, Seong-Hun (School of Information and Computer Engineering Hansung University)
  • Published : 2002.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a new neuro-fuzzy system that is fast trained by evolution strategy and describes application results of the proposed system to nonlinear system identification to show its usefulness. As training methods of neuro-fuzzy systems, modified error back-propagation algorithms and genetic algorithms have been used so far. However, the former has some drawbacks such as long training time, falling to local optimum, and experimental selecting of learning rates and the latter has difficulty in precise searching solutions because genetic algorithms represents solutions as genotype individuals. The evolution strategy we used can do precise search because its individuals are represented as phenotype real values, it seldom falls into a local optimum, and its training speed is faster than error back-propagation algorithms. We apply our neuro-fuzzy systems to nonlinear system identification. It was found from experiments that training speed is fast and the training results were considerably good.

본 논문에서는 진화전략을 이용하여 빠르게 학습하는 새로운 구조의 뉴로퍼지 시스템을 제안하고 제안한 시스템의 효용성을 입증하기 위하여 비선형 시스템 동정에 응용한 결과를 설명한다. 뉴로퍼지 시스템의 학습 방법으로는 지금까지 주로 변형된 오류역전파 알고리즘과 최적화 기법인 유전자 알고리즘이 많이 사용되어왔으나, 오류역전파 알고리즘은 학습시간이 많이 걸리며 유전자 알고리즘은 해를 유전형 형태로 표현함으로 인하여 미세한 탐색이 힘든 단점이 있었다. 본 논문에서 사용한 진화전력은 해를 표현형의 개체로 나타내어 실수형태로 진화하기 대문에 미세한 탐색이 가능하며 오류역전파 알고리즘에 비해 지역해에 빠질 가능성이 작고 속도가 빠른 장점이 있다. 제안한 뉴로퍼지 시스템을 비선형 시스템 동정에 적용한 결과 학습속도가 빠르며 학습결과도 우수함을 보았다.

Keywords

References

  1. D. Nauck, 'Beyond neuro-fuzzy: Perspectives and directions,' in Proc if the Third European Congress on Intelligent Techniques and Soft Computing (EUFIT '95), pp. 1159-1163, 1995
  2. c. -J. IIN, 'SISO Nonlinear System Identificatio Using A Fuzzy-neural Hybrid System,' International journal if Neural Systems, Vol. 8, pp.325-337, June 1997 https://doi.org/10.1142/S0129065797000331
  3. W. A. Farag, V. H. Quintana, and G. Lambert-Torres, 'A Genetic-Based Neuro-Fuzzy Approach for Modeling and Control of Dynamical Systems,' IEEE Trans. on Neural Networks, Vol. 9, pp. 756-767, Sept. 1998 https://doi.org/10.1109/72.712150
  4. S. K. Pal and S. Mitra, eds., Neuro-Fuzzy Pattern Recognition-Methods in Sift Computing. John Wile & Sons, 1999
  5. K. S. Narendra and K. Parthasarathy, 'Identification and Control of Dynamical Systems Using Neural Networks,' IEEE Trans. on Neural Networks, Vol. 1, pp. 4-27, Mar. 1990 https://doi.org/10.1109/72.80202
  6. J. Kim and N. Kasabov, 'HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems,' Neural Networks, Vol. 12, pp. 1301-1319, 1999 https://doi.org/10.1016/S0893-6080(99)00067-2
  7. Fabrizio, 'Evolutionary Neural Fuzzy Systems for Noise Cancellation in Image Data,' IEEE Trans. on Instrumentation and Measurement, Vol. 48, pp. 915-920, Oct. 1999 https://doi.org/10.1109/19.799647
  8. C.-H. Lee and C.-C. Teng, 'Identification and Control of Dynamic Systems Using Recurrent Fuzzy Neural Networks,' IEEE Transactions on Fuzzy Systems, Vol. 8, pp. 349-366, Aug. 2000 https://doi.org/10.1109/91.868943
  9. D. Nauck and R. Kruse, 'New learning strategies for nefclass,' in Proc Seventh International Fuzzy Systems Association World Congress IFSA '97, pp. 50-55, 1997
  10. D. Nauck and R. Kruse, 'A neuro-fuzzy approach to obtain interpretable fuzzy systems for function approximation,' in Proc IEEE International Conference on Fuzzy Systems (FUZZ IEEE '98), pp. 1106-1111, 1998 https://doi.org/10.1109/FUZZY.1998.686273
  11. T. L. Seng, M B. Khalid, and R. Yusof, 'Tuning of a Neuro-Fuzzy Controller by Genetic Algorithm,' IEEE Trans. on Systems, Man and Cybernetics, Vol. 29, pp. 226-236, Apr. 1999 https://doi.org/10.1109/3477.752795
  12. D. B. Fogel, 'An Introduction to Simulated Evolutionary Optimization,' IEEE Trans. on Neural Networks, Vol. 5, pp. 3-14, Jan. 1994 https://doi.org/10.1109/72.265956
  13. S. H. Jung, K. H. Cho, T. G. Kim, and K H Park, 'Defuzzification Method for Multishaped Output Fuzzy Sets,' Electronics Letters, Vol. 30, pp. 740-742, Apr. 1994 https://doi.org/10.1049/el:19940468