The Transactions of the Korean Institute of Electrical Engineers D (대한전기학회논문지:시스템및제어부문D)

The Korean Institute of Electrical Engineers (대한전기학회)
권호 표지

Genetically Optimized Self-Organizing Polynomial Neural Networks

진화론적 최적 자기구성 다항식 뉴럴 네트워크

  • 박호성 (원광대학 제어계측공학과) ;
  • 박병준 (원광대학 전기전자공학부) ;
  • 장성환 (원광대학 전기전자공학부) ;
  • 오성권 (원광대학 전기전자공학부)
  • Published : 2004.01.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Self-Organizing Polynomial Neural Networks(SOPNN), discuss a comprehensive design methodology and carry out a series of numeric experiments. The conventional SOPNN is based on the extended Group Method of Data Handling(GMDH) method and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons (or nodes) located in each layer through a growth process of the network. Moreover it does not guarantee that the SOPNN generated through learning has the optimal network architecture. But the proposed GA-based SOPNN enable the architecture to be a structurally more optimized network, and to be much more flexible and preferable neural network than the conventional SOPNN. In order to generate the structurally optimized SOPNN, GA-based design procedure at each stage (layer) of SOPNN leads to the selection of preferred nodes (or PNs) with optimal parameters- such as the number of input variables, input variables, and the order of the polynomial-available within SOPNN. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization (predictive) abilities of the model. A detailed design procedure is discussed in detail. To evaluate the performance of the GA-based SOPNN, the model is experimented with using two time series data (gas furnace and NOx emission process data of gas turbine power plant). A comparative analysis shows that the proposed GA-based SOPNN is model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

Keywords

References

  1. V. Cherkassky, D. Gehring, and F. Mulier, 'Comparison of adaptive methods for function estimation from samples', IEEE Trans. Neural Networks, vol. 7, pp. 969 984, July 1996 https://doi.org/10.1109/72.508939
  2. J. A. Dicherson and B. Kosko, 'Fuzzy function approximation with ellipsoidal rules', IEEE Trans. Syst., Man, Cybern, Part B, vol. 26, pp.542 560, Aug. 1996 https://doi.org/10.1109/3477.517030
  3. A. G. Ivakhnenko, 'Polynomial theory of complex systems', IEEE Trans. on Systems, Man and Cybernetics, Vol. SMC-1, pp. 364-378, 1971
  4. A. G. Ivakhnenko and H. R. Madala, Inductive Learning Algorithms for Complex Systems Modeling, CRC Press, London, 1994
  5. A. G. Ivakhnenko and G. A. Ivaknenko, 'The Review of Problems Solvable by Algorithms of the Group Method of Data Handling(GMDH)', Pattern Recognition and Image Analysis, Vol. 5, No.4, pp. 527-535, 1995
  6. A. G. Ivakhnenko, G. A. Ivaknenko and J.A. Muller, 'Self-organization of Neural Networks with Active Neurons', Pattern Recognition and Image Analysis, Vol. 4, No.2, pp. 185-196, 1994
  7. V. Sommer, P. Tobias, D. Kohl, H. Sundgreen, and L. Lundstrom, 'Neural networks and abductive networks for chemical sensor signals: A case comparison', Sensors and Actuators, B. 2S, pp. 217-222, 1995 https://doi.org/10.1016/0925-4005(95)01721-6
  8. S. Kleinsteuber and N. Sepehri, 'A polynomial network modeling approach to a class of large-scale hydraulic systems', Computers Elect. Eng. 22, pp. 151-168, 1996 https://doi.org/10.1016/0045-7906(95)00033-X
  9. S.-K. Oh and W. Pedrycz, 'The design of self-orgaruzmg Polynomial Neural Networks', Information Science, Vol. 141, pp. 237-258, 2002 https://doi.org/10.1016/S0020-0255(02)00175-5
  10. S.-K. Oh, W. Pedrycz and B.-J. Park, 'Polynomial Neural Networks Architecture: Analysis and Design', Computers and Electrical Engineering, Vol. 29, Issue 6, pp. 703-725, 2003 https://doi.org/10.1016/S0045-7906(02)00045-9
  11. Holland, J. H., Adatation In Natural and Artificial Systems. The University of Michigan Press, Ann Arbour. 1975
  12. D. E. Goldberg, Genetic Algorithm in search, Optimization & Machine Learning, Addison wesley, 1989
  13. K. De Jong. Are genetic algorithms function optimizer? In Proc. of PPSN II(Parallel Problem Solving from Nature), pages 3-13, Amsterdam, North Holland, 1992
  14. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, Berlin Heidelberg, 1996
  15. S.-K. Oh and W. Pedrycz, 'Identification of Fuzzy Systems by means of an Auto-Tuning Algorithm and Its Application to Nonlinear Systems', Fuzzy sets and Systems, Vol. 115, No.2, pp, 205-230, 2000 https://doi.org/10.1016/S0165-0114(98)00174-2
  16. D. E. Box and G. M. Jenkins, Time Series Analysis, Forcasting and Control, California: Holden Day, 1976
  17. G. Vachtsevanos, V. Ramani, and T. W. Hwang, 'Prediction of Gas Turbine NOx Emissions using Polynomial Neural Network', Technical Report, Georgia Institute of Technology, Atlanta, 1995
  18. R. M. Tong, 'The evaluation of fuzzy models derived from experimental data', Fuzzy Sets and Systems, Vol. 13, pp. 1-12, 1980 https://doi.org/10.1016/0165-0114(80)90059-7
  19. A. Sugeno and T. Yasukawa, 'A Fuzzy-Logic -Based Approach to Qualitative Modeling', IEEE Trans. Fuzzy Systems, Vol. 1, No.1, pp. 7-31, 1993 https://doi.org/10.1109/TFUZZ.1993.390281
  20. C. W. Xu, and Y. Zailu, 'Fuzzy model identification self-learning for dynamic system', IEEE Trans. on Syst, Man, Cybern., Vol. SMC-17, No.4, pp.683-689, 1987 https://doi.org/10.1109/TSMC.1987.289361
  21. W. Pedtycz, 'An identification algorithm in fuzzy relational system', Fuzzy Sets and Systems, Vol. 13, pp.153-167, 1984 https://doi.org/10.1016/0165-0114(84)90015-0
  22. E. T. Kim, H. J. Lee, M. K. Park and M. Park, 'A simple identified Sugeno-type fuzzy model via double clustering', Information Science 1l0, pp. 25-39, 1998 https://doi.org/10.1016/S0020-0255(97)10083-4
  23. Y. Lin, G. A. Cunningham Ⅲ, 'A new approach to fuzzy-neural modeling', IEEE Trans. Fuzzy Systems Vol. 3, No.2, pp. 190-197, 1995 https://doi.org/10.1109/91.388173
  24. T.-C. Ahn, S.-K. Oh, A thesis of emission pattern model about the atmosphere pollution material of a power plant, Electrical Engineering & Science Research Institute. Korea, 1997(in Korean)
  25. S.-K. Oh, W. Pedrycz and H.-S. Park, 'Hybrid Identification in Fuzzy-Neural Networks', Fuzzy Sets & Systems, Vol. 138, pp. 399-426, 2003 https://doi.org/10.1016/S0165-0114(02)00441-4
  26. S.- K. Oh, W. Pedrycz and H.-S. Park, 'Rule-based Multi-FNN Identification with the Aid of Evolutionary Fuzzy Granulation', Journal of Knowledge-Based Systems, 2003(In press) https://doi.org/10.1016/S0950-7051(03)00047-9
  27. H.-S. Park, B.-J. Park and S.-K. Oh, 'Optimal Design of Self-Organizing Polynomial Neural Networks By Means of Genetic Algorithms', Journal of the Research Institute of Engineering Technology Development, Vol. 22, pp. 111-121, 2002
  28. 오성권, 'C 프로그래밍에 의한 퍼지모델 및 제어시스템,' 내하출판사, 2002. 1
  29. 오성권, '프로그래밍에 의한 컴퓨터지능(퍼지, 신경회로망 및 유전자알고리즘을 중심으로)', 내하출판사, 2002. 8