전기학회논문지 (The Transactions of The Korean Institute of Electrical Engineers)

  • 제60권2호
  • /
  • Pages.398-406
  • /
  • 2011
  • /
  • 1975-8359(pISSN)
  • /
  • 2287-4364(eISSN)
대한전기학회 (The Korean Institute of Electrical Engineers)
권호 표지
DOI QR코드

DOI QR Code

입자 군집 최적화 알고리즘 기반 다항식 신경회로망의 설계

Design of Particle Swarm Optimization-based Polynomial Neural Networks

  • 투고 : 2010.07.02
  • 심사 : 2010.09.24
  • 발행 : 2011.02.01
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

In this paper, we introduce a new architecture of PSO-based Polynomial Neural Networks (PNN) and discuss its comprehensive design methodology. The conventional PNN is based on a extended Group Method of Data Handling (GMDH) method, and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons located in each layer through a growth process of the network. Moreover it does not guarantee that the conventional PNN generated through learning results in the optimal network architecture. The PSO-based PNN results in a structurally optimized structure and comes with a higher level of flexibility that the one encountered in the conventional PNN. The PSO-based design procedure being applied at each layer of PNN leads to the selection of preferred PNs with specific local characteristics (such as the number of input variables, input variables, and the order of the polynomial) available within the PNN. In the sequel, two general optimization mechanisms of the PSO-based PNN are explored: the structural optimization is realized via PSO whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the PSO-based PNN, the model is experimented with using Gas furnace process data, and pH neutralization process data. For the characteristic analysis of the given entire data with non-linearity and the construction of efficient model, the given entire system data is partitioned into two type such as Division I(Training dataset and Testing dataset) and Division II(Training dataset, Validation dataset, and Testing dataset). A comparative analysis shows that the proposed PSO-based PNN is model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

키워드

참고문헌

  1. V. Rouss, W. Charon, and G. Cirrincione, "Neural model of the dynamic behaviour of a non-linear mechanical system," Mechanical Systems and Signal Processing, Vol 23, pp. 1145-1159, 2009. https://doi.org/10.1016/j.ymssp.2008.09.004
  2. A. Tortum, and N. Yayla, "The modeling of mode choices of intercity freight transportation with the artificial neural networks and adaptive neuro-fuzzy inference system," Expert Systems with Applications, Vol 36, Issue 3, Part 2, pp. 6199-6217, 2009. https://doi.org/10.1016/j.eswa.2008.07.032
  3. M. Khashei, S. R. Hejazi, and M. Bijari, "A new hybrid artificial neural networks and fuzzy regression model for time series forecasting," Fuzzy Sets and Systems, Volume 159, Issue 7, pp. 769-786, 2008. https://doi.org/10.1016/j.fss.2007.10.011
  4. A. G. Ivahnenko, "Polynomial theory of complex systems," IEEE Trans. on Systems, Man and Cybernetics, Vol. SMC-1, pp. 364-378, 1971. https://doi.org/10.1109/TSMC.1971.4308320
  5. S. K. Oh and W. Pedrycz, "The Design of Self-Organizing Polynomial Neural Networks," Information Sciences, Vol. 141, pp. 237-258, 2002. https://doi.org/10.1016/S0020-0255(02)00175-5
  6. S. K. Oh, T. C. Ahn, and W. Pedrycz, "Fuzzy Polynomial Neural Networks-Based Structure and Its Application to Nonlinear Process Systems," 7th IFSA World Conference, Vol. 2, pp. 495-499, 1997.
  7. S. K. Oh, W. Pedrycz, and B. J. Park, "Polynomial Neural Networks Architecture : Analysis and Design," Computers and Electrical Engineering. Vol. 29, No. 6, pp. 703-725, 2003. https://doi.org/10.1016/S0045-7906(02)00045-9
  8. 박호성, 박병준, 장성환, 오성권 "진화론적 최적 자기구성 다항식 뉴럴 네트워크," 전기학회 논문지, Vol. 53D, No. 1, pp. 40-49, 2004.
  9. 김완수, 이인태, 오성권, 김현기, "유전자 알고리즘 기반 최적 다항식 뉴럴네트워크 연구 및 비선형 공정으로의 응용," 퍼지 및 지능시스템학회 논문지, Vol 15, No 7, pp 846-851, 2005.
  10. S. K. Oh, W. Pedrycz, and S. B. Roh, "Hybrid fuzzy set-based polynomial neural networks and their development with the aid of genetic optimization and information granulation," Applied Soft Computing Journal, Vol. 9, No. 3, pp.1068-1089, 2009. https://doi.org/10.1016/j.asoc.2009.02.007
  11. S. K. Oh, W. Pedrycz, and H. S. Park, "Genetically optimized fuzzy polynomial neural networks," IEEE Trans. Fuzzy Syst., Vol. 14, No. 1, pp. 124-144, 2006.
  12. 박병준, 오성권, 김용수, 안태천 "PSO의 특징과 차원성에 관한 비교연구," 제어.자동화.시스템공학 논문지 Vol. 12, No. 4, pp. 328-338, 2006.
  13. Y. Jiang, T. Hu, C. C. Huang, and X. Wu, "An improved particle swarm optimization algorithm," Applied Mathematics and Computation, Vol 193, Issue 1, pp. 231-239, 2007. https://doi.org/10.1016/j.amc.2007.03.047
  14. J. N. Choi, H. K. Kim, and S. K. Oh, "Optimization of FCM-based Radial Basis Function Neural Network Using Particl Swarm Optimization," 대한전기학회, Vol. 57, No. 11, pp. 2108-2115, 2008.
  15. R. E. Perez and K. Behdinan, "Particle swarm approach for structural design optimization," Computers & Structures, Vol 85, Issues 19-20, pp. 1579-1588, 2007. https://doi.org/10.1016/j.compstruc.2006.10.013
  16. S. K. Oh, W. Pedrycz, and D. W. Kim, "Hybrid fuzzy polynomial neural networks," Int. J. Uncert. Fuzzy. Knowledge-Based Syst. pp. 257-280, 2002.
  17. S. K. Oh and W. Pedrycz, "Identification of Fuzzy Systems by means of an Auto-Tuning Algorithm and Its Application to Nonlinear Systems," Fuzzy sets and System, Vol. 115, No. 2, pp. 205-230, 2000. https://doi.org/10.1016/S0165-0114(98)00174-2
  18. D. E. Box and G. M. Jenkins, Time Series Analysis, Forcasting and Control, California: Holden Day, 1976.
  19. H. S. Park, S. K. Oh, and Y. W. Yoon, "A new modeling approach to fuzzy-neural networks architecture," J. Cont. Automat. Syst. Eng. Vol. 7, pp. 664-674, 2001.
  20. J. Nie, A. P. Loh, and C. C. Hang, "Modeling pH neutralization processes using fuzzy-neural approaches," Fuzzy Sets and Systems, Vol. 78, pp. 5-22, 1996. https://doi.org/10.1016/0165-0114(95)00118-2
  21. W. Pedrycz and K. C. Kwak, "Linguistic Models as a Framework of User-Centric System Modeling," IEEE Trans. SMC-A, Vol. 36, No. 4, pp. 727-745, 2006.
  22. W. Pedrycz and K. C. Kwak, "The development of incremental models," IEEE Trans. Fuzzy Systems, Vol. 15, No. 3, pp. 507-518, 2007. https://doi.org/10.1109/TFUZZ.2006.889967
  23. W. Pedrycz, H. S. Park, and S. K. Oh, "A granular-oriented development of functional radial basis function neural networks," Neurocomputing, Vol. 72, No. 1-3, pp. 420-435, 2008. https://doi.org/10.1016/j.neucom.2007.12.016
  24. http://archive.ics.uci.edu/ml/datasets/