The Transactions of the Korea Information Processing Society (한국정보처리학회논문지)

Korea Information Processing Society (한국정보처리학회)
권호 표지

Performance Improvement of General Regression Neural Network Using Principal Component Analysis

주요성분분석에 의한 일반회귀 신경망의 성능개선

  • 조용현 (대구카톨릭대학교 컴퓨터정보통신공학부)
  • Published : 2000.11.01
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes an efficient method for improving the performance of a general regression neural network by using the feature to the independent variables as the center for partern-layer neurons. The adaptive principal component analysis is applied for extracting, efficiently the fcarures by reducing the dimension of given independent variables. In can acluevc a supertor property of the principal component analysis that converts input data into set of statistically independent features and the general regression neuralnetwork, espedtively. The proposed general regression neural network has been applied to regress the Solow's economy(2-independent variable set) and the wie elephone(1-independent vanable set). The simulation results show that the proposed meural networks have better performances of the regressionfor the lest data, in comparison with those using the means or the weighted means of independent variables. Also,it is affected less by the number of neurons and the scope of the smoothing factor.

본 논문에서는 독립변수들의 특징을 추출하여 패턴층 뉴런의 중앙값을 이용함으로써 일반회귀 신경망의 성능을 개선하는 방법을 제안하였다. 제안된 방법에서는 적응적 학습 알고리즘의 주요성분분석 기법을 이용하여 회귀분석에 이용되는 데이터의 각 독립변수들의 집합으로 변환시키는 특징을 살려 일반회귀 신경망의 성능을 더 개선하기 위함이다. 제안된 기법의 일반회귀 신경망을 2개의 독립변수 집합을 가진 Solow의 경제문제와 4개의 독립변수 집합을 가진 국내 유선전화문제에 각각 적용하여 시뮬레이션한 결과, 중심값을 각 독립변수들의 평균이나 가중평균을 이용하는 일반회귀 신경망에 의한 결과와 비교할 때 더욱 우수한 회귀성능이 있음을 확인할 수 있었다. 그리고 신경망의 뉴런 수나 평활요소의 설정 면에서도 우수한 특성이 있음을 확인할 수 있었다.

Keywords

References

  1. D. F. Specht, 'A General Regression Neural Network,' IEEE Trans. on Neural Networks. Vol.2, No.6, pp.568-576, Nov, 1991 https://doi.org/10.1109/72.97934
  2. M. Caudill. 'GRNN and Bear It,' AI Expert, Vol 5, pp.28-33. May. 1993
  3. T Masters. 'Advanced Algorithms for Neural Networks : A C++ Sourcebook'. John Wiley & Sons, Inc., New York, 1992
  4. M. Catasus, W Branagh, and E. D. Salin, 'Improved Calibration for Inductively Coupled Plasma-Atomic Emission Spectrometry Using Generalized Regssion Neural Net works,' Applied Spectroscopy, Vol 49, No, 6, pp.798-807, 1995 https://doi.org/10.1366/0003702953964444
  5. Y. Chtioui, S Panigrahi, and L. Francl, 'A Generalized Regression Neural Network and Its Application for Leaf Wetness Prediction to Forecast Plant Disease,' Elsevier, Chemometrics and Intelligent. Laboratory Systems, Vol 48. pp.47-58, 1999 https://doi.org/10.1016/S0169-7439(99)00006-4
  6. 강명욱 외 3, '회귀분석 : 모형개발과 진단', 율곡출판사, 1997
  7. 성낙일 외 1, '한국통신의 통신요금지수 개발 및 추세 분석', 한국통신보고서, 1996
  8. A Ciehock and R Unbehaun, 'Neural Networks for Optimization and Signal Processing'. John Wiley & Sons., New York, 1993
  9. P Foldiak, 'Adaptive Network for Optmal Linear Feature Extraction,' International Joint Conference on Neural Networks. Washington D,C,. Vol.1, pp. 401-406, June 1989 https://doi.org/10.1109/IJCNN.1989.118615
  10. K I. Diamantaras and S. Y Kung, 'Principal Component Neural Networks: Theory and Applications. Adaptive and Learning Systems for Signal Processing. Communications and Control'. John Wiley & Sons. Inc,. 1996