Performance Evaluation of Linear Regression, Back-Propagation Neural Network, and Linear Hebbian Neural Network for Fitting Linear Function

선형함수 fitting을 위한 선형회귀분석, 역전파신경망 및 성현 Hebbian 신경망의 성능 비교

  • Published : 1995.12.01

Abstract

Recently, neural network models have been employed as an alternative to regression analysis for point estimation or function fitting in various field. Thus far, however, no theoretical or empirical guides seem to exist for selecting the tool which the most suitable one for a specific function-fitting problem. In this paper, we evaluate performance of three major function-fitting techniques, regression analysis and two neural network models, back-propagation and linear-Hebbian-learning neural networks. The functions to be fitted are simple linear ones of a single independent variable. The factors considered are size of noise both in dependent and independent variables, portion of outliers, and size of the data. Based on comutational results performed in this study, some guidelines are suggested to choose the best technique that can be used for a specific problem concerned.

Keywords

References

  1. 하이테크정보 신경망 이론과 응용 김대수
  2. 경영과학 v.11 no.2 A Comparison of Neural Networks to Ols Regression in Press/Quality Control Application 남경두;Sanford,C.C.;Jayakmur,M.D.
  3. 대한인간공학회 '93 추계학술대회논문집 뉴럴 네트워크를 이용한 다변수 관측작업의 평균탐색시간 예측 박성준,정의승
  4. 회귀분석 박성현
  5. USING NWORKS
  6. World Conference on Neural Networks Neural Networks Versus Regression Techniques For Noise Prediction In Urban Areas Cammarata,G.;Cavalieri,S.;Fichera,A.;Maraletta,L.
  7. Neural Networks v.4 Constrained Topological Mapping for Nonparametric Regression Analysis Cherkassky,V.;Lari-Najafi,H.
  8. NEURAL NETWORKS : Algorithms, Applications, Programming Techniques Freeman,J.A.;Skapura,D.M.
  9. Introduction to the Theory of Neural Comutation Hertz,J.;Krogh,A.;Palmer,R.G.
  10. Neural networks v.2 Multilayer Feedforward Networks are Universal Approximators Hornik,K.
  11. IEEE Regression Analysis of Spectroscopic Process Data Using a Combined Architecture of Linear and Nonlinear Artificial Neural Networks Lee,S.E.;Holt,B.R.
  12. Proceedings of 1993 International Joint Conference on Neural Networks A Hybrid Neural Network System for the Rainfall Estimation using Satellite Imagery Murao,H.;Nishikawa,E.;Kitamura,S.
  13. Proceedings of International Joint Conference on Neural Networks Next Day Peak Load Forecasting using an Artificial Neural Network Onoda,T.
  14. Computers & Operations Research v.20 no.7 An Experimental Evaluations of Neural Networks for Classification Subramanian,V.;Hung,M.S.;Hu,Y.M.
  15. Computers and Industrial Engineering v.25 no.1-4 Neural Network Performance on the Bankruptcy Classification Problem Udo,G.
  16. Neural Networks v.3 Connectionist Nonparametric Regression Multilayer Feedforward Networks can Learn Arbitrary Mappings White,H.
  17. Neural Networks v.5 Modified Hebbian Learning for Curve and Surface Fitting Xu,L.;Oja,E.;Suen,C.Y.