• Title/Summary/Keyword: Error backpropagation

Search Result 133, Processing Time 0.028 seconds

Improved Error Backpropagation Algorithm using Modified Activation Function Derivative (수정된 Activation Function Derivative를 이용한 오류 역전파 알고리즘의 개선)

  • 권희용;황희영
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.41 no.3
    • /
    • pp.274-280
    • /
    • 1992
  • In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments.

  • PDF

Prediction for the Error due to Role Eccentricity in Hole-drilling Method Using Backpropagation Neural Network (역전파신경망을 이용한 구멍뚫기법의 편심 오차 예측)

  • Kim, Cheol;Yang, Won-Ho;Heo, Sung-Pil;Chung, Ki-Hyun
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.3
    • /
    • pp.436-444
    • /
    • 2002
  • The measurement of residual stresses by the hole-drilling method has been commonly used to evaluate residual stresses in structural members. In this method, eccentricity can usually occur between the hole center and rosette gage center. In this study, the error due to the hole eccentricity is predicted using the artificial neural network. The neural network has trained training examples of stress ratio, normalized eccentricity, off-centered direction and stress error using backpropagation learning process. The prediction results of the error using the trained neural network are good agreement with FE analyzed ones.

Improve Digit Recognition Capability of Backpropagation Neural Networks by Enhancing Image Preprocessing Technique

  • Feng, Xiongfeng;Kubik, K.Bogunia
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.49.4-49
    • /
    • 2001
  • Digit recognition based on backpropagation neural networks, as an important application of pattern recognition, was attracted much attention. Although it has the advantages of parallel calculation, high error-tolerance, and learning capability, better recognition effects can only be achieved with some specific fixed format input of the digit image. Therefore, digit image preprocessing ability directly affects the accuracy of recognition. Here using Matlab software, the digit image was enhanced by resizing and neutral-rotating the extracted digit image, which improved the digit recognition capability of the backpropagation neural network under practical conditions. This method may also be helpful for recognition of other patterns with backpropagation neural networks.

  • PDF

Rejection of Interference Signal Using Neural Network in Multi-path Channel Systems (다중 경로 채널 시스템에서 신경회로망을 이용한 간섭 신호 제거)

  • 석경휴
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1998.06c
    • /
    • pp.357-360
    • /
    • 1998
  • DS/CDMA system rejected narrow-band interference and additional White Gaussian noise which are occured at multipath, intentional jammer and multiuser to share same bandwidth in mobile communication systems. Because of having not sufficiently obtained processing gain which is related to system performance, they were not effectively suppressed. In this paper, an matched filter channel model using backpropagation neural network based on complex multilayer perceptron is presented for suppressing interference of narrow-band of direct sequence spread spectrum receiver in DS/CDMA mobile communication systems. Recursive least square backpropagation algorithm with backpropagation error is used for fast convergence and better performance in matched filter receiver scheme. According to signal noise ratio and transmission power ratio, computer simulation results show that bit error ratio of matched filter using backpropagation neural network improved than that of RAKE receiver of direct sequence spread spectrum considering of con-channel and narrow-band interference.

  • PDF

A new learning algorithm for multilayer neural networks (새로운 다층 신경망 학습 알고리즘)

  • 고진욱;이철희
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.1285-1288
    • /
    • 1998
  • In this paper, we propose a new learning algorithm for multilayer neural networks. In the error backpropagation that is widely used for training multilayer neural networks, weights are adjusted to reduce the error function that is sum of squared error for all the neurons in the output layer of the network. In the proposed learning algorithm, we consider each output of the output layer as a function of weights and adjust the weights directly so that the output neurons produce the desired outputs. Experiments show that the proposed algorithm outperforms the backpropagation learning algorithm.

  • PDF

An Effective Mapping for a Mobile Robot using Error Backpropagation based Sensor Fusion (오류 역전파 신경망 기반의 센서융합을 이용한 이동로봇의 효율적인 지도 작성)

  • Kim, Kyoung-Dong;Qu, Xiao-Chuan;Choi, Kyung-Sik;Lee, Suk-Gyu
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.28 no.9
    • /
    • pp.1040-1047
    • /
    • 2011
  • This paper proposes a novel method based on error back propagation neural networks to fuse laser sensor data and ultrasonic sensor data for enhancing the accuracy of mapping. For navigation of single robot, the robot has to know its initial position and accurate environment information around it. However, due to the inherent properties of sensors, each sensor has its own advantages and drawbacks. In our system, the robot equipped with seven ultrasonic sensors and a laser sensor navigates to map two different corridor environments. The experimental results show the effectiveness of the heterogeneous sensor fusion using an error backpropagation algorithm for mapping.

Performance of Adaptive Correlator using Recursive Least Square Backpropagation Neural Network in DS/SS Mobile Communication Systems (DS/SS 이동 통신에서 반복적 최소 자승 역전파 신경망을 이용한 적응 상관기)

  • Jeong, Woo-Yeol;Kim, Hwan-Yong
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.2
    • /
    • pp.79-84
    • /
    • 1996
  • In this paper, adaptive correlator model using backpropagation neural network based on complex multilayer perceptron is presented for suppressing interference of narrow-band of direct sequence spread spectrum receiver in CDMA mobile communication systems. Recursive least square backpropagation algorithm with backpropagation error is used for fast convergence and better performance in adaptive correlator scheme. According to signal noise ratio and transmission power ratio, computer simulation results show that bit error ratio of adaptive correlator uswing backpropagation neural network improved than that of adaptive transversal filter of direct sequence spread spectrum considering of co-channel and narrow-band interference. Bit error ratio of adaptive correlator using backpropagation neural network is reduced about $10^{-1}$ than that of adaptive transversal filter where interference versus signal ratio is 5 dB.

  • PDF

The Roundness Prediction at Numerical Control Machine Using Neural Network (수치제어 공작기계에서 신경망을 이용한 진원도 예측)

  • Shin, Kwan-Soo
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.18 no.3
    • /
    • pp.315-320
    • /
    • 2009
  • The purpose of this study is to predict the roundness of Numerical Control Machining so that helps the operator to choose the right machining conditions to produce a product within the given error limits. Learning of neural network is Backpropagation theory. From this study, the base was set to setup the database to produce precisely machined product by predicting the rate of error in the fabrication facility which does not have the environment to analyze it.

  • PDF

Adaptive Error Constrained Backpropagation Algorithm (적응 오류 제약 Backpropagation 알고리즘)

  • 최수용;고균병;홍대식
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.28 no.10C
    • /
    • pp.1007-1012
    • /
    • 2003
  • In order to accelerate the convergence speed of the conventional BP algorithm, constrained optimization techniques are applied to the BP algorithm. First, the noise-constrained least mean square algorithm and the zero noise-constrained LMS algorithm are applied (designated the NCBP and ZNCBP algorithms, respectively). These methods involve an important assumption: the filter or the receiver in the NCBP algorithm must know the noise variance. By means of extension and generalization of these algorithms, the authors derive an adaptive error-constrained BP algorithm, in which the error variance is estimated. This is achieved by modifying the error function of the conventional BP algorithm using Lagrangian multipliers. The convergence speeds of the proposed algorithms are 20 to 30 times faster than those of the conventional BP algorithm, and are faster than or almost the same as that achieved with a conventional linear adaptive filter using an LMS algorithm.

Forecasting algorithm using an improved genetic algorithm based on backpropagation neural network model (개선된 유전자 역전파 신경망에 기반한 예측 알고리즘)

  • Yoon, YeoChang;Jo, Na Rae;Lee, Sung Duck
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.6
    • /
    • pp.1327-1336
    • /
    • 2017
  • In this study, the problems in the short term stock market forecasting are analyzed and the feasibility of the ARIMA method and the backpropagation neural network is discussed. Neural network and genetic algorithm in short term stock forecasting is also examined. Since the backpropagation algorithm often falls into the local minima trap, we optimized the backpropagation neural network and established a genetic algorithm based on backpropagation neural network for forecasting model in order to achieve high forecasting accuracy. The experiments adopted the korea composite stock price index series to make prediction and provided corresponding error analysis. The results show that the genetic algorithm based on backpropagation neural network model proposed in this study has a significant improvement in stock price index series forecasting accuracy.