• Title/Summary/Keyword: backpropagation neural network

Search Result 448, Processing Time 0.038 seconds

Recurrent Neural Network with Backpropagation Through Time Learning Algorithm for Arabic Phoneme Recognition

  • Ismail, Saliza;Ahmad, Abdul Manan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1033-1036
    • /
    • 2004
  • The study on speech recognition and understanding has been done for many years. In this paper, we propose a new type of recurrent neural network architecture for speech recognition, in which each output unit is connected to itself and is also fully connected to other output units and all hidden units [1]. Besides that, we also proposed the new architecture and the learning algorithm of recurrent neural network such as Backpropagation Through Time (BPTT, which well-suited. The aim of the study was to observe the difference of Arabic's alphabet like "alif" until "ya". The purpose of this research is to upgrade the people's knowledge and understanding on Arabic's alphabet or word by using Recurrent Neural Network (RNN) and Backpropagation Through Time (BPTT) learning algorithm. 4 speakers (a mixture of male and female) are trained in quiet environment. Neural network is well-known as a technique that has the ability to classified nonlinear problem. Today, lots of researches have been done in applying Neural Network towards the solution of speech recognition [2] such as Arabic. The Arabic language offers a number of challenges for speech recognition [3]. Even through positive results have been obtained from the continuous study, research on minimizing the error rate is still gaining lots attention. This research utilizes Recurrent Neural Network, one of Neural Network technique to observe the difference of alphabet "alif" until "ya".

  • PDF

The Performance Advancement of Test Algorithm for Inner Defects in Semiconductor Packages (반도체 패키지의 내부 결함 검사용 알고리즘 성능 향상)

  • 김재열;윤성운;한재호;김창현;양동조;송경석
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.10a
    • /
    • pp.345-350
    • /
    • 2002
  • In this study, researchers classifying the artificial flaws in semiconductor packages are performed by pattern recognition technology. For this purposes, image pattern recognition package including the user made software was developed and total procedure including ultrasonic image acquisition, equalization filtration, binary process, edge detection and classifier design is treated by Backpropagation Neural Network. Specially, it is compared with various weights of Backpropagation Neural Network and it is compared with threshold level of edge detection in preprocessing method fur entrance into Multi-Layer Perceptron(Backpropagation Neural network). Also, the pattern recognition techniques is applied to the classification problem of defects in semiconductor packages as normal, crack, delamination. According to this results, it is possible to acquire the recognition rate of 100% for Backpropagation Neural Network.

  • PDF

The Performance Advancement of Test Algorithm for Inner Defects In Semiconductor Packages (반도체 패키지의 내부 결함 검사용 알고리즘 성능 향상)

  • Kim J.Y.;Kim C.H.;Yoon S.U.
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2005.10a
    • /
    • pp.721-726
    • /
    • 2005
  • In this study, researchers classifying the artificial flaws in semiconductor. packages are performed by pattern recognition technology. For this purposes, image pattern recognition package including the user made software was developed and total procedure including ultrasonic image acquisition, equalization filtration, binary process, edge detection and classifier design is treated by Backpropagation Neural Network. Specially, it is compared with various weights of Backpropagation Neural Network and it is compared with threshold level of edge detection in preprocessing method for entrance into Multi-Layer Perceptron(Backpropagation Neural network). Also, the pattern recognition techniques is applied to the classification problem of defects in semiconductor packages as normal, crack, delamination. According to this results, it is possible to acquire the recognition rate of 100% for Backpropagation Neural Network.

  • PDF

Recognition of vehicle number plate using multi backpropagation neural network (다중 역전파 신경망을 이용한 차량 번호판의 인식)

  • 최재호;조범준
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.22 no.11
    • /
    • pp.2432-2438
    • /
    • 1997
  • This paper proposes recognition system using multi-backpropagation neural networks rather than single backpropagation neural network to enhance the rate of character recognition resultsing from extracting the region of velhicle number in that the image of vehicle number plate from CCD camera has a distinguish feature, that is, illumination of a pattern. The experiment in this paper shows an output that the method using multi-backpropagation neural networks rather than signal backpropagation neural network takes less training time for computation and also has higher recognition rage of vehicle number.

  • PDF

Forecasting algorithm using an improved genetic algorithm based on backpropagation neural network model (개선된 유전자 역전파 신경망에 기반한 예측 알고리즘)

  • Yoon, YeoChang;Jo, Na Rae;Lee, Sung Duck
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.6
    • /
    • pp.1327-1336
    • /
    • 2017
  • In this study, the problems in the short term stock market forecasting are analyzed and the feasibility of the ARIMA method and the backpropagation neural network is discussed. Neural network and genetic algorithm in short term stock forecasting is also examined. Since the backpropagation algorithm often falls into the local minima trap, we optimized the backpropagation neural network and established a genetic algorithm based on backpropagation neural network for forecasting model in order to achieve high forecasting accuracy. The experiments adopted the korea composite stock price index series to make prediction and provided corresponding error analysis. The results show that the genetic algorithm based on backpropagation neural network model proposed in this study has a significant improvement in stock price index series forecasting accuracy.

Improved Learning Algorithm with Variable Activating Functions

  • Pak, Ro-Jin
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.815-821
    • /
    • 2005
  • Among the various artificial neural networks the backpropagation network (BPN) has become a standard one. One of the components in a neural network is an activating function or a transfer function of which a representative function is a sigmoid. We have discovered that by updating the slope parameter of a sigmoid function simultaneous with the weights could improve performance of a BPN.

  • PDF

Prediction for the Error due to Role Eccentricity in Hole-drilling Method Using Backpropagation Neural Network (역전파신경망을 이용한 구멍뚫기법의 편심 오차 예측)

  • Kim, Cheol;Yang, Won-Ho;Heo, Sung-Pil;Chung, Ki-Hyun
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.3
    • /
    • pp.436-444
    • /
    • 2002
  • The measurement of residual stresses by the hole-drilling method has been commonly used to evaluate residual stresses in structural members. In this method, eccentricity can usually occur between the hole center and rosette gage center. In this study, the error due to the hole eccentricity is predicted using the artificial neural network. The neural network has trained training examples of stress ratio, normalized eccentricity, off-centered direction and stress error using backpropagation learning process. The prediction results of the error using the trained neural network are good agreement with FE analyzed ones.

Predictive System Evaluation of Residual Stresses of Plate Butt Welding Using Neural Network (신경회로망을 이용한 평판 맞대기용접의 잔류응력 예측시스템 개발)

  • 차용훈;성백섭;이연신
    • Journal of Welding and Joining
    • /
    • v.21 no.1
    • /
    • pp.80-86
    • /
    • 2003
  • This study develops a system for effective prediction of residual stresses by the backpropagation algorithm using the neural network. To achieve this goal, a series of experiments were carried out to and measured the residual stresses using the sectional method. With the experimental results, the optional control algorithms using a neural network could be developed in order to reduce the effect of the external disturbances during GMA welding processes. Then the results obtained from this study were compared between the measured and calculated results, weld guality might be controlled by the neural network based on backpropagation algorithm.. This system can not only help to understand the interaction between the process parameters and residual stress, but also improve the quantity control for welded structures.

Using Classification function to integrate Discriminant Analysis, Logistic Regression and Backpropagation Neural Networks for Interest Rates Forecasting

  • Oh, Kyong-Joo;Ingoo Han
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2000.11a
    • /
    • pp.417-426
    • /
    • 2000
  • This study suggests integrated neural network models for Interest rate forecasting using change-point detection, classifiers, and classification functions based on structural change. The proposed model is composed of three phases with tee-staged learning. The first phase is to detect successive and appropriate structural changes in interest rare dataset. The second phase is to forecast change-point group with classifiers (discriminant analysis, logistic regression, and backpropagation neural networks) and their. combined classification functions. The fecal phase is to forecast the interest rate with backpropagation neural networks. We propose some classification functions to overcome the problems of two-staged learning that cannot measure the performance of the first learning. Subsequently, we compare the structured models with a neural network model alone and, in addition, determine which of classifiers and classification functions can perform better. This article then examines the predictability of the proposed classification functions for interest rate forecasting using structural change.

  • PDF

Improve Digit Recognition Capability of Backpropagation Neural Networks by Enhancing Image Preprocessing Technique

  • Feng, Xiongfeng;Kubik, K.Bogunia
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.49.4-49
    • /
    • 2001
  • Digit recognition based on backpropagation neural networks, as an important application of pattern recognition, was attracted much attention. Although it has the advantages of parallel calculation, high error-tolerance, and learning capability, better recognition effects can only be achieved with some specific fixed format input of the digit image. Therefore, digit image preprocessing ability directly affects the accuracy of recognition. Here using Matlab software, the digit image was enhanced by resizing and neutral-rotating the extracted digit image, which improved the digit recognition capability of the backpropagation neural network under practical conditions. This method may also be helpful for recognition of other patterns with backpropagation neural networks.

  • PDF