• Title/Summary/Keyword: Error backpropagation

Search Result 133, Processing Time 0.029 seconds

Improving Speaker Enrolling Speed for Speaker Verification Systems Based on Multilayer Perceptrons by Using a Qualitative Background Speaker Selection (정질적 기준을 이용한 다층신경망 기반 화자증명 시스템의 등록속도 단축방법)

  • 이태승;황병원
    • The Journal of the Acoustical Society of Korea
    • /
    • v.22 no.5
    • /
    • pp.360-366
    • /
    • 2003
  • Although multilayer perceptrons (MLPs) present several advantages against other pattern recognition methods, MLP-based speaker verification systems suffer from slow enrollment speed caused by many background speakers to achieve a low verification error. To solve this problem, the quantitative discriminative cohort speakers (QnDCS) method, by introducing the cohort speakers method into the systems, reduced the number of background speakers required to enroll speakers. Although the QnDCS achieved the goal to some extent, the improvement rate for the enrolling speed was still unsatisfactory. To improve the enrolling speed, this paper proposes the qualitative DCS (QlDCS) by introducing a qualitative criterion to select less background speakers. An experiment for both methods is conducted to use the speaker verification system based on MLPs and continuants, and speech database. The results of the experiment show that the proposed QlDCS method enrolls speakers in two times shorter time than the QnDCS does over the online error backpropagation(EBP) method.

Dynamic Control of Robot Manipulators Using Multilayer Neural Networks and Error Backpropagation (다층 신경회로 및 역전달 학습방법에 의한 로보트 팔의 다이나믹 제어)

  • 오세영;류연식
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.39 no.12
    • /
    • pp.1306-1316
    • /
    • 1990
  • A controller using a multilayer neural network is proposed to the dynamic control of a PUMA 560 robot arm. This controller is developed based on an error back-propagation (BP) neural network. Since the neural network can model an arbitrary nonlinear mapping, it is used as a commanded feedforward torque generator. A Proportional Derivative (PD) feedback controller is used in parallel with the feedforward neural network to train the system. The neural network was trained by the current state of the manipulator as well as the PD feedback error torque. No a priori knowledge on system dynamics is needed and this information is rather implicitly stored in the interconnection weights of the neural network. In another experiment, the neural network was trained with the current, past and future positions only without any use of velocity sensors. Form this thim window of position values, BP network implicitly filters out the velocity and acceleration components for each joint. Computer simulation demonstrates such powerful characteristics of the neurocontroller as adaptation to changing environments, robustness to sensor noise, and continuous performance improvement with self-learning.

  • PDF

Adaptive Control of Nonlinear Systems through Improvement of Learning Speed of Neural Networks and Compensation of Control Inputs (신경망의 학습속도 개선 및 제어입력 보상을 통한 비선형 시스템의 적응제어)

  • 배병우;전기준
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.43 no.6
    • /
    • pp.991-1000
    • /
    • 1994
  • To control nonlinear systems adaptively, we improve learning speed of neural networks and present a novel control algorithm characterized by compensation of control inputs. In an error-backpropagation algorithm for tranining multilayer neural networks(MLNN's) the effect of the slope of activation functions on learning performance is investigated and the learning speed of neural networks is improved by auto-adjusting the slope of activation functions. The control system is composed of two MLNN's, one for control and the other for identification, with the weights initialized by off-line training. The control algoritm is modified by a control strategy which compensates the control error induced by the indentification error. Computer simulations show that the proposed control algorithm is efficient in controlling a nonlinear system with abruptly changing parameters.

A Study On Adaptive Correlator Receiver with Narrow-band Interferance in CDMA System (CDMA System에서 협대역 간섭제거 적응 상관기에 관한 연구)

  • Jeong Chan-Ju;Yang Hwa-Sup;Kim Yong-Shik;Oh Seung-Jae;Kim Jae-Gab
    • Management & Information Systems Review
    • /
    • v.3
    • /
    • pp.201-214
    • /
    • 1999
  • Adaptive correlator receiver with neural network based on complex multilayer perceptron is persented for suppressing interference of narrow-band of direct spread spectrum communication systems. Recursive least square algorithm with backpropagation error is used for fast convergence and better performance in adaptive correlator scheme. According to signal noise and transmission power, computer simulation results show that bit error ratio of adaptive correlator using neural network improved that of adative transversal filter of direct sequence spread spectrum considering of jamming and narrow-band interference. Bit error ratio of adaptive correlator with neural network is reduced about 10-1 than that of adaptive transversal filter where interference versus signal ratio is 5dB.

  • PDF

Nonlinear Neural Networks for Vehicle Modeling Control Algorithm based on 7-Depth Sensor Measurements (7자유도 센서차량모델 제어를 위한 비선형신경망)

  • Kim, Jong-Man;Kim, Won-Sop;Sin, Dong-Yong
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2008.06a
    • /
    • pp.525-526
    • /
    • 2008
  • For measuring nonlinear Vehicle Modeling based on 7-Depth Sensor, the neural networks are proposed m adaptive and in realtime. The structure of it is similar to recurrent neural networks; a delayed output as the input and a delayed error between the output of plant and neural networks as a bias input. In addition, we compute the desired value of hidden layer by an optimal method instead of transfering desired values by backpropagation and each weights are updated by RLS(Recursive Least Square). Consequently, this neural networks are not sensitive to initial weights and a learning rate, and have a faster convergence rate than conventional neural networks. This new neural networks is Error Estimated Neural Networks. We can estimate nonlinear models in realtime by the proposed networks and control nonlinear models.

  • PDF

Accelerating Levenberg-Marquardt Algorithm using Variable Damping Parameter (가변 감쇠 파라미터를 이용한 Levenberg-Marquardt 알고리즘의 학습 속도 향상)

  • Kwak, Young-Tae
    • Journal of the Korea Society of Computer and Information
    • /
    • v.15 no.4
    • /
    • pp.57-63
    • /
    • 2010
  • The damping parameter of Levenberg-Marquardt algorithm switches between error backpropagation and Gauss-Newton learning and affects learning speed. Fixing the damping parameter induces some oscillation of error and decreases learning speed. Therefore, we propose the way of a variable damping parameter with referring to the alternation of error. The proposed method makes the damping parameter increase if error rate is large and makes it decrease if error rate is small. This method so plays the role of momentum that it can improve learning speed. We tested both iris recognition and wine recognition for this paper. We found out that this method improved learning speed in 67% cases on iris recognition and in 78% cases on wine recognition. It was also showed that the oscillation of error by the proposed way was less than those of other algorithms.

Predicting the 2-dimensional airfoil by using machine learning methods

  • Thinakaran, K.;Rajasekar, R.;Santhi, K.;Nalini, M.
    • Advances in Computational Design
    • /
    • v.5 no.3
    • /
    • pp.291-304
    • /
    • 2020
  • In this paper, we develop models to design the airfoil using Multilayer Feed-forward Artificial Neural Network (MFANN) and Support Vector Regression model (SVR). The aerodynamic coefficients corresponding to series of airfoil are stored in a database along with the airfoil coordinates. A neural network is created with aerodynamic coefficient as input to produce the airfoil coordinates as output. The performance of the models have been evaluated. The results show that the SVR model yields the lowest prediction error.

The Study on the Method which escapee from Local maxima of Error-Backpropagation Algorithm (오류역전파 알고리즘의 Local maxima를 탈출하기 위한 방법에 관한 연구)

  • 서원택;조범준
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2001.10b
    • /
    • pp.313-315
    • /
    • 2001
  • 본 논문에서 소개하는 알고리즘을 은닉층의 뉴런의 수를 학습하는 동안 동적으로 변화시켜 역전파 알고리즘의 단점인 Local maxima를 탈출하고 또한 은닉층의 뉴런의 수를 결정하는 과정을 없애기 위해 연구되었다. 본 알고리즘의 성능을 평가하기 위해 두 가지 실험에 적용하였는데 첫번째는 Exclusive-OR 문제이고 두번째는 7$\times$8 한글 자음과 모음의 폰트 학습에 적용하였다. 이 실험의 결과로 네트웍이 local maxima에 빠져드는 확률이 줄어드는 것을 알 수 있었고 학습속도 또한 일반적인 역전파 알고리즘보다 빠른 것으로 증명되었다.

  • PDF

Speed-Sensorless Vector Control of an Induction Motor Using Neural Network (신경망을 이용한 유도 전동기의 센서리스 속도제어)

  • Kim, Jung-Gon;Park, Seong-Wook;Seo, Bo-Hyeok
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2149-2151
    • /
    • 2002
  • In this paper, a novel speed estimation method of an induction motor using neural networks(NNs) is presented. The NN speed estimator is trained online by using the error backpropagation algorithm, and the training starts simultaneously with the induction motor working. The neural network based vector controller has the advantage of robustness against machine parameter variation. The simulation results using Matlab/Simulink verify the useful of the proposed method.

  • PDF

ART1-based Fuzzy Supervised Learning Algorithm (ART-1 기반 퍼지 지도 학습 알고리즘)

  • Kim Kwang-Baek;Cho Jae-Hyun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.9 no.4
    • /
    • pp.883-889
    • /
    • 2005
  • Error backpropagation algorithm of multilayer perceptron may result in local-minima because of the insufficient nodes in the hidden layer, inadequate momentum set-up, and initial weights. In this paper, we proposed the ART-1 based fuzzy supervised learning algorithm which is composed of ART-1 and fuzzy single layer supervised learning algorithm. The Proposed fuzzy supervised learning algorithm using self-generation method applied not only ART-1 to creation of nodes from the input layer to the hidden layer, but also the winer-take-all method, modifying stored patterns according to specific patterns. to adjustment of weights. We have applied the proposed learning method to the problem of recognizing a resident registration number in resident cards. Our experimental result showed that the possibility of local-minima was decreased and the teaming speed and the paralysis were improved more than the conventional error backpropagation algorithm.