• Title/Summary/Keyword: adaptive learning rate

Search Result 124, Processing Time 0.028 seconds

Active Random Noise Control using Adaptive Learning Rate Neural Networks

  • Sasaki, Minoru;Kuribayashi, Takumi;Ito, Satoshi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.941-946
    • /
    • 2005
  • In this paper an active random noise control using adaptive learning rate neural networks is presented. The adaptive learning rate strategy increases the learning rate by a small constant if the current partial derivative of the objective function with respect to the weight and the exponential average of the previous derivatives have the same sign, otherwise the learning rate is decreased by a proportion of its value. The use of an adaptive learning rate attempts to keep the learning step size as large as possible without leading to oscillation. It is expected that a cost function minimize rapidly and training time is decreased. Numerical simulations and experiments of active random noise control with the transfer function of the error path will be performed, to validate the convergence properties of the adaptive learning rate Neural Networks. Control results show that adaptive learning rate Neural Networks control structure can outperform linear controllers and conventional neural network controller for the active random noise control.

  • PDF

Characteristics Modeling of Dynamic Systems Using Adaptive Neural Computation (적응 뉴럴 컴퓨팅 방법을 이용한 동적 시스템의 특성 모델링)

  • Kim, Byoung-Ho
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.4
    • /
    • pp.309-314
    • /
    • 2007
  • This paper presents an adaptive neural computation algorithm for multi-layered neural networks which are applied to identify the characteristic function of dynamic systems. The main feature of the proposed algorithm is that the initial learning rate for the employed neural network is assigned systematically, and also the assigned learning rate can be adjusted empirically for effective neural leaning. By employing the approach, enhanced modeling of dynamic systems is possible. The effectiveness of this approach is veri tied by simulations.

A novel visual tracking system with adaptive incremental extreme learning machine

  • Wang, Zhihui;Yoon, Sook;Park, Dong Sun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.1
    • /
    • pp.451-465
    • /
    • 2017
  • This paper presents a novel discriminative visual tracking algorithm with an adaptive incremental extreme learning machine. The parameters for an adaptive incremental extreme learning machine are initialized at the first frame with a target that is manually assigned. At each frame, the training samples are collected and random Haar-like features are extracted. The proposed tracker updates the overall output weights for each frame, and the updated tracker is used to estimate the new location of the target in the next frame. The adaptive learning rate for the update of the overall output weights is estimated by using the confidence of the predicted target location at the current frame. Our experimental results indicate that the proposed tracker can manage various difficulties and can achieve better performance than other state-of-the-art trackers.

Multi-Channel Speech Enhancement Algorithm Using DOA-based Learning Rate Control (DOA 기반 학습률 조절을 이용한 다채널 음성개선 알고리즘)

  • Kim, Su-Hwan;Lee, Young-Jae;Kim, Young-Il;Jeong, Sang-Bae
    • Phonetics and Speech Sciences
    • /
    • v.3 no.3
    • /
    • pp.91-98
    • /
    • 2011
  • In this paper, a multi-channel speech enhancement method using the linearly constrained minimum variance (LCMV) algorithm and a variable learning rate control is proposed. To control the learning rate for adaptive filters of the LCMV algorithm, the direction of arrival (DOA) is measured for each short-time input signal and the likelihood function of the target speech presence is estimated to control the filter learning rate. Using the likelihood measure, the learning rate is increased during the pure noise interval and decreased during the target speech interval. To optimize the parameter of the mapping function between the likelihood value and the corresponding learning rate, an exhaustive search is performed using the Bark's scale distortion (BSD) as the performance index. Experimental results show that the proposed algorithm outperforms the conventional LCMV with fixed learning rate in the BSD by around 1.5 dB.

  • PDF

Improvement of learning performance and control of a robot manipulator using neural network with adaptive learning rate (적응 학습률을 이용한 신경회로망의 학습성능개선 및 로봇 제어)

  • Lee, Bo-Hee;Lee, Taek-Seung;Kim, Jin-Geol
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.3 no.4
    • /
    • pp.363-372
    • /
    • 1997
  • In this paper, the design and the implementation of the adaptive learning rate neural network controller for an articulate robot, which is being developed (or) has been developed in our Automatic Control Laboratory, are mainly discussed. The controller reduces software computational load via distributed processing method using multiple CPU's, and simplifies hardware structures by the time-division control with TMS32OC31 DSP chip. Proposed neural network controller with adaptive learning rate structure using expert's heuristics can improve learning speed. The proposed controller verifies its superiority by comparing response characteristics of conventional controller with those of the proposed controller that are obtained from the experiments for the 5 axis vertical articulated robot. We, also, present the generalization property of proposed controller for unlearned trajectory and the change of load through experimental data.

  • PDF

An Adaptive Learning Rate with Limited Error Signals for Training of Multilayer Perceptrons

  • Oh, Sang-Hoon;Lee, Soo-Young
    • ETRI Journal
    • /
    • v.22 no.3
    • /
    • pp.10-18
    • /
    • 2000
  • Although an n-th order cross-entropy (nCE) error function resolves the incorrect saturation problem of conventional error backpropagation (EBP) algorithm, performance of multilayer perceptrons (MLPs) trained using the nCE function depends heavily on the order of nCE. In this paper, we propose an adaptive learning rate to markedly reduce the sensitivity of MLP performance to the order of nCE. Additionally, we propose to limit error signal values at out-put nodes for stable learning with the adaptive learning rate. Through simulations of handwritten digit recognition and isolated-word recognition tasks, it was verified that the proposed method successfully reduced the performance dependency of MLPs on the nCE order while maintaining advantages of the nCE function.

  • PDF

Adaptive Learning Rate and Limited Error Signal to Reduce the Sensitivity of Error Back-Propagation Algorithm on the n-th Order Cross-Entropy Error (오류 역전파 알고리즘의 n차 크로스-엔트로피 오차신호에 대한 민감성 제거를 위한 가변 학습률 및 제한된 오차신호)

  • 오상훈;이수영
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.6
    • /
    • pp.67-75
    • /
    • 1998
  • Although the nCE(n-th order cross-entropy) error function resolves the incorrect saturation problem of conventional EBP(error back-propagation) algorithm, the performance of MLP's (multilayer perceptrons) trained using the nCE function depends heavily on the order of the nCE function. In this paper, we propose an adaptive learning rate to make the performance of MLP's insensitive to the order of the nCE error. Additionally, we propose a limited error signal of output node to prevent unstable learning due to the adaptive learning rate. The effectiveness of the proposed method is demonstrated in simulations of handwritten digit recognition and thyroid diagnosis tasks.

  • PDF

The Adaptive Congestion Control Using Neural Network in ATM network (ATM 망에서 뉴럴 네트워크를 이용한 적응 폭주제어)

  • Lee, Yong-Il;Kim, Yung-Kwon
    • Journal of IKEEE
    • /
    • v.2 no.1 s.2
    • /
    • pp.134-138
    • /
    • 1998
  • Because of the statistical fluctuations and the high 'time-variability' nature of the traffic, managing the resources of the network require highly dynamic techniques with minimal Intervention and reaction times, and adaptive and learning capabilities. The neural networks normalizes the ATM cell arrival rate and queue length and has the adaptive learning algorithm, and experimentally investigated the method to prevent the congestion generated in ATM networks.

  • PDF

Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate

  • No, Gun-hyo;Hong, Yong-hee;Park, Jin-ho;Jhee, Ho-jin
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.7
    • /
    • pp.81-90
    • /
    • 2018
  • In this paper, reducing lense Vignetting effect and adaptive learning rate method are proposed to complement Scribner's neural network for nuc algorithm which is the effective algorithm in statistic SBNUC algorithm. Proposed reducing vignetting effect method is updated weight and bias each differently using different cost function. Proposed adaptive learning rate for updating weight and bias is using sobel edge detection method, which has good result for boundary condition of image. The ordinary statistic SBNUC algorithm has problem to compensate lense vignetting effect, because statistic algorithm is updated weight and bias by using gradient descent method, so it should not be effective for global weight problem same like, lense vignetting effect. We employ the proposed methods to Scribner's neural network method(NNM) and Torres's reducing ghosting correction for neural network nuc algorithm(improved NNM), and apply it to real-infrared detector image stream. The result of proposed algorithm shows that it has 10dB higher PSNR and 1.5 times faster convergence speed then the improved NNM Algorithm.

An Inquiry into Prediction of Learner's Academic Performance through Learner Characteristics and Recommended Items with AI Tutors in Adaptive Learning (적응형 온라인 학습환경에서 학습자 특성 및 AI튜터 추천문항 학습활동의 학업성취도 예측력 탐색)

  • Choi, Minseon;Chung, Jaesam
    • Journal of Information Technology Services
    • /
    • v.20 no.4
    • /
    • pp.129-140
    • /
    • 2021
  • Recently, interest in AI tutors is rising as a way to bridge the educational gap in school settings. However, research confirming the effectiveness of AI tutors is lacking. The purpose of this study is to explore how effective learner characteristics and recommended item learning activities are in predicting learner's academic performance in an adaptive online learning environment. This study proposed the hypothesis that learner characteristics (prior knowledge, midterm evaluation) and recommended item learning activities (learning time, correct answer check, incorrect answer correction, satisfaction, correct answer rate) predict academic achievement. In order to verify the hypothesis, the data of 362 learners were analyzed by collecting data from the learning management system (LMS) from the perspective of learning analytics. For data analysis, regression analysis was performed using the regsubset function provided by the leaps package of the R program. The results of analyses showed that prior knowledge, midterm evaluation, correct answer confirmation, incorrect answer correction, and satisfaction had a positive effect on academic performance, but learning time had a negative effect on academic performance. On the other hand, the percentage of correct answers did not have a significant effect on academic performance. The results of this study suggest that recommended item learning activities, which mean behavioral indicators of interaction with AI tutors, are important in the learning process stage to increase academic performance in an adaptive online learning environment.