• 제목/요약/키워드: Real-Time Adaptive Learning

검색결과 116건 처리시간 0.022초

오차 자기순환 신경회로망에 기초한 적응 PID제어기 (Adaptive PID controller based on error self-recurrent neural networks)

  • 이창구;신동용
    • 제어로봇시스템학회논문지
    • /
    • 제4권2호
    • /
    • pp.209-214
    • /
    • 1998
  • In this paper, we are dealing with the problem of controlling unknown nonlinear dynamical system by using neural networks. A novel error self-recurrent(ESR) neural model is presented to perform black-box identification. Through the various outcome of the experiment, a new neural network is seen to be considerably faster than the BP algorithm and has advantages of being less affected by poor initial weights and learning rate. These characteristics make it flexible to design the controller in real-time based on neural networks model. In addition, we design an adaptive PID controller that Keyser suggested by using ESR neural networks, and present a method on the implementation of adaptive controller based on neural network for practical applications. We obtained good results in the case of robot manipulator experiment.

  • PDF

Implementation of Self-adaptive System using the Algorithm of Neural Network Learning Gain

  • Lee, Seong-Su;Kim, Yong-Wook;Oh, Hun;Park, Wal-Seo
    • International Journal of Control, Automation, and Systems
    • /
    • 제6권3호
    • /
    • pp.453-459
    • /
    • 2008
  • The neural network is currently being used throughout numerous control system fields. However, it is not easy to obtain an input-output pattern when the neural network is used for the system of a single feedback controller and it is difficult to obtain satisfactory performance with when the load changes rapidly or disturbance is applied. To resolve these problems, this paper proposes a new mode to implement a neural network controller by installing a real object for control and an algorithm for this, which can replace the existing method of implementing a neural network controller by utilizing activation function at the output node. The real plant object for controlling of this mode implements a simple neural network controller replacing the activation function and provides the error back propagation path to calculate the error at the output node. As the controller is designed using a simple structure neural network, the input-output pattern problem is solved naturally and real-time learning becomes possible through the general error back propagation algorithm. The new algorithm applied neural network controller gives excellent performance for initial and tracking response and shows a robust performance for rapid load change and disturbance, in which the permissible error surpasses the range border. The effect of the proposed control algorithm was verified in a test that controlled the speed of a motor equipped with a high speed computing capable DSP on which the proposed algorithm was loaded.

Reinforcement learning-based control with application to the once-through steam generator system

  • Cheng Li;Ren Yu;Wenmin Yu;Tianshu Wang
    • Nuclear Engineering and Technology
    • /
    • 제55권10호
    • /
    • pp.3515-3524
    • /
    • 2023
  • A reinforcement learning framework is proposed for the control problem of outlet steam pressure of the once-through steam generator(OTSG) in this paper. The double-layer controller using Proximal Policy Optimization(PPO) algorithm is applied in the control structure of the OTSG. The PPO algorithm can train the neural networks continuously according to the process of interaction with the environment and then the trained controller can realize better control for the OTSG. Meanwhile, reinforcement learning has the characteristic of difficult application in real-world objects, this paper proposes an innovative pretraining method to solve this problem. The difficulty in the application of reinforcement learning lies in training. The optimal strategy of each step is summed up through trial and error, and the training cost is very high. In this paper, the LSTM model is adopted as the training environment for pretraining, which saves training time and improves efficiency. The experimental results show that this method can realize the self-adjustment of control parameters under various working conditions, and the control effect has the advantages of small overshoot, fast stabilization speed, and strong adaptive ability.

Adaptive Weight Collaborative Complementary Learning for Robust Visual Tracking

  • Wang, Benxuan;Kong, Jun;Jiang, Min;Shen, Jianyu;Liu, Tianshan;Gu, Xiaofeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제13권1호
    • /
    • pp.305-326
    • /
    • 2019
  • Discriminative correlation filter (DCF) based tracking algorithms have recently shown impressive performance on benchmark datasets. However, amount of recent researches are vulnerable to heavy occlusions, irregular deformations and so on. In this paper, we intend to solve these problems and handle the contradiction between accuracy and real-time in the framework of tracking-by-detection. Firstly, we propose an innovative strategy to combine the template and color-based models instead of a simple linear superposition and rely on the strengths of both to promote the accuracy. Secondly, to enhance the discriminative power of the learned template model, the spatial regularization is introduced in the learning stage to penalize the objective boundary information corresponding to features in the background. Thirdly, we utilize a discriminative multi-scale estimate method to solve the problem of scale variations. Finally, we research strategies to limit the computational complexity of our tracker. Abundant experiments demonstrate that our tracker performs superiorly against several advanced algorithms on both the OTB2013 and OTB2015 datasets while maintaining the high frame rates.

e-Learning에서 나타날 수 있는 학습자의 얼굴 표정 분석 (Analyzing facial expression of a learner in e-Learning system)

  • 박정현;정상목;이완복;송기상
    • 한국콘텐츠학회:학술대회논문집
    • /
    • 한국콘텐츠학회 2006년도 춘계 종합학술대회 논문집
    • /
    • pp.160-163
    • /
    • 2006
  • e-Learning에서 교수 시스템이 학습자의 학습에 대한 흥미도, 관심도 또는 각성상태를 실시간으로 측정하여 학습자의 정서 상태를 정확히 알아낼 수 있다면 학습자가 지루해 할 때 학습에 대한 흥미를 느낄 수 있는 요소를 피드백 해줄 수 있으며, 학습자가 학습내용을 이해하지 못하고 있거나 어려움을 느끼고 있는 경우 학습내용을 이해할 수 있는 도움내용을 처치하는 등의 적응적 교수 시스템(adaptive tutoring system)의 역할을 수행할 수 있다. 현재의 표정 인식 분야는 대부분 성인의 얼굴표정을 대상으로 하여 일상적인 감정인 분노, 혐오, 공포, 슬픔, 놀라움, 기쁨 등을 대상으로 하고 있다. 하지만 이러한 일상적인 표정들은 e-Learning 에서 나타나는 학습자의 감정이라고 보기 어렵다. 따라서 표정을 통하여 학습자의 감정 상태를 인식하도록 해주기 위해서는 e-Learning에서 학습자가 어떤 표정을 짓는지를 먼저 연구하여 다양한 표정사진을 충분히 취득한 후에 각 표정사진의 감정상태가 무엇인지를 밝혀주는 작업이 필요하다. 이에 본 연구는 표정 데이터베이스의 구축을 위한 선행 연구로 e-Learning에서 학습자가 나타내는 감정과 그 감정에 따른 표정이 어떻게 이루어져 있는지를 찾아내고 그 특징을 분석해보았다.

  • PDF

An adaptive neuro-fuzzy approach using IoT data in predicting springback in ultra-thin stainless steel sheets with consideration of grain size

  • Jing Zhao;Lichun Wan;Mostafa Habibi;Ameni Brahmia
    • Advances in nano research
    • /
    • 제17권2호
    • /
    • pp.109-124
    • /
    • 2024
  • In the era of smart manufacturing, precise prediction of springback-a common issue in ultra-thin sheet metal forming- and forming limits are critical for ensuring high-quality production and minimizing waste. This paper presents a novel approach that leverages the Internet of Things (IoT) and Artificial Neural Networks (ANN) to enhance springback and forming limits prediction accuracy. By integrating IoT-enabled sensors and devices, real-time data on material properties, forming conditions, and environmental factors are collected and transmitted to a central processing unit. This data serves as the input for an ANN model, which is trained with crystal plasticity simulations and experimental data to predict springback with high precision. Our proposed system not only provides continuous monitoring and adaptive learning capabilities but also facilitates real-time decision-making in manufacturing processes. Experimental results demonstrate significant improvements in prediction accuracy compared to traditional methods, highlighting the potential of IoT and ANN integration in advancing smart manufacturing. This approach promises to revolutionize quality control and operational efficiency in the industry, paving the way for more intelligent and responsive manufacturing systems.

분류자 시스템을 이용한 인공개미의 적응행동의 학습 (Learning of Adaptive Behavior of artificial Ant Using Classifier System)

  • 정치선;심귀보
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 1998년도 추계학술대회 학술발표 논문집
    • /
    • pp.361-367
    • /
    • 1998
  • The main two applications of the Genetic Algorithms(GA) are the optimization and the machine learning. Machine Learning has two objectives that make the complex system learn its environment and produce the proper output of a system. The machine learning using the Genetic Algorithms is called GA machine learning or genetic-based machine learning (GBML). The machine learning is different from the optimization problems in finding the rule set. In optimization problems, the population of GA should converge into the best individual because optimization problems, the population of GA should converge into the best individual because their objective is the production of the individual near the optimal solution. On the contrary, the machine learning systems need to find the set of cooperative rules. There are two methods in GBML, Michigan method and Pittsburgh method. The former is that each rule is expressed with a string, the latter is that the set of rules is coded into a string. Th classifier system of Holland is the representative model of the Michigan method. The classifier systems arrange the strength of classifiers of classifier list using the message list. In this method, the real time process and on-line learning is possible because a set of rule is adjusted on-line. A classifier system has three major components: Performance system, apportionment of credit system, rule discovery system. In this paper, we solve the food search problem with the learning and evolution of an artificial ant using the learning classifier system.

  • PDF

적응적 상호작용기반 동영상 강의계획서 설계 및 구현 (Design and Implementation of Adaptive Interaction-based Video Syllabus)

  • 심현;최원호
    • 한국전자통신학회논문지
    • /
    • 제12권4호
    • /
    • pp.663-670
    • /
    • 2017
  • 본 논문에서는 적응적 상호작용 기반의 동영상 강의계획서 템플릿을 정의하고 있다. 대학에서의 강의계획서는 교수학습 설계도로서 매우 중요한 의미를 가지고 있으나 단편적인 구조내용, 타서비스 연계 부족, 재사용성 부족 등으로 형식적인 문서로 여겨지고 실제로는 단순한 조회에 그치고 있다. 본 논문에서는 교수학습과 관련된 실질적인 정보를 제공하고 교수자와 학습자의 상호학습 정보공유가 가능한 입체적인 강의계획서를 설계한다. 제안하는 기법은 강의계획서의 계층구조 정의, 학습자의 선호도에 맞는 미디어 콘텐츠 적용, 정보전달의 실시간 변동 기능 등을 포함하여 교수학습 중심의 강의계획서 서비스를 가능하게 한다. 실제 LMS를 통해 제공된 동영상 강의계획서는 편의성을 강화해서 사용자들의 활용도를 높이고 교수학습의 유용성과 신뢰성을 보인다.

로못 머니퓰레이터를 위한 적응학습제어 알고리즘의 구현 (Implementation of an adaptive learning control algorithm for robot manipulators)

  • 이형기;최한호;정명진
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1992년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 19-21 Oct. 1992
    • /
    • pp.632-637
    • /
    • 1992
  • Recently many dynamics control algorithms using robot dynamic equation have been proposed. One of them, Kawato's feedback error learning scheme requires neither an accurate model nor parameter estimation and makes the robot motion closer to the desired trajectory by repeating operation. In this paper, the feedback error learning algorithm is implemented to control a robot system, 5 DOF revolute type movemaster. For this purpose, an actuator dynamic model is constructed considering equivalent robot dynamics model with respect to actuator as well as friction model. The command input acquired from the actuator dynamic model is the sum of products of unknown parameters and known functions. To compute the control algorithm, a parallel processing computer, transputer, is used and real-time computing is achieved. The experiment is done for the three major link of movemaster and its result is presented.

  • PDF

In-Process Cutter Runout Compensation Using Repetitive Learning Control

  • Joon Hwang;Chung, Eui-Sik
    • International Journal of Precision Engineering and Manufacturing
    • /
    • 제4권4호
    • /
    • pp.13-18
    • /
    • 2003
  • This paper presents the in-process compensation to control cutter ronout and to improve the machined surface quality. Cutter ronout compensation system consists of the micro-positioning servo system with piezoelectric actuator which is embeded in the sliding table to manipulate radial depth of cut in real-time. Cutting force feedback control was proposed in the angle domain based upon repetitive learning control strategy to eliminate chip load variation in end milling process. Micro-positioning control due to adaptive actuation force response improves the machined surface quality by cutter ronout compensation.