• Title/Summary/Keyword: CMAC learning controller

Search Result 25, Processing Time 0.024 seconds

CMAC Learning Controller Implementation With Multiple Sampling Rate: An Inverted Pendulum Example (다중 샘플링 타임을 갖는 CMAC 학습 제어기 실현: 역진자 제어)

  • Lee, Byoung-Soo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.13 no.4
    • /
    • pp.279-285
    • /
    • 2007
  • The objective of the research is two fold. The first is to design and propose a stable and robust learning control algorithm. The controller is CMAC Learning Controller which consists of a model-based controller, such as LQR or PID, as a reference control and a CMAC. The second objective is to implement a reference control and CMAC at two different sampling rates. Generally, a conventional controller is designed based on a mathematical plant model. However, increasing complexity of the plant and accuracy requirement on mathematical models nearly prohibits the application of the conventional controller design approach. To avoid inherent complexity and unavoidable uncertainty in modeling, biology mimetic methods have been developed. One of such attempts is Cerebellar Model Articulation Computer(CMAC) developed by Albus. CMAC has two main disadvantages. The first disadvantage of CMAC is increasing memory requirement with increasing number of input variables and with increasing accuracy demand. The memory needs can be solved with cheap memories due to recent development of new memory technology. The second disadvantage is a demand for processing powers which could be an obstacle especially when CMAC should be implemented in real-time. To overcome the disadvantages of CMAC, we propose CMAC learning controller with multiple sampling rates. With this approach a conventional controller which is a reference to CMAC at high enough sampling rate but CMAC runs at the processor's unoccupied time. To show efficiency of the proposed method, an inverted pendulum controller is designed and implemented. We also demonstrate it's possibility as an industrial control solution and robustness against a modeling uncertainty.

A Reinforcement Learning with CMAC

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.6 no.4
    • /
    • pp.271-276
    • /
    • 2006
  • To implement a generalization of value functions in Adaptive Search Element (ASE)-reinforcement learning, CMAC (Cerebellar Model Articulation Controller) is integrated into ASE controller. ASE-reinforcement learning scheme is briefly studied to discuss how CMAC is integrated into ASE controller. Neighbourhood Sequential Training for CMAC is utilized to establish the look-up table and to produce discrete control outputs. In computer simulation, an ASE controller and a couple of ASE-CMAC neural network are trained to balance the inverted pendulum on a cart. The number of trials until the controllers are established and the learning performance of the controllers are evaluated to find that generalization ability of the CMAC improves the speed of the ASE-reinforcement learning enough to realize the cartpole control system.

CMAC Controller with Adaptive Critic Learning for Cart-Pole System (운반차-막대 시스템을 위한 적응비평학습에 의한 CMAC 제어계)

  • 권성규
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.10 no.5
    • /
    • pp.466-477
    • /
    • 2000
  • For developing a CMAC-based adaptive critic learning system to control the cart-pole system, various papers including neural network based learning control schemes as well as an adaptive critic learning algorithm with Adaptive Search Element are reviewed and the adaptive critic learning algorithm for the ASE is integrated into a CMAC controller. Also, quantization problems involved in integrating CMAC into ASE system are studied. By comparing the learning speed of the CMAC system with that of the ASE system and by considering the learning genemlization of the CMAC system with the adaptive critic learning, the applicability of the adaptive critic learning algorithm to CMAC is discussed.

  • PDF

Active Vibration Control of Structure using CMAC Neural Network under Earthquake (CMAC 신경망을 이용한 지진시 구조물의 진동제어)

  • 김동현
    • Proceedings of the Earthquake Engineering Society of Korea Conference
    • /
    • 2000.10a
    • /
    • pp.509-514
    • /
    • 2000
  • A structural control algorithm using CMAC(Cerebellar Model Articulation Controller) neural network is proposed Learning rule for CMAC is derived based on cost function. Learning convergence of CMAC is compared with MLNN(Multilayer Neural Network). Numerical examples are shown to verify the proposed control algorithm. Examples show that CMAC can be applicable to structural control with fast learning speed.

  • PDF

Neighborhood Sequential Training Technique for CMAC (CMAC을 위한 이웃간訓鍊 方法)

  • 권성규
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.16 no.10
    • /
    • pp.1816-1823
    • /
    • 1992
  • In order to develop general CMAC training technique applicable to any CMAC, characteristics of CMAC learning algorithm and training problems of CMAC are studied. Neighborhood Sequential Training technique which is general and free fro CMAC learning interference is proposed. The technique is used to generate mathematical functions and found to be effective.

LEARNING PERFORMANCE AND DESIGN OF AN ADAPTIVE CONTROL FUCTION GENERATOR: CMAC(Cerebellar Model Arithmetic Controller)

  • Choe, Dong-Yeop;Hwang, Hyeon
    • 한국기계연구소 소보
    • /
    • s.19
    • /
    • pp.125-139
    • /
    • 1989
  • As an adaptive control function generator, the CMAC (Cerebellar Model Arithmetic or Articulated Controller) based learning control has drawn a great attention to realize a rather robust real-time manipulator control under the various uncertainties. There remain, however, inherent problems to be solved in the CMAC application to robot motion control or perception of sensory information. To apply the CMAC to the various unmodeled or modeled systems more efficiently, it is necessary to analyze the effects of the CMAC control parameters on the trained net. Although the CMAC control parameters such as size of the quantizing block, learning gain, input offset, and ranges of input variables play a key role in the learning performance and system memory requirement, these have not been fully investigated yet. These parameters should be determined, of course, considering the shape of the desired function to be trained and learning algorithms applied. In this paper, the interrelation of these parameters with learning performance is investigated under the basic learning schemes presented by authors. Since an analytic approach only seems to be very difficult and even impossible for this purpose, various simulations have been performed with pre specified functions and their results were analyzed. A general step following design guide was set up according to the various simulation results.

  • PDF

CMAC (Cerebellar Model Arithmetic Controller)

  • Hwang, Heon;Choi, Dong-Y.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1989.10a
    • /
    • pp.675-681
    • /
    • 1989
  • As an adaptive control function generator, the CMAC (Cerebellar Model Arithmetic or Articulated Controller) based learning control has drawn a great attention to realize a rather robust real-time manipulator control under the various uncertainties. There remain, however, inherent problems to be solved in the CMAC application to robot motion control or perception of sensory information. To apply the CMAC to the various unmodeled or modeled systems more efficiently, It is necessary to analyze the effects of the CMAC control parameters an the trained net. Although the CMAC control parameters such as size of the quantizing block, learning gain, input offset, and ranges of input variables play a key role in the learning performance and system memory requirement, these have not been fully investigated yet. These parameters should be determined, of course, considering the shape of the desired function to be trained and learning algorithms applied. In this paper, the interrelation of these parameters with learning performance is investigated under the basic learning schemes presented by authors. Since an analytic approach only seems to be very difficult and even impossible for this purpose, various simulations have been performed with prespecified functions and their results were analyzed. A general step following design guide was set up according to the various simulation results.

  • PDF

Credit-Assigned-CMAC-based Reinforcement Learning with application to the Acrobot Swing Up Control Problem (Acrobot Swing Up 제어를 위한 Credit-Assigned-CMAC 기반의 강화학습)

  • Shin, Yeon-Yong;Jang, Si-Young;Seo, Seung-Hwan;Suh, Il-Hong
    • Proceedings of the KIEE Conference
    • /
    • 2003.11c
    • /
    • pp.621-624
    • /
    • 2003
  • For real world applications of reinforcement learning techniques, function approximation or generalization will be required to avoid curse of dimensionality. For this, an improved function approximation-based reinforcement learning method is proposed to speed up convergence by using CA-CMAC(Credit-Assigned Cerebellar Model Articulation Controller). To show that our proposed CACRL(CA-CMAC-based Reinforcement Learning) performs better than the CRL(CMAC-based Reinforcement Learning), computer simulation results are illustrated, where a swing-up control problem of an acrobot is considered.

  • PDF

A CMAC-based pressure tracking controller design for hydroforming process (CMAC를 이용한 하이드로 포밍 공정의 압력제어기 설계)

  • 이우호;박희재;조형석;현봉섭
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1989.10a
    • /
    • pp.302-307
    • /
    • 1989
  • A pressure tracking control of hydroforming process is considered in this paper. To account for nonlinearities and uncertainties of the process, an iterative learning control scheme is proposed using Cerebellar Model Arithmatic Computer (CMAC). The experimental result shows that the proposed learning control is superior to any fixed gain controller in the sense that it enables the system to do the same work more effectively as the number of operation increases.

  • PDF

Design for CMAC Neural Network Speed Controller of DC Motor by Digital Simulations (디지털 시뮬레이션에 의한 CMAC 신경망 직류전동기 속도 제어기 설계)

  • 최광호;조용범
    • The Transactions of the Korean Institute of Power Electronics
    • /
    • v.6 no.3
    • /
    • pp.273-281
    • /
    • 2001
  • In this paper, we propose a CMAC(Cerebellar Model Articulation Controller) neural network for controlling a non-linear system. CMAC is a neural network that models the human cerebellum. CMAC uses a table look-up method to resolve the complex non-linear system instead of numerical calculation method. It is very fast learn compared with other neural networks. It does not need a calculation time to generate control signals. The simulation results show that the proposed CMAC controllers for a simple non-linear function and a DC Motor speed control reduce tracking errors and improve the stability of its learning controllers. The validity of the proposed CMAC controller is also proved by the real-time tension control.

  • PDF