• 제목/요약/키워드: CMAC learning controller

검색결과 25건 처리시간 0.021초

다중 샘플링 타임을 갖는 CMAC 학습 제어기 실현: 역진자 제어 (CMAC Learning Controller Implementation With Multiple Sampling Rate: An Inverted Pendulum Example)

  • 이병수
    • 제어로봇시스템학회논문지
    • /
    • 제13권4호
    • /
    • pp.279-285
    • /
    • 2007
  • The objective of the research is two fold. The first is to design and propose a stable and robust learning control algorithm. The controller is CMAC Learning Controller which consists of a model-based controller, such as LQR or PID, as a reference control and a CMAC. The second objective is to implement a reference control and CMAC at two different sampling rates. Generally, a conventional controller is designed based on a mathematical plant model. However, increasing complexity of the plant and accuracy requirement on mathematical models nearly prohibits the application of the conventional controller design approach. To avoid inherent complexity and unavoidable uncertainty in modeling, biology mimetic methods have been developed. One of such attempts is Cerebellar Model Articulation Computer(CMAC) developed by Albus. CMAC has two main disadvantages. The first disadvantage of CMAC is increasing memory requirement with increasing number of input variables and with increasing accuracy demand. The memory needs can be solved with cheap memories due to recent development of new memory technology. The second disadvantage is a demand for processing powers which could be an obstacle especially when CMAC should be implemented in real-time. To overcome the disadvantages of CMAC, we propose CMAC learning controller with multiple sampling rates. With this approach a conventional controller which is a reference to CMAC at high enough sampling rate but CMAC runs at the processor's unoccupied time. To show efficiency of the proposed method, an inverted pendulum controller is designed and implemented. We also demonstrate it's possibility as an industrial control solution and robustness against a modeling uncertainty.

A Reinforcement Learning with CMAC

  • Kwon, Sung-Gyu
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제6권4호
    • /
    • pp.271-276
    • /
    • 2006
  • To implement a generalization of value functions in Adaptive Search Element (ASE)-reinforcement learning, CMAC (Cerebellar Model Articulation Controller) is integrated into ASE controller. ASE-reinforcement learning scheme is briefly studied to discuss how CMAC is integrated into ASE controller. Neighbourhood Sequential Training for CMAC is utilized to establish the look-up table and to produce discrete control outputs. In computer simulation, an ASE controller and a couple of ASE-CMAC neural network are trained to balance the inverted pendulum on a cart. The number of trials until the controllers are established and the learning performance of the controllers are evaluated to find that generalization ability of the CMAC improves the speed of the ASE-reinforcement learning enough to realize the cartpole control system.

운반차-막대 시스템을 위한 적응비평학습에 의한 CMAC 제어계 (CMAC Controller with Adaptive Critic Learning for Cart-Pole System)

  • 권성규
    • 한국지능시스템학회논문지
    • /
    • 제10권5호
    • /
    • pp.466-477
    • /
    • 2000
  • 이 논문에서는 운반차-막대 시스템을 제어하기 위한 CMAC을 이용한 적응 학습 제어계를 개발하기 위하여, 적응비평학습을 이용하는 신경망 제어계에 관한 여러 연구 문헌들을 조사하고, ASE 요소를 이용하는 적응비평학습 기법을 CMAC을 바탕으로 하는 제어계에 통합하였다. 적응비평학습 기법을 CMAC에 구현하는데 있어서의 변환 문제를 검토하고, CMAC 제어계와 ASE 제어계가 운반차-막대 문제를 학습하는 속도를 비교하여, CMAC 제어계의 학습 속도가 빠르기는 하지만, 입력 공간의 더 넓은 영역에 대해서는 학습효과를 발휘하지 못하는 문제의 관점에서 적응비평학습 방법이 CMAC의 특성과 어울리는지를 고찰하였다.

  • PDF

CMAC 신경망을 이용한 지진시 구조물의 진동제어 (Active Vibration Control of Structure using CMAC Neural Network under Earthquake)

  • 김동현
    • 한국지진공학회:학술대회논문집
    • /
    • 한국지진공학회 2000년도 추계 학술발표회 논문집 Proceedings of EESK Conference-Fall 2000
    • /
    • pp.509-514
    • /
    • 2000
  • A structural control algorithm using CMAC(Cerebellar Model Articulation Controller) neural network is proposed Learning rule for CMAC is derived based on cost function. Learning convergence of CMAC is compared with MLNN(Multilayer Neural Network). Numerical examples are shown to verify the proposed control algorithm. Examples show that CMAC can be applicable to structural control with fast learning speed.

  • PDF

CMAC을 위한 이웃간訓鍊 方法 (Neighborhood Sequential Training Technique for CMAC)

  • 권성규
    • 대한기계학회논문집
    • /
    • 제16권10호
    • /
    • pp.1816-1823
    • /
    • 1992
  • 본 연구에서는 CMAC의 훈련에 관련된 문제점 뿐만 아니라 효율적인 CMAC 훈련 방법의 개발에 관한 문제를 연구하였으며, 학습간섭의 영향을 전혀 받지 않으면서 CM- AC의 학습일반화(learning generalization) 특성을 살린, 일반적으로 응용될 수 있는 이웃간훈련방법을 제안하였다. 이 훈련 방법을 2변수 연속함수를 위한 2차원 CMAC의 훈련모사에 적용하여 전체 입력점 수의 1.3% 정도의 훈련 회수로 그 연속함수의 최대 함수값 1.0에 대해 0.0025의 제곱 평균 제곱근 오차(root mean square error, 이하 RMS error라 함)를 갖는 수준의 훈련성과를 거둘 수 있다.

LEARNING PERFORMANCE AND DESIGN OF AN ADAPTIVE CONTROL FUCTION GENERATOR: CMAC(Cerebellar Model Arithmetic Controller)

  • 최동엽;황현
    • 한국기계연구소 소보
    • /
    • 통권19호
    • /
    • pp.125-139
    • /
    • 1989
  • As an adaptive control function generator, the CMAC (Cerebellar Model Arithmetic or Articulated Controller) based learning control has drawn a great attention to realize a rather robust real-time manipulator control under the various uncertainties. There remain, however, inherent problems to be solved in the CMAC application to robot motion control or perception of sensory information. To apply the CMAC to the various unmodeled or modeled systems more efficiently, it is necessary to analyze the effects of the CMAC control parameters on the trained net. Although the CMAC control parameters such as size of the quantizing block, learning gain, input offset, and ranges of input variables play a key role in the learning performance and system memory requirement, these have not been fully investigated yet. These parameters should be determined, of course, considering the shape of the desired function to be trained and learning algorithms applied. In this paper, the interrelation of these parameters with learning performance is investigated under the basic learning schemes presented by authors. Since an analytic approach only seems to be very difficult and even impossible for this purpose, various simulations have been performed with pre specified functions and their results were analyzed. A general step following design guide was set up according to the various simulation results.

  • PDF

CMAC (Cerebellar Model Arithmetic Controller)

  • Hwang, Heon;Choi, Dong-Y.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1989년도 한국자동제어학술회의논문집; Seoul, Korea; 27-28 Oct. 1989
    • /
    • pp.675-681
    • /
    • 1989
  • As an adaptive control function generator, the CMAC (Cerebellar Model Arithmetic or Articulated Controller) based learning control has drawn a great attention to realize a rather robust real-time manipulator control under the various uncertainties. There remain, however, inherent problems to be solved in the CMAC application to robot motion control or perception of sensory information. To apply the CMAC to the various unmodeled or modeled systems more efficiently, It is necessary to analyze the effects of the CMAC control parameters an the trained net. Although the CMAC control parameters such as size of the quantizing block, learning gain, input offset, and ranges of input variables play a key role in the learning performance and system memory requirement, these have not been fully investigated yet. These parameters should be determined, of course, considering the shape of the desired function to be trained and learning algorithms applied. In this paper, the interrelation of these parameters with learning performance is investigated under the basic learning schemes presented by authors. Since an analytic approach only seems to be very difficult and even impossible for this purpose, various simulations have been performed with prespecified functions and their results were analyzed. A general step following design guide was set up according to the various simulation results.

  • PDF

Acrobot Swing Up 제어를 위한 Credit-Assigned-CMAC 기반의 강화학습 (Credit-Assigned-CMAC-based Reinforcement Learning with application to the Acrobot Swing Up Control Problem)

  • 신연용;장시영;서승환;서일홍
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2003년도 학술회의 논문집 정보 및 제어부문 B
    • /
    • pp.621-624
    • /
    • 2003
  • For real world applications of reinforcement learning techniques, function approximation or generalization will be required to avoid curse of dimensionality. For this, an improved function approximation-based reinforcement learning method is proposed to speed up convergence by using CA-CMAC(Credit-Assigned Cerebellar Model Articulation Controller). To show that our proposed CACRL(CA-CMAC-based Reinforcement Learning) performs better than the CRL(CMAC-based Reinforcement Learning), computer simulation results are illustrated, where a swing-up control problem of an acrobot is considered.

  • PDF

CMAC를 이용한 하이드로 포밍 공정의 압력제어기 설계 (A CMAC-based pressure tracking controller design for hydroforming process)

  • 이우호;박희재;조형석;현봉섭
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1989년도 한국자동제어학술회의논문집; Seoul, Korea; 27-28 Oct. 1989
    • /
    • pp.302-307
    • /
    • 1989
  • A pressure tracking control of hydroforming process is considered in this paper. To account for nonlinearities and uncertainties of the process, an iterative learning control scheme is proposed using Cerebellar Model Arithmatic Computer (CMAC). The experimental result shows that the proposed learning control is superior to any fixed gain controller in the sense that it enables the system to do the same work more effectively as the number of operation increases.

  • PDF

디지털 시뮬레이션에 의한 CMAC 신경망 직류전동기 속도 제어기 설계 (Design for CMAC Neural Network Speed Controller of DC Motor by Digital Simulations)

  • 최광호;조용범
    • 전력전자학회논문지
    • /
    • 제6권3호
    • /
    • pp.273-281
    • /
    • 2001
  • 본 논문에서는 비선형 시스템을 제어하기 위한 CMAC 신경망을 제안한다. CMAC 신경망은 사람의 소뇌를 모방한 신경망으로서 복잡한 비선형 함수의 해를 수치적인 연산에 의해 구하지 않고 table look-up방식을 이용하기 때문에 학습이 타 신경망에 비해 월등히 빠르고 용이하며 제어신호를 출력하기 위한 계산시간이 거의 필요치가 않다. 본 논문에서는 제안한 제어기 구조의 타당성을 증명하기 위해 간단한 비선형 함수와 직류전동기 속도제어에 대한 CMAC 제어기를 시뮬레이션을 통하여 학습 제어기의 안정성 및 추적에러의 감소를 확인하였다. 또한 제안 CMAC 제어기를 실시간 장력제어에 적용하여 직류전동기의 속도를 제어하므로 시뮬레이션 값과 비슷한 장력제어를 보인으로서 유용성을 입증하였다.

  • PDF