• 제목/요약/키워드: Gradient Descent Method

검색결과 234건 처리시간 0.033초

경사감소학습을 이용한 이동로봇의 적응 PD 제어 방법 (An Adaptive PD Control Method for Mobile Robots Using Gradient Descent Learning)

  • 최영규;박진현
    • 한국정보통신학회논문지
    • /
    • 제20권9호
    • /
    • pp.1679-1687
    • /
    • 2016
  • 이동로봇은 유연한 생산시스템이 필요한 산업현장에서 유용하게 사용된다. 이동로봇이 생산부품과 같은 기계적 부하를 싣고 정해진 경로를 따라 정확히 이동하여야 하며 통상 기구학적 제어기가 사용되고 있다. 그러나 부하가 매우 크고 비선형 마찰도 클 경우, 기구학적 제어기로 만족할 만한 제어성능을 기대할 수 없어서 동적 제어기가 연구되고 있다. 기존의 동적 제어기는 부하의 무게와 위치를 정확히 알아야 한다는 조건이 있다. 그러나 실제 기계적 부하는 빈번히 변하고 정확히 알 수 없으므로 기존의 동적제어기 성능에 한계가 있다. 따라서 기계적 부하를 정확히 알지 못해도 이동로봇의 동적제어가 작동하도록 경사감소학습을 이용하여 적응 PD 제어 방법을 본 논문에서 제안하였다. 여러 가지 부하 변동 조건하에서 다양하게 시뮬레이션 하여 본 논문의 적응 PD 제어 방법이 기존의 방법보다 폭넓은 수렴영역을 가지고 있음을 확인하였다.

Pruning and Learning Fuzzy Rule-Based Classifier

  • Kim, Do-Wan;Park, Jin-Bae;Joo, Young-Hoon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2004년도 ICCAS
    • /
    • pp.663-667
    • /
    • 2004
  • This paper presents new pruning and learning methods for the fuzzy rule-based classifier. The structure of the proposed classifier is framed from the fuzzy sets in the premise part of the rule and the Bayesian classifier in the consequent part. For the simplicity of the model structure, the unnecessary features for each fuzzy rule are eliminated through the iterative pruning algorithm. The quality of the feature is measured by the proposed correctness method, which is defined as the ratio of the fuzzy values for a set of the feature values on the decision region to one for all feature values. For the improvement of the classification performance, the parameters of the proposed classifier are finely adjusted by using the gradient descent method so that the misclassified feature vectors are correctly re-categorized. The cost function is determined as the squared-error between the classifier output for the correct class and the sum of the maximum output for the rest and a positive scalar. Then, the learning rules are derived from forming the gradient. Finally, the fuzzy rule-based classifier is tested on two data sets and is found to demonstrate an excellent performance.

  • PDF

확률적 근사법과 공액기울기법을 이용한 다층신경망의 효율적인 학습 (An Efficient Traning of Multilayer Neural Newtorks Using Stochastic Approximation and Conjugate Gradient Method)

  • 조용현
    • 한국지능시스템학회논문지
    • /
    • 제8권5호
    • /
    • pp.98-106
    • /
    • 1998
  • 본 논문에서는 신경망의 학습성능을 개선하기 위해 확룰적 근사법과 공액기울기법에 기초를 둔 새로운 학습방법을 제안하였다. 제안된 방법에서는 확률적 근사법과 공액기울기법을 조합 사용한 전역 최적화 기법의 역전파 알고리즘을 적용함으로써 학습성능을 최대한 개선할 수 있도록 하였다. 확률적 근사법은 국소최소점을 벗어나 전역최적점에 치우친 근사점을 결정해 주는 기능을 하도록 하며, 이점을 초기값으로 하여 결정론적 기법의 공액기울기법을 적용함으로써 빠른 수렴속도로 전역최적점으로의 수렴확률을 놓였다. 제안된 방법을 패리티 검사와 패턴 분류에 각각 적용하여 그 타당성과 성능을 확인한 결과 제안된 방법은 초기값을 무작위로 설정하는 기울기하강법에 기초를 둔 기존의 역전파 알고리즘이나 확률적 근사법과 기울기하강법에 기초를 둔 역전파 알고리즘에 비해 최적해로의 수렴 확률과 그 수렴속도가 우수함을 확인할 수 있었다.

  • PDF

학습기능을 사용한 Z. Cao의 퍼지추론방식 (Z. Cao's Fuzzy Reasoning Method using Learning Ability)

  • 박진현;이태환
    • 한국정보통신학회:학술대회논문집
    • /
    • 한국해양정보통신학회 2008년도 춘계종합학술대회 A
    • /
    • pp.193-196
    • /
    • 2008
  • 과거 Z. cao는 Relation matrix를 사용한 정밀한 추론이 가능한 NFRM(New fuzzy reasoning method)을 제안하였다. 이는 추론의 규칙 수가 적음에도 불구하고 Mamdani의 퍼지추론방식에 비하여 좋은 성능을 보였다. 그러나 정밀한 추론을 위하여 relation matrix는 시행착오법을 사용하여 구하고, 이는 많은 시간과 노력이 필요하다. 본 연구에서는 이러한 relation matrix를 구하기 위하여 시행착오법에 의해 소요되는 많은 시간과 노력을 줄이고, 더욱 정밀한 추론 성능의 개선을 위하여 경사감소학습법을 사유한 학습기능을 갖는 Z. Cao의 퍼지추론 방식을 제안하고자 한다.

  • PDF

다양한 평가 지표와 최적화 기법을 통한 오염부하 산정 회귀 모형 평가 (Evaluation of Regression Models with various Criteria and Optimization Methods for Pollutant Load Estimations)

  • 김종건;임경재;박윤식
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2018년도 학술발표회
    • /
    • pp.448-448
    • /
    • 2018
  • In this study, the regression models (Load ESTimator and eight-parameter model) were evaluated to estimate instantaneous pollutant loads under various criteria and optimization methods. As shown in the results, LOADEST commonly used in interpolating pollutant loads could not necessarily provide the best results with the automatic selected regression model. It is inferred that the various regression models in LOADEST need to be considered to find the best solution based on the characteristics of watersheds applied. The recently developed eight-parameter model integrated with Genetic Algorithm (GA) and Gradient Descent Method (GDM) were also compared with LOADEST indicating that the eight-parameter model performed better than LOADEST, but it showed different behaviors in calibration and validation. The eight-parameter model with GDM could reproduce the nitrogen loads properly outside of calibration period (validation). Furthermore, the accuracy and precision of model estimations were evaluated using various criteria (e.g., $R^2$ and gradient and constant of linear regression line). The results showed higher precisions with the $R^2$ values closed to 1.0 in LOADEST and better accuracy with the constants (in linear regression line) closed to 0.0 in the eight-parameter model with GDM. In hence, based on these finding we recommend that users need to evaluate the regression models under various criteria and calibration methods to provide the more accurate and precise results for pollutant load estimations.

  • PDF

New Fuzzy Inference System Using a Kernel-based Method

  • Kim, Jong-Cheol;Won, Sang-Chul;Suga, Yasuo
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.2393-2398
    • /
    • 2003
  • In this paper, we proposes a new fuzzy inference system for modeling nonlinear systems given input and output data. In the suggested fuzzy inference system, the number of fuzzy rules and parameter values of membership functions are automatically decided by using the kernel-based method. The kernel-based method individually performs linear transformation and kernel mapping. Linear transformation projects input space into linearly transformed input space. Kernel mapping projects linearly transformed input space into high dimensional feature space. The structure of the proposed fuzzy inference system is equal to a Takagi-Sugeno fuzzy model whose input variables are weighted linear combinations of input variables. In addition, the number of fuzzy rules can be reduced under the condition of optimizing a given criterion by adjusting linear transformation matrix and parameter values of kernel functions using the gradient descent method. Once a structure is selected, coefficients in consequent part are determined by the least square method. Simulated result illustrates the effectiveness of the proposed technique.

  • PDF

유전자 알고리즘을 위한 지역적 미세 조정 메카니즘 (Genetic Algorithm with the Local Fine-Tuning Mechanism)

  • 임영희
    • 인지과학
    • /
    • 제4권2호
    • /
    • pp.181-200
    • /
    • 1994
  • 다층 신경망의 학습에 있어서 역전파 알고리즘은 시스템이 지역적 최소치에 빠질수 있고,탐색공간의 피라미터들에 의해 신경망 시스템의 성능이 크게 좌우된다는 단점이 있다.이러한 단점을 보완하기 의해 유전자 알고리즘이 신경망의 학습에 도입도었다.그러나 유전자 알고리즘에는 역전파 알고리즘과 같은 미세 조정되는 지역적 탐색(fine-tuned local search) 을 위한 메카니즘이 존재하지 않으므로 시스템이 전역적 최적해로 수렴하는데 많은 시간을 필요로 한다는 단점이 있다. 따라서 본 논문에서는 역전파 알고리즘의 기울기 강하 기법(gradient descent method)을 교배나 돌연변이와 같은 유전 연산자로 둠으로써 유전자 알고리즘에 지역적 미세 조정(local fine-tuning)을 위한 메카니즘을 제공해주는 새로운 형태의 GA-BP 방법을 제안한다.제안된 방법의 유용성을 보이기 위해 3-패러티 비트(3-parity bit) 문제에 실험하였다.

Fuzzy Learning Method Using Genetic Algorithms

  • Choi, Sangho;Cho, Kyung-Dal;Park, Sa-Joon;Lee, Malrey;Kim, Kitae
    • 한국멀티미디어학회논문지
    • /
    • 제7권6호
    • /
    • pp.841-850
    • /
    • 2004
  • This paper proposes a GA and GDM-based method for removing unnecessary rules and generating relevant rules from the fuzzy rules corresponding to several fuzzy partitions. The aim of proposed method is to find a minimum set of fuzzy rules that can correctly classify all the training patterns. When the fine fuzzy partition is used with conventional methods, the number of fuzzy rules has been enormous and the performance of fuzzy inference system became low. This paper presents the application of GA as a means of finding optimal solutions over fuzzy partitions. In each rule, the antecedent part is made up the membership functions of a fuzzy set, and the consequent part is made up of a real number. The membership functions and the number of fuzzy inference rules are tuned by means of the GA, while the real numbers in the consequent parts of the rules are tuned by means of the gradient descent method. It is shown that the proposed method has improved than the performance of conventional method in formulating and solving a combinatorial optimization problem that has two objectives: to maximize the number of correctly classified patterns and to minimize the number of fuzzy rules.

  • PDF

Stable Intelligent Control of Chaotic Systems via Wavelet Neural Network

  • Choi, Jong-Tae;Choi, Yoon-Ho;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.316-321
    • /
    • 2003
  • This paper presents a design method of the wavelet neural network based controller using direct adaptive control method to deal with a stable intelligent control of chaotic systems. The various uncertainties, such as mechanical parametric variation, external disturbance, and unstructured uncertainty influence the control performance. However, the conventional control methods such as optimal control, adaptive control and robust control may not be feasible when an explicit, faithful mathematical model cannot be constructed. Therefore, an intelligent control system that is an on-line trained WNN controller based on direct adaptive control method with adaptive learning rates is proposed to control chaotic nonlinear systems whose mathematical models are not available. The adaptive learning rates are derived in the sense of discrete-type Lyapunov stability theorem, so that the convergence of the tracking error can be guaranteed in the closed-loop system. In the whole design process, the strict constrained conditions and prior knowledge of the controlled plant are not necessary due to the powerful learning ability of the proposed intelligent control system. The gradient-descent method is used for training a wavelet neural network controller of chaotic systems. Finally, the effectiveness and feasibility of the proposed control method is demonstrated with application to the chaotic systems.

  • PDF

Fuzzy-Sliding Mode Control of a Polishing Robot Based on Genetic Algorithm

  • Go, Seok-Jo;Lee, Min-Cheol;Park, Min-Kyu
    • Journal of Mechanical Science and Technology
    • /
    • 제15권5호
    • /
    • pp.580-591
    • /
    • 2001
  • This paper proposes a fuzzy-sliding mode control which is designed by a self tuning fuzzy inference method based on a genetic algorithm. Using the method, the number of inference rules and the shape of the membership functions of the proposed fuzzy-sliding mode control are optimized without the aid of an expert in robotics. The fuzzy outputs of the consequent part are updated by the gradient descent method. It is further guaranteed that the selected solution becomes the global optimal solution by optimizing Akaikes information criterion expressing the quality of the inference rules. In order to evaluate the learning performance of the proposed fuzzy-sliding mode control based on a genetic algorithm, a trajectory tracking simulation of the polishing robot is carried out. Simulation results show that the optimal fuzzy inference rules are automatically selected by the genetic algorithm and the trajectory control result is similar to the result of the fuzzy-sliding mode control which is selected through trial error by an expert. Therefore, a designer who does not have expert knowledge of robot systems can design the fuzzy-sliding mode controller using the proposed self tuning fuzzy inference method based on the genetic algorithm.

  • PDF