• Title/Summary/Keyword: Weight Learning

Search Result 658, Processing Time 0.028 seconds

Performance Improvement of Backpropagation Algorithm by Automatic Tuning of Learning Rate using Fuzzy Logic System

  • Jung, Kyung-Kwon;Lim, Joong-Kyu;Chung, Sung-Boo;Eom, Ki-Hwan
    • Journal of information and communication convergence engineering
    • /
    • v.1 no.3
    • /
    • pp.157-162
    • /
    • 2003
  • We propose a learning method for improving the performance of the backpropagation algorithm. The proposed method is using a fuzzy logic system for automatic tuning of the learning rate of each weight. Instead of choosing a fixed learning rate, the fuzzy logic system is used to dynamically adjust the learning rate. The inputs of fuzzy logic system are delta and delta bar, and the output of fuzzy logic system is the learning rate. In order to verify the effectiveness of the proposed method, we performed simulations on the XOR problem, character classification, and function approximation. The results show that the proposed method considerably improves the performance compared to the general backpropagation, the backpropagation with momentum, and the Jacobs'delta-bar-delta algorithm.

Application of Iterative Learning Control to 2-Mass Resonant System with Initial Position Error (위치 오차를 갖는 2관성 공진계에 대한 반복학습 제어의 적용에 관한 연구)

  • Lee, Hak-Seong
    • Proceedings of the KIEE Conference
    • /
    • 2003.11b
    • /
    • pp.307-310
    • /
    • 2003
  • In this paper, an iterative learning control method is applied to suppress the vibration of a 2-mass system which has a flexible coupling between a load an a motor. More specifically, conditions for the load speed without vibration are derived based on the steady-state condition. And the desired motor position trajectory is synthesized based on the relation between the load and motor speed. Finally, a PD-type learning iterative control law is applied for the desired motor position trajectory. Since the learning law applied for the desired trajectory guarantees the perfect tracking performance, the resulting load speed shows no vibration. In order to handle the initial position error, the PD-type learning law is changed to PID-type and a weight function is added to suppress the residual vibration caused by the initial error. The simulation results show the effectiveness of the proposed learning method.

  • PDF

Unsupervised Incremental Learning of Associative Cubes with Orthogonal Kernels

  • Kang, Hoon;Ha, Joonsoo;Shin, Jangbeom;Lee, Hong Gi;Wang, Yang
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.25 no.1
    • /
    • pp.97-104
    • /
    • 2015
  • An 'associative cube', a class of auto-associative memories, is revisited here, in which training data and hidden orthogonal basis functions such as wavelet packets or Fourier kernels, are combined in the weight cube. This weight cube has hidden units in its depth, represented by a three dimensional cubic structure. We develop an unsupervised incremental learning mechanism based upon the adaptive least squares method. Training data are mapped into orthogonal basis vectors in a least-squares sense by updating the weights which minimize an energy function. Therefore, a prescribed orthogonal kernel is incrementally assigned to an incoming data. Next, we show how a decoding procedure finds the closest one with a competitive network in the hidden layer. As noisy test data are applied to an associative cube, the nearest one among the original training data are restored in an optimal sense. The simulation results confirm robustness of associative cubes even if test data are heavily distorted by various types of noise.

A Comparative Study of Life Prediction using Accelerated Aging Tests and Machine Learning Techniques to Predict the Life of Composite Materials including CNT Materials (CNT소재를 포함하는 복합소재의 수명예측을 위해 가속열화 시험 및 머신러닝 기법을 이용한 수명예측 비교 연구)

  • Kim, Sung-Dong;Kim, Nam-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.05a
    • /
    • pp.456-458
    • /
    • 2022
  • Due to the environmental regulations of the International Maritime Organization, shipyards are conducting various researches to improve the efficiency of ships, and efforts are being made to reduce the weight of ships. Recently, composite materials including CNT materials have the advantage of being able to reduce weight by 40% or more compared to general steel plate materials, and have the advantage of being able to be used as a substitute for ship clamps or door skins. Therefore, in this study, to predict the life of composite materials including CNT materials, the results were compared through the accelerated deterioration test method and the life prediction using machine learning techniques. The accelerated degradation test used the Arrhenius model equation, and the machine learning method predicted the life using a regression analysis algorithm.

  • PDF

A construction of fuzzy controller using learning (학습을 이용한 퍼지 제어기의 구성)

  • 안상철;권욱현
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1992.10a
    • /
    • pp.484-489
    • /
    • 1992
  • The inference of fuzzy controller can be considered a mapping from the controller input to membership value. The membership value, a kind of weight, has a role to decide if the input is appropriate to the rule. The membership function is described by several values, which are decided by a learning method. The learning method is adopted from adaptive filtering theory. The simulation shows the proposed fuzzy controller can learn linear and nonlinear functions. the structure of the proposed fuzzy controller becomes a kind of neural network.

  • PDF

A Study for the Chinese Character Recognition Using IDMLP (IDMLP를 이용한 한자인식에 관한 연구)

  • 려진경;이우일;정호선
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.28B no.10
    • /
    • pp.783-789
    • /
    • 1991
  • A learing method for the recognition of printed Chinese character by using the input driven multi-layer perceptron model was proposed and the circuit representing the learning result was designed. In learning the extracted features from Chinese characters are used as inputs and the synapse's weight is integer value. So it is possible to implement the learning result with CMOS circuit.

  • PDF

A New Effective Learning Algorithm for a Neo Fuzzy Neuron Model

  • Yamakawa, Takeshi;Kusanagi, Hiroaki;Uchino, Eiji;Miki, Tsutomu
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1993.06a
    • /
    • pp.1017-1020
    • /
    • 1993
  • This paper describes a neo fuzzy neuron which was produced by a fusion of fuzzy logic and neuroscience. Some learning algorithms are presented. The guarantee for the global minimum on the error-weight space is proved by a reduction to absurdity. Enhanced is that the learning speed of the neo fuzzy neuron exceeds 100,000 times of that of conventional multi-layer neural networks.

  • PDF

Learning a Second Culture through Interactive Practices: A Study-Abroad Language Learners' Experiences

  • Lee, Eun-Sil
    • English Language & Literature Teaching
    • /
    • v.15 no.4
    • /
    • pp.137-156
    • /
    • 2009
  • This case study examines language learners' oral interactive practices and what they learn along with these practices. Language learners who study abroad take on the challenge of living in a foreign place and undergo difficulties in communicating and interacting with people in their new country. These difficulties, caused by cultural differences, are experienced most particularly in their daily interactions. Language learners' trials and efforts to learn English while dealing with a different culture and the difficulties are mainly observed for this paper. The process of learning a second culture is closely related to the process of learning a second language. Oral interactive practices can give the study abroad language learners opportunities to learn their target culture. Therefore, the purpose of this paper is to discuss how participating in interactive practices assists the learners in understanding their target culture while they deal with their difficulties inherent in studying abroad. This study adds weight to the notion that culture is an essential and major factor in learning a language, and that only active participation in interactions can be effective in learning both a language and its culture.

  • PDF

Prediction of Weight of Spiral Molding Using Injection Molding Analysis and Machine Learning (사출성형 CAE와 머신러닝을 이용한 스파이럴 성형품의 중량 예측)

  • Bum-Soo Kim;Seong-Yeol Han
    • Design & Manufacturing
    • /
    • v.17 no.1
    • /
    • pp.27-32
    • /
    • 2023
  • In this paper, we intend to predict the mass of the spiral using CAE and machine learning. First, We generated 125 data for the experiment through a complete factor design of 3 factors and 5 levels. Next, the data were derived by performing a molding analysis through CAE, and the machine learning process was performed using a machine learning tool. To select the optimal model among the models learned using the learning data, accuracy was evaluated using RMSE. The evaluation results confirmed that the Support Vector Machine had a good predictive performance. To evaluate the predictive performance of the predictive model, We randomly generated 10 non-overlapping data within the existing injection molding condition level. We compared the CAE and support vector machine results by applying random data. As a result, good performance was confirmed with a MAPE value of 0.48%.

  • PDF

A Dynamic Ensemble Method using Adaptive Weight Adjustment for Concept Drifting Streaming Data (컨셉 변동 스트리밍 데이터를 위한 적응적 가중치 조정을 이용한 동적 앙상블 방법)

  • Kim, Young-Deok;Park, Cheong Hee
    • Journal of KIISE
    • /
    • v.44 no.8
    • /
    • pp.842-853
    • /
    • 2017
  • Streaming data is a sequence of data samples that are consistently generated over time. The data distribution or concept can change over time, and this change becomes a factor to reduce the performance of a classification model. Adaptive incremental learning can maintain the classification performance by updating the current classification model with the weight adjusted according to the degree of concept drift. However, selecting the proper weight value depending on the degree of concept drift is difficult. In this paper, we propose a dynamic ensemble method based on adaptive weight adjustment according to the degree of concept drift. Experimental results demonstrate that the proposed method shows higher performance than the other compared methods.