• Title/Summary/Keyword: Delta learning rule

Search Result 27, Processing Time 0.02 seconds

An Enhanced Fuzzy Single Layer Perceptron With Linear Activation Function (선형 활성화 함수를 이용한 개선된 퍼지 단층 퍼셉트론)

  • Park, Choong-Shik;Cho, Jae-Hyun;Kim, Kwang-Baek
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.7
    • /
    • pp.1387-1393
    • /
    • 2007
  • Even if the linearly separable patterns can be classified by the conventional single layer perceptron, the non-linear problems such as XOR can not be classified by it. A fuzzy single layer perceptron can solve the conventional XOR problems by applying fuzzy membership functions. However, in the fuzzy single layer perception, there are a couple disadvantages which are a decision boundary is sometimes vibrating and a convergence may be extremely lowered according to the scopes of the initial values and learning rates. In this paper, for these reasons, we proposed an enhanced fuzzy single layer perceptron algorithm that can prevent from vibration the decision boundary by introducing a bias term and can also reduce the learn time by applying the modified delta rule which include the learning rates and the momentum concept and applying the new linear activation function. Consequently, the simulation results of the XOR and pattern classification problems presented that the proposed method provided the shorter learning time and better convergence than the conventional fuzzy single layer perceptron.

The Speed Control of Induction Motor using Automatic Neural Network Gain Regulator (신경망이득 자동조절기를 이용한 유도모터 속도 제어)

  • Park, Wal-Seo;Kim, Yong-Wook;Lee, Sung-Su
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.20 no.7
    • /
    • pp.53-57
    • /
    • 2006
  • PID controller is widely uesd as automatic equipment for industry. However when a system has various characters of intermittence or continuance, a new parameter decision for accurate control is a hard task. As method of solving this problem, in this paper, a Neural Network gain automatic regulator as PID controller functions is presented. A property feedback control gain of system is decided by a rule of Delta learning. The function of proposed automatic Neural Network gain regulator is verified by speed control experiment results of Induction Motor.

A Design of Intelligent and Evolving Receiver Based on Stochastic Morphological Sampling Theorem (Stochastic Morphological Sampling Theorem을 이용한 지능형 진화형 수신기 구현)

  • 박재현;이경록송문호김운경
    • Proceedings of the IEEK Conference
    • /
    • 1998.06a
    • /
    • pp.46-49
    • /
    • 1998
  • In this paper, we introduce the notion of intelligent communication by introducing a novel intelligent receiver model. This receiver is continually evolving and learns and improves in performance as it compiles its experience over time. In digital communication context, in a typical training mode, it jearns the concept of "1" as is deteriorated by arbitrary (not necessarily additive as is typically assumed) disturbance and /or modulation. After learning "1", in test mode, it classifies the received signal "1" and "0" almost completely. The intelligent receiver as implemented is grounded on the recently introduced Stochastic Morphological Sampling Theorem(SMST), a distribution-free result which gives theoretical bounds on the sample complexity(training size) needed for the required performance parameters such as accuracy($\varepsilon$) and confidence($\delta$). Based on this theorem, we demonstrate --almost irrespective of channel and modulation model-- the number of samples needed to learn the concept of "1" is not too "large" and the resulting universal receiver structure, that corresponding to classical Nearest Neighbor rule in Pattern Recognition Theory, is trivial. We check the surprising efficiency and validity of this model through some simple simulations. and validity of this model through some simple simulations.

  • PDF

Estimating Evapotranspiration of Rice Crop Using Neural Networks -Application of Back-propagation and Counter-propagation Algorithm- (신경회로망을 이용한 수도 증발산량 예측 -백프로파게이션과 카운터프로파게이션 알고리즘의 적용-)

  • 이남호;정하우
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.36 no.2
    • /
    • pp.88-95
    • /
    • 1994
  • This paper is to evaluate the applicability of neural networks to the estimation of evapotranspiration. Two neural networks were developed to forecast daily evapotranspiration of the rice crop with back-propagation and counter-propagation algorithm. The neural network trained by back-propagation algorithm with delta learning rule is a three-layer network with input, hidden, and output layers. The other network with counter-propagation algorithm is a four-layer network with input, normalizing, competitive, and output layers. Training neural networks was conducted using daily actual evapotranspiration of rice crop and daily climatic data such as mean temperature, sunshine hours, solar radiation, relative humidity, and pan evaporation. During the training, neural network parameters were calibrated. The trained networks were applied to a set of field data not used in the training. The created response of the back-propagation network was in good agreement with desired values and showed better performances than the counter-propagation network did. Evaluating the neural network performance indicates that the back-propagation neural network may be applied to the estimation of evapotranspiration of the rice crop. This study does not provide with a conclusive statement as to the ability of a neural network to evapotranspiration estimating. More detailed study is required for better understanding and evaluating the behavior of neural networks.

  • PDF

Voltage Control of Generator using Neural Network Self Adaptative Control (신경망 자율 적응제어를 이용한 발전기의 전압제어)

  • Park, Wal-Seo;Oh, Hun;Yoo, Seok-Ju;La, Seong-Hoon
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.23 no.2
    • /
    • pp.103-107
    • /
    • 2009
  • PI controller is widely used as voltage control system of generator. However when a generator system has various characters of continuance, a new PI parameter decision for accurate control is a hard task as method of solving this problem, in this paper, the method to generator voltage control using Neural Network self adaptive control is presented. A property continuous feedback control gain of voltage control system is decided by a rule of delta learning. The function of proposed control method is verified by voltage control experiment results of DC generator.

A Study on the Experimental Application of the Artificial Neural Network for the Process Improvement (공정개선을 위한 인공신경망의 실험적 적용에 관한 연구)

  • 한우철
    • Journal of the Korea Society of Computer and Information
    • /
    • v.7 no.1
    • /
    • pp.174-183
    • /
    • 2002
  • In this paper a control chart pattern recognition methodology based on the back propagation algorithm and Multi layer perceptron, a neural computing theory, is presented. This pattern recognition algorithm, suitable for real time statistical process control. evaluates observations routinely collected for control charting to determine whether a Pattern, such as a cycle. trend or shift, which is exists in the data. This approach is promising because of its flexible training and high speed computation with low-end workstation. The artificial neural network methodology is developed utilizing the delta learning rule, sigmoid activation function with two hidden layers. In a computer integrated manufacturing environment, the operator need not routinely monitor the control chart but, rather, can be alerted to patterns by a computer signal generated by the proposed system.

  • PDF

The extension of the largest generalized-eigenvalue based distance metric Dij1) in arbitrary feature spaces to classify composite data points

  • Daoud, Mosaab
    • Genomics & Informatics
    • /
    • v.17 no.4
    • /
    • pp.39.1-39.20
    • /
    • 2019
  • Analyzing patterns in data points embedded in linear and non-linear feature spaces is considered as one of the common research problems among different research areas, for example: data mining, machine learning, pattern recognition, and multivariate analysis. In this paper, data points are heterogeneous sets of biosequences (composite data points). A composite data point is a set of ordinary data points (e.g., set of feature vectors). We theoretically extend the derivation of the largest generalized eigenvalue-based distance metric Dij1) in any linear and non-linear feature spaces. We prove that Dij1) is a metric under any linear and non-linear feature transformation function. We show the sufficiency and efficiency of using the decision rule $\bar{{\delta}}_{{\Xi}i}$(i.e., mean of Dij1)) in classification of heterogeneous sets of biosequences compared with the decision rules min𝚵iand median𝚵i. We analyze the impact of linear and non-linear transformation functions on classifying/clustering collections of heterogeneous sets of biosequences. The impact of the length of a sequence in a heterogeneous sequence-set generated by simulation on the classification and clustering results in linear and non-linear feature spaces is empirically shown in this paper. We propose a new concept: the limiting dispersion map of the existing clusters in heterogeneous sets of biosequences embedded in linear and nonlinear feature spaces, which is based on the limiting distribution of nucleotide compositions estimated from real data sets. Finally, the empirical conclusions and the scientific evidences are deduced from the experiments to support the theoretical side stated in this paper.