• Title/Summary/Keyword: Sigmoid function

Search Result 202, Processing Time 0.028 seconds

Design of Nonlinear(Sigmoid) Activation Function for Digital Neural Network (Digital 신경회로망을 위한 비선형함수의 구현)

  • Kim, Jin-Tae;Chung, Duck-Jin
    • Proceedings of the KIEE Conference
    • /
    • 1993.07a
    • /
    • pp.501-503
    • /
    • 1993
  • A circuit of sigmoid function for neural network is designed by using Piecewise Linear (PWL) method. The slope of sigmoid function can be adjusted to 2 and 0.25. Also the circuit presents both sigmoid function and its differential form. The circuits is simulated by using ViewLogic. Theoretical and simulated performance agree with 1.8 percent.

  • PDF

Optimization of Sigmoid Activation Function Parameters using Genetic Algorithms and Pattern Recognition Analysis in Input Space of Two Spirals Problem (유전자알고리즘을 이용한 시그모이드 활성화 함수 파라미터의 최적화와 이중나선 문제의 입력공간 패턴인식 분석)

  • Lee, Sang-Wha
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.4
    • /
    • pp.10-18
    • /
    • 2010
  • This paper presents a optimization of sigmoid activation function parameter using genetic algorithms and pattern recognition analysis in input space of two spirals benchmark problem. To experiment, cascade correlation learning algorithm is used. In the first experiment, normal sigmoid activation function is used to analyze the pattern classification in input space of the two spirals problem. In the second experiment, sigmoid activation functions using different fixed values of the parameters are composed of 8 pools. In the third experiment, displacement of the sigmoid function to determine the value of the three parameters is obtained using genetic algorithms. The parameter values applied to the sigmoid activation functions for candidate neurons are used. To evaluate the performance of these algorithms, each step of the training input pattern classification shows the shape of the two spirals.

The Study of Neural Networks Using Orthogonal function System in Hidden-Layer (직교함수를 은닉층에 지닌 신경회로망에 대한 연구)

  • 권성훈;최용준;이정훈;유석용;엄기환;손동설
    • Proceedings of the IEEK Conference
    • /
    • 1999.06a
    • /
    • pp.482-485
    • /
    • 1999
  • In this paper we proposed a heterogeneous hidden layer consisting of both sigmoid functions and RBFs(Radial Basis Function) in multi-layered neural networks. Focusing on the orthogonal relationship between the sigmoid function and its derivative, a derived RBF that is a derivative of the sigmoid function is used as the RBF in the neural network. so the proposed neural network is called ONN(Orthogonal Neural Network). Identification results using a nonlinear function confirm both the ONN's feasibility and characteristics by comparing with those obtained using a conventional neural network which has sigmoid function or RBF in hidden layer

  • PDF

The Study of Neural Networks Using Orthogonal Function System (직교함수를 사용한 신경회로망에 대한 연구)

  • 권성훈;최용준;이정훈;손동설;엄기환
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 1999.11a
    • /
    • pp.214-217
    • /
    • 1999
  • In this paper we proposed a heterogeneous hidden layer consisting of both sigmoid functions and RBFs(Radial Basis Function) in multi-layered neural networks. Focusing on the orthogonal relationship between the sigmoid function and its derivative, a derived RBF that is a derivative of the sigmoid function is used as the RBF in the neural network. so the proposed neural network is called ONN's feasibility Neural Network). Identification results using a nonlinear. function confirm both the ONN's feasibility and characteristics by comparing with those obtained using a conventional neural network which has sigmoid function or RBF in hidden layer.

  • PDF

Improved Learning Algorithm with Variable Activating Functions

  • Pak, Ro-Jin
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.815-821
    • /
    • 2005
  • Among the various artificial neural networks the backpropagation network (BPN) has become a standard one. One of the components in a neural network is an activating function or a transfer function of which a representative function is a sigmoid. We have discovered that by updating the slope parameter of a sigmoid function simultaneous with the weights could improve performance of a BPN.

  • PDF

Sliding Mode Control with Nonlinear Interpolation in Variable Boundary Layer

  • Kim, Yookyung;Jeon, Gijoon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.35.1-35
    • /
    • 2002
  • $\textbullet$ Sliding mode control (SMC) with nonlinear interpolation in variable boundary layer (VBL) is proposed $\textbullet$ A sigmoid function is used for nonlinear interpolation in VBL. $\textbullet$ The Parameter of the sigmoid function is tuned by fuzzy controller $\textbullet$ The choice of parameter for the sigmoid function is guided by FC. $\textbullet$ The parameter is continuously updated as boundary layer thickness varies. $\textbullet$ The proposed method hasbetter tracking performance than the conventional linear interpolation $\textbullet$ To demonstrate its performance the proposed control algorithm is applied to a nonlinear system.

  • PDF

Design of a Sliding Mode Controller with Nonlinear Boundary Transfer Characteristics

  • Kim, Yoo K.;Gi J. Jeon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.164.2-164
    • /
    • 2001
  • Sliding mode control (SMC) with variable nonlinear boundary layer is proposed. Two Fuzzy logic controllers (FLCs) are used to decide both boundary layer thickness and nonlinear interpolation using sigmoid function in the boundary layer. The nonlinear interpolation in the boundary layer suing FLC reduces stead state error and chattering. Sigmoid function is used to nonlinear interpolation in the boundary layer sigmoid function parameter with FLC. To demonstrate its performance, the Proposed control algorithm is applied to a simple nonlinear system.

  • PDF

PMSM Sensorless Speed Control Using a High Speed Sliding Mode Observer (고속 슬라이딩모드 관측기를 이용한 PMSM 센서리스 속도제어)

  • Son, Ju-Beom;Kim, Hong-Ryel;Seo, Young-Soo;Lee, Jang-Myung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.3
    • /
    • pp.256-263
    • /
    • 2010
  • The paper proposes a sensorless speed control strategy for a PMSM (Permanent Magnet Synchronous Motor) based on a new SMO (Sliding Mode Observer), which substitutes a signum function with a sigmoid function. To apply robust sensorless control of PMSM against parameter fluctuations and disturbance, the high speed SMO is proposed, which estimates the rotor position and angular velocity from the back EMF. The low-pass filter and additional position compensation of the rotor are used to reduce the chattering problem commonly found in sliding mode observer with signum function, which becomes possible by applying the sigmoid function with the control of a switching function. Also the proposed sliding mode observer with the sigmoid function has better efficiency than the conventional sliding mode observer since it adjusts the observer gain by variable boundary layer and estimates the stator resistance. The stability of the proposed sliding mode observer is verified by the Lyapunov second method in determining the observer gain. The validity of the proposed high speed PMSM sensorless velocity control has been demonstrated by real experiments.

Error Reduction of Sliding Mode Control Using Sigmoid-Type Nonlinear Interpolation in the Boundary Layer

  • Kim, Yoo-K.;Jeon, Gi-J.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1810-1815
    • /
    • 2003
  • Sliding mode control with nonlinear interpolation in the boundary layer is proposed. A modified sigmoid function is used for nonlinear interpolation in the boundary layer and its parameter is tuned by a fuzzy logic controller. The fuzzy logic controller that takes the distance between the system state and the sliding surface as its input guides the choice of parameter of the modified sigmoid function and the parameter is on-line tuned. Owing to the decreased thickness, the proposed method has better tracking performance than the conventional linear interpolation method. To demonstrate its performance, the proposed control algorithm is applied to a simple nonlinear system model.

  • PDF