• Title/Summary/Keyword: radial basis function neural networks

Search Result 142, Processing Time 0.024 seconds

Hydrological Forecasting Based on Hybrid Neural Networks in a Small Watershed (중소하천유역에서 Hybrid Neural Networks에 의한 수문학적 예측)

  • Kim, Seong-Won;Lee, Sun-Tak;Jo, Jeong-Sik
    • Journal of Korea Water Resources Association
    • /
    • v.34 no.4
    • /
    • pp.303-316
    • /
    • 2001
  • In this study, Radial Basis Function(RBF) Neural Networks Model, a kind of Hybrid Neural Networks was applied to hydrological forecasting in a small watershed. RBF Neural Networks Model has four kinds of parameters in it and consists of unsupervised and supervised training patterns. And Gaussian Kernel Function(GKF) was used among many kinds of Radial Basis Functions(RBFs). K-Means clustering algorithm was applied to optimize centers and widths which ate the parameters of GKF. The parameters of RBF Neural Networks Model such as centers, widths weights and biases were determined by the training procedures of RBF Neural Networks Model. And, with these parameters the validation procedures of RBF Neural Networks Model were carried out. RBF Neural Networks Model was applied to Wi-Stream basin which is one of the IHP Representative basins in South Korea. 10 rainfall events were selected for training and validation of RBF Neural Networks Model. The results of RBF Neural Networks Model were compared with those of Elman Neural Networks(ENN) Model. ENN Model is composed of One Step Secant BackPropagation(OSSBP) and Resilient BackPropagation(RBP) algorithms. RBF Neural Networks shows better results than ENN Model. RBF Neural Networks Model spent less time for the training of model and can be easily used by the hydrologists with little background knowledge of RBF Neural Networks Model.

  • PDF

Design of Optimized Radial Basis Function Neural Networks Classifier with the Aid of Principal Component Analysis and Linear Discriminant Analysis (주성분 분석법과 선형판별 분석법을 이용한 최적화된 방사형 기저 함수 신경회로망 분류기의 설계)

  • Kim, Wook-Dong;Oh, Sung-Kwun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.22 no.6
    • /
    • pp.735-740
    • /
    • 2012
  • In this paper, we introduce design methodologies of polynomial radial basis function neural network classifier with the aid of Principal Component Analysis(PCA) and Linear Discriminant Analysis(LDA). By minimizing the information loss of given data, Feature data is obtained through preprocessing of PCA and LDA and then this data is used as input data of RBFNNs. The hidden layer of RBFNNs is built up by Fuzzy C-Mean(FCM) clustering algorithm instead of receptive fields and linear polynomial function is used as connection weights between hidden and output layer. In order to design optimized classifier, the structural and parametric values such as the number of eigenvectors of PCA and LDA, and fuzzification coefficient of FCM algorithm are optimized by Artificial Bee Colony(ABC) optimization algorithm. The proposed classifier is applied to some machine learning datasets and its result is compared with some other classifiers.

A Study on Feature Selection in Face Image Using Principal Component Analysis and Particle Swarm Optimization Algorithm (PCA와 입자 군집 최적화 알고리즘을 이용한 얼굴이미지에서 특징선택에 관한 연구)

  • Kim, Woong-Ki;Oh, Sung-Kwun;Kim, Hyun-Ki
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.12
    • /
    • pp.2511-2519
    • /
    • 2009
  • In this paper, we introduce the methodological system design via feature selection using Principal Component Analysis and Particle Swarm Optimization algorithms. The overall methodological system design comes from three kinds of modules such as preprocessing module, feature extraction module, and recognition module. First, Histogram equalization enhance the quality of image by exploiting contrast effect based on the normalized function generated from histogram distribution values of 2D face image. Secondly, PCA extracts feature vectors to be used for face recognition by using eigenvalues and eigenvectors obtained from covariance matrix. Finally the feature selection for face recognition among the entire feature vectors is considered by means of the Particle Swarm Optimization. The optimized Polynomial-based Radial Basis Function Neural Networks are used to evaluate the face recognition performance. This study shows that the proposed methodological system design is effective to the analysis of preferred face recognition.

Optimization for the Initial Designed Structure by Localization Using Genetic Algorithm

  • Kim, Seong-Joo;Kim, Yong-Taek;Ko, Jae-Yang;Jeon, Hong-Tae
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1650-1653
    • /
    • 2002
  • In this paper, we propose the initial optimized structure of the Radial Basis function Networks that is simple in the part of the structure and fast converges more than neural networks with the analysis method using Time- Frequency Localization. We construct the hidden node with the Radial Basis functions their localization are similar with approximation target function in the plane of the Time and Frequency. We finally make a good decision of the initial structure for function approximation using genetic algorithm

  • PDF

The Design of Optimized Type-2 Fuzzy Neural Networks and Its Application (최적 Type-2 퍼지신경회로망 설계와 응용)

  • Kim, Gil-Sung;Ahn, Ihn-Seok;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.8
    • /
    • pp.1615-1623
    • /
    • 2009
  • In order to develop reliable on-site partial discharge (PD) pattern recognition algorithm, we introduce Type-2 Fuzzy Neural Networks (T2FNNs) optimized by means of Particle Swarm Optimization(PSO). T2FNNs exploit Type-2 fuzzy sets which have a characteristic of robustness in the diverse area of intelligence systems. Considering the on-site situation where it is not easy to obtain voltage phases to be used for PRPDA (Phase Resolved Partial Discharge Analysis), the PD data sets measured in the laboratory were artificially changed into data sets with shifted voltage phases and added noise in order to test the proposed algorithm. Also, the results obtained by the proposed algorithm were compared with that of conventional Neural Networks(NNs) as well as the existing Radial Basis Function Neural Networks (RBFNNs). The T2FNNs proposed in this study were appeared to have better performance when compared to conventional NNs and RBFNNs.

Nonlinear Approximations Using RBF Neural Networks (RBF 신경망을 이용한 비선형 근사)

  • 박주영
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.6 no.2
    • /
    • pp.26-35
    • /
    • 1996
  • In this paper, some fundamental problems concerning RBF(radial-basis-function) networks and approximation of functions are addressed. First, a comprehensive introduction to RBF networks is given with typical RBF networks classified into three classes. Next, sharp conditions are given under which continuous functions of a finite number of real variables can be approximated arbitrarily well by a certain class of RBF networks. Finally, a related result is given concerning the representation of functions in the form of distributed RBF networks.

  • PDF

A Study on Static Situation Awareness System with the Aid of Optimized Polynomial Radial Basis Function Neural Networks (최적화된 pRBF 뉴럴 네트워크에 의한 정적 상황 인지 시스템에 관한 연구)

  • Oh, Sung-Kwun;Na, Hyun-Suk;Kim, Wook-Dong
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.60 no.12
    • /
    • pp.2352-2360
    • /
    • 2011
  • In this paper, we introduce a comprehensive design methodology of Radial Basis Function Neural Networks (RBFNN) that is based on mechanism of clustering and optimization algorithm. We can divide some clusters based on similarity of input dataset by using clustering algorithm. As a result, the number of clusters is equal to the number of nodes in the hidden layer. Moreover, the centers of each cluster are used into the centers of each receptive field in the hidden layer. In this study, we have applied Fuzzy-C Means(FCM) and K-Means(KM) clustering algorithm, respectively and compared between them. The weight connections of model are expanded into the type of polynomial functions such as linear and quadratic. In this reason, the output of model consists of relation between input and output. In order to get the optimal structure and better performance, Particle Swarm Optimization(PSO) is used. We can obtain optimized parameters such as both the number of clusters and the polynomial order of weights connection through structural optimization as well as the widths of receptive fields through parametric optimization. To evaluate the performance of proposed model, NXT equipment offered by National Instrument(NI) is exploited. The situation awareness system-related intelligent model was built up by the experimental dataset of distance information measured between object and diverse sensor such as sound sensor, light sensor, and ultrasonic sensor of NXT equipment.

Forecasting of Runoff Hydrograph Using Neural Network Algorithms (신경망 알고리즘을 적용한 유출수문곡선의 예측)

  • An, Sang-Jin;Jeon, Gye-Won;Kim, Gwang-Il
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.4
    • /
    • pp.505-515
    • /
    • 2000
  • THe purpose of this study is to forecast of runoff hydrographs according to rainfall event in a stream. The neural network theory as a hydrologic blackbox model is used to solve hydrological problems. The Back-Propagation(BP) algorithm by the Levenberg-Marquardt(LM) techniques and Radial Basis Function(RBF) network in Neural Network(NN) models are used. Runoff hydrograph is forecasted in Bocheongstream basin which is a IHP the representative basin. The possibility of a simulation for runoff hydrographs about unlearned stations is considered. The results show that NN models are performed to effective learning for rainfall-runoff process of hydrologic system which involves a complexity and nonliner relationships. The RBF networks consist of 2 learning steps. The first step is an unsupervised learning in hidden layer and the next step is a supervised learning in output layer. Therefore, the RBF networks could provide rather time saved in the learning step than the BP algorithm. The peak discharge both BP algorithm and RBF network model in the estimation of an unlearned are a is trended to observed values.

  • PDF

Visual servoing of robot manipulator by fuzzy membership function based neural network (퍼지 신경망에 의한 로보트의 시각구동)

  • 김태원;서일홍;조영조
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1992.10a
    • /
    • pp.874-879
    • /
    • 1992
  • It is shown that there exists a nonlinear mappping which transforms features and their changes to the desired camera motion without measurement of the relative distance between the camera and the part, and the nonlinear mapping can eliminate several difficulties encountered when using the inverse of the feature Jacobian as in the usual feature-based visual feedback controls. And instead of analytically deriving the closed form of such a nonlinear mapping, a fuzzy membership function (FMF) based neural network is then proposed to approximate the nonlinear mapping, where the structure of proposed networks is similar to that of radial basis function neural network which is known to be very useful in function approximations. The proposed FMF network is trained to be capable of tracking moving parts in the whole work space along the line of sight. For the effective implementation of proposed IMF networks, an image feature selection processing is investigated, and required fuzzy membership functions are designed. Finally, several numerical examples are illustrated to show the validities of our proposed visual servoing method.

  • PDF

A Practical Radial Basis Function Network and Its Applications

  • Yang, S.Q.;Jia, C.Y.
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2001.10a
    • /
    • pp.297-300
    • /
    • 2001
  • Artificial neural networks have become important tools in many fields. This paper describes a new algorithm fur training an RBF network. This algorithm has two main advantages: higher accuracy and a too stable learning process. In addition, it can be used as a good classifier in pattern recognition.

  • PDF