• Title/Summary/Keyword: self-organizing neural networks

Search Result 129, Processing Time 0.026 seconds

3D Object Recognition Using SOFM (3D Object Recognition Using SOFM)

  • Cho, Hyun-Chul;Shon, Ho-Woong
    • Journal of the Korean Geophysical Society
    • /
    • v.9 no.2
    • /
    • pp.99-103
    • /
    • 2006
  • 3D object recognition independent of translation and rotation using an ultrasonic sensor array, invariant moment vectors and SOFM(Self Organizing Feature Map) neural networks is presented. Using invariant moment vectors of the acquired 16×8 pixel data of square, rectangular, cylindric and regular triangular blocks, 3D objects could be classified by SOFM neural networks. Invariant moment vectors are constant independent of translation and rotation. The recognition rates for the training and testing data were 95.91% and 92.13%, respectively.

  • PDF

Self-organizing Networks with Activation Nodes Based on Fuzzy Inference and Polynomial Function (펴지추론과 다항식에 기초한 활성노드를 가진 자기구성네트윅크)

  • 김동원;오성권
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.15-15
    • /
    • 2000
  • In the past couple of years, there has been increasing interest in the fusion of neural networks and fuzzy logic. Most of the existing fused models have been proposed to implement different types of fuzzy reasoning mechanisms and inevitably they suffer from the dimensionality problem when dealing with complex real-world problem. To overcome the problem, we propose the self-organizing networks with activation nodes based on fuzzy inference and polynomial function. The proposed model consists of two parts, one is fuzzy nodes which each node is operated as a small fuzzy system with fuzzy implication rules, and its fuzzy system operates with Gaussian or triangular MF in Premise part and constant or regression polynomials in consequence part. the other is polynomial nodes which several types of high-order polynomials such as linear, quadratic, and cubic form are used and are connected as various kinds of multi-variable inputs. To demonstrate the effectiveness of the proposed method, time series data for gas furnace process has been applied.

  • PDF

Machine-Part Grouping with Alternative Process Plan - An algorithm based on the self-organizing neural networks - (대체공정이 있는 기계-부품 그룹의 형성 - 자기조직화 신경망을 이용한 해법 -)

  • Jeon, Yong-Deok
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.39 no.3
    • /
    • pp.83-89
    • /
    • 2016
  • The group formation problem of the machine and part is a critical issue in the planning stage of cellular manufacturing systems. The machine-part grouping with alternative process plans means to form machine-part groupings in which a part may be processed not only by a specific process but by many alternative processes. For this problem, this study presents an algorithm based on self organizing neural networks, so called SOM (Self Organizing feature Map). The SOM, a special type of neural networks is an intelligent tool for grouping machines and parts in group formation problem of the machine and part. SOM can learn from complex, multi-dimensional data and transform them into visually decipherable clusters. In the proposed algorithm, output layer in SOM network had been set as one-dimensional structure and the number of output node has been set sufficiently large in order to spread out the input vectors in the order of similarity. In the first stage of the proposed algorithm, SOM has been applied twice to form an initial machine-process group. In the second stage, grouping efficacy is considered to transform the initial machine-process group into a final machine-process group and a final machine-part group. The proposed algorithm was tested on well-known machine-part grouping problems with alternative process plans. The results of this computational study demonstrate the superiority of the proposed algorithm. The proposed algorithm can be easily applied to the group formation problem compared to other meta-heuristic based algorithms. In addition, it can be used to solve large-scale group formation problems.

GA-based Feed-forward Self-organizing Neural Network Architecture and Its Applications for Multi-variable Nonlinear Process Systems

  • Oh, Sung-Kwun;Park, Ho-Sung;Jeong, Chang-Won;Joo, Su-Chong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.3 no.3
    • /
    • pp.309-330
    • /
    • 2009
  • In this paper, we introduce the architecture of Genetic Algorithm(GA) based Feed-forward Polynomial Neural Networks(PNNs) and discuss a comprehensive design methodology. A conventional PNN consists of Polynomial Neurons, or nodes, located in several layers through a network growth process. In order to generate structurally optimized PNNs, a GA-based design procedure for each layer of the PNN leads to the selection of preferred nodes(PNs) with optimal parameters available within the PNN. To evaluate the performance of the GA-based PNN, experiments are done on a model by applying Medical Imaging System(MIS) data to a multi-variable software process. A comparative analysis shows that the proposed GA-based PNN is modeled with higher accuracy and more superb predictive capability than previously presented intelligent models.

A new Design of Granular-oriented Self-organizing Polynomial Neural Networks (입자화 중심 자기구성 다항식 신경 회로망의 새로운 설계)

  • Oh, Sung-Kwun;Park, Ho-Sung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.61 no.2
    • /
    • pp.312-320
    • /
    • 2012
  • In this study, we introduce a new design methodology of a granular-oriented self-organizing polynomial neural networks (GoSOPNNs) that is based on multi-layer perceptron with Context-based Polynomial Neurons (CPNs) or Polynomial Neurons (PNs). In contrast to the typical architectures encountered in polynomial neural networks (PNN), our main objective is to develop a methodological design strategy of GoSOPNNs as follows : (a) The 1st layer of the proposed network consists of Context-based Polynomial Neuron (CPN). In here, CPN is fully reflective of the structure encountered in numeric data which are granulated with the aid of Context-based Fuzzy C-Means (C-FCM) clustering method. The context-based clustering supporting the design of information granules is completed in the space of the input data while the build of the clusters is guided by a collection of some predefined fuzzy sets (so-called contexts) defined in the output space. (b) The proposed design procedure being applied at each layer of GoSOPNN leads to the selection of preferred nodes of the network (CPNs or PNs) whose local characteristics (such as the number of contexts, the number of clusters, a collection of the specific subset of input variables, and the order of the polynomial) can be easily adjusted. These options contribute to the flexibility as well as simplicity and compactness of the resulting architecture of the network. For the evaluation of performance of the proposed GoSOPNN network, we describe a detailed characteristic of the proposed model using a well-known learning machine data(Automobile Miles Per Gallon Data, Boston Housing Data, Medical Image System Data).

Advanced Self-Organizing Neural Networks Based on Competitive Fuzzy Polynomial Neurons (경쟁적 퍼지다항식 뉴런에 기초한 고급 자기구성 뉴럴네트워크)

  • 박호성;박건준;이동윤;오성권
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.3
    • /
    • pp.135-144
    • /
    • 2004
  • In this paper, we propose competitive fuzzy polynomial neurons-based advanced Self-Organizing Neural Networks(SONN) architecture for optimal model identification and discuss a comprehensive design methodology supporting its development. The proposed SONN dwells on the ideas of fuzzy rule-based computing and neural networks. And it consists of layers with activation nodes based on fuzzy inference rules and regression polynomial. Each activation node is presented as Fuzzy Polynomial Neuron(FPN) which includes either the simplified or regression polynomial fuzzy inference rules. As the form of the conclusion part of the rules, especially the regression polynomial uses several types of high-order polynomials such as linear, quadratic, and modified quadratic. As the premise part of the rules, both triangular and Gaussian-like membership (unction are studied and the number of the premise input variables used in the rules depends on that of the inputs of its node in each layer. We introduce two kinds of SONN architectures, that is, the basic and modified one with both the generic and the advanced type. Here the basic and modified architecture depend on the number of input variables and the order of polynomial in each layer. The number of the layers and the nodes in each layer of the SONN are not predetermined, unlike in the case of the popular multi-layer perceptron structure, but these are generated in a dynamic way. The superiority and effectiveness of the Proposed SONN architecture is demonstrated through two representative numerical examples.

Intelligent Control by Immune Network Algorithm Based Auto-Weight Function Tuning

  • Kim, Dong-Hwa
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2002.10a
    • /
    • pp.120.2-120
    • /
    • 2002
  • In this paper auto-tuning scheme of weight function in the neural networks has been suggested by immune algorithm for nonlinear process. A number of structures of the neural networks are considered as learning methods for control system. A general view is provided that they are the special cases of either the membership functions or the modification of network structure in the neural networks. On the other hand, since the immune network system possesses a self organizing and distributed memory, it is thus adaptive to its external environment and allows a PDP (parallel distributed processing) network to complete patterns against the environmental situation. Also. It can provi..

  • PDF

Advanced Polynomial Neural Networks Architecture with New Adaptive Nodes

  • Oh, Sung-Kwun;Kim, Dong-Won;Park, Byoung-Jun;Hwang, Hyung-Soo
    • Transactions on Control, Automation and Systems Engineering
    • /
    • v.3 no.1
    • /
    • pp.43-50
    • /
    • 2001
  • In this paper, we propose the design procedure of advance Polynomial Neural Networks(PNN) architecture for optimal model identification of complex and nonlinear system. The proposed PNN architecture is presented as the generic and advanced type. The essence of the design procedure dwells on the Group Method of Data Handling(GMDH). PNN is a flexible neural architecture whose structure is developed through learning. In particular, the number of layers of the PNN is not fixed in advance but is generated in a dynamic way. In this sense, PNN is a self-organizing network. With the aid of three representative numerical examples, compari-sons show that the proposed advanced PNN algorithm can produce the model with higher accuracy than previous other works. And performance index related to approximation and generalization capabilities of model is evaluated and also discussed.

  • PDF

Genetically Optimized Self-Organizing Polynomial Neural Networks (진화론적 최적 자기구성 다항식 뉴럴 네트워크)

  • 박호성;박병준;장성환;오성권
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.1
    • /
    • pp.40-49
    • /
    • 2004
  • In this paper, we propose a new architecture of Genetic Algorithms(GAs)-based Self-Organizing Polynomial Neural Networks(SOPNN), discuss a comprehensive design methodology and carry out a series of numeric experiments. The conventional SOPNN is based on the extended Group Method of Data Handling(GMDH) method and utilized the polynomial order (viz. linear, quadratic, and modified quadratic) as well as the number of node inputs fixed (selected in advance by designer) at Polynomial Neurons (or nodes) located in each layer through a growth process of the network. Moreover it does not guarantee that the SOPNN generated through learning has the optimal network architecture. But the proposed GA-based SOPNN enable the architecture to be a structurally more optimized network, and to be much more flexible and preferable neural network than the conventional SOPNN. In order to generate the structurally optimized SOPNN, GA-based design procedure at each stage (layer) of SOPNN leads to the selection of preferred nodes (or PNs) with optimal parameters- such as the number of input variables, input variables, and the order of the polynomial-available within SOPNN. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between approximation and generalization (predictive) abilities of the model. A detailed design procedure is discussed in detail. To evaluate the performance of the GA-based SOPNN, the model is experimented with using two time series data (gas furnace and NOx emission process data of gas turbine power plant). A comparative analysis shows that the proposed GA-based SOPNN is model with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

Reinforcement Learning Control using Self-Organizing Map and Multi-layer Feed-Forward Neural Network

  • Lee, Jae-Kang;Kim, Il-Hwan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.142-145
    • /
    • 2003
  • Many control applications using Neural Network need a priori information about the objective system. But it is impossible to get exact information about the objective system in real world. To solve this problem, several control methods were proposed. Reinforcement learning control using neural network is one of them. Basically reinforcement learning control doesn't need a priori information of objective system. This method uses reinforcement signal from interaction of objective system and environment and observable states of objective system as input data. But many methods take too much time to apply to real-world. So we focus on faster learning to apply reinforcement learning control to real-world. Two data types are used for reinforcement learning. One is reinforcement signal data. It has only two fixed scalar values that are assigned for each success and fail state. The other is observable state data. There are infinitive states in real-world system. So the number of observable state data is also infinitive. This requires too much learning time for applying to real-world. So we try to reduce the number of observable states by classification of states with Self-Organizing Map. We also use neural dynamic programming for controller design. An inverted pendulum on the cart system is simulated. Failure signal is used for reinforcement signal. The failure signal occurs when the pendulum angle or cart position deviate from the defined control range. The control objective is to maintain the balanced pole and centered cart. And four states that is, position and velocity of cart, angle and angular velocity of pole are used for state signal. Learning controller is composed of serial connection of Self-Organizing Map and two Multi-layer Feed-Forward Neural Networks.

  • PDF