• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.55 no.2
• /
• pp.45-51
• /
• 2006

In this paper, we propose a new architecture of Information Granulation based genetically optimized Self-Organizing Fuzzy Polynomial Neural Networks (IG_gSOFPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially information granulation and genetic algorithms. The proposed IG_gSOFPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional SOFPNNs. The design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial of the consequent part of fuzzy rules, and a collection of the specific subset of input variables) and addresses specific aspects of parametric optimization. In addition, the fuzzy rules used in the networks exploit the notion of information granules defined over system's variables and formed through the process of information granulation. That is, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. This granulation is realized with the aid of the hard c-menas clustering method (HCM). To evaluate the performance of the IG_gSOFPNN, the model is experimented with using two time series data(gas furnace process and NOx process data).

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.55 no.6
• /
• pp.264-273
• /
• 2006

In this paper, we propose a new architecture of Self-Organizing Fuzzy Polynomial Neural Networks (SOFPNN) by means of consecutive optimization and also discuss its comprehensive design methodology involving mechanisms of genetic optimization. The network is based on a structurally as well as parametrically optimized fuzzy polynomial neurons (FPNs) conducted with the aid of information granulation and genetic algorithms. In structurally identification of FPN, the design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics and addresses specific aspects of parametric optimization. In addition, the fuzzy rules used in the networks exploit the notion of information granules defined over system's variables and formed through the process of information granulation. That is, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. This granulation is realized with the aid of the hard c-menas clustering method (HCM). For the parametric identification, we obtained the effective model that the axes of MFs are identified by GA to reflect characteristic of given data. Especially, the genetically dynamic search method is introduced in the identification of parameter. It helps lead to rapidly optimal convergence over a limited region or a boundary condition. To evaluate the performance of the proposed model, the model is experimented with using two time series data(gas furnace process, nonlinear system data, and NOx process data).

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.21 no.48
• /
• pp.123-132
• /
• 1998

The group formation problem of the machine and part is a very important issue in the planning stage of cellular manufacturing systems. This paper investigates Self-Organizing Map(SOM) neural networks approach to machine-part grouping problem. We present a two-phase algorithm based on SOM for grouping parts and machines. SOM can learn from complex, multi-dimensional data and transform them into visually decipherable clusters. Output layer in SOM network is one-dimensional structure and the number of output node has been increased sufficiently to spread out the input vectors in the order of similarity. The proposed algorithm performs remarkably well in comparison with many other algorithms for the well-known problems shown in previous papers.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2004.04a
• /
• pp.288-291
• /
• 2004

기존의 SOFPNN은 데이터 수가 적고 비선형 요소가 많은 시스템에 대한 체계적이고 효율적인 최적 모델 을 구축할 수 있었으며 각 층 노드의 선택 입력을 변화시킴으로써 네트워크 구조 전체의 적응능력을 향상 시켰다. SOFPNN의 구조는 퍼지 다항식 뉴론(FPN)들로 구성되어 있으며, 층이 진행하는 동안 모델 스스로 노드의 선택과 제거를 통해 최적의 네트워크 구조를 생성할 수 있는 유연성을 가지고 있다. 그러나, 노드의 입력변수의 수와 규칙 후반부 다항식 차수 그리고 입력변수는 설계자의 경험 또는 반복적인 학습을 통해 선호된 네트워크 구조를 선택하였으나, 최적의 네트워크 구조를 구축하는데는 어려옴이 내재되어 있었다. 본 논문에서는 자기구성 퍼지 다항식 뉴럴네트워크(Self-Organizing Fuzzy Polynomial Neural Networks： SOFPNN)을 최적화시키기 위해 유전자 알고리즘을 이용하여 자기구성 퍼지 다항식 뉴럴 네트워크의 입력변수의 수와 이에 해당되는 입력변수 그리고 규칙 후반부 다항식의 차수를 탐색하여 최적 의 자기구성 퍼지 다항식 뉴럴 네트워크를 구축한다. 따라서 모델 구축에 있어서 유연성과 정확성을 가지며 객관적이고 좀 더 정확한 예측 능력을 가진 SOFPNN 모델 구조를 구축할 수가 있다.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2004.04a
• /
• pp.434-437
• /
• 2004

본 논문에서는 유전자 알고리즘에 기반을 둔 자기구성 다항식 뉴럴네트워크(Self-Organizing Polynomial Neural Networks： SOPNN)의 새로운 구조를 제안하고, 포괄적인 설계 방법론을 토의한다. 기존의 자기구성 다항식 뉴럴 네트워크는 확장된 GMDH 방법에 기반을 두며, 네트워크의 성장과정을 통하여 각 충의 다항식 뉴런에서 고정된 노드 입력들의 수 뿐만 아니라 다항식 차수(1차, 2차, 그리고 수정된 2차식)를 이용하였다. 더구나, 그 방법은 학습을 통해 생성된 SOPNN이 최적 네트워크 구조를 가진다는 것을 보증하지 못한다. 그러나, 제안된 GA 기반 SOPNN은 그 구조를 구조적으로 더 최적화된 네트워크가 되도록 하고, 기존의 SOPNN보다 훨씬 더 유연하고, 선호된 뉴럴 네트워크가 되도록 한다. 구조적으로 더 최적화된 SOPNN을 생성하기 위해, SOPNN의 각 단계에서의 GA기반 설계 절차는 SOPNN내에서 이용할 수 있는 다음의 최적 파라미터들- 즉 입력변수의 수, 입력변수, 및 다항식 차수-을 가진 선호된 노드들의 선택으로 이끈다. 하중계수를 가진 합성성능지수가 그 모델의 근사화 및 일반화(예측) 능력 사이의 상호 균형을 얻기 위해 제안된다. 상세 설계 절차가 상세히 토의된다.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.23 no.61
• /
• pp.127-135
• /
• 2000

This paper provides a new method of initializing neurons used in self-organizing neural networks and sequencing input nodes for applying to Euclidean traveling salesman problem. We use a general property that in any optimal solution for Euclidean traveling salesman problem, vertices located on the convex hull are visited in the order in which they appear on the convex hull boundary. We composite input nodes as number of convex hulls and initialize neurons as shape of the external convex hull. And then adapt input nodes as the convex hull unit and all convex hulls are adapted as same pattern, clockwise or counterclockwise. As a result of our experiments, we obtain l∼3 % improved solutions and these solutions can be used for initial solutions of any global search algorithms.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.23 no.61
• /
• pp.137-146
• /
• 2000

One of the problems faced in implementing cellular manufacturing systems is machine-part group formation. This paper proposes machine-part grouping algorithms based on Self-Organizing Map(SOM) neural networks and K-Means algorithm in cellular manufacturing systems. Although the SOM spreads out input vectors to output vectors in the order of similarity, it does not always find the optimal solution. We rearrange the input vectors using SOM and determine the number of groups. In order to find the number of groups and grouping efficacy, we iterate K-Means algorithm changing k until we cannot obtain better solution. The results of using the proposed approach are compared to the best solutions reported in literature. The computational results show that the proposed approach provides a powerful means of solving the machine-part grouping problem. The proposed algorithm Is applied by simple calculation, so it can be for designer to change production constraints.

• Journal of the Korean Institute of Telematics and Electronics B
• /
• v.33B no.7
• /
• pp.173-182
• /
• 1996

In this paper, we propose the parallel, self-organizing, hierarchical neural netowrks as a handwritten digit recognition system. This system can absorb the various shape variations of handwritten digits by using the different methods of extracting the features in each stage neural network (SNN) of the PSHNN, and can reduce training time by using the single layer neural network as the SNN, and can obtain high rate of correct recognition by using the certainty area in all the output nodes individually. experiments have been performed with NIST database. In which we use 21, 315 digits (10, 625 digits for training and 10,663 digits for testing). The results show that the correct rate is 97.48% the error rate is 1.72% and the reject rate is 0.78%.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.115.4-115
• /
• 2001

This paper deals with recognizing ten korean voiced vowels using Self Organizing Map. SOM is a good classifier. The output layer is composed of two dimensions. The input vector is the frequency values having the characteristic of voiced vowels. The short time frequency transform is used getting input vector. The final neural networks is attached SOM output layer.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.12 no.3
• /
• pp.261-268
• /
• 2002

This paper represents that auto tunings of membership functions and weights in the fuzzy neural networks are effectively performed by immune algorithm. A number of hybrid methods in fuzzy-neural networks are considered in the context of tuning of learning method, a general view is provided that they are the special cases of either the membership functions or the gain modification in the neural networks by genetic algorithms. On the other hand, since the immune network system possesses a self organizing and distributed memory, it is thus adaptive to its external environment and allows a PDP (parallel distributed processing) network to complete patterns against the environmental situation. Also, it can provide optimal solution. Simulation results reveal that immune algorithms are effective approaches to search for optimal or near optimal fuzzy rules and weights.