• Title/Summary/Keyword: polynomial optimization

Search Result 354, Processing Time 0.033 seconds

A New Approach of Self-Organizing Fuzzy Polynomial Neural Networks Based on Information Granulation and Genetic Algorithms (정보 입자화와 유전자 알고리즘에 기반한 자기구성 퍼지 다항식 뉴럴네트워크의 새로운 접근)

  • Park Ho-Sung;Oh Sung-Kwun;Kim Hvun-Ki
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.55 no.2
    • /
    • pp.45-51
    • /
    • 2006
  • In this paper, we propose a new architecture of Information Granulation based genetically optimized Self-Organizing Fuzzy Polynomial Neural Networks (IG_gSOFPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially information granulation and genetic algorithms. The proposed IG_gSOFPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional SOFPNNs. The design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial of the consequent part of fuzzy rules, and a collection of the specific subset of input variables) and addresses specific aspects of parametric optimization. In addition, the fuzzy rules used in the networks exploit the notion of information granules defined over system's variables and formed through the process of information granulation. That is, we determine the initial location (apexes) of membership functions and initial values of polynomial function being used in the premised and consequence part of the fuzzy rules respectively. This granulation is realized with the aid of the hard c-menas clustering method (HCM). To evaluate the performance of the IG_gSOFPNN, the model is experimented with using two time series data(gas furnace process and NOx process data).

Development of an Efficient Line Search Method by Using the Sequential Polynomial Approximation (순차적 다항식 근사화를 적용한 효율적 선탐색기법의 개발)

  • 김민수;최동훈
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.19 no.2
    • /
    • pp.433-442
    • /
    • 1995
  • For the line search of a multi-variable optimization, an efficient algorithm is presented. The algorithm sequentially employs several polynomial approximations such as 2-point quadratic interpolation, 3-point cubic interpolation/extrapolation and 4-point cubic interpolation/extrapolation. The order of polynomial function is automatically increased for improving the accuracy of approximation. The method of approximation (interpolation or extrapolation) is automatically switched by checking the slope information of the sample points. Also, for selecting the initial step length along the descent vector, a new approach is presented. The performance of the proposed method is examined by solving typical test problems such as mathematical problems, mechanical design problems and dynamic response problems.

Genetically Optimized Rule-based Fuzzy Polynomial Neural Networks (진화론적 최적 규칙베이스 퍼지다항식 뉴럴네트워크)

  • Park Byoung-Jun;Kim Hyun-Ki;Oh Sung-Kwun
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.11 no.2
    • /
    • pp.127-136
    • /
    • 2005
  • In this paper, a new architecture and comprehensive design methodology of genetically optimized Rule-based Fuzzy Polynomial Neural Networks(gRFPNN) are introduced and a series of numeric experiments are carried out. The architecture of the resulting gRFPNN results from asynergistic usage of the hybrid system generated by combining rule-based Fuzzy Neural Networks(FNN) with polynomial neural networks (PNN). FNN contributes to the formation of the premise part of the overall rule-based structure of the gRFPNN. The consequence part of the gRFPNN is designed using PNNs. At the premise part of the gRFPNN, FNN exploits fuzzy set based approach designed by using space partitioning in terms of individual variables and comes in two fuzzy inference forms: simplified and linear. As the consequence part of the gRFPNN, the development of the genetically optimized PNN dwells on two general optimization mechanism: the structural optimization is realized via GAs whereas in case of the parametric optimization we proceed with a standard least square method-based learning. To evaluate the performance of the gRFPNN, the models are experimented with the use of several representative numerical examples. A comparative analysis shows that the proposed gRFPNN are models with higher accuracy as well as more superb predictive capability than other intelligent models presented previously.

Polynomial-Filled Function Algorithm for Unconstrained Global Optimization Problems

  • Salmah;Ridwan Pandiya
    • Kyungpook Mathematical Journal
    • /
    • v.64 no.1
    • /
    • pp.95-111
    • /
    • 2024
  • The filled function method is useful in solving unconstrained global optimization problems. However, depending on the type of function, and parameters used, there are limitations that cause difficultiies in implemenations. Exponential and logarithmic functions lead to the overflow effect, requiring iterative adjustment of the parameters. This paper proposes a polynomial-filled function that has a general form, is non-exponential, nonlogarithmic, non-parameteric, and continuously differentiable. With this newly proposed filled function, the aforementioned shortcomings of the filled function method can be overcome. To confirm the superiority of the proposed filled function algorithm, we apply it to a set of unconstrained global optimization problems. The data derived by numerical implementation shows that the proposed filled function can be used as an alternative algorithm when solving unconstrained global optimization problems.

Optimization of Polynomial Neural Networks: An Evolutionary Approach (다항식 뉴럴 네트워크의 최적화: 진화론적 방법)

  • Kim Dong-Won;Park Gwi-Tae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.7
    • /
    • pp.424-433
    • /
    • 2003
  • Evolutionary design related to the optimal design of Polynomial Neural Networks (PNNs) structure for model identification of complex and nonlinear system is studied in this paper. The PNN structure is consisted of layers and nodes like conventional neural networks but is not fixed and can be changable according to the system environments. three types of polynomials such as linear, quadratic, and modified quadratic is used in each node that is connected with various kinds of multi-variable inputs. Inputs and order of polynomials in each node are very important element for the performance of model. In most cases these factors are decided by the background information and trial and error of designer. For the high reliability and good performance of the PNN, the factors must be decided according to a logical and systematic way. In the paper evolutionary algorithm is applied to choose the optimal input variables and order. Evolutionary (genetic) algorithm is a random search optimization technique. The evolved PNN with optimally chosen input variables and order is not fixed in advance but becomes fully optimized automatically during the identification process. Gas furnace and pH neutralization processes are used in conventional PNN version are modeled. It shows that the designed PNN architecture with evolutionary structure optimization can produce the model with higher accuracy than previous PNN and other works.

Optimization of Polynomial Neural Networks: An Evolutionary Approach (다항식 뉴럴 네트워크의 최적화 : 진화론적 방법)

  • Kim, Dong Won;Park, Gwi Tae
    • The Transactions of the Korean Institute of Electrical Engineers C
    • /
    • v.52 no.7
    • /
    • pp.424-424
    • /
    • 2003
  • Evolutionary design related to the optimal design of Polynomial Neural Networks (PNNs) structure for model identification of complex and nonlinear system is studied in this paper. The PNN structure is consisted of layers and nodes like conventional neural networks but is not fixed and can be changable according to the system environments. three types of polynomials such as linear, quadratic, and modified quadratic is used in each node that is connected with various kinds of multi-variable inputs. Inputs and order of polynomials in each node are very important element for the performance of model. In most cases these factors are decided by the background information and trial and error of designer. For the high reliability and good performance of the PNN, the factors must be decided according to a logical and systematic way. In the paper evolutionary algorithm is applied to choose the optimal input variables and order. Evolutionary (genetic) algorithm is a random search optimization technique. The evolved PNN with optimally chosen input variables and order is not fixed in advance but becomes fully optimized automatically during the identification process. Gas furnace and pH neutralization processes are used in conventional PNN version are modeled. It shows that the designed PNN architecture with evolutionary structure optimization can produce the model with higher accuracy than previous PNN and other works.

Concurrent topology optimization of composite macrostructure and microstructure under uncertain dynamic loads

  • Cai, Jinhu;Yang, Zhijie;Wang, Chunjie;Ding, Jianzhong
    • Structural Engineering and Mechanics
    • /
    • v.81 no.3
    • /
    • pp.267-280
    • /
    • 2022
  • Multiscale structure has attracted significant interest due to its high stiffness/strength to weight ratios and multifunctional performance. However, most of the existing concurrent topology optimization works are carried out under deterministic load conditions. Hence, this paper proposes a robust concurrent topology optimization method based on the bidirectional evolutionary structural optimization (BESO) method for the design of structures composed of periodic microstructures subjected to uncertain dynamic loads. The robust objective function is defined as the weighted sum of the mean and standard deviation of the module of dynamic structural compliance with constraints are imposed to both macro- and microscale structure volume fractions. The polynomial chaos expansion (PCE) method is used to quantify and propagate load uncertainty to evaluate the objective function. The effective properties of microstructure is evaluated by the numerical homogenization method. To release the computation burden, the decoupled sensitivity analysis method is proposed for microscale design variables. The proposed method is a non-intrusive method, and it can be conveniently extended to many topology optimization problems with other distributions. Several numerical examples are used to validate the effectiveness of the proposed robust concurrent topology optimization method.

Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture

  • Park, Ho-Sung;Park, Byoung-Jun;Kim, Hyun-Ki;Oh, Sung-Kwun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.4
    • /
    • pp.423-434
    • /
    • 2004
  • In this paper, we introduce a new topology of Self-Organizing Polynomial Neural Networks (SOPNN) based on genetically optimized Multi-Layer Perceptron (MLP) and discuss its comprehensive design methodology involving mechanisms of genetic optimization. Let us recall that the design of the 'conventional' SOPNN uses the extended Group Method of Data Handling (GMDH) technique to exploit polynomials as well as to consider a fixed number of input nodes at polynomial neurons (or nodes) located in each layer. However, this design process does not guarantee that the conventional SOPNN generated through learning results in optimal network architecture. The design procedure applied in the construction of each layer of the SOPNN deals with its structural optimization involving the selection of preferred nodes (or PNs) with specific local characteristics (such as the number of input variables, the order of the polynomials, and input variables) and addresses specific aspects of parametric optimization. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between the approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented using pH neutralization process data as well as sewage treatment process data. A comparative analysis indicates that the proposed SOPNN is the model having higher accuracy as well as more superb predictive capability than other intelligent models presented previously.reviously.

Design of RBF-based Polynomial Neural Network And Optimization (방사형 기저 함수 기반 다항식 뉴럴네트워크 설계 및 최적화)

  • Kim, Ki-Sang;Jin, Yong-Ha;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2009.07a
    • /
    • pp.1863_1864
    • /
    • 2009
  • 본 연구에서는 복잡한 비선형 모델링 방법인 RBF 뉴럴 네트워크(Radial Basis Function Neural Network)와 PNN(Polynomial Neural Network)을 접목한 새로운 형태의 Radial Basis Function Polynomial Neural Network(RPNN)를 제안한다. RBF 뉴럴 네트워크는 빠른 학습 시간, 일반화 그리고 단순화의 특징으로 비선형 시스템 모델링 등에 적용되고 있으며, PNN은 생성된 노드들 중에서 우수한 결과값을 가진 노드들을 선택함으로써 모델의 근사화 및 일반화에 탁월한 효과를 가진 비선형 모델링 방법이다. 제안된 RPNN모델의 기본적인 구조는 PNN의 형태를 이루고 있으며, 각각의 노드는 RBF 뉴럴 네트워크로 구성하였다. 사용된 RBF 뉴럴 네트워크에서의 커널 함수로는 FCM 클러스터링을 사용하였으며, 각 노드의 후반부는 다항식 구조로 표현하였다. 또한 입력개수, 입력변수, 클러스터의 개수를 PSO알고리즘(Particle Swarm Optimization)을 사용하여 최적화 시켰다. 제안한 모델의 적용 및 유용성을 비교 평가하기 위하여 비선형 데이터를 이용하여 그 우수성을 보인다.

  • PDF

FPTAS and pseudo-polynomial separability of integral hull of generalized knapsack problem

  • Hong Sung-Pil
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2004.10a
    • /
    • pp.225-228
    • /
    • 2004
  • The generalized knapsack problem, or gknap is the combinatorial optimization problem of optimizing a nonnegative linear functional over the integral hull of the intersection of a polynomially separable 0 - 1 polytope and a knapsack constraint. Among many potential applications, the knapsack, the restricted shortest path, and the restricted spanning tree problem are such examples. We prove via the ellipsoid method the equivalence between the fully polynomial approximability and a certain pseudo-polynomial separability of the gknap polytope.

  • PDF