• Title/Summary/Keyword: Regression Model Optimization

Search Result 334, Processing Time 0.027 seconds

Application of Multivariate Adaptive Regression Spline-Assisted Objective Function on Optimization of Heat Transfer Rate Around a Cylinder

  • Dey, Prasenjit;Das, Ajoy K.
    • Nuclear Engineering and Technology
    • /
    • v.48 no.6
    • /
    • pp.1315-1320
    • /
    • 2016
  • The present study aims to predict the heat transfer characteristics around a square cylinder with different corner radii using multivariate adaptive regression splines (MARS). Further, the MARS-generated objective function is optimized by particle swarm optimization. The data for the prediction are taken from the recently published article by the present authors [P. Dey, A. Sarkar, A.K. Das, Development of GEP and ANN model to predict the unsteady forced convection over a cylinder, Neural Comput. Appl. (2015) 1-13]. Further, the MARS model is compared with artificial neural network and gene expression programming. It has been found that the MARS model is very efficient in predicting the heat transfer characteristics. It has also been found that MARS is more efficient than artificial neural network and gene expression programming in predicting the forced convection data, and also particle swarm optimization can efficiently optimize the heat transfer rate.

Evaluation of Regression Models with various Criteria and Optimization Methods for Pollutant Load Estimations (다양한 평가 지표와 최적화 기법을 통한 오염부하 산정 회귀 모형 평가)

  • Kim, Jonggun;Lim, Kyoung Jae;Park, Youn Shik
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2018.05a
    • /
    • pp.448-448
    • /
    • 2018
  • In this study, the regression models (Load ESTimator and eight-parameter model) were evaluated to estimate instantaneous pollutant loads under various criteria and optimization methods. As shown in the results, LOADEST commonly used in interpolating pollutant loads could not necessarily provide the best results with the automatic selected regression model. It is inferred that the various regression models in LOADEST need to be considered to find the best solution based on the characteristics of watersheds applied. The recently developed eight-parameter model integrated with Genetic Algorithm (GA) and Gradient Descent Method (GDM) were also compared with LOADEST indicating that the eight-parameter model performed better than LOADEST, but it showed different behaviors in calibration and validation. The eight-parameter model with GDM could reproduce the nitrogen loads properly outside of calibration period (validation). Furthermore, the accuracy and precision of model estimations were evaluated using various criteria (e.g., $R^2$ and gradient and constant of linear regression line). The results showed higher precisions with the $R^2$ values closed to 1.0 in LOADEST and better accuracy with the constants (in linear regression line) closed to 0.0 in the eight-parameter model with GDM. In hence, based on these finding we recommend that users need to evaluate the regression models under various criteria and calibration methods to provide the more accurate and precise results for pollutant load estimations.

  • PDF

Optimized Neural Network Weights and Biases Using Particle Swarm Optimization Algorithm for Prediction Applications

  • Ahmadzadeh, Ezat;Lee, Jieun;Moon, Inkyu
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.8
    • /
    • pp.1406-1420
    • /
    • 2017
  • Artificial neural networks (ANNs) play an important role in the fields of function approximation, prediction, and classification. ANN performance is critically dependent on the input parameters, including the number of neurons in each layer, and the optimal values of weights and biases assigned to each neuron. In this study, we apply the particle swarm optimization method, a popular optimization algorithm for determining the optimal values of weights and biases for every neuron in different layers of the ANN. Several regression models, including general linear regression, Fourier regression, smoothing spline, and polynomial regression, are conducted to evaluate the proposed method's prediction power compared to multiple linear regression (MLR) methods. In addition, residual analysis is conducted to evaluate the optimized ANN accuracy for both training and test datasets. The experimental results demonstrate that the proposed method can effectively determine optimal values for neuron weights and biases, and high accuracy results are obtained for prediction applications. Evaluations of the proposed method reveal that it can be used for prediction and estimation purposes, with a high accuracy ratio, and the designed model provides a reliable technique for optimization. The simulation results show that the optimized ANN exhibits superior performance to MLR for prediction purposes.

A random forest-regression-based inverse-modeling evolutionary algorithm using uniform reference points

  • Gholamnezhad, Pezhman;Broumandnia, Ali;Seydi, Vahid
    • ETRI Journal
    • /
    • v.44 no.5
    • /
    • pp.805-815
    • /
    • 2022
  • The model-based evolutionary algorithms are divided into three groups: estimation of distribution algorithms, inverse modeling, and surrogate modeling. Existing inverse modeling is mainly applied to solve multi-objective optimization problems and is not suitable for many-objective optimization problems. Some inversed-model techniques, such as the inversed-model of multi-objective evolutionary algorithm, constructed from the Pareto front (PF) to the Pareto solution on nondominated solutions using a random grouping method and Gaussian process, were introduced. However, some of the most efficient inverse models might be eliminated during this procedure. Also, there are challenges, such as the presence of many local PFs and developing poor solutions when the population has no evident regularity. This paper proposes inverse modeling using random forest regression and uniform reference points that map all nondominated solutions from the objective space to the decision space to solve many-objective optimization problems. The proposed algorithm is evaluated using the benchmark test suite for evolutionary algorithms. The results show an improvement in diversity and convergence performance (quality indicators).

Optimization of Transonic Airfoil Using GA Based on Neural Network and Multiple Regression Model (유전 알고리듬과 반응표면을 이용한 천음속 익형의 최적설계)

  • Kim, Yun-Sik;Kim, Jong-Hun;Lee, Jong-Soo
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.12
    • /
    • pp.2556-2564
    • /
    • 2002
  • The design of airfoil had practiced by repeat tests in its first stage, though an airfoil has as been designed based on simulations according to techniques of computational fluid dynamics. Here, using of traditional optimization is unsuitable because a state of flux is hypersensitive to the shape of airfoil. Therefore the paper optimized the shape of airfoil in transonic region using a genetic algorithm (GA). Response surfaces are based on back propagation neural network (BPN) and regression model. Training data of BPN and regression model were obtained by computational fluid dynamic analysis using CFD-ACE, and each analysis has been designed by design of experiments.

Self-Organizing Fuzzy Modeling Based on Hyperplane-Shaped Clusters (다차원 평면 클러스터를 이용한 자기 구성 퍼지 모델링)

  • Koh, Taek-Beom
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.12
    • /
    • pp.985-992
    • /
    • 2001
  • This paper proposes a self-organizing fuzzy modeling(SOFUM)which an create a new hyperplane shaped cluster and adjust parameters of the fuzzy model in repetition. The suggested algorithm SOFUM is composed of four steps: coarse tuning. fine tuning cluster creation and optimization of learning rates. In the coarse tuning fuzzy C-regression model(FCRM) clustering and weighted recursive least squared (WRLS) algorithm are used and in the fine tuning gradient descent algorithm is used to adjust parameters of the fuzzy model precisely. In the cluster creation, a new hyperplane shaped cluster is created by applying multiple regression to input/output data with relatively large fuzzy entropy based on parameter tunings of fuzzy model. And learning rates are optimized by utilizing meiosis-genetic algorithm in the optimization of learning rates To check the effectiveness of the suggested algorithm two examples are examined and the performance of the identified fuzzy model is demonstrated via computer simulation.

  • PDF

A Short-Term Wind Speed Forecasting Through Support Vector Regression Regularized by Particle Swarm Optimization

  • Kim, Seong-Jun;Seo, In-Yong
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.11 no.4
    • /
    • pp.247-253
    • /
    • 2011
  • A sustainability of electricity supply has emerged as a critical issue for low carbon green growth in South Korea. Wind power is the fastest growing source of renewable energy. However, due to its own intermittency and volatility, the power supply generated from wind energy has variability in nature. Hence, accurate forecasting of wind speed and power plays a key role in the effective harvesting of wind energy and the integration of wind power into the current electric power grid. This paper presents a short-term wind speed prediction method based on support vector regression. Moreover, particle swarm optimization is adopted to find an optimum setting of hyper-parameters in support vector regression. An illustration is given by real-world data and the effect of model regularization by particle swarm optimization is discussed as well.

Sequential Approximate Optimization of Shock Absorption System for Lunar Lander by using Quadratic Polynomial Regression Meta-model (2차 다항회귀 메타모델을 이용한 달착륙선 충격흡수 시스템의 순차적 근사 최적설계)

  • Oh, Min-Hwan;Cho, Young-Min;Lee, Hee-Jun;Cho, Jin-Yeon;Hwang, Do-Soon
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.39 no.4
    • /
    • pp.314-320
    • /
    • 2011
  • In this work, optimization of two-stage shock absorption system for lunar lander has been carried out. Because of complexity of impact phenomena of shock absorption system, a 1-D constitutive model is proposed to describe the behavior of shock absorption system. Quadratic polynomial regression meta-model is constructed by using a commercial software ABAQUS with the proposed 1-D constitutive model, and sequential approximate optimization of two-stage shock absorption system has been carried out along with the constructed meta-model. Through the optimization, it is verified that landing impact force on lunar lander can be considerably reduced by changing the cell size and foil thickness of honeycomb structure in two-stage shock absorption system.

Ram Accelerator Optimization Using the Response Surface Method (반응면 기법을 이용한 램 가속기 최적설계에 관한 연구)

  • Jeon Kwon-Su;Jeon Yong-Hee;Lee Jae-Woo;Byun Yung-Hwan
    • Journal of computational fluids engineering
    • /
    • v.5 no.2
    • /
    • pp.55-63
    • /
    • 2000
  • In this paper, the numerical study has been done for the improvement of the superdetonative ram accelerator performance and for the design optimization of the system. The objective function to optimize the premixture composition is the ram tube length, required to accelerate projectile from initial velocity V/sub 0/ to target velocity V/sub e/. The premixture is composed of H₂, O₂, N₂ and the mole numbers of these species are selected as design variables. RSM(Response Surface Methodology) which is widely used for the complex optimization problems is selected as the optimization technique. In particular, to improve the non-linearity of the response and to consider the accuracy and the efficiency of the solution, design space stretching technique has been applied. Separate sub-optimization routine is introduced to determine the stretching position and clustering parameters which construct the optimum regression model. Two step optimization technique has been applied to obtain the optimal system. With the application of stretching technique, we can perform system optimization with a small number of experimental points, and construct precise regression model for highly non-linear domain. The error compared with analysis result is only 0.01% and it is demonstrated that present method can be applied to more practical design optimization problems with many design variables.

  • PDF

Sparse Multinomial Kernel Logistic Regression

  • Shim, Joo-Yong;Bae, Jong-Sig;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.1
    • /
    • pp.43-50
    • /
    • 2008
  • Multinomial logistic regression is a well known multiclass classification method in the field of statistical learning. More recently, the development of sparse multinomial logistic regression model has found application in microarray classification, where explicit identification of the most informative observations is of value. In this paper, we propose a sparse multinomial kernel logistic regression model, in which the sparsity arises from the use of a Laplacian prior and a fast exact algorithm is derived by employing a bound optimization approach. Experimental results are then presented to indicate the performance of the proposed procedure.