• 제목/요약/키워드: Regression Model Optimization

검색결과 334건 처리시간 0.03초

Application of Multivariate Adaptive Regression Spline-Assisted Objective Function on Optimization of Heat Transfer Rate Around a Cylinder

  • Dey, Prasenjit;Das, Ajoy K.
    • Nuclear Engineering and Technology
    • /
    • 제48권6호
    • /
    • pp.1315-1320
    • /
    • 2016
  • The present study aims to predict the heat transfer characteristics around a square cylinder with different corner radii using multivariate adaptive regression splines (MARS). Further, the MARS-generated objective function is optimized by particle swarm optimization. The data for the prediction are taken from the recently published article by the present authors [P. Dey, A. Sarkar, A.K. Das, Development of GEP and ANN model to predict the unsteady forced convection over a cylinder, Neural Comput. Appl. (2015) 1-13]. Further, the MARS model is compared with artificial neural network and gene expression programming. It has been found that the MARS model is very efficient in predicting the heat transfer characteristics. It has also been found that MARS is more efficient than artificial neural network and gene expression programming in predicting the forced convection data, and also particle swarm optimization can efficiently optimize the heat transfer rate.

다양한 평가 지표와 최적화 기법을 통한 오염부하 산정 회귀 모형 평가 (Evaluation of Regression Models with various Criteria and Optimization Methods for Pollutant Load Estimations)

  • 김종건;임경재;박윤식
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2018년도 학술발표회
    • /
    • pp.448-448
    • /
    • 2018
  • In this study, the regression models (Load ESTimator and eight-parameter model) were evaluated to estimate instantaneous pollutant loads under various criteria and optimization methods. As shown in the results, LOADEST commonly used in interpolating pollutant loads could not necessarily provide the best results with the automatic selected regression model. It is inferred that the various regression models in LOADEST need to be considered to find the best solution based on the characteristics of watersheds applied. The recently developed eight-parameter model integrated with Genetic Algorithm (GA) and Gradient Descent Method (GDM) were also compared with LOADEST indicating that the eight-parameter model performed better than LOADEST, but it showed different behaviors in calibration and validation. The eight-parameter model with GDM could reproduce the nitrogen loads properly outside of calibration period (validation). Furthermore, the accuracy and precision of model estimations were evaluated using various criteria (e.g., $R^2$ and gradient and constant of linear regression line). The results showed higher precisions with the $R^2$ values closed to 1.0 in LOADEST and better accuracy with the constants (in linear regression line) closed to 0.0 in the eight-parameter model with GDM. In hence, based on these finding we recommend that users need to evaluate the regression models under various criteria and calibration methods to provide the more accurate and precise results for pollutant load estimations.

  • PDF

Optimized Neural Network Weights and Biases Using Particle Swarm Optimization Algorithm for Prediction Applications

  • Ahmadzadeh, Ezat;Lee, Jieun;Moon, Inkyu
    • 한국멀티미디어학회논문지
    • /
    • 제20권8호
    • /
    • pp.1406-1420
    • /
    • 2017
  • Artificial neural networks (ANNs) play an important role in the fields of function approximation, prediction, and classification. ANN performance is critically dependent on the input parameters, including the number of neurons in each layer, and the optimal values of weights and biases assigned to each neuron. In this study, we apply the particle swarm optimization method, a popular optimization algorithm for determining the optimal values of weights and biases for every neuron in different layers of the ANN. Several regression models, including general linear regression, Fourier regression, smoothing spline, and polynomial regression, are conducted to evaluate the proposed method's prediction power compared to multiple linear regression (MLR) methods. In addition, residual analysis is conducted to evaluate the optimized ANN accuracy for both training and test datasets. The experimental results demonstrate that the proposed method can effectively determine optimal values for neuron weights and biases, and high accuracy results are obtained for prediction applications. Evaluations of the proposed method reveal that it can be used for prediction and estimation purposes, with a high accuracy ratio, and the designed model provides a reliable technique for optimization. The simulation results show that the optimized ANN exhibits superior performance to MLR for prediction purposes.

A random forest-regression-based inverse-modeling evolutionary algorithm using uniform reference points

  • Gholamnezhad, Pezhman;Broumandnia, Ali;Seydi, Vahid
    • ETRI Journal
    • /
    • 제44권5호
    • /
    • pp.805-815
    • /
    • 2022
  • The model-based evolutionary algorithms are divided into three groups: estimation of distribution algorithms, inverse modeling, and surrogate modeling. Existing inverse modeling is mainly applied to solve multi-objective optimization problems and is not suitable for many-objective optimization problems. Some inversed-model techniques, such as the inversed-model of multi-objective evolutionary algorithm, constructed from the Pareto front (PF) to the Pareto solution on nondominated solutions using a random grouping method and Gaussian process, were introduced. However, some of the most efficient inverse models might be eliminated during this procedure. Also, there are challenges, such as the presence of many local PFs and developing poor solutions when the population has no evident regularity. This paper proposes inverse modeling using random forest regression and uniform reference points that map all nondominated solutions from the objective space to the decision space to solve many-objective optimization problems. The proposed algorithm is evaluated using the benchmark test suite for evolutionary algorithms. The results show an improvement in diversity and convergence performance (quality indicators).

유전 알고리듬과 반응표면을 이용한 천음속 익형의 최적설계 (Optimization of Transonic Airfoil Using GA Based on Neural Network and Multiple Regression Model)

  • 김윤식;김종헌;이종수
    • 대한기계학회논문집A
    • /
    • 제26권12호
    • /
    • pp.2556-2564
    • /
    • 2002
  • The design of airfoil had practiced by repeat tests in its first stage, though an airfoil has as been designed based on simulations according to techniques of computational fluid dynamics. Here, using of traditional optimization is unsuitable because a state of flux is hypersensitive to the shape of airfoil. Therefore the paper optimized the shape of airfoil in transonic region using a genetic algorithm (GA). Response surfaces are based on back propagation neural network (BPN) and regression model. Training data of BPN and regression model were obtained by computational fluid dynamic analysis using CFD-ACE, and each analysis has been designed by design of experiments.

다차원 평면 클러스터를 이용한 자기 구성 퍼지 모델링 (Self-Organizing Fuzzy Modeling Based on Hyperplane-Shaped Clusters)

  • 고택범
    • 제어로봇시스템학회논문지
    • /
    • 제7권12호
    • /
    • pp.985-992
    • /
    • 2001
  • This paper proposes a self-organizing fuzzy modeling(SOFUM)which an create a new hyperplane shaped cluster and adjust parameters of the fuzzy model in repetition. The suggested algorithm SOFUM is composed of four steps: coarse tuning. fine tuning cluster creation and optimization of learning rates. In the coarse tuning fuzzy C-regression model(FCRM) clustering and weighted recursive least squared (WRLS) algorithm are used and in the fine tuning gradient descent algorithm is used to adjust parameters of the fuzzy model precisely. In the cluster creation, a new hyperplane shaped cluster is created by applying multiple regression to input/output data with relatively large fuzzy entropy based on parameter tunings of fuzzy model. And learning rates are optimized by utilizing meiosis-genetic algorithm in the optimization of learning rates To check the effectiveness of the suggested algorithm two examples are examined and the performance of the identified fuzzy model is demonstrated via computer simulation.

  • PDF

A Short-Term Wind Speed Forecasting Through Support Vector Regression Regularized by Particle Swarm Optimization

  • Kim, Seong-Jun;Seo, In-Yong
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제11권4호
    • /
    • pp.247-253
    • /
    • 2011
  • A sustainability of electricity supply has emerged as a critical issue for low carbon green growth in South Korea. Wind power is the fastest growing source of renewable energy. However, due to its own intermittency and volatility, the power supply generated from wind energy has variability in nature. Hence, accurate forecasting of wind speed and power plays a key role in the effective harvesting of wind energy and the integration of wind power into the current electric power grid. This paper presents a short-term wind speed prediction method based on support vector regression. Moreover, particle swarm optimization is adopted to find an optimum setting of hyper-parameters in support vector regression. An illustration is given by real-world data and the effect of model regularization by particle swarm optimization is discussed as well.

2차 다항회귀 메타모델을 이용한 달착륙선 충격흡수 시스템의 순차적 근사 최적설계 (Sequential Approximate Optimization of Shock Absorption System for Lunar Lander by using Quadratic Polynomial Regression Meta-model)

  • 오민환;조영민;이희준;조진연;황도순
    • 한국항공우주학회지
    • /
    • 제39권4호
    • /
    • pp.314-320
    • /
    • 2011
  • 본 연구에서는 2단으로 구성된 달착륙선 충격 흡수 장치에 대한 최적화를 수행하였다. 충격 흡수 장치의 복잡한 충격거동을 모사하기 위해 1차원 구성방정식 모델을 제안하였으며, 이와 함께 상용해석 소프트웨어인 ABAQUS를 활용하여 최적화를 위한 2차 다항회귀 메타모델을 구성하였다. 구성된 메타모델을 순차적 근사 최적설계 기법에 적용하여 2단 충격 흡수 장치의 최적화를 수행하였으며, 이를 통해 허니컴 구조를 이용한 충격 흡수장치의 셀크기와 포일 두께를 변화시킴에 따라 달착륙선의 월면 착륙 시 충격하중을 크게 저감시킬 수 있음을 확인하였다.

반응면 기법을 이용한 램 가속기 최적설계에 관한 연구 (Ram Accelerator Optimization Using the Response Surface Method)

  • 전권수;전용희;이재우;변영환
    • 한국전산유체공학회지
    • /
    • 제5권2호
    • /
    • pp.55-63
    • /
    • 2000
  • In this paper, the numerical study has been done for the improvement of the superdetonative ram accelerator performance and for the design optimization of the system. The objective function to optimize the premixture composition is the ram tube length, required to accelerate projectile from initial velocity V/sub 0/ to target velocity V/sub e/. The premixture is composed of H₂, O₂, N₂ and the mole numbers of these species are selected as design variables. RSM(Response Surface Methodology) which is widely used for the complex optimization problems is selected as the optimization technique. In particular, to improve the non-linearity of the response and to consider the accuracy and the efficiency of the solution, design space stretching technique has been applied. Separate sub-optimization routine is introduced to determine the stretching position and clustering parameters which construct the optimum regression model. Two step optimization technique has been applied to obtain the optimal system. With the application of stretching technique, we can perform system optimization with a small number of experimental points, and construct precise regression model for highly non-linear domain. The error compared with analysis result is only 0.01% and it is demonstrated that present method can be applied to more practical design optimization problems with many design variables.

  • PDF

Sparse Multinomial Kernel Logistic Regression

  • Shim, Joo-Yong;Bae, Jong-Sig;Hwang, Chang-Ha
    • Communications for Statistical Applications and Methods
    • /
    • 제15권1호
    • /
    • pp.43-50
    • /
    • 2008
  • Multinomial logistic regression is a well known multiclass classification method in the field of statistical learning. More recently, the development of sparse multinomial logistic regression model has found application in microarray classification, where explicit identification of the most informative observations is of value. In this paper, we propose a sparse multinomial kernel logistic regression model, in which the sparsity arises from the use of a Laplacian prior and a fast exact algorithm is derived by employing a bound optimization approach. Experimental results are then presented to indicate the performance of the proposed procedure.