• Title/Summary/Keyword: mean squared prediction error

Search Result 150, Processing Time 0.028 seconds

Improvement of multi layer perceptron performance using combination of adaptive moments and improved harmony search for prediction of Daecheong Dam inflow (대청댐 유입량 예측을 위한 Adaptive Moments와 Improved Harmony Search의 결합을 이용한 다층퍼셉트론 성능향상)

  • Lee, Won Jin;Lee, Eui Hoon
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.1
    • /
    • pp.63-74
    • /
    • 2023
  • High-reliability prediction of dam inflow is necessary for efficient dam operation. Recently, studies were conducted to predict the inflow of dams using Multi Layer Perceptron (MLP). Existing studies used the Gradient Descent (GD)-based optimizer as the optimizer among MLP operators to find the optimal correlation between data. However, the GD-based optimizers have disadvantages in that the prediction performance is deteriorated due to the possibility of convergence to the local optimal value and the absence of storage space. This study improved the shortcomings of the GD-based optimizer by developing Adaptive moments combined with Improved Harmony Search (AdamIHS), which combines Adaptive moments among GD-based optimizers and Improved Harmony Search (IHS). In order to evaluate the learning and prediction performance of MLP using AdamIHS, Daecheong Dam inflow was learned and predicted and compared with the learning and prediction performance of MLP using GD-based optimizer. Comparing the learning results, the Mean Squared Error (MSE) of MLP, which is 5 hidden layers using AdamIHS, was the lowest at 11,577. Comparing the prediction results, the average MSE of MLP, which is one hidden layer using AdamIHS, was the lowest at 413,262. Using AdamIHS developed in this study, it will be possible to show improved prediction performance in various fields.

Compositional Feature Selection and Its Effects on Bandgap Prediction by Machine Learning (기계학습을 이용한 밴드갭 예측과 소재의 조성기반 특성인자의 효과)

  • Chunghee Nam
    • Korean Journal of Materials Research
    • /
    • v.33 no.4
    • /
    • pp.164-174
    • /
    • 2023
  • The bandgap characteristics of semiconductor materials are an important factor when utilizing semiconductor materials for various applications. In this study, based on data provided by AFLOW (Automatic-FLOW for Materials Discovery), the bandgap of a semiconductor material was predicted using only the material's compositional features. The compositional features were generated using the python module of 'Pymatgen' and 'Matminer'. Pearson's correlation coefficients (PCC) between the compositional features were calculated and those with a correlation coefficient value larger than 0.95 were removed in order to avoid overfitting. The bandgap prediction performance was compared using the metrics of R2 score and root-mean-squared error. By predicting the bandgap with randomforest and xgboost as representatives of the ensemble algorithm, it was found that xgboost gave better results after cross-validation and hyper-parameter tuning. To investigate the effect of compositional feature selection on the bandgap prediction of the machine learning model, the prediction performance was studied according to the number of features based on feature importance methods. It was found that there were no significant changes in prediction performance beyond the appropriate feature. Furthermore, artificial neural networks were employed to compare the prediction performance by adjusting the number of features guided by the PCC values, resulting in the best R2 score of 0.811. By comparing and analyzing the bandgap distribution and prediction performance according to the material group containing specific elements (F, N, Yb, Eu, Zn, B, Si, Ge, Fe Al), various information for material design was obtained.

Extrapolation of wind pressure for low-rise buildings at different scales using few-shot learning

  • Yanmo Weng;Stephanie G. Paal
    • Wind and Structures
    • /
    • v.36 no.6
    • /
    • pp.367-377
    • /
    • 2023
  • This study proposes a few-shot learning model for extrapolating the wind pressure of scaled experiments to full-scale measurements. The proposed ML model can use scaled experimental data and a few full-scale tests to accurately predict the remaining full-scale data points (for new specimens). This model focuses on extrapolating the prediction to different scales while existing approaches are not capable of accurately extrapolating from scaled data to full-scale data in the wind engineering domain. Also, the scaling issue observed in wind tunnel tests can be partially resolved via the proposed approach. The proposed model obtained a low mean-squared error and a high coefficient of determination for the mean and standard deviation wind pressure coefficients of the full-scale dataset. A parametric study is carried out to investigate the influence of the number of selected shots. This technique is the first of its kind as it is the first time an ML model has been used in the wind engineering field to deal with extrapolation in wind performance prediction. With the advantages of the few-shot learning model, physical wind tunnel experiments can be reduced to a great extent. The few-shot learning model yields a robust, efficient, and accurate alternative to extrapolating the prediction performance of structures from various model scales to full-scale.

Estimating the unconfined compression strength of low plastic clayey soils using gene-expression programming

  • Muhammad Naqeeb Nawaz;Song-Hun Chong;Muhammad Muneeb Nawaz;Safeer Haider;Waqas Hassan;Jin-Seop Kim
    • Geomechanics and Engineering
    • /
    • v.33 no.1
    • /
    • pp.1-9
    • /
    • 2023
  • The unconfined compression strength (UCS) of soils is commonly used either before or during the construction of geo-structures. In the pre-design stage, UCS as a mechanical property is obtained through a laboratory test that requires cumbersome procedures and high costs from in-situ sampling and sample preparation. As an alternative way, the empirical model established from limited testing cases is used to economically estimate the UCS. However, many parameters affecting the 1D soil compression response hinder employing the traditional statistical analysis. In this study, gene expression programming (GEP) is adopted to develop a prediction model of UCS with common affecting soil properties. A total of 79 undisturbed soil samples are collected, of which 54 samples are utilized for the generation of a predictive model and 25 samples are used to validate the proposed model. Experimental studies are conducted to measure the unconfined compression strength and basic soil index properties. A performance assessment of the prediction model is carried out using statistical checks including the correlation coefficient (R), the root mean square error (RMSE), the mean absolute error (MAE), the relatively squared error (RSE), and external criteria checks. The prediction model has achieved excellent accuracy with values of R, RMSE, MAE, and RSE of 0.98, 10.01, 7.94, and 0.03, respectively for the training data and 0.92, 19.82, 14.56, and 0.15, respectively for the testing data. From the sensitivity analysis and parametric study, the liquid limit and fine content are found to be the most sensitive parameters whereas the sand content is the least critical parameter.

Development of a Real-Time Algorithm for Isometric Pinch Force Prediction from Electromyogram (EMG) (근전도 기반의 실시간 등척성 손가락 힘 예측 알고리즘 개발)

  • Choi, Chang-Mok;Kwon, Sun-Cheol;Park, Won-Il;Shin, Mi-Hye;Kim, Jung
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.1588-1593
    • /
    • 2008
  • This paper describes a real-time isometric pinch force prediction algorithm from surface electromyogram (sEMG) using multilayer perceptron (MLP) for human robot interactive applications. The activities of seven muscles which are observable from surface electrodes and also related to the movements of the thumb and index finger joints were recorded during pinch force experiments. For the successful implementation of the real-time prediction algorithm, an off-line analysis was performed using the recorded activities. Four muscles were selected for the force prediction by using the Fisher linear discriminant analysis among seven muscles, and the four muscle activities provided effective information for mapping sEMG to the pinch force. The MLP structure was designed to make training efficient and to avoid both under- and over-fitting problems. The pinch force prediction algorithm was tested on five volunteers and the results were evaluated using two criteria: normalized root mean squared error (NRMSE) and correlation (CORR). The training time for the subjects was only 2 min 29 sec, but the prediction results were successful with NRMSE = 0.112 ${\pm}$ 0.082 and CORR = 0.932 ${\pm}$ 0.058. These results imply that the proposed algorithm is useful to measure the produced pinch force without force sensors in real-time. The possible applications include controlling bionic finger robot systems to overcome finger paralysis or amputation.

  • PDF

Fuzzy System and Knowledge Information for Stock-Index Prediction

  • Kim, Hae-Gyun;Bae, Hyeon;Kim, Sung-Shin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.172.6-172
    • /
    • 2001
  • In recent years, many attempts have been made to predict the behavior of bonds, currencies, stock, or other economic markets. Most previous experiments used multilayer perceptrons(MLP) for stock market forecasting, The Kospi 200 Index is modeled using different neural networks and fuzzy system predictions. In this paper, a multilayer perceptron architecture, a dynamic polynomial neural network(DPNN) and a fuzzy system are used to predict the Kospi 200 index. The results of prediction is compared with the root mean squared error(RMSE) and the scatter plot. The results show that the fuzzy system is performing slightly better than DPNN and MLP. We can develop the desired fuzzy system by learning methods ...

  • PDF

Neural Network Modeling of Charge Concentration of Thin Films Deposited by Plasma-enhanced Chemical Vapor Deposition (플라즈마 화학기상법을 이용하여 증착된 박막 전하 농도의 신경망 모델링)

  • Kim, Woo-Serk;Kim, Byung-Whan
    • Proceedings of the KIEE Conference
    • /
    • 2006.04a
    • /
    • pp.108-110
    • /
    • 2006
  • A prediction model of charge concentration of silicon nitride (SiN) thin films was constructed by using neural network and genetic algorithm. SIN films were deposited by plasma enhanced chemical vapor deposition and the deposition process was characterized by means of $2^{6-1}$ fractional factorial experiment. Effect of five training factors on the model prediction performance was optimized by using genetic algorithm. This was examined as a function of the learring rate. The root mean squared error of optimized model was 0.975, which is much smaller than statistical regression model by about 45%. The constructed model can facilitate a Qualitative analysis of parameter effects on the charge concentration.

  • PDF

Stock-Index Prediction using Fuzzy System and Knowledge Information (퍼지시스템과 지식정보를 이용한 주가지수 예측)

  • Kim, Hae-Gyun;Kim, Sung-Shin
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2030-2032
    • /
    • 2001
  • In recent years, many attempts have been made to predict the behavior of bonds, currencies, stock, or other economic markets. Most previous experiments used multilayer perceptrons(MLP) for stock market forecasting. The Kospi 200 Index is modeled using different neural networks and fuzzy system predictions. In this paper, a multilayer perceptron architecture, a dynamic polynomial neural network(DPNN) and a fuzzy system are used to predict the Kospi 200 index. The results of prediction is compared with the root mean squared error(RMSE) and the scatter plot. Results show that both networks can be trained to predict the index. And the fuzzy system is performing slightly better than DPNN and MLP.

  • PDF

Application of data mining and statistical measurement of agricultural high-quality development

  • Yan Zhou
    • Advances in nano research
    • /
    • v.14 no.3
    • /
    • pp.225-234
    • /
    • 2023
  • In this study, we aim to use big data resources and statistical analysis to obtain a reliable instruction to reach high-quality and high yield agricultural yields. In this regard, soil type data, raining and temperature data as well as wheat production in each year are collected for a specific region. Using statistical methodology, the acquired data was cleaned to remove incomplete and defective data. Afterwards, using several classification methods in machine learning we tried to distinguish between different factors and their influence on the final crop yields. Comparing the proposed models' prediction using statistical quantities correlation factor and mean squared error between predicted values of the crop yield and actual values the efficacy of machine learning methods is discussed. The results of the analysis show high accuracy of machine learning methods in the prediction of the crop yields. Moreover, it is indicated that the random forest (RF) classification approach provides best results among other classification methods utilized in this study.

System Development of the Stock Price Prediction (주가 예측을 위한 Web Site 개발)

  • Cho, Kyu Cheol;Lee, Sung Hee
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.01a
    • /
    • pp.161-162
    • /
    • 2021
  • 주식을 매매할 때, 주식의 차트와 가치를 분석한 다음 언제 주식이 상한가 또는 하한가가 될지 예측한 후 매매하게 된다. 하지만 일반적으로 주식을 예측하기 어려워 주식의 수익을 내기 힘들다. 따라서 본 논문은 지난날의 주식 가격 데이터를 분석해 주식의 가격을 예측하는 주식 차트 분석을 할 수 있게 '주가 예측을 위한 웹 사이트'를 개발하였다. 이 사이트는 주식의 차트 분석을 지원하고 주식을 언제 매매할지에 대한 의사결정을 도와줄 수 있을 것으로 기대된다.

  • PDF