• Title/Summary/Keyword: MLP(Multi-Layer Perceptron)

Search Result 234, Processing Time 0.036 seconds

Use of multi-hybrid machine learning and deep artificial intelligence in the prediction of compressive strength of concrete containing admixtures

  • Jian, Guo;Wen, Sun;Wei, Li
    • Advances in concrete construction
    • /
    • v.13 no.1
    • /
    • pp.11-23
    • /
    • 2022
  • Conventional concrete needs some improvement in the mechanical properties, which can be obtained by different admixtures. However, making concrete samples costume always time and money. In this paper, different types of hybrid algorithms are applied to develop predictive models for forecasting compressive strength (CS) of concretes containing metakaolin (MK) and fly ash (FA). In this regard, three different algorithms have been used, namely multilayer perceptron (MLP), radial basis function (RBF), and support vector machine (SVR), to predict CS of concretes by considering most influencers input variables. These algorithms integrated with the grey wolf optimization (GWO) algorithm to increase the model's accuracy in predicting (GWMLP, GWRBF, and GWSVR). The proposed MLP models were implemented and evaluated in three different layers, wherein each layer, GWO, fitted the best neuron number of the hidden layer. Correspondingly, the key parameters of the SVR model are identified using the GWO method. Also, the optimization algorithm determines the hidden neurons' number and the spread value to set the RBF structure. The results show that the developed models all provide accurate predictions of the CS of concrete incorporating MK and FA with R2 larger than 0.9972 and 0.9976 in the learning and testing stage, respectively. Regarding GWMLP models, the GWMLP1 model outperforms other GWMLP networks. All in all, GWSVR has the worst performance with the lowest indices, while the highest score belongs to GWRBF.

Genetically Opimized Self-Organizing Fuzzy Polynomial Neural Networks Based on Fuzzy Polynomial Neurons (퍼지다항식 뉴론 기반의 유전론적 최적 자기구성 퍼지 다항식 뉴럴네트워크)

  • 박호성;이동윤;오성권
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.53 no.8
    • /
    • pp.551-560
    • /
    • 2004
  • In this paper, we propose a new architecture of Self-Organizing Fuzzy Polynomial Neural Networks (SOFPNN) that is based on a genetically optimized multilayer perceptron with fuzzy polynomial neurons (FPNs) and discuss its comprehensive design methodology involving mechanisms of genetic optimization, especially genetic algorithms (GAs). The proposed SOFPNN gives rise to a structurally optimized structure and comes with a substantial level of flexibility in comparison to the one we encounter in conventional SOFPNNs. The design procedure applied in the construction of each layer of a SOFPNN deals with its structural optimization involving the selection of preferred nodes (or FPNs) with specific local characteristics (such as the number of input variables, the order of the polynomial of the consequent part of fuzzy rules, and a collection of the specific subset of input variables) and addresses specific aspects of parametric optimization. Through the consecutive process of such structural and parametric optimization, an optimized and flexible fuzzy neural network is generated in a dynamic fashion. To evaluate the performance of the genetically optimized SOFPNN, the model is experimented with using two time series data(gas furnace and chaotic time series), A comparative analysis reveals that the proposed SOFPNN exhibits higher accuracy and superb predictive capability in comparison to some previous models available in the literatures.

Predicting Probability of Precipitation Using Artificial Neural Network and Mesoscale Numerical Weather Prediction (인공신경망과 중규모기상수치예보를 이용한 강수확률예측)

  • Kang, Boosik;Lee, Bongki
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.28 no.5B
    • /
    • pp.485-493
    • /
    • 2008
  • The Artificial Neural Network (ANN) model was suggested for predicting probability of precipitation (PoP) using RDAPS NWP model, observation at AWS and upper-air sounding station. The prediction work was implemented for flood season and the data period is the July, August of 2001 and June of 2002. Neural network input variables (predictors) were composed of geopotential height 500/750/1000 hPa, atmospheric thickness 500-1000 hPa, X & Y-component of wind at 500 hPa, X & Y-component of wind at 750 hPa, wind speed at surface, temperature at 500/750 hPa/surface, mean sea level pressure, 3-hr accumulated precipitation, occurrence of observed precipitation, precipitation accumulated in 6 & 12 hrs previous to RDAPS run, precipitation occurrence in 6 & 12 hrs previous to RDAPS run, relative humidity measured 0 & 12 hrs before RDAPS run, precipitable water measured 0 & 12 hrs before RDAPS run, precipitable water difference in 12 hrs previous to RDAPS run. The suggested ANN has a 3-layer perceptron (multi layer perceptron; MLP) and back-propagation learning algorithm. The result shows that there were 6.8% increase in Hit rate (H), especially 99.2% and 148.1% increase in Threat Score (TS) and Probability of Detection (POD). It illustrates that the suggested ANN model can be a useful tool for predicting rainfall event prediction. The Kuipers Skill Score (KSS) was increased 92.8%, which the ANN model improves the rainfall occurrence prediction over RDAPS.

Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture

  • Park, Ho-Sung;Park, Byoung-Jun;Kim, Hyun-Ki;Oh, Sung-Kwun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.4
    • /
    • pp.423-434
    • /
    • 2004
  • In this paper, we introduce a new topology of Self-Organizing Polynomial Neural Networks (SOPNN) based on genetically optimized Multi-Layer Perceptron (MLP) and discuss its comprehensive design methodology involving mechanisms of genetic optimization. Let us recall that the design of the 'conventional' SOPNN uses the extended Group Method of Data Handling (GMDH) technique to exploit polynomials as well as to consider a fixed number of input nodes at polynomial neurons (or nodes) located in each layer. However, this design process does not guarantee that the conventional SOPNN generated through learning results in optimal network architecture. The design procedure applied in the construction of each layer of the SOPNN deals with its structural optimization involving the selection of preferred nodes (or PNs) with specific local characteristics (such as the number of input variables, the order of the polynomials, and input variables) and addresses specific aspects of parametric optimization. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between the approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented using pH neutralization process data as well as sewage treatment process data. A comparative analysis indicates that the proposed SOPNN is the model having higher accuracy as well as more superb predictive capability than other intelligent models presented previously.reviously.

ELM based short-term Water Demand Prediction for Effective Operation of Water Treatment Plant (정수장 운영효율 향상을 위한 ELM 기반 단기 물 수요 예측)

  • Choi, Gee-Seon;Lee, Dong-Hoon;Kim, Sung-Hwan;Lee, Kyung-Woo;Chun, Myung-Geun
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.23 no.9
    • /
    • pp.108-116
    • /
    • 2009
  • In this paper, we develop an ELM(Extreme Learning Machine) based short-tenn water demand prediction algorithm which solves overfitting problem of MLP(Multi Layer Perceptron) and has quick training time. To show effectiveness of proposed method, we analyzed time series data collected in A water treatment plant at Chung-Nam province during $2007{\sim}2008$ years and used the selected data for the verification of developed algorithm. According to the experimental results, MLP model showed 5.82[%], but the proposed ELM based model showed 5.61[%] with respect to MAPE, respectively. Also, MLP model needed 7.57s training time, but ELM based model was 0.09s. Therefore, the proposed ELM based short-term water demand prediction model can be used to operate the water treatment plant effectively.

A computational estimation model for the subgrade reaction modulus of soil improved with DCM columns

  • Dehghanbanadaki, Ali;Rashid, Ahmad Safuan A.;Ahmad, Kamarudin;Yunus, Nor Zurairahetty Mohd;Said, Khairun Nissa Mat
    • Geomechanics and Engineering
    • /
    • v.28 no.4
    • /
    • pp.385-396
    • /
    • 2022
  • The accurate determination of the subgrade reaction modulus (Ks) of soil is an important factor for geotechnical engineers. This study estimated the Ks of soft soil improved with floating deep cement mixing (DCM) columns. A novel prediction model was developed that emphasizes the accuracy of identifying the most significant parameters of Ks. Several multi-layer perceptron (MLP) models that were trained using the Levenberg Marquardt (LM) backpropagation method were developed to estimate Ks. The models were trained using a reliable database containing the results of 36 physical modelling tests. The input parameters were the undrained shear strength of the DCM columns, undrained shear strength of soft soil, area improvement ratio and length-to-diameter ratio of the DCM columns. Grey wolf optimization (GWO) was coupled with the MLPs to improve the performance indices of the MLPs. Sensitivity tests were carried out to determine the importance of the input parameters for prediction of Ks. The results showed that both the MLP-LM and MLP-GWO methods showed high ability to predict Ks. However, it was shown that MLP-GWO (R = 0.9917, MSE = 0.28 (MN/m2/m)) performed better than MLP-LM (R =0.9126, MSE =6.1916 (MN/m2/m)). This proves the greater reliability of the proposed hybrid model of MLP-GWO in approximating the subgrade reaction modulus of soft soil improved with floating DCM columns. The results revealed that the undrained shear strength of the soil was the most effective factor for estimation of Ks.

A study on the Recognition of Hand-written Characters and Arabic numbers by Neural Networks (신경회로망을 이용한 필기체 한글 자모음 및 숫자인식에 관한 연구)

  • Oh, Dong-Su;Lee, Eun-Un;Yoo, Jae-Guen;Nam, Moon-Hyun
    • Proceedings of the KIEE Conference
    • /
    • 1991.07a
    • /
    • pp.900-904
    • /
    • 1991
  • In this paper, our study for the recognition of Hand-written Korean characters, Arabic numbers and alphabets by neural netwoks. This System extracts feature of character by using the MESH feature point of handwritten character, Arabic numbers and alphabets. To reduce the input image data, features are extracted from each input images. A MLP(multi-layer perceptron) with one hidden layer was trained with a modified BEP(back error propagation) algorithm. This method extracts feature sets of the characters directly from the scanner and can enhance computation speed without using the special preprocesses such as size normalization, smoothing, and thinning.

  • PDF

Performance of the Phoneme Segmenter in Speech Recognition System (음성인식 시스템에서의 음소분할기의 성능)

  • Lee, Gwang-seok
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.705-708
    • /
    • 2009
  • This research describes a neural network-based phoneme segmenter for recognizing spontaneous speech. The input of the phoneme segmenter for spontaneous speech is 16th order mel-scaled FFT, normalized frame energy, ratio of energy among 0~3[KHz] band and more than 3[KHz] band. All the features are differences of two consecutive 10 [msec] frame. The main body of the segmenter is single-hidden layer MLP(Multi-Layer Perceptron) with 72 inputs, 20 hidden nodes, and one output node. The segmentation accuracy is 78% with 7.8% insertion.

  • PDF

Prediction of dairy cow mastitis with multi-sensor data using Multi-Layer Perceptron(MLP) (다중 센서 데이터와 다층 퍼셉트론을 활용한 젖소의 유방염 진단 예측)

  • Song, Hye-Won;Park, Gi-Cheol;Park, JaeHwa
    • Annual Conference of KIPS
    • /
    • 2020.11a
    • /
    • pp.788-791
    • /
    • 2020
  • 낙농업에서 경제적 손실을 불러일으키고 관찰 시간과 비용이 필요한 젖소의 유방염 관리는 중요하다. 그러나 지금까지의 연구는 유방염 진단에 초점을 맞추고 있고, 예측하려는 시도는 전무하다. 유방염에 걸린 개체는 며칠 동안 우유를 생산할 수 없기 때문에 낙농가에 막대한 피해를 준다. 따라서 젖소가 유방염에 걸려 증상이 나타나기 전에 미리 파악해 조처를 할 수 있도록 하는 것이 중요하다. 이에 본 연구는 유방염 예측을 위해 생체 데이터를 포함한 다중 센싱 데이터를 사용해 유방염 예측 모델을 개발하였다. 모델에 사용된 데이터는 충청남도의 농가에 설치된 로봇 착유기로 부터 수집하였으며, 일정 기간 동안의 다중 센싱 데이터를 바탕으로 다음 날의 유방염 여부를 예측한다. 많은 양의 비선형 데이터를 효과적으로 처리하기 위해 다층 퍼셉트론을 사용해 모델을 학습하였다. 그 결과, 81.6%의 예측 정확도를 보였으며 교차 검증을 통해 정확도뿐만 아니라 재현율까지 우수함을 확인할 수 있었다.

A Study on the Spoken Korean Citynames Using Multi-Layered Perceptron of Back-Propagation Algorithm (오차 역전파 알고리즘을 갖는 MLP를 이용한 한국 지명 인식에 대한 연구)

  • Song, Do-Sun;Lee, Jae-Gheon;Kim, Seok-Dong;Lee, Haing-Sei
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.6
    • /
    • pp.5-14
    • /
    • 1994
  • This paper is about an experiment of speaker-independent automatic Korean spoken words recognition using Multi-Layered Perceptron and Error Back-propagation algorithm. The object words are 50 citynames of D.D.D local numbers. 43 of those are 2 syllables and the rest 7 are 3 syllables. The words were not segmented into syllables or phonemes, and some feature components extracted from the words in equal gap were applied to the neural network. That led independent result on the speech duration, and the PARCOR coefficients calculated from the frames using linear predictive analysis were employed as feature components. This paper tried to find out the optimum conditions through 4 differerent experiments which are comparison between total and pre-classified training, dependency of recognition rate on the number of frames and PAROCR order, recognition change due to the number of neurons in the hidden layer, and the comparison of the output pattern composition method of output neurons. As a result, the recognition rate of $89.6\%$ is obtaimed through the research.

  • PDF