• Title/Summary/Keyword: Multi-Layer Perceptron(MLP)

Search Result 232, Processing Time 0.033 seconds

Swarm-based hybridizations of neural network for predicting the concrete strength

  • Ma, Xinyan;Foong, Loke Kok;Morasaei, Armin;Ghabussi, Aria;Lyu, Zongjie
    • Smart Structures and Systems
    • /
    • v.26 no.2
    • /
    • pp.241-251
    • /
    • 2020
  • Due to the undeniable importance of approximating the concrete compressive strength (CSC) in civil engineering, this paper focuses on presenting four novel optimizations of multi-layer perceptron (MLP) neural network, namely artificial bee colony (ABC-MLP), grasshopper optimization algorithm (GOA-MLP), shuffled frog leaping algorithm (SFLA-MLP), and salp swarm algorithm (SSA-MLP) for predicting this crucial parameter. The used dataset consists of 103 rows of information concerning seven influential parameters (cement, slag, water, fly ash, superplasticizer, fine aggregate, and coarse aggregate). In this work, the best-fitted complexity of each ensemble is determined by a population-based sensitivity analysis. The GOA distinguished its self by the least complexity (population size = 50) and emerged as the second time-effective optimizer. Referring to the prediction results, all tested algorithms are able to construct reliable networks. However, the SSA (Correlation = 0.9652 and Error = 1.3939) and GOA (Correlation = 0.9629 and Error = 1.3922) performed more accurately than ABC (Correlation = 0.7060 and Error = 4.0161) and SFLA (Correlation = 0.8890 and Error = 2.5480). Therefore, the SSA-MLP and GOA-MLP can be promising alternatives to laboratorial and traditional CSC evaluative methods.

A Study on the Pattern Classificatiion of the EMG Signals Using Neural Network and Probabilistic Model (신경회로망과 확률모델을 이용한 근전도신호의 패턴분류에 관한 연구)

  • 장영건;권장우;장원환;장원석;홍성홍
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.28B no.10
    • /
    • pp.831-841
    • /
    • 1991
  • A combined model of probabilistic and MLP(multi layer perceptron) model is proposed for the pattern classification of EMG( electromyogram) signals. The MLP model has a problem of not guaranteeing the global minima of error and different quality of approximations to Bayesian probabilities. The probabilistic model is, however, closely related to the estimation error of model parameters and the fidelity of assumptions. A proper combination of these will reduce the effects of the problems and be robust to input variations. Proposed model is able to get the MAP(maximum a posteriori probability) in the probabilistic model by estimating a priori probability distribution using the MLP model adaptively. This method minimize the error probability of the probabilistic model as long as the realization of the MLP model is optimal, and this is a good combination of the probabilistic model and the MLP model for the usage of MLP model reliability. Simulation results show the benefit of the proposed model compared to use the Mlp and the probabilistic model seperately and the average calculation time fro classification is about 50ms in the case of combined motion using an IBM PC 25 MHz 386model.

  • PDF

A Personal Video Event Classification Method based on Multi-Modalities by DNN-Learning (DNN 학습을 이용한 퍼스널 비디오 시퀀스의 멀티 모달 기반 이벤트 분류 방법)

  • Lee, Yu Jin;Nang, Jongho
    • Journal of KIISE
    • /
    • v.43 no.11
    • /
    • pp.1281-1297
    • /
    • 2016
  • In recent years, personal videos have seen a tremendous growth due to the substantial increase in the use of smart devices and networking services in which users create and share video content easily without many restrictions. However, taking both into account would significantly improve event detection performance because videos generally have multiple modalities and the frame data in video varies at different time points. This paper proposes an event detection method. In this method, high-level features are first extracted from multiple modalities in the videos, and the features are rearranged according to time sequence. Then the association of the modalities is learned by means of DNN to produce a personal video event detector. In our proposed method, audio and image data are first synchronized and then extracted. Then, the result is input into GoogLeNet as well as Multi-Layer Perceptron (MLP) to extract high-level features. The results are then re-arranged in time sequence, and every video is processed to extract one feature each for training by means of DNN.

Cancer Diagnosis System using Genetic Algorithm and Multi-boosting Classifier (Genetic Algorithm과 다중부스팅 Classifier를 이용한 암진단 시스템)

  • Ohn, Syng-Yup;Chi, Seung-Do
    • Journal of the Korea Society for Simulation
    • /
    • v.20 no.2
    • /
    • pp.77-85
    • /
    • 2011
  • It is believed that the anomalies or diseases of human organs are identified by the analysis of the patterns. This paper proposes a new classification technique for the identification of cancer disease using the proteome patterns obtained from two-dimensional polyacrylamide gel electrophoresis(2-D PAGE). In the new classification method, three different classification methods such as support vector machine(SVM), multi-layer perceptron(MLP) and k-nearest neighbor(k-NN) are extended by multi-boosting method in an array of subclassifiers and the results of each subclassifier are merged by ensemble method. Genetic algorithm was applied to obtain optimal feature set in each subclassifier. We applied our method to empirical data set from cancer research and the method showed the better accuracy and more stable performance than single classifier.

LM-BP algorithm application for odour classification and concentration prediction using MOS sensor array (MOS 센서어레이를 이용한 냄새 분류 및 농도추정을 위한 LM-BP 알고리즘 응용)

  • 최찬석;변형기;김정도
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.210-210
    • /
    • 2000
  • In this paper, we have investigated the properties of multi-layer perceptron (MLP) for odour patterns classification and concentration estimation simultaneously. When the MLP may be has a fast convergence speed with small error and excellent mapping ability for classification, it can be possible to use for classification and concentration prediction of volatile chemicals simultaneously. However, the conventional MLP, which is back-Propagation of error based on the steepest descent method, was difficult to use for odour classification and concentration estimation simultaneously, because it is slow to converge and may fall into the local minimum. We adapted the Levenberg-Marquardt(LM) algorithm [4,5] having advantages both the steepest descent method and Gauss-Newton method instead of the conventional steepest descent method for the simultaneous classification and concentration estimation of odours. And, We designed the artificial odour sensing system(Electronic Nose) and applied LM-BP algorithm for classification and concentration prediction of VOC gases.

  • PDF

A Basal Cell Carcinoma Classifier with an Ambiguous Category (모호한 카테고리를 도입한 기저 세포암 검출기)

  • Park, Aa-Ron;Min, So-Hee;Baek, Seong-Joon;Na, Seung-Yu
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.261-262
    • /
    • 2006
  • According to the previous work, various well known methods including maximum a posteriori probability classifier (MAP) and multi layer perceptron networks classifier (MLP) showed competitive results. Since even the small errors often leads to a fatal result, we investigated the method that reduces classification error perfectly by screening out some ambiguous patterns. Those ambiguous patterns can be examined by routine biopsy. We incorporated an ambiguous category in MAP and MLP. Classification results involving 216 spectra gave 100% sensitivity for the case of MLP.

  • PDF

Marker Classification by Sensor Fusion for Hand Pose Tracking in HMD Environments using MLP (HMD 환경에서 사용자 손의 자세 추정을 위한 MLP 기반 마커 분류)

  • Vu, Luc Cong;Choi, Eun-Seok;You, Bum-Jae
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2018.10a
    • /
    • pp.920-922
    • /
    • 2018
  • This paper describes a method to classify simple circular artificial markers on surfaces of a box on the back of hand to detect the pose of user's hand for VR/AR applications by using a Leap Motion camera and two IMU sensors. One IMU sensor is located in the box and the other IMU sensor is fixed with the camera. Multi-layer Perceptron (MLP) algorithm is adopted to classify artificial markers on each surface tracked by the camera using IMU sensor data. It is experimented successfully in real-time, 70Hz, under PC environments.

Compressive strength estimation of eco-friendly geopolymer concrete: Application of hybrid machine learning techniques

  • Xiang, Yang;Jiang, Daibo;Hateo, Gou
    • Steel and Composite Structures
    • /
    • v.45 no.6
    • /
    • pp.877-894
    • /
    • 2022
  • Geopolymer concrete (GPC) has emerged as a feasible choice for construction materials as a result of the environmental issues associated with the production of cement. The findings of this study contribute to the development of machine learning methods for estimating the properties of eco-friendly concrete to help reduce CO2 emissions in the construction industry. The compressive strength (fc) of GPC is predicted using artificial intelligence approaches in the present study when ground granulated blast-furnace slag (GGBS) is substituted with natural zeolite (NZ), silica fume (SF), and varying NaOH concentrations. For this purpose, two machine learning methods multi-layer perceptron (MLP) and radial basis function (RBF) were considered and hybridized with arithmetic optimization algorithm (AOA), and grey wolf optimization algorithm (GWO). According to the results, all methods performed very well in predicting the fc of GPC. The proposed AOA - MLP might be identified as the outperformed framework, although other methodologies (AOA - RBF, GWO - RBF, and GWO - MLP) were also reliable in the fc of GPC forecasting process.

SG-MLP: Switch Gated Multi-Layer Perceptron Model for Natural Language Understanding (자연어 처리를 위한 조건부 게이트 다층 퍼셉트론 모델 개발 및 구현)

  • Son, Guijin;Kim, Seungone;Joo, Se June;Cho, Woojin;Nah, JeongEun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2021.11a
    • /
    • pp.1116-1119
    • /
    • 2021
  • 2018 년 Google 사의 사전 학습된 언어 인공지능 BERT 를 기점으로, 자연어 처리 학계는 주요 구조를 유지한 채 경쟁적으로 모델을 대형화하는 방향으로 발전했다. 그 결과, 오늘날 자연어 인공지능은 거대 사기업과 그에 준하는 컴퓨팅 자원을 소유한 연구 단체만의 전유물이 되었다. 본 논문에서는 다층 퍼셉트론을 병렬적으로 배열해 자연어 인공지능을 제작하는 기법의 모델을 제안하고, 이를 적용한'조건부 게이트 다층 퍼셉트론 모델(SG-MLP)'을 구현하고 그 결과를 비교 관찰하였다. SG-MLP 는 BERT 의 20%에 해당하는 사전 학습량만으로 다수의 지표에서 그것과 준하는 성능을 보였고, 동일한 과제에 대해 더 적은 연산 비용을 소요한다.

Spoken Digit Recognition Using URAN(Universally Reconstructable Artificial Neural-network)VLSI Chip (URAN VLSI chip을 이용한 숫자음 인식)

  • 김기철
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1993.06a
    • /
    • pp.117-120
    • /
    • 1993
  • In this paper, we explore the possibility of URAN(Universally Reconstructable Artificial Neural-network) VLSI chip for speech recognition. URAN, a newly developed analog-digital hybrid neural chip, is discussed in respects to its input, output, and weight accuracy and their relations to its performance on speaker independent digit recognition. Multi-layer perceptron(MLP) nets including a large frame input layer are used to recognize a digit syllable at a forward retrieval. The simulation results using the full and limited floating precision computations for the input, output, and weight variables of the network give the comparable classification performance. An MLP with piecewise linear hidden and output units is also trained successfully using low accuracy computation.

  • PDF