• Title/Summary/Keyword: multilayer perceptron (MLP)

Search Result 134, Processing Time 0.028 seconds

OrdinalEncoder based DNN for Natural Gas Leak Prediction (천연가스 누출 예측을 위한 OrdinalEncoder 기반 DNN)

  • Khongorzul, Dashdondov;Lee, Sang-Mu;Kim, Mi-Hye
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.10
    • /
    • pp.7-13
    • /
    • 2019
  • The natural gas (NG), mostly methane leaks into the air, it is a big problem for the climate. detected NG leaks under U.S. city streets and collected data. In this paper, we introduced a Deep Neural Network (DNN) classification of prediction for a level of NS leak. The proposed method is OrdinalEncoder(OE) based K-means clustering and Multilayer Perceptron(MLP) for predicting NG leak. The 15 features are the input neurons and the using backpropagation. In this paper, we propose the OE method for labeling target data using k-means clustering and compared normalization methods performance for NG leak prediction. There five normalization methods used. We have shown that our proposed OE based MLP method is accuracy 97.7%, F1-score 96.4%, which is relatively higher than the other methods. The system has implemented SPSS and Python, including its performance, is tested on real open data.

Faster User Enrollment for Neural Speaker Verification Systems (신경망 기반 화자증명 시스템에서 더욱 향상된 사용자 등록속도)

  • Lee, Tae-Seung;Park, Sung-Won;Hwang, Byong-Won
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2003.10a
    • /
    • pp.1021-1026
    • /
    • 2003
  • While multilayer perceptrons (MLPs) have great possibility on the application to speaker verification, they suffer from inferior learning speed. To appeal to users, the speaker verification systems based on MLPs must achieve a reasonable enrolling speed and it is thoroughly dependent on the fast teaming of MLPs. To attain real-time enrollment on the systems, the previous two studies have been devoted to the problem and each satisfied the objective. In this paper, the two studies are combined and applied to the systems, on the assumption that each method operates on different optimization principle. By conducting experiments using an MLP-based speaker verification system to which the combination is applied on real speech database, the feasibility of the combination is verified from the results of the experiments.

  • PDF

Development of a Real-Time Algorithm for Isometric Pinch Force Prediction from Electromyogram (EMG) (근전도 기반의 실시간 등척성 손가락 힘 예측 알고리즘 개발)

  • Choi, Chang-Mok;Kwon, Sun-Cheol;Park, Won-Il;Shin, Mi-Hye;Kim, Jung
    • Proceedings of the KSME Conference
    • /
    • 2008.11a
    • /
    • pp.1588-1593
    • /
    • 2008
  • This paper describes a real-time isometric pinch force prediction algorithm from surface electromyogram (sEMG) using multilayer perceptron (MLP) for human robot interactive applications. The activities of seven muscles which are observable from surface electrodes and also related to the movements of the thumb and index finger joints were recorded during pinch force experiments. For the successful implementation of the real-time prediction algorithm, an off-line analysis was performed using the recorded activities. Four muscles were selected for the force prediction by using the Fisher linear discriminant analysis among seven muscles, and the four muscle activities provided effective information for mapping sEMG to the pinch force. The MLP structure was designed to make training efficient and to avoid both under- and over-fitting problems. The pinch force prediction algorithm was tested on five volunteers and the results were evaluated using two criteria: normalized root mean squared error (NRMSE) and correlation (CORR). The training time for the subjects was only 2 min 29 sec, but the prediction results were successful with NRMSE = 0.112 ${\pm}$ 0.082 and CORR = 0.932 ${\pm}$ 0.058. These results imply that the proposed algorithm is useful to measure the produced pinch force without force sensors in real-time. The possible applications include controlling bionic finger robot systems to overcome finger paralysis or amputation.

  • PDF

A 4-layer AaMLP for Keystroke Dynamics Identity Verification (4 층 자기연상 다층퍼셉트론을 이용한 키스트로크 기반 사용자 인증)

  • U Eun Cheol;Jo Seong Jun
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2002.05a
    • /
    • pp.639-644
    • /
    • 2002
  • Password typing is the most wifely ued identity verification method in computer security domain. However, due to its simplicity, it is vulnerable to imposter attacks Keystroke dynamics adds a shield to password. Discriminating imposters from owners is a novelty detection problem. Auto-Associative Multilayer Perceptron (AaMLP) has teen proved to be a good novelty detector. However, the wifely used 2-layer AaMLP cannot identify nonlinear boundaries, which can result in serious problems in computer security. In this paper, a nonlinear model, i.e. 4-layer AaMLP, is proposed to serve as the novelty detector, which can remedy the limitations of 2-layer AaMLP.

  • PDF

Prediction of box office using data mining (데이터마이닝을 이용한 박스오피스 예측)

  • Jeon, Seonghyeon;Son, Young Sook
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.7
    • /
    • pp.1257-1270
    • /
    • 2016
  • This study deals with the prediction of the total number of movie audiences as a measure for the box office. Prediction is performed by classification techniques of data mining such as decision tree, multilayer perceptron(MLP) neural network model, multinomial logit model, and support vector machine over time such as before movie release, release day, after release one week, and after release two weeks. Predictors used are: online word-of-mouth(OWOM) variables such as the portal movie rating, the number of the portal movie rater, and blog; in addition, other variables include showing the inherent properties of the film (such as nationality, grade, release month, release season, directors, actors, distributors, the number of audiences, and screens). When using 10-fold cross validation technique, the accuracy of the neural network model showed more than 90 % higher predictability before movie release. In addition, it can be seen that the accuracy of the prediction increases by adding estimates of the final OWOM variables as predictors.

Feature Vector Extraction and Automatic Classification for Transient SONAR Signals using Wavelet Theory and Neural Networks (Wavelet 이론과 신경회로망을 이용한 천이 수중 신호의 특징벡타 추출 및 자동 식별)

  • Yang, Seung-Chul;Nam, Sang-Won;Jung, Yong-Min;Cho, Yong-Soo;Oh, Won-Tcheon
    • The Journal of the Acoustical Society of Korea
    • /
    • v.14 no.3
    • /
    • pp.71-81
    • /
    • 1995
  • In this paper, feature vector extraction methods and classification algorithms for the automatic classification of transient signals in underwater are discussed. A feature vector extraction method using wavelet transform, which shows good performance with small number of coefficients, is proposed and compared with the existing classical methods. For the automatic classification, artificial neural networks such as multilayer perceptron (MLP), radial basis function (RBF), and MLP-Class are utilized, where those neural networks as well as extracted feature vectors are combined to improve the performance and reliability of the proposed algorithm. It is confirmed by computer simulation with Traco's standard transient data set I and simulated data that the proposed feature vector extraction method and classification algorithm perform well, assuming that the energy of a given transient signal is sufficiently larger than that of a ambient noise, that there are the finite number of noise sources, and that there does not exist noise sources more than two simultaneously.

  • PDF

Fuzzy System and Knowledge Information for Stock-Index Prediction

  • Kim, Hae-Gyun;Bae, Hyeon;Kim, Sung-Shin
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.172.6-172
    • /
    • 2001
  • In recent years, many attempts have been made to predict the behavior of bonds, currencies, stock, or other economic markets. Most previous experiments used multilayer perceptrons(MLP) for stock market forecasting, The Kospi 200 Index is modeled using different neural networks and fuzzy system predictions. In this paper, a multilayer perceptron architecture, a dynamic polynomial neural network(DPNN) and a fuzzy system are used to predict the Kospi 200 index. The results of prediction is compared with the root mean squared error(RMSE) and the scatter plot. The results show that the fuzzy system is performing slightly better than DPNN and MLP. We can develop the desired fuzzy system by learning methods ...

  • PDF

Stock-Index Prediction using Fuzzy System and Knowledge Information (퍼지시스템과 지식정보를 이용한 주가지수 예측)

  • Kim, Hae-Gyun;Kim, Sung-Shin
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2030-2032
    • /
    • 2001
  • In recent years, many attempts have been made to predict the behavior of bonds, currencies, stock, or other economic markets. Most previous experiments used multilayer perceptrons(MLP) for stock market forecasting. The Kospi 200 Index is modeled using different neural networks and fuzzy system predictions. In this paper, a multilayer perceptron architecture, a dynamic polynomial neural network(DPNN) and a fuzzy system are used to predict the Kospi 200 index. The results of prediction is compared with the root mean squared error(RMSE) and the scatter plot. Results show that both networks can be trained to predict the index. And the fuzzy system is performing slightly better than DPNN and MLP.

  • PDF

Malay Syllables Speech Recognition Using Hybrid Neural Network

  • Ahmad, Abdul Manan;Eng, Goh Kia
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.287-289
    • /
    • 2005
  • This paper presents a hybrid neural network system which used a Self-Organizing Map and Multilayer Perceptron for the problem of Malay syllables speech recognition. The novel idea in this system is the usage of a two-dimension Self-organizing feature map as a sequential mapping function which transform the phonetic similarities or acoustic vector sequences of the speech frame into trajectories in a square matrix where elements take on binary values. This property simplifies the classification task. An MLP is then used to classify the trajectories that each syllable in the vocabulary corresponds to. The system performance was evaluated for recognition of 15 Malay common syllables. The overall performance of the recognizer showed to be 91.8%.

  • PDF

A Method on the Learning Speed Improvement of the Online Error Backpropagation Algorithm in Speech Processing (음성처리에서 온라인 오류역전파 알고리즘의 학습속도 향상방법)

  • 이태승;이백영;황병원
    • The Journal of the Acoustical Society of Korea
    • /
    • v.21 no.5
    • /
    • pp.430-437
    • /
    • 2002
  • Having a variety of good characteristics against other pattern recognition techniques, the multilayer perceptron (MLP) has been widely used in speech recognition and speaker recognition. But, it is known that the error backpropagation (EBP) algorithm that MLP uses in learning has the defect that requires restricts long learning time, and it restricts severely the applications like speaker recognition and speaker adaptation requiring real time processing. Because the learning data for pattern recognition contain high redundancy, in order to increase the learning speed it is very effective to use the online-based learning methods, which update the weight vector of the MLP by the pattern. A typical online EBP algorithm applies the fixed learning rate for each update of the weight vector. Though a large amount of speedup with the online EBP can be obtained by choosing the appropriate fixed rate, firing the rate leads to the problem that the algorithm cannot respond effectively to different learning phases as the phases change and the number of patterns contributing to learning decreases. To solve this problem, this paper proposes a Changing rate and Omitting patterns in Instant Learning (COIL) method to apply the variable rate and the only patterns necessary to the learning phase when the phases come to change. In this paper, experimentations are conducted for speaker verification and speech recognition, and results are presented to verify the performance of the COIL.