• Title/Summary/Keyword: MLP.

Search Result 676, Processing Time 0.029 seconds

Hierarchical Architecture of Multilayer Perceptrons for Performance Improvement (다층퍼셉트론의 계층적 구조를 통한 성능향상)

  • Oh, Sang-Hoon
    • The Journal of the Korea Contents Association
    • /
    • v.10 no.6
    • /
    • pp.166-174
    • /
    • 2010
  • Based on the theoretical results that multi-layer feedforward neural networks with enough hidden nodes are universal approximators, we usually use three-layer MLP's(multi-layer perceptrons) consisted of input, hidden, and output layers for many application problems. However, this conventional three-layer architecture of MLP shows poor generalization performance in some applications, which are complex with various features in an input vector. For the performance improvement, this paper proposes a hierarchical architecture of MLP especially when each part of inputs has a special information. That is, one input vector is divided into sub-vectors and each sub-vector is presented to a separate MLP. These lower-level MLPs are connected to a higher-level MLP, which has a role to do a final decision. The proposed method is verified through the simulation of protein disorder prediction problem.

A Structural Learning of MLP Classifiers Using PfSGA and Its Application to Sign Language Recognition (PfSGA를 이용한 MLP분류기의 구조 학습 및 수화인식에의 응용)

  • 김상운;신성효
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.36C no.11
    • /
    • pp.75-83
    • /
    • 1999
  • We propose a PfSGA(parameter-free species genetic algorithm) to learn the topological structure of MLP classifiers being adequate to given applications. The PfSGA is a combinational method of SGA(species genetic algorithm) and PfGA(parameter-free genetic algorithm). In SGA, we divide the total search space into several subspaces(species) according to the number of hidden units, and reduce the unnecessary search by eliminating the low promising species from the evolutionary process. However the performances of SGA classifiers are readily affected by the values of parameters such as mutation ratio and crossover ratio. In this paper, therefore, we combine SGA with PfGA, for which it is not necessary to determine the learning parameters. Experimental results on benchmark data and sign language words show that PfSGA can reduce the learning time of SGA and is not affected by the selection parameter values on structural learning. The results also show that PfSGA is more efficient than the exisiting methods in the aspect of misclassification ratio, learning rate, and complexity of MLP structure.

  • PDF

Feature Extraction and Classification of High Dimensional Biomedical Spectral Data (고차원을 갖는 생체 스펙트럼 데이터의 특징추출 및 분류기법)

  • Cho, Jae-Hoon;Park, Jin-Il;Lee, Dae-Jong;Chun, Myung-Geun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.19 no.3
    • /
    • pp.297-303
    • /
    • 2009
  • In this paper, we propose the biomedical spectral pattern classification techniques by the fusion scheme based on the SpPCA and MLP in extended feature space. A conventional PCA technique for the dimension reduction has the problem that it can't find an optimal transformation matrix if the property of input data is nonlinear. To overcome this drawback, we extract features by the SpPCA technique in extended space which use the local patterns rather than whole patterns. In the classification step, individual classifier based on MLP calculates the similarity of each class for local features. Finally, biomedical spectral patterns is classified by the fusion scheme to effectively combine the individual information. As the simulation results to verify the effectiveness, the proposed method showed more improved classification results than conventional methods.

Hydrologic Disaggregation Model using Neural Networks Technique (신경망기법을 이용한 수문학적 분해모형)

  • Kim, Sung-Won
    • Journal of Wetlands Research
    • /
    • v.12 no.3
    • /
    • pp.79-97
    • /
    • 2010
  • The purpose of this research is to apply the neural networks models for the hydrologic disaggregation of the yearly pan evaporation(PE) data in Republic of Korea. The neural networks models consist of multilayer perceptron neural networks model(MLP-NNM) and support vector machine neural networks model(SVM-NNM), respectively. And, for the evaluation of the neural networks models, they are composed of training and test performances, respectively. The three types of data such as the historic, the generated, and the mixed data are used for the training performance. The only historic data, however, is used for the testing performance. The application of MLP-NNM and SVM-NNM for the hydrologic disaggregation of nonlinear time series data is evaluated from results of this research. Four kinds of the statistical index for the evaluation are suggested; CC, RMSE, E, and AARE, respectively. Homogeneity test using ANOVA and Mann-Whitney U test, furthermore, is carried out for the observed and calculated monthly PE data. We can construct the credible monthly PE data from the hydrologic disaggregation of the yearly PE data, and the available data for the evaluation of irrigation and drainage networks system can be suggested.

Research on improving correctness of cardiac disorder data classifier by applying Best-First decision tree method (Best-First decision tree 기법을 적용한 심전도 데이터 분류기의 정확도 향상에 관한 연구)

  • Lee, Hyun-Ju;Shin, Dong-Kyoo;Park, Hee-Won;Kim, Soo-Han;Shin, Dong-Il
    • Journal of Internet Computing and Services
    • /
    • v.12 no.6
    • /
    • pp.63-71
    • /
    • 2011
  • Cardiac disorder data are generally tested using the classifier and QRS-Complex and R-R interval which is used in this experiment are often extracted by ECG(Electrocardiogram) signals. The experimentation of ECG data with classifier is generally performed with SVM(Support Vector Machine) and MLP(Multilayer Perceptron) classifier, but this study experimented with Best-First Decision Tree(B-F Tree) derived from the Dicision Tree among Random Forest classifier algorithms to improve accuracy. To compare and analyze accuracy, experimentation of SVM, MLP, RBF(Radial Basic Function) Network and Decision Tree classifiers are performed and also compared the result of announced papers carried out under same interval and data. Comparing the accuracy of Random Forest classifier with above four ones, Random Forest is the best in accuracy. As though R-R interval was extracted using Band-pass filter in pre-processing of this experiment, in future, more filter study is needed to extract accurate interval.

Low-noise reconstruction method for coded-aperture gamma camera based on multi-layer perceptron

  • Zhang, Rui;Tang, Xiaobin;Gong, Pin;Wang, Peng;Zhou, Cheng;Zhu, Xiaoxiang;Liang, Dajian;Wang, Zeyu
    • Nuclear Engineering and Technology
    • /
    • v.52 no.10
    • /
    • pp.2250-2261
    • /
    • 2020
  • Accurate localization of radioactive materials is crucial in homeland security and radiological emergencies. Coded-aperture gamma camera is an interesting solution for such applications and can be developed into portable real-time imaging devices. However, traditional reconstruction methods cannot effectively deal with signal-independent noise, thereby hindering low-noise real-time imaging. In this study, a novel reconstruction method with excellent noise-suppression capability based on a multi-layer perceptron (MLP) is proposed. A coded-aperture gamma camera based on pixel detector and coded-aperture mask was constructed, and the process of radioactive source imaging was simulated. Results showed that the MLP method performs better in noise suppression than the traditional correlation analysis method. When the Co-57 source with an activity of 1 MBq was at 289 different positions within the field of view which correspond to 289 different pixels in the reconstructed image, the average contrast-to-noise ratio (CNR) obtained by the MLP method was 21.82, whereas that obtained by the correlation analysis method was 5.85. The variance in CNR of the MLP method is larger than that of correlation analysis, which means the MLP method has some instability in certain conditions.

Mobile Router Decision Using Multi-layered Perceptron in Nested Mobile Networks (중첩 이동 네트워크에서 Multi-layered Perceptron을 이용한 최적의 이동 라우터 지정 방안)

  • Song, Jiyoung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.12
    • /
    • pp.2843-2852
    • /
    • 2013
  • In the nested mobile network environment, the mobile node selects one of multiple mobile routers. The MR(Mobile Router) by existing top-down or bottom-up methods may not be the optimal MR if the numbers of mobile nodes and routers are substantially increased, and the scale of the network is increased drastically. Since an inappropriate MR decision causes handover or binding renewal to mobile nodes, determining of the optimal MR is important for efficiency. In this paper, we propose an algorithm that decides on the optimal MR using MR QoS(Quality of Service) information, and we describe how to understand the various structured MLP(Multi-Layered Perceptron) based on the algorithm. In conclusion, we prove the ability of the suggested neural network for a nesting mobile network through the performance analysis of each learned MLP.

PDA-based Text Extraction System using Client/Server Architecture (Client/Server구조를 이용한 PDA기반의 문자 추출 시스템)

  • Park Anjin;Jung Keechul
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.2
    • /
    • pp.85-98
    • /
    • 2005
  • Recently, a lot of researches about mobile vision using Personal Digital Assistant(PDA) has been attempted. Many CPUs for PDA are integer CPUs, which have no floating-computation component. It results in slow computation of the algorithms peformed by vision system or image processing, which have much floating-computation. In this paper, in order to resolve this weakness, we propose the Client(PDA)/server(PC) architecture which is connected to each other with a wireless LAN, and we construct the system with pipelining processing using two CPUs of the Client(PDA) and the Server(PC) in image sequence. The Client(PDA) extracts tentative text regions using Edge Density(ED). The Server(PC) uses both the Multi-1.aver Perceptron(MLP)-based texture classifier and Connected Component(CC)-based filtering for a definite text extraction based on the Client(PDA)'s tentativel99-y extracted results. The proposed method leads to not only efficient text extraction by using both the MLP and the CC, but also fast running time using Client(PDA)/server(PC) architecture with the pipelining processing.

OrdinalEncoder based DNN for Natural Gas Leak Prediction (천연가스 누출 예측을 위한 OrdinalEncoder 기반 DNN)

  • Khongorzul, Dashdondov;Lee, Sang-Mu;Kim, Mi-Hye
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.10
    • /
    • pp.7-13
    • /
    • 2019
  • The natural gas (NG), mostly methane leaks into the air, it is a big problem for the climate. detected NG leaks under U.S. city streets and collected data. In this paper, we introduced a Deep Neural Network (DNN) classification of prediction for a level of NS leak. The proposed method is OrdinalEncoder(OE) based K-means clustering and Multilayer Perceptron(MLP) for predicting NG leak. The 15 features are the input neurons and the using backpropagation. In this paper, we propose the OE method for labeling target data using k-means clustering and compared normalization methods performance for NG leak prediction. There five normalization methods used. We have shown that our proposed OE based MLP method is accuracy 97.7%, F1-score 96.4%, which is relatively higher than the other methods. The system has implemented SPSS and Python, including its performance, is tested on real open data.

gMLP-based Self-Supervised Learning Anomaly Detection using a Simple Synthetic Data Generation Method (단순한 합성데이터 생성 방식을 활용한 gMLP 기반 자기 지도 학습 이상탐지 기법)

  • Ju-Hyo, Hwang;Kyo-Hong, Jin
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.27 no.1
    • /
    • pp.8-14
    • /
    • 2023
  • The existing self-supervised learning-based CutPaste generated synthetic data by cutting and attaching specific patches from normal images and then performed anomaly detection. However, this method has a problem in that there is a clear difference in the boundary of the patch. NSA for solving these problems have achieved higher anomaly detection performance by generating natural synthetic data through Poisson Blending. However, NSA has the disadvantage of having many hyperparameters that need to be adjusted for each class. In this paper, synthetic data similar to normal were generated by a simple method of making the size of the synthetic patch very small. At this time, since the patches are so locally synthesized, models that learn local features can easily overfit synthetic data. Therefore, we performed anomaly detection using gMLP, which learns global features, and even with simple synthesis methods, we were able to achieve higher performance than conventional self-supervised learning techniques.