• Title/Summary/Keyword: Multilayer Perceptrons

Search Result 65, Processing Time 0.024 seconds

Achieving Faster User Enrollment for Neural Speaker Verification Systems

  • Lee, Tae-Seung;Park, Sung-Won;Lim, Sang-Seok;Hwang, Byong-Won
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2003.09a
    • /
    • pp.205-208
    • /
    • 2003
  • While multilayer perceptrons (MLPs) have great possibility on the application to speaker verification, they suffer from inferior learning speed. to appeal to users, the speaker verification systems based on MLPs must achieve a reasonable enrolling speed and it is thoroughly dependent on the fast learning of MLPs. To attain real-time enrollment on the systems, the previous two studies have been devoted to the problem and each satisfied the objective. In this paper the two studies are combined md applied to the systems, on the assumption that each method operates on different optimization principle. By conducting experiments using an MLP-based speaker verification system to which the combination is applied on real speech database, the feasibility of the combination is verified from the results of the experiments.

  • PDF

APPLICATION OF NEURAL NETWORK FOR THE CLOUD DETECTION FROM GEOSTATIONARY SATELLITE DATA

  • Ahn, Hyun-Jeong;Ahn, Myung-Hwan;Chung, Chu-Yong
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.34-37
    • /
    • 2005
  • An efficient and robust neural network-based scheme is introduced in this paper to perform automatic cloud detection. Unlike many existing cloud detection schemes which use thresholding and statistical methods, we used the artificial neural network methods, the multi-layer perceptrons (MLP) with back-propagation algorithm and radial basis function (RBF) networks for cloud detection from Geostationary satellite images. We have used a simple scene (a mixed scene containing only cloud and clear sky). The main results show that the neural networks are able to handle complex atmospheric and meteorological phenomena. The experimental results show that two methods performed well, obtaining a classification accuracy reaching over 90 percent. Moreover, the RBF model is the most effective method for the cloud classification.

  • PDF

Comparison of Different Schemes for Speed Sensorless Control of Induction Motor Drives by Neural Network (유도전동기의 속도 센서리스 제어를 위한 신경회로망 알고리즘의 추정 특성 비교)

  • 이경훈;국윤상;김윤호;최원범
    • Proceedings of the KIPE Conference
    • /
    • 1999.07a
    • /
    • pp.526-530
    • /
    • 1999
  • This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

  • PDF

Trends in Neuromorphic Photonics Technology (뉴로모픽 포토닉스 기술 동향)

  • Kwon, Y.H.;Kim, K.S.;Baek, Y.S.
    • Electronics and Telecommunications Trends
    • /
    • v.35 no.4
    • /
    • pp.34-41
    • /
    • 2020
  • The existing Von Neumann architecture places limits to data processing in AI, a booming technology. To address this issue, research is being conducted on computing architectures and artificial neural networks that simulate neurons and synapses, which are the hardware of the human brain. With high-speed, high-throughput data communication infrastructures, photonic solutions today are a mature industrial reality. In particular, due to the recent outstanding achievements of artificial neural networks, there is considerable interest in improving their speed and energy efficiency by exploiting photonic-based neuromorphic hardware instead of electronic-based hardware. This paper covers recent photonic neuromorphic studies and a classification of existing solutions (categorized into multilayer perceptrons, convolutional neural networks, spiking neural networks, and reservoir computing).

New Two Phases Training Algorithm for Multilayer Perceptrons (다층 퍼셉트론의 새로운 두 단계 학습 알고리즘)

  • Choi Hyoungjoon;Lee Jaewook
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2003.05a
    • /
    • pp.849-856
    • /
    • 2003
  • 본 논문에서는 다층 퍼셉트론의 학습을 위한 새로운 두 단계 학습방법을 제안하였다. 첫 번째 단계는 국소최적해로 빨리 수렴하기 위해 Levenberg-Marquardt 알고리즘을 이용한 국소 탐색 단계이다. 두 번째 단계는 첫 번째 단계에서 찾은 국소최적해가 원하는 수준에 미치지 못할 경우 새로운 국소최적해로 벗어나기 위한 선형탐색을 기반의 터널링 단계이다. 이 방법은 연결가중치 공간에서 전역최적해를 빠르게 찾을 수 잇는 새로운 방법을 제공한다. 4가지 벤치마크 문제에 기존의 다층 퍼셉트론의 학습 알고리즘과 비교 실험을 통해, 제안된 알고리즘이 빠른 수렴 속도와 낮은 오차값을 가짐을 알 수 있었다.

  • PDF

Intelligent Modeling of Nuclear Power Plant Steam Generator (원자력발전소 증기발생기의 인공지능 모델링에 관한 연구)

  • Choi, Jin-Young;Lee, Jae-Gi
    • Proceedings of the KIEE Conference
    • /
    • 1997.11a
    • /
    • pp.675-678
    • /
    • 1997
  • In this research we continue the study of nuclear power plant steam generator's intelligent modeling. This model represents the input-output behavior and is a preliminary stage for intelligent control. Among many intelligent models available, we study neural network models that have been proven as universal function approximators. We select multilayer perceptrons, circular backpropagation networks, piecewise linearly trained networks and recurrent neural networks as the candidates for the steam generator's intelligent models. We take the input-output pairs from steam generator's reference model and train the neural network models. We validate trained neural network models as intelligent models of steam generator.

  • PDF

Neural Network Based Recognition of Machine Printed Hangul Characters of Low Quality

  • Lim, Kil-Taek;Kim, Ho-Yon;Nam, Yun-Seok;Kim, Hye-Kyu
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1772-1775
    • /
    • 2002
  • In this paper, we propose a Hangul character recognition method in which new letter components as recognition units are introduced and the MLP (multilayer perceptrons) neural networks are employed for two-step recognition of Hangul. To recognize Hangul character, we divide it into two or three recognition units and extract the direction angle features of them to be fed to the corresponding neural network recognizers. The recognition results of neural network recognizers are combined by another neural network. The experiments were conducted on the Hangul characters from real letter envelopes which are collected in the mail centers in Korea and the results showed that our method performs better than the conventional one.

  • PDF

An Adaptive Neural Network Control Method for Robot Manipulators

  • Lee, Min-Jung;Choi, Young-Kiu
    • Proceedings of the KIEE Conference
    • /
    • 2001.07d
    • /
    • pp.2341-2344
    • /
    • 2001
  • In recent years the neural network known as a sort of the intelligent control strategy is used as a powerful tool for designing control system since it has learning ability. But it is difficult for neural network controllers to guarantee the stability of control systems. In this paper we try connecting a radial basis function network to an adaptive control strategy. Radial basis function networks are simpler and easier to handle than multilayer perceptrons. We use the radial basis function network to generate control input signals that are similar to the control inputs of adaptive control using linear reparameterization of the robot manipulator. We adopt the saturation function as an auxiliary controller. This paper also proves mathematically the stability of the control system under the existence of disturbances and modeling errors.

  • PDF

Improved Error Backpropagation by Elastic Learning Rate and Online Update (가변학습율과 온라인모드를 이용한 개선된 EBP 알고리즘)

  • Lee, Tae-Seung;Park, Ho-Jin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.568-570
    • /
    • 2004
  • The error-backpropagation (EBP) algerithm for training multilayer perceptrons (MLPs) is known to have good features of robustness and economical efficiency. However, the algorithm has difficulty in selecting an optimal constant learning rate and thus results in non-optimal learning speed and inflexible operation for working data. This paper Introduces an elastic learning rate that guarantees convergence of learning and its local realization by online upoate of MLP parameters Into the original EBP algorithm in order to complement the non-optimality. The results of experiments on a speaker verification system with Korean speech database are presented and discussed to demonstrate the performance improvement of the proposed method in terms of learning speed and flexibility fer working data of the original EBP algorithm.

  • PDF

High Performance MLP-based Speaker Verification System (MLP에 기반한 고성능 화자증명 시스템)

  • Lee, Tae-Seung;Park, Ho-Jin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.571-573
    • /
    • 2004
  • Speaker verification systems based on multilayer perceptrons (MLPs) have good prospects in reliability and flexibility required as a successful authentication system. However, the poor learning speed of the error backpropagation (EBP) which is representative learning method of MLPs is the major defect to be complemented to achieve real-time user enrollments. In this paper, we implement an MLP-based speaker verification system and apply the existing two methods of the omitting patterns in instant learning (OIL) and the discriminative cohort speakers (DCS) to approach real-time enrollment. An evaluation of the system on a Korean speech database demonstrates the feasibility of the system as a speaker verification system of high performance.

  • PDF