• Title/Summary/Keyword: Learning Vector Quantization (LVQ)

Search Result 52, Processing Time 0.023 seconds

Novelty Detection Methods for Response Modeling (반응 모델링을 위한 이상탐지 기법)

  • Lee Hyeong-Ju;Jo Seong-Jun
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2006.05a
    • /
    • pp.1825-1831
    • /
    • 2006
  • 본 논문에서는 반응 모델링에서의 집단 불균형을 해소하기 위한 이상탐지 기법의 활용을 제안한다. DMEF4 데이터셋의 카탈로그 발송 작업에 대하여 두 가지의 이상탐지 기법, one-class support vector machine (1-SVM)과 learning vector quantization for novelty detection (LVQ-ND)을 적용하여 이진분류기법들과 비교한다. 반응률이 낮은 경우에는 이상 탐지 기법들이 더 높은 정확도를 보인 반면, 반응률이 상대적으로 높은 경우에는 오분류 비용을 조정한 SVM 기법이 가장 좋은 성능을 보였다. 또한, 이상탐지 기법들은 발송비용이 낮은 경우에 높은 이익을 달성하였고, 발송비용이 높은 경우에는 SVM 모델이 가장 높은 이익을 달성하였다.

  • PDF

Vehicle Recognition using NMF in Urban Scene (도심 영상에서의 비음수행렬분해를 이용한 차량 인식)

  • Ban, Jae-Min;Lee, Byeong-Rae;Kang, Hyun-Chul
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.7C
    • /
    • pp.554-564
    • /
    • 2012
  • The vehicle recognition consists of two steps; the vehicle region detection step and the vehicle identification step based on the feature extracted from the detected region. Features using linear transformations have the effect of dimension reduction as well as represent statistical characteristics, and show the robustness in translation and rotation of objects. Among the linear transformations, the NMF(Non-negative Matrix Factorization) is one of part-based representation. Therefore, we can extract NMF features with sparsity and improve the vehicle recognition rate by the representation of local features of a car as a basis vector. In this paper, we propose a feature extraction using NMF suitable for the vehicle recognition, and verify the recognition rate with it. Also, we compared the vehicle recognition rate for the occluded area using the SNMF(sparse NMF) which has basis vectors with constraint and LVQ2 neural network. We showed that the feature through the proposed NMF is robust in the urban scene where occlusions are frequently occur.

IAFC(Integrated Adaptive Fuzzy Clustering)Model Using Supervised Learning Rule for Pattern Recognition (패턴 인식을 위한 감독학습을 사용한 IAFC( Integrated Adaptive Fuzzy Clustering)모델)

  • 김용수;김남진;이재연;지수영;조영조;이세열
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2004.10a
    • /
    • pp.153-157
    • /
    • 2004
  • 본 논문은 패턴인식을 위해 사용할 수 있는 감독학습을 이용한 supervised IAFC neural network 1과 supervised IAFC neural network 2를 제안하였다 Supervised IAFC neural network 1과 supervised IAFC neural network 2는 LVQ(Learning Vector Quantization)를 퍼지화한 새로운 퍼지 학습법칙을 사용하고 있다. 이 새로운 퍼지 학습 법칙은 기존의 학습률 대신에 퍼지화된 학습률을 사용하고 있는데, 이 퍼지화된 학습률은 조건 확률을 퍼지화 한 것에 근간을 두고 있다. Supervised IAFC neural network 1과 supervised IAFC neural network 2의 성능과 오류역전파 신경회로망의 성능을 비교하기 위하여 iris 데이터를 사용하였는데, 실험결과 supervised IAFC neural network 2 의 성능이 오류역전파 신경회로망의 성능보다 우수함이 입증되었다.

  • PDF

A Study on the Two-Phased Hybrid Neural Network Approach to an Effective Decision-Making (효과적인 의사결정을 위한 2단계 하이브리드 인공신경망 접근방법에 관한 연구)

  • Lee, Geon-Chang
    • Asia pacific journal of information systems
    • /
    • v.5 no.1
    • /
    • pp.36-51
    • /
    • 1995
  • 본 논문에서는 비구조적인 의사결정문제를 효과적으로 해결하기 위하여 감독학습 인공신경망 모형과 비감독학습 인공신경망 모형을 결합한 하이브리드 인공신경망 모형인 HYNEN(HYbrid NEural Network) 모형을 제안한다. HYNEN모형은 주어진 자료를 클러스터화 하는 CNN(Clustering Neural Network)과 최종적인 출력을 제공하는 ONN(Output Neural Network)의 2단계로 구성되어 있다. 먼저 CNN에서는 주어진 자료로부터 적정한 퍼지규칙을 찾기 위하여 클러스터를 구성한다. 그리고 이러한 클러스터를 지식베이스로하여 ONN에서 최종적인 의사결정을 한다. CNN에서는 SOFM(Self Organizing Feature Map)과 LVQ(Learning Vector Quantization)를 클러스터를 만든 후 역전파학습 인공신경망 모형으로 이를 학습한다. ONN에서는 역전파학습 인공신경망 모형을 이용하여 각 클러스터의 내용을 학습한다. 제안된 HYNEN 모형을 우리나라 기업의 도산자료에 적용하여 그 결과를 다변량 판별분석법(MDA:Multivariate Discriminant Analysis)과 ACLS(Analog Concept Learning System) 퍼지 ARTMAP 그리고 기존의 역전파학습 인공신경망에 의한 실험결과와 비교하였다.

  • PDF

Classification System using Vibration Signal for Diagnosing Rotating Machinery (회전기계의 이상진단을 위한 진동신호 분류시스템에 관한 연구)

  • Lim, Dong-Soo;An, Jin-Long;Yang, Bo-Suk
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2000.06a
    • /
    • pp.1133-1138
    • /
    • 2000
  • This paper describes a signal recognition method for diagnosing the rotating machinery using wavelet-aided Self-Organizing Feature Map(SOFM). The SOFM specialized from neural network is a new and effective algorithm for interpreting large and complex data sets. It converts high-dimensional data items into simple order relationships with low dimension. Additionally the Learning Vector Quantization(LVQ) is used for reducing the error from SOFM. Multi-resolution and wavelet transform are used to extract salient features from the primary vibration signals. Since it decomposes the raw timebase signal into two respective parts in the time space and frequency domain, it does not lose either information unlike Fourier transform. This paper is focused on the development of advanced signal classifier in order to automatize vibration signal pattern recognition. This method is verified by the experiment and several abnormal vibrations such as unbalance and rubbing are classified with high flexibility and reliability by the proposed methods.

  • PDF

Combination of Classifiers Decisions for Multilingual Speaker Identification

  • Nagaraja, B.G.;Jayanna, H.S.
    • Journal of Information Processing Systems
    • /
    • v.13 no.4
    • /
    • pp.928-940
    • /
    • 2017
  • State-of-the-art speaker recognition systems may work better for the English language. However, if the same system is used for recognizing those who speak different languages, the systems may yield a poor performance. In this work, the decisions of a Gaussian mixture model-universal background model (GMM-UBM) and a learning vector quantization (LVQ) are combined to improve the recognition performance of a multilingual speaker identification system. The difference between these classifiers is in their modeling techniques. The former one is based on probabilistic approach and the latter one is based on the fine-tuning of neurons. Since the approaches are different, each modeling technique identifies different sets of speakers for the same database set. Therefore, the decisions of the classifiers may be used to improve the performance. In this study, multitaper mel-frequency cepstral coefficients (MFCCs) are used as the features and the monolingual and cross-lingual speaker identification studies are conducted using NIST-2003 and our own database. The experimental results show that the combined system improves the performance by nearly 10% compared with that of the individual classifier.

KOREAN CONSONANT RECOGNITION USING A MODIFIED LVQ2 METHOD

  • Makino, Shozo;Okimoto, Yoshiyuki;Kido, Ken'iti;Kim, Hoi-Rin;Lee, Yong-Ju
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1994.06a
    • /
    • pp.1033-1038
    • /
    • 1994
  • This paper describes recognition results using the modified Learning Vector Quantization (MLVQ2) method which we proposed previously. At first, we investigated the property of duration of 29 Korean consonants and found that the variances of th duration were extremely big comparing to other languages. We carried out preliminary recognition experiments for three stop consonants P, T and K. From the recognition results, we defined the optimum conditions for the learning. Then we applied the MLVQ2 method to the recognition of Korean consonants. The training was carried out using the phoneme samples in the 611 word vocabulary uttered by 2 male speakers, where each of the speakers uttered two repetitions. The recognition experiment was carried out for the phoneme samples in two repetitions of the 611 word vocabulary uttered by another male speaker. The recognition scores for the twelve plosives were 68.2% for the test samples. The recofnition scores for the 29 Korean consonants were 64.8% for the test samples.

  • PDF

A New Supervised Competitive Learning Algorithm and Its Application to Power System Transient Stability Analysis (새로운 지도 경쟁 학습 알고리즘의 개발과 전력계통 과도안정도 해석에의 적용)

  • Park, Young-Moon;Cho, Hong-Shik;Kim, Gwang-Won
    • Proceedings of the KIEE Conference
    • /
    • 1995.07b
    • /
    • pp.591-593
    • /
    • 1995
  • Artificial neural network based pattern recognition method is one of the most probable candidate for on-line power system transient stability analysis. Especially, Kohonen layer is an adequate neural network for the purpose. Each node of Kehonen layer competes on the basis of which of them has its clustering center closest to an input vector. This paper discusses Kohonen's LVQ(Learning Victor Quantization) and points out a defection of the algorithm when applied to the transient stability analysis. Only the clustering centers located near the decision boundary of the stability region is needed for the stability criterion and the centers far from the decision boundary are redundant. This paper presents a new algorithm ratted boundary searching algorithm II which assigns only the points that are near the boundary in an input space to nodes or Kohonen layer as their clustering centers. This algorithm is demonstrated with satisfaction using 4-generator 6-bus sample power system.

  • PDF

A Study on Optimal Output Neuron Allocation of LVQ Neural Network using Variance Estimation (분산추정에 의한 LVQ 신경회로망의 최적 출력뉴런 분할에 관한 연구)

  • 정준원;조성원
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1996.10a
    • /
    • pp.239-242
    • /
    • 1996
  • 본 논문에서는 BP(Back Propagation)에 비해서 빠른 학습시간과 다른 경쟁학습 신경회로망 알고리즘에 비해서 비교적 우수한 성능으로 패턴인식 등에 많이 이용되고 있는 LVQ(Learning Vector Quantization) 알고리즘의 성능을 향상시키기 위한 방법을 논의하고자 한다. 일반적으로 LVQ는 음(negative)의 학습을 하기 때문에 초기 가중치가 제대로 설정되지 않으면 발산할 수 있다는 단점이 있으며, 경쟁학습 계열의 신경망이기 때문에 출력 층의 뉴런 수에 따라 성능에 큰 영향을 받는다고 알려져 있다.[1]. 지도학습 형태를 지닌 LVQ의 경우에 학습패턴이 n개의 클래스를 가지고, 각 클래스 별로 학습패턴의 수가 같은 경우에 일반적으로 전체 출력뉴런에 대해서 (출력뉴런수/n)개의 뉴런을 각 클래스의 목표(desired) 클러스터로 할당하여 학습을 수행하는데, 본 논문에서는 각 클래스에 동일한 수의 출력뉴런을 할당하지 않고, 학습데이터에서 각 클래스의 분산을 추정하여 각 클래스의 분산을 추정분산에 비례하게 목표 출력뉴런을 할당하고, 초기 가중치도 추정분산에 비례하게 각 클래스의 초기 임의 위치 입력백터를 사용하여 학습을 수행하는 방법을 제안한다. 본 논문에서 제안하는 방법은 분류하고자 하는 데이터에 대해서 필요한 최적의 출력뉴런 수를 찾는 것이 아니라 이미 결정되어 있는 출력뉴런 수에 대해서 각 클래스에 할당할 출력 뉴런 수를 데이터의 추정분산에 의해서 결정하는 것으로, 추정분산이 크면 상대적으로 많은 출력 뉴런을 할당하고 작으면 상대적으로 적은 출력뉴런을 할당하고 초기 가중치도 마찬가지 방법으로 결정하며, 이렇게 하면 정해진 출력뉴런 개수 안에서 각 클래스 별로 분류의 어려움에 따라서 출력뉴런을 할당하기 때문에 미학습 뉴런이 줄어들게 되어 성능의 향상을 기대할 수 있으며, 실험적으로 제안된 방법이 더 나은 성능을 보임을 확인했다.initially they expected a more practical program about planting than programs that teach community design. Many people are active in their own towns to create better environments and communities. The network system "Alpha Green-Net" is functional to support graduates of the course. In the future these educational programs for citizens will becomes very important. Other cities are starting to have their own progrms, but they are still very short term. "Alpha Green-Net" is in the process of growing. Many members are very keen to develop their own abilities. In the future these NPOs should become independent. To help these NPOs become independent and active the educational programs should consider and teach about how to do this more in the future.단하였는데 그 결과, 좌측 촉각엽에서 제4형의 신경연접이 퇴행성 변화를 나타내었다. 그러므로 촉각의 지각신경세포는 뇌의 같은 족 촉각엽에 뻗어와 제4형 신경연접을 형성한다고 결론되었다.$/ 값이 210 $\mu\textrm{g}$/$m\ell$로서 효과적인 저해 활성을 나타내었다 따라서, 본 연구에서 빈

  • PDF

Condition Classification for Small Reciprocating Compressors Using Wavelet Transform and Artificial Neural Network (웨이브릿 변환과 인공신경망 기법을 이용한 소형 왕복동 압축기의 상태 분류)

  • Lim, D.S.;Yang, B.S.;An, B.H.;Tan, A.;Kim, D.J.
    • Journal of Power System Engineering
    • /
    • v.7 no.2
    • /
    • pp.29-35
    • /
    • 2003
  • The monitoring and diagnostics of the rotating machinery have been received considerable attention for many years. The objectives are to classify the machinery condition and to find out the cause of abnormal condition. This paper describes a classification method of diagnosing the small reciprocating compressor for refrigerators using the artificial neural network and the wavelet transform. In order to extract salient features, the wavelet transform are used from primary noise signals. Since the wavelet transform decomposes raw time-waveform signals into two respective parts in the time space and frequency domain, more and better features can be obtained easier than time-waveform analysis. In the training phase for classification, self-organizing feature map(SOFM) and learning vector quantization(LVQ) are applied, and the accuracies of them ate compared with each other. This paper is focused on the development of an advanced signal classifier to automatize the vibration signal pattern recognition. This method is verified by small reciprocating compressors, for refrigerator and normal and abnormal conditions are classified with high flexibility and reliability.

  • PDF