• Title/Summary/Keyword: unsupervised model

Search Result 239, Processing Time 0.044 seconds

Hierarchical Ann Classification Model Combined with the Adaptive Searching Strategy (적응적 탐색 전략을 갖춘 계층적 ART2 분류 모델)

  • 김도현;차의영
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.7_8
    • /
    • pp.649-658
    • /
    • 2003
  • We propose a hierarchical architecture of ART2 Network for performance improvement and fast pattern classification model using fitness selection. This hierarchical network creates coarse clusters as first ART2 network layer by unsupervised learning, then creates fine clusters of the each first layer as second network layer by supervised learning. First, it compares input pattern with each clusters of first layer and select candidate clusters by fitness measure. We design a optimized fitness function for pruning clusters by measuring relative distance ratio between a input pattern and clusters. This makes it possible to improve speed and accuracy. Next, it compares input pattern with each clusters connected with selected clusters and finds winner cluster. Finally it classifies the pattern by a label of the winner cluster. Results of our experiments show that the proposed method is more accurate and fast than other approaches.

Development of Artificial Diagnosis Algorithm for Dissolved Gas Analysis of Power Transformer (전력용 변압기의 유중가스 해석을 위한 지능형 진단 알고리즘 개발)

  • Lim, Jae-Yoon;Lee, Dae-Jong;Lee, Jong-Pil;Ji, Pyeong-Shik
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.21 no.7
    • /
    • pp.75-83
    • /
    • 2007
  • IEC code based decision nile have been widely applied to detect incipient faults in power transformers. However, this method has a drawback to achieve the diagnosis with accuracy without experienced experts. In order to resolve this problem, we propose an artificial diagnosis algorithm to detect faults of power transformers using Self-Organizing Feature Map(SOM). The proposed method has two stages such as model construction and diagnostic procedure. First, faulty model is constructed by feature maps obtained by unsupervised learning for training data. And then, diagnosis is performed by compare feature map with it obtained for test data. Also the proposed method usぉms the possibility and degree of aging as well as the fault occurred in transformer by clustering and distance measure schemes. To demonstrate the validity of proposed method, various experiments are unformed and their results are presented.

Detection of Ship Movement Anomaly using AIS Data: A Study (AIS 데이터 분석을 통한 이상 거동 선박의 식별에 관한 연구)

  • Oh, Jae-Yong;Kim, Hye-Jin;Park, Se-Kil
    • Journal of Navigation and Port Research
    • /
    • v.42 no.4
    • /
    • pp.277-282
    • /
    • 2018
  • Recently, the Vessel Traffic Service (VTS) coverage has expanded to include coastal areas following the increased attention on vessel traffic safety. However, it has increased the workload on the VTS operators. In some cases, when the traffic volume increases sharply during the rush hour, the VTS operator may not be aware of the risks. Therefore, in this paper, we proposed a new method to recognize ship movement anomalies automatically to support the VTS operator's decision-making. The proposed method generated traffic pattern model without any category information using the unsupervised learning algorithm.. The anomaly score can be calculated by classification and comparison of the trained model. Finally, we reviewed the experimental results using a ship-handling simulator and the actual trajectory data to verify the feasibility of the proposed method.

Anomaly Data Detection Using Machine Learning in Crowdsensing System (크라우드센싱 시스템에서 머신러닝을 이용한 이상데이터 탐지)

  • Kim, Mihui;Lee, Gihun
    • Journal of IKEEE
    • /
    • v.24 no.2
    • /
    • pp.475-485
    • /
    • 2020
  • Recently, a crowdsensing system that provides a new sensing service with real-time sensing data provided from a user's device including a sensor without installing a separate sensor has attracted attention. In the crowdsensing system, meaningless data may be provided due to a user's operation error or communication problem, or false data may be provided to obtain compensation. Therefore, the detection and removal of the abnormal data determines the quality of the crowdsensing service. The proposed methods in the past to detect these anomalies are not efficient for the fast-changing environment of crowdsensing. This paper proposes an anomaly data detection method by extracting the characteristics of continuously and rapidly changing sensing data environment by using machine learning technology and modeling it with an appropriate algorithm. We show the performance and feasibility of the proposed system using deep learning binary classification model of supervised learning and autoencoder model of unsupervised learning.

An Empirical Comparison Study on Attack Detection Mechanisms Using Data Mining (데이터 마이닝을 이용한 공격 탐지 메커니즘의 실험적 비교 연구)

  • Kim, Mi-Hui;Oh, Ha-Young;Chae, Ki-Joon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.2C
    • /
    • pp.208-218
    • /
    • 2006
  • In this paper, we introduce the creation methods of attack detection model using data mining technologies that can classify the latest attack types, and can detect the modification of existing attacks as well as the novel attacks. Also, we evaluate comparatively these attack detection models in the view of detection accuracy and detection time. As the important factors for creating detection models, there are data, attribute, and detection algorithm. Thus, we used NetFlow data gathered at the real network, and KDD Cup 1999 data for the experiment in large quantities. And for attribute selection, we used a heuristic method and a theoretical method using decision tree algorithm. We evaluate comparatively detection models using a single supervised/unsupervised data mining approach and a combined supervised data mining approach. As a result, although a combined supervised data mining approach required more modeling time, it had better detection rate. All models using data mining techniques could detect the attacks within 1 second, thus these approaches could prove the real-time detection. Also, our experimental results for anomaly detection showed that our approaches provided the detection possibility for novel attack, and especially SOM model provided the additional information about existing attack that is similar to novel attack.

The Trend Analysis of Vegetation Change Applied to Unsupervised Classification Over East Asia: Using the NDVI 10-day data in 1999~2010 (무감독분류 기법을 이용한 동아시아지역의 식생변화 경향분석: 1999~2010 NDVI 10-day 자료를 바탕으로)

  • Kim, Sang-Il;Han, Kyung-Soo;Pi, Kyoung-Jin
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.19 no.4
    • /
    • pp.153-159
    • /
    • 2011
  • Vegetative land cover is an important variable many Earth system process, general circulation and carbon exchange model requires vegetative cover as boundary layer necessary to run model. The purpose of this study is to detect and to understand land surface change. To monitor changes of East Asia vegetation, we used NDVI 10-day MVC data derived from SPOT VEGETATION during 12 years from 1999 to 2010. Finally, according to the land cover of classified class, we performed analysis for dynamic zone(positive change zone and negative change zone), static zone in 1999, 2010. Therefore, land covers corresponding to each class have appeared change by 2010. Land cover change was confirmed by analyzing data during 12 years which appeared vegetation change of surrounding the actual desert area to east.

Forecasting of Runoff Hydrograph Using Neural Network Algorithms (신경망 알고리즘을 적용한 유출수문곡선의 예측)

  • An, Sang-Jin;Jeon, Gye-Won;Kim, Gwang-Il
    • Journal of Korea Water Resources Association
    • /
    • v.33 no.4
    • /
    • pp.505-515
    • /
    • 2000
  • THe purpose of this study is to forecast of runoff hydrographs according to rainfall event in a stream. The neural network theory as a hydrologic blackbox model is used to solve hydrological problems. The Back-Propagation(BP) algorithm by the Levenberg-Marquardt(LM) techniques and Radial Basis Function(RBF) network in Neural Network(NN) models are used. Runoff hydrograph is forecasted in Bocheongstream basin which is a IHP the representative basin. The possibility of a simulation for runoff hydrographs about unlearned stations is considered. The results show that NN models are performed to effective learning for rainfall-runoff process of hydrologic system which involves a complexity and nonliner relationships. The RBF networks consist of 2 learning steps. The first step is an unsupervised learning in hidden layer and the next step is a supervised learning in output layer. Therefore, the RBF networks could provide rather time saved in the learning step than the BP algorithm. The peak discharge both BP algorithm and RBF network model in the estimation of an unlearned are a is trended to observed values.

  • PDF

Classification of Seoul Metro Stations Based on Boarding/ Alighting Patterns Using Machine Learning Clustering (기계학습 클러스터링을 이용한 승하차 패턴에 따른 서울시 지하철역 분류)

  • Min, Meekyung
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.18 no.4
    • /
    • pp.13-18
    • /
    • 2018
  • In this study, we classify Seoul metro stations according to boarding and alighting patterns using machine earning technique. The target data is the number of boarding and alighting passengers per hour every day at 233 subway stations from 2008 to 2017 provided by the public data portal. Gaussian mixture model (GMM) and K-means clustering are used as machine learning techniques in order to classify subway stations. The distribution of the boarding time and the alighting time of the passengers can be modeled by the Gaussian mixture model. K-means clustering algorithm is used for unsupervised learning based on the data obtained by GMM modeling. As a result of the research, Seoul metro stations are classified into four groups according to boarding and alighting patterns. The results of this study can be utilized as a basic knowledge for analyzing the characteristics of Seoul subway stations and analyzing it economically, socially and culturally. The method of this research can be applied to public data and big data in areas requiring clustering.

A Study on the Space Usage by the New Hanok Plan Composition - Focused on the New Hanok in Jeollanam-do Province - (신한옥의 평면구성에 따른 공간활용상태에 관한 연구 - 전라남도 신한옥을 중심으로 -)

  • Park, Jin-A;Kim, Soo-Am
    • Journal of the Korean housing association
    • /
    • v.23 no.4
    • /
    • pp.59-67
    • /
    • 2012
  • Developing the modern design of Hanok and providing support for the commercialization model development in recent years propelled by the New Hanok Support Strategies of the central government in conjunction with the New Hanok revitalization related projects reflecting local goverments. New Hanok revitalization, the rekindling and revaluing of human behaviors and interests in local goverments following the social and cultural changes of the past decades, has emeraged as an increasingly traditional area of concerning in New Hanok planning. In this paper we attempt to this discussion by describing recent projects in New Hanok revitalization in Jeollanam-do Province. Therefore, this study aims to examine the classification of compound knowledges based multidimensional relationship by using Self-Organizing Maps (SOM). SOM is an unsupervised learning neural network model for the analysis of high-dimensional input data. By using SOM, we were able to create a cluster map reflecting the characteristics of the New Hanok. In this case the pattern of the preference data was easily understood by visual analysis. Liking for compound knowledge deduced from this data was classified into 8 categories according to the compound knowledge properties of New Hanok. As a result, a systematic approach for analysis the characteristics of individual family and living environment of New Hanoks and 10 space usage patterns the changes in some aspects of New Hanok.

3D Human Shape Deformation using Deep Learning (딥러닝을 이용한 3차원 사람모델형상 변형)

  • Kim, DaeHee;Hwang, Bon-Woo;Lee, SeungWook;Kwak, Sooyeong
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.25 no.2
    • /
    • pp.19-27
    • /
    • 2020
  • Recently, rapid and accurate 3D models creation is required in various applications using virtual reality and augmented reality technology. In this paper, we propose an on-site learning based shape deformation method which transforms the clothed 3D human model into the shape of an input point cloud. The proposed algorithm consists of two main parts: one is pre-learning and the other is on-site learning. Each learning consists of encoder, template transformation and decoder network. The proposed network is learned by unsupervised method, which uses the Chamfer distance between the input point cloud form and the template vertices as the loss function. By performing on-site learning on the input point clouds during the inference process, the high accuracy of the inference results can be obtained and presented through experiments.