• Title/Summary/Keyword: K-평균.군집분석

Search Result 449, Processing Time 0.03 seconds

Hierarchical and Incremental Clustering for Semi Real-time Issue Analysis on News Articles (준 실시간 뉴스 이슈 분석을 위한 계층적·점증적 군집화)

  • Kim, Hoyong;Lee, SeungWoo;Jang, Hong-Jun;Seo, DongMin
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.6
    • /
    • pp.556-578
    • /
    • 2020
  • There are many different researches about how to analyze issues based on real-time news streams. But, there are few researches which analyze issues hierarchically from news articles and even a previous research of hierarchical issue analysis make clustering speed slower as the increment of news articles. In this paper, we propose a hierarchical and incremental clustering for semi real-time issue analysis on news articles. We trained siamese neural network based weighted cosine similarity model, applied this model to k-means algorithm which is used to make word clusters and converted news articles to document vectors by using these word clusters. Finally, we initialized an issue cluster tree from document vectors, updated this tree whenever news articles happen, and analyzed issues in semi real-time. Through the experiment and evaluation, we showed that up to about 0.26 performance has been improved in terms of NMI. Also, in terms of speed of incremental clustering, we also showed about 10 times faster than before.

Functional clustering for electricity demand data: A case study (시간단위 전력수요자료의 함수적 군집분석: 사례연구)

  • Yoon, Sanghoo;Choi, Youngjean
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.4
    • /
    • pp.885-894
    • /
    • 2015
  • It is necessary to forecast the electricity demand for reliable and effective operation of the power system. In this study, we try to categorize a functional data, the mean curve in accordance with the time of daily power demand pattern. The data were collected between January 1, 2009 and December 31, 2011. And it were converted to time series data consisting of seasonal components and error component through log transformation and removing trend. Functional clustering by Ma et al. (2006) are applied and parameters are estimated using EM algorithm and generalized cross validation. The number of clusters is determined by classifying holidays or weekdays. Monday, weekday (Tuesday to Friday), Saturday, Sunday or holiday and season are described the mean curve of daily power demand pattern.

Finding Meaningful Chronological Pattern of Key Words in Computer Science Bibliography (K-평균 군집화 기법을 활용한 DBLP 논문 서지정보의 연대별 출현 패턴 연구)

  • Heo, Joo-Seong;Im, Hyeon-Gyo;Kim, Gyeong-Han;Han, Youn-Hee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.10a
    • /
    • pp.542-545
    • /
    • 2016
  • 컴퓨터공학 분야의 논문 정보를 다루고 있는 대표적인 사이트인 DBLP의 연구 동향을 알아보기 위해 본 논문에서는 약 300만개 이상의 논문 서지정보 가져와 분석했다. IT용어 사전을 만들고 각 논문의 제목과 초록에 포함된 주제어를 추출해 분석을 위한 고차원의 행렬을 만들고, k-평균 군집화 기법을 활용하여 1960년도부터 2010년도까지 총 60여 년간의 연대별 주제어 출현 패턴을 분석함으로써 흥미로운 결과를 도출해 냈다.

Study on Scaling Exponent for Classification of Regions using Scaling Property (스케일 성질을 이용한 군집 지역에서의 스케일 인자에 대한 연구)

  • Jung, Younghun;Kim, Sunghun;Ahn, Hyunjun;Heo, Jun-Haeng
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2015.05a
    • /
    • pp.504-504
    • /
    • 2015
  • 수공구조물을 설계하기 위해서는 설계수문량을 빈도해석을 통해 산정할 수 있다. 빈도해석 중 지점빈도해석을 보완한 지역빈도해석을 적용하기 위해서는 군집분석을 통한 지역구분이 무엇보다 중요하다. 또한 스케일 성질(scaling property)은 강우의 시 공간적 특성을 지속기간별 관측된 강우자료를 이용하여 재현기간에 대한 지속기간의 함수로 강우의 IDF곡선을 제시할 수 있는 방법이다. 따라서 스케일 성질을 통해 군집된 지역에서의 강우자료에 적용하여 스케일 인자(scaling exponent)를 추정한 후 수문학적 동질성을 통계적 특성으로 설명하고자 한다. 본 연구를 수행하기에 앞서 군집 분석은 4개의 군집방법(평균연결법, Ward방법, Two-Step방법, K-means방법)을 적용하였고, 한강유역에 위치한 104개의 강우지점은 4개의 지역으로 구분하는 것이 적절하다고 판단되어 비계층적 방법인 k-means방법을 이용하여 지역을 구분하였다. 본 연구에서는 군집된 결과를 바탕으로 4개의 지역으로 구분된 지역에 포함된 강우지점을 대상으로 스케일 인자를 추정하고 수문학적 동질성을 통계적 방법으로 제시하고자 한다.

  • PDF

A Study on Obesity Index and Attributes of Selecting Places to Eat Out by Food-Related Lifestyle Types - Focusing on Pusan University Students - (식생활 라이프스타일에 따른 비만도와 외식선택속성에 관한 연구 - 부산지역 대학생을 중심으로 -)

  • Lee, Jong-Ho
    • Culinary science and hospitality research
    • /
    • v.18 no.4
    • /
    • pp.47-58
    • /
    • 2012
  • This study, targeting the students of "K" university in Busan City area, was performed to draw the groups by food-related lifestyle types and to identify the correlation between each group's attributes of selecting places to eat out and obesity index. The purpose of the study was achieved by means of the PASW Statistic 18.0(Predictive Analytics Software) which conducted frequency analysis, factor analysis, reliability analysis, t-test, ${\chi}^2$-test, non-hierarchical cluster analysis and ANOVA. It turned out that the male university students were 175.59 cm tall and weigh 69.53 kg on average. And the female university students showed their average height of 162.81 cm and weight of 53.42 kg. When examined by the body mass index(BMI), male students were composed of 1.7% of underweight, 64.6% of normal weight, 19.7% of overweight and 14.0% of obese. As for the female students, 22.9% were classified as underweight, 62.7% as normal weight, 8.5% as overweight and 5.9% as obese. The food-related lifestyle categories were divided into five factors; health seeking type, safety seeking type, mood seeking type, taste seeking type, and western food seeking type. The four attributes of selecting places to eat out included quality of food and service, price reasonableness, accessibility and atmosphere, and experience to have eaten. With regard to food-related lifestyle, the groups were named by cluster 1 [careless diet group], Cluster 2 [health oriented group], and cluster3 [careless healthcare group]. In terms of the correlation between the clusters by food-related lifestyle and their attributes of selecting places to eat out, Cluster 1 had a high mean value in experience to have eaten, Cluster 2 quality of food and service, Cluster 3 accessibility and atmosphere.

  • PDF

Daily Behavior Pattern Extraction using Time-Series Behavioral Data of Dairy Cows and k-Means Clustering (행동 시계열 데이터와 k-평균 군집화를 통한 젖소의 일일 행동패턴 검출)

  • Lee, Seonghun;Park, Gicheol;Park, Jaehwa
    • Journal of Software Assessment and Valuation
    • /
    • v.17 no.1
    • /
    • pp.83-92
    • /
    • 2021
  • There are continuous and tremendous attempts to apply various sensor systems and ICTs into the dairy science for data accumulation and improvement of dairy productivity. However, these only concerns the fields which directly affect to the dairy productivity such as the number of individuals and the milk production amount, while researches on the physiology aspects of dairy cows are not enough which are fundamentally involved in the dairy productivity. This paper proposes the basic approach for extraction of daily behavior pattern from hourly behavioral data of dairy cows to identify the health status and stress. Total four clusters were grouped by k-means clustering and the reasonability was proved by visualization of the data in each groups and the representatives of each groups. We hope that provided results should lead to the further researches on catching abnormalities and disease signs of dairy cows.

Genetic Diversity and Genetic Structure of Phellodendron amurense Populations in South Korea (황벽나무 자연집단의 유전다양성 및 유전구조 분석)

  • Lee, Jei-Wan;Hong, Kyung-Nak;Kang, Jin-Taek
    • Journal of Korean Society of Forest Science
    • /
    • v.103 no.1
    • /
    • pp.51-58
    • /
    • 2014
  • Genetic diversity and genetic structures were estimated in seven natural populations of Phellodendron amurense Rupr in South Korea using ISSR markers. The average of polymorphic loci per primer and the proportion of polymorphic loci per population were 4.5 and 78.8% respectively with total 27 polymorphic loci from 6 ISSR primers. The Shannon's diversity index(I) was 0.421 and the expected heterozygosity($H_e$) was 0.285, which was similar to the heterozygosity (hs =0.287) inferred by Bayesian method. In AMOVA, 7.6% of total genetic variation in the populations was resulted from the genetic difference among populations and the other 92.4% was resulted from the difference among individuals within populations. Genetic differentiation(${\theta}^{II}$) and inbreeding coefficient(f) for total population were estimated to be 0.066 and 0.479 by Bayesian method respectively. In Bayesian clustering analysis, seven populations were assigned into three groups. This result was similar to the results of genetic relationships by UPGMA and PCA. The first group included Hwachoen, Gapyeong, Bongpyeong and Yongpyeong population, and the second included two populations in Sancheong region. Muju population was discretely assigned into the third group in spite of the geographically short distance from the Sancheong region. There was no significant correlation between genetic relationship and geographic distribution among populations in Mantel's test. For conservation of the phellodendron trees, it would be effective to consider the findings resulted from this study with ecological traits and life histories of this species.

Cluster analysis for Seoul apartment price using symbolic data (서울 아파트 매매가 자료의 심볼릭 데이터를 이용한 군집분석)

  • Kim, Jaejik
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.6
    • /
    • pp.1239-1247
    • /
    • 2015
  • In this study, 64 administrative regions with high frequencies of apartment trade in Seoul, Korea are classified by the apartment sale price. To consider distributions of apartment price for each region as well as the mean of the price, the symbolic histogram-valued data approach is employed. Symbolic data include all types of data which have internal variation in themselves such as intervals, lists, histograms, distributions, and models, etc. As a result of the cluster analysis using symbolic histogram data, it is found that Gangnam, Seocho, and Songpa districts and regions near by those districts have relatively higher prices and larger dispersions. This result makes sense because those regions have good accessibility to downtown and educational environment.

A Study on the Application Modeling of SNS Big-data for a Micro-Targeting using K-Means Clustering (K-평균 군집을 이용한 마이크로타겟팅을 위한 SNS 빅데이터 활용 모델링에 관한 연구)

  • Song, Jeo;Lee, Sang Moon
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2015.01a
    • /
    • pp.321-324
    • /
    • 2015
  • 본 논문에서는 SNS에 존재하는 특정 제품과 브랜드 또는 기업에 대한 평가, 의견, 느낌, 사용 후기 등의 소비자 생각을 수집하여 기업에서 향후 신제품 개발이나 시장 진출 및 확대 등의 경영활동에 활용할 수 있도록 SNS 빅데이터를 문석하고, 이를 활용하여 보다 소집단화 되고 개인화 되어가는 Micro-Trend 중심의 마케팅 활동을 할 수 있는 Micro-Targeting 관련 분석 정보를 제공 모델링하는 것을 제안한다. 본 연구에서는 SNS 데이터의 수집, 저장, 분석에 대한 내용을 다루고 있으며, 특히 마이크로타겟팅을 위한 정보를 머하웃(Mahout)의 유클리드 거리 기반의 유사도와 K-평균 군집 알고리즘을 활용하여 구현하고자 하였다.

  • PDF

Analysis of Bus Accident Severity Using K-Means Clustering Model and Ordered Logit Model (K-평균 군집모형 및 순서형 로짓모형을 이용한 버스 사고 심각도 유형 분석 측면부 사고를 중심으로)

  • Lee, Insik;Lee, Hyunmi;Jang, Jeong Ah;Yi, Yongju
    • Journal of Auto-vehicle Safety Association
    • /
    • v.13 no.3
    • /
    • pp.69-77
    • /
    • 2021
  • Although accident data from the National Police Agency and insurance companies do not know the vehicle safety, the damage level information can be obtained from the data managed by the bus credit association or the bus company itself. So the accident severity was analyzed based on the side impact accidents using accident repair cost. K-means clustering analysis separated the cost of accident repair into 'minor', 'moderate', 'severe', and 'very severe'. In addition, the side impact accident severity was analyzed by using an ordered logit model. As a result, it is appeared that the longer the repair period, the greater the impact on the severity of the side impact accident. Also, it is appeared that the higher the number of collision points, the greater the impact on the severity of the side impact accident. In addition, oblique collisions of the angle of impact were derived to affect the severity of the accident less than right angle collisions. Finally, the absence of opponent vehicle and large commercial vehicles involved accidents were shown to have less impact on the side impact accident severity than passenger cars.