• Proceedings of the Korean Society for Information Management Conference
• /
• 1999.08a
• /
• pp.25-28
• /
• 1999

자동분류나 정보검색에 주로 이용되는 문헌 클러스터링에서는 문헌간의 유사성을 측정하기 위해 다양한 유사계수를 이용하는데, 모든 유사계수가 동일한 클러스터링 결과를 가져오는 것은 아니다. 본고에서는 50건의 신문기사를 대상으로 SPSS 통계 패키지를 이용하여 다양한 유사계수에 각각 달라지는 문헌 클러스터링의 결과를 살펴본 후, 유사계수간의 연관성을 측정하였다.

• Journal of the Korean Society for information Management
• /
• v.24 no.4
• /
• pp.267-283
• /
• 2007

In this study, measures of distributional similarity such as KL-divergence are applied to cluster documents instead of traditional cosine measure, which is the most prevalent vector similarity measure for document clustering. Three variations of KL-divergence are investigated; Jansen-Shannon divergence, symmetric skew divergence, and minimum skew divergence. In order to verify the contribution of distributional similarities to document clustering, two experiments are designed and carried out on three test collections. In the first experiment the clustering performances of the three divergence measures are compared to that of cosine measure. The result showed that minimum skew divergence outperformed the other divergence measures as well as cosine measure. In the second experiment second-order distributional similarities are calculated with Pearson correlation coefficient from the first-order similarity matrixes. From the result of the second experiment, secondorder distributional similarities were found to improve the overall performance of document clustering. These results suggest that minimum skew divergence must be selected as document vector similarity measure when considering both time and accuracy, and second-order similarity is a good choice for considering clustering accuracy only.

• Journal of the Korean Society for information Management
• /
• v.24 no.1 s.63
• /
• pp.251-271
• /
• 2007

This paper studies the problem of classifying documents with labeled and unlabeled learning data, especially with regards to using document similarity features. The problem of using unlabeled data is practically important because in many information systems obtaining training labels is expensive, while large quantities of unlabeled documents are readily available. There are two steps In general semi-supervised learning algorithm. First, it trains a classifier using the available labeled documents, and classifies the unlabeled documents. Then, it trains a new classifier using all the training documents which were labeled either manually or automatically. We suggested two types of semi-supervised learning algorithm with regards to using document similarity features. The one is one step semi-supervised learning which is using unlabeled documents only to generate document similarity features. And the other is two step semi-supervised learning which is using unlabeled documents as learning examples as well as similarity features. Experimental results, obtained using support vector machines and naive Bayes classifier, show that we can get improved performance with small labeled and large unlabeled documents then the performance of supervised learning which uses labeled-only data. When considering the efficiency of a classifier system, the one step semi-supervised learning algorithm which is suggested in this study could be a good solution for improving classification performance with unlabeled documents.

• Journal of Korean Library and Information Science Society
• /
• v.40 no.3
• /
• pp.367-387
• /
• 2009

The similar bibliographic retrieval system follows whether it selects a thing of the extracted index term and or not the difference in which the similar document retrieval system There be many in the search result is generated. In this research, the method minimally making the error of the selection of the extracted candidate index term is provided In this research, the word information in which it is adjacent by using candidate index terms extracted from the similar literature and the keyword topic information were used. And by using the related author information and the reranking method of the search result, the similar bibliographic system in which an accuracy is high was developed. In this paper, we conducted experiments for similar bibliographic retrieval system on a collection of Korean journal articles of science and technology arena. The performance of similar bibliographic retrieval system was proved through an experiment and user evaluation.

• Journal of the Korean Society for information Management
• /
• v.29 no.2
• /
• pp.155-171
• /
• 2012

In text categorization, core terms of an input document are hardly selected as classification features if they do not occur in a training document set. Besides, synonymous terms with the same concept are usually treated as different features. This study aims to improve text categorization performance by integrating synonyms into a single feature and by replacing input terms not in the training document set with the most similar term occurring in training documents using Wikipedia. For the selection of classification features, experiments were performed in various settings composed of three different conditions: the use of category information of non-training terms, the part of Wikipedia used for measuring term-term similarity, and the type of similarity measures. The categorization performance of a kNN classifier was improved by 0.35~1.85% in $F_1$ value in all the experimental settings when non-learning terms were replaced by the learning term with the highest similarity above the threshold value. Although the improvement ratio is not as high as expected, several semantic as well as structural devices of Wikipedia could be used for selecting more effective classification features.

• Proceedings of the Korean Society for Information Management Conference
• /
• 2003.08a
• /
• pp.233-244
• /
• 2003

본 연구는 우리나라 디자인학분야 5개 학회(협회)지의 2002년분에 인용된 3,046개 문헌을 인용문헌의 형태별, 발행지별, 발행년도별, 주제별로 분석하여 디자인학분야 연구자의 문헌 이용행태와 문헌의 이용가치 감소현상 즉 반감기를 측정하였다. 연구결과 디자인학분야 연구자들은 단행본(62.5%), 학술잡지기사(21.8%), 논문(10.8%), 보고서(2.9%), 기타(2%)순으로 많이 이용하였으며, 단행본의 인용이 현저히 많은 것으로 자료 형태별 이용에 있어 국내 디자인학분야 연구자의 연구활동이 국내 사회과학, 미술분야와 유사하다고 볼 수 있다. 발행지별로 분석한 결과는 국내 디자인학분야 연구자들이 국내문헌을 해외문헌보다 2.5배정도 많이 이용한 것으로 국내문헌에 많이 의존하는 것으로 분석되었다. 이것은 해외문헌을 국내문헌보다 2배정도 많이 이용한 것으로 분석된 사회과학분야의 선행연구와 비교할 때 디자인학분야에서는 정반대의 현상을 보이는 것이나 4배정도 국내문헌을 많이 이용한 것으로 분석된 미술분야의 선행연구와는 유사한 결과를 나타내는 것이다. 디자인학분야 문헌의 반감기는 5.75년이었으며, 자료형태별 반감기는 단행본(6.64년), 논문(5.97년), 학술잡지기사 (4.55년), 기타(3.73년), 보고서(3.41년) 순으로 분석되었고, 발행지별 반감기는 해외문헌(9.1년), 국내문헌(5.1년)순으로 분석되었다. 또한 타주제와의 관계분석에 있어 경영학, 건축술, 공학 등과 긴밀한 관계를 맺고 있는 것으로 디자인학이 단순히 미를 추구하는 것이 아니라 산업경쟁력 증진의 도구로서 존재한다는 것을 알 수 있다.

• Journal of the Korean Society for information Management
• /
• v.22 no.3 s.57
• /
• pp.261-287
• /
• 2005

The purpose of this paper is to explore the ways to improve the performance of SVM (Support Vector Machines) text classifier using inter-document similarities. SVMs are powerful machine learning systems, which are considered as the state-of-the-art technique for automatic document classification. In this paper text categorization via SVMs approach based on feature representation with document vectors is suggested. In this approach, document vectors instead of index terms are used as features, and vector similarities instead of term weights are used as feature values. Experiments show that SVM classifier with document vector features can improve the document classification performance. For the sake of run-time efficiency, two methods are developed: One is to select document vector features, and the other is to use category centroid vector features instead. Experiments on these two methods show that we can get improved performance with small vector feature set than the performance of conventional methods with index term features.

• Journal of the Korean Society for Library and Information Science
• /
• v.34 no.2
• /
• pp.87-115
• /
• 2000

The effects of the Case, Part of Speech, Word and Clause Location, Word Frequency etc. were studied in discriminating the similar sentences of the Korean text. Word Frequency was much related to the discrimination of similarity and Tilte word and Functional Clause were little, but the others were not. The cosine coefficient and Salton'similarity measurement are used to measure the similarity between sentences. The change of clauses between each sentence is also used to unify the similar sentences into a represenative sentence.

• KIISE Transactions on Computing Practices
• /
• v.21 no.10
• /
• pp.623-630
• /
• 2015

In this paper, the design and implementation of an automatic reference-citation-mark attachment system are introduced. The system automatically attaches a citation mark to the end of a sentence in a technical document if the corresponding statement has a high similarity to another statement in the same document; simultaneously, the corresponding bibliographic data is automatically created from the cited-document information. In accordance with functional specifications, a Web-based, online service model and the development of its prototype system are proposed. The developed system can help in the elimination of unexpected plagiarism issues, and will alleviate the burdens of reference citation and reference-list creation for technical writers.

• Proceedings of the Korea Water Resources Association Conference
• /
• 2011.05a
• /
• pp.335-335
• /
• 2011

토양유실은 농업환경지표를 비롯한 국제 규범에서 농업에 의한 환경오염의 핵심문제로 제기되고 있다. 이러한 토양유실의 문제점을 해결하기 위해 USLE를 기반으로 한 SATEEC모형을 사용하여 토양유실량 및 유사량을 산정하였다. SATEEC모형은 USLE입력자료와 DEM을 이용하여 산정된 토양유실량 과 GA-SDR모듈을 통해 산정된 유달률(Sediment Delivery Ratio, SDR)을 통하여 최종유출구에서의 유사량을 산정한다. 많은 연구자들은 최종유출구에서의 유사량을 실측유사량과 비교하여 비슷하게 모의되면 유역의 특성을 잘 반영한다고 판단하므로 SATEEC모형의 단점인 토양유실량이 과하게 산정되는 문제점을 중요하게 생각하지 않는다. 하지만 SATEEC 모형의 결과값인 유사량의 신뢰도를 향상시키기 위해서는 토양유실량 검증을 통한 정확한 입력자료 구축이 필요하다. 따라서 본 연구에서는 여러개의 토양유실량 시나리오를 만들어 이에 따른 SATEEC 모형의 유사량을 비교/평가하고, 이를 이용하여 토양유실량의 검증이 필요함을 제시하고자 한다. 본 연구에서 사용한 토양유실량 시나리오는 총 4개로써, 시나리오 1은 SATEEC모형을 이용하여 산정된 토양유실량이며, 시나리오2~4는 ArcGIS를 사용하여 기존의 토양유실량 값에 ${\pm}0.25$의 범위를 주어 새롭게 산정된 토양유실량으로 SATEEC모형을 이용한 유사량 산정시 입력자료로 활용하였다. 그 결과 SATEEC모형을 이용하여 산정된 토양유실량은 시나리오별로 차이를 보였다. 또한 SATEEC GA-SDR모듈을 통해 예측된 토양유실량 값과 실측유사량을 이용하여 유달률을 산정하였으며 유달률도 토양유실량 시나리오별로 차이를 보였다. 따라서 SATEEC모형을 이용하여 최종유출구에서의 유사량 산정 결과 토양유실량의 차이에도 불구하고 유사량은 거의 비슷한 값을 나타내고 있으며, 최종유출구에서의 모의된 예측 유사량이 실측유사량과 비교 시 R2=0.688, EI=0.643 정도로 실측유사량과 비슷한 경향을 나타냈다. 따라서 SATEEC모형을 이용하여 유사량 산정시 먼저 문헌을 통한 토양유실량 검증이 필요하리라 판단되며, 문헌을 통해 토양유실량 검증 후 정확한 입력자료를 구축하여 유역에서의 유사량 저감을 위한 최적관리 기법 분석에 사용할 수 있도록 프로세서를 구축해야 할 것이라 판단된다.