• Title/Summary/Keyword: Data filtering

Search Result 1,777, Processing Time 0.027 seconds

Dynamic Fuzzy Cluster based Collaborative Filtering

  • Min, Sung-Hwan;Han, Ingoo
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2004.11a
    • /
    • pp.203-210
    • /
    • 2004
  • Due to the explosion of e-commerce, recommender systems are rapidly becoming a core tool to accelerate cross-selling and strengthen customer loyalty. There are two prevalent approaches for building recommender systems - content-based recommending and collaborative filtering. Collaborative filtering recommender systems have been very successful in both information filtering domains and e-commerce domains, and many researchers have presented variations of collaborative filtering to increase its performance. However, the current research on recommendation has paid little attention to the use of time related data in the recommendation process. Up to now there has not been any study on collaborative filtering to reflect changes in user interest. This paper proposes dynamic fuzzy clustering algorithm and apply it to collaborative filtering algorithm for dynamic recommendations. The proposed methodology detects changes in customer behavior using the customer data at different periods of time and improves the performance of recommendations using information on changes. The results of the evaluation experiment show the proposed model's improvement in making recommendations.

  • PDF

A Study on Improving Efficiency of Recommendation System Using RFM (RFM을 활용한 추천시스템 효율화 연구)

  • Jeong, Sora;Jin, Seohoon
    • Journal of the Korean Institute of Plant Engineering
    • /
    • v.23 no.4
    • /
    • pp.57-64
    • /
    • 2018
  • User-based collaborative filtering is a method of recommending an item to a user based on the preference of the neighbor users who have similar purchasing history to the target user. User-based collaborative filtering is based on the fact that users are strongly influenced by the opinions of other users with similar interests. Item-based collaborative filtering is a method of recommending an item by comparing the similarity of the user's previously preferred items. In this study, we create a recommendation model using user-based collaborative filtering and item-based collaborative filtering with consumer's consumption data. Collaborative filtering is performed by using RFM (recency, frequency, and monetary) technique with purchasing data to recommend items with high purchase potential. We compared the performance of the recommendation system with the purchase amount and the performance when applying the RFM method. The performance of recommendation system using RFM technique is better.

Sparsity Effect on Collaborative Filtering-based Personalized Recommendation (협업 필터링 기반 개인화 추천에서의 평가자료의 희소 정도의 영향)

  • Kim, Jong-Woo;Bae, Se-Jin;Lee, Hong-Joo
    • Asia pacific journal of information systems
    • /
    • v.14 no.2
    • /
    • pp.131-149
    • /
    • 2004
  • Collaborative filtering is one of popular techniques for personalized recommendation in e-commerce sites. An advantage of collaborative filtering is that the technique can work with sparse evaluation data to predict preference scores of new alternative contents or advertisements. There is, however, no in-depth study about the sparsity effect of customer's evaluation data to the performance of recommendation. In this study, we investigate the sparsity effect and hybrid usages of customers' evaluation data and purchase data using an experiment result. The result of the analysis shows that the performance of recommendation decreases monotonically as the sparsity increases, and also the hybrid usage of two different types of data; customers' evaluation data and purchase data helps to increase the performance of recommendation in sparsity situation.

Deep Learning-based Evolutionary Recommendation Model for Heterogeneous Big Data Integration

  • Yoo, Hyun;Chung, Kyungyong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.9
    • /
    • pp.3730-3744
    • /
    • 2020
  • This study proposes a deep learning-based evolutionary recommendation model for heterogeneous big data integration, for which collaborative filtering and a neural-network algorithm are employed. The proposed model is used to apply an individual's importance or sensory level to formulate a recommendation using the decision-making feedback. The evolutionary recommendation model is based on the Deep Neural Network (DNN), which is useful for analyzing and evaluating the feedback data among various neural-network algorithms, and the DNN is combined with collaborative filtering. The designed model is used to extract health information from data collected by the Korea National Health and Nutrition Examination Survey, and the collaborative filtering-based recommendation model was compared with the deep learning-based evolutionary recommendation model to evaluate its performance. The RMSE is used to evaluate the performance of the proposed model. According to the comparative analysis, the accuracy of the deep learning-based evolutionary recommendation model is superior to that of the collaborative filtering-based recommendation model.

Optimal Fingerprint Data Filtering Model for Location Based Services (위치기반 서비스 강화를 위한 최적 데이터 필터링 기법 및 측위 시스템 적용 모델)

  • Jung, Jun;Kim, Jae-Hoon
    • Korean Management Science Review
    • /
    • v.29 no.2
    • /
    • pp.79-90
    • /
    • 2012
  • Focusing on the rapid market penetration of smart phones, the importance of LBS (Location Based Service) is drastically increased. However, traditional GPS method has critical weakness caused by limited availability, such as indoor environment. WPS is newly attractive method as a widely applicable positioning method. In WPS, RSSI (Received Signal Strength Indication) data of all Wi-Fi APs (Access Point) are measured and stored into a huge database. The stored RSSI data in database make single radio fingerprint map. By the radio fingerprint map, we can estimate the actual position of target point. The essential factor of radio fingerprint database is data integrity of RSSI. Because of millions of APs in urban area, RSSI measurement data are seriously contaminated. Therefore, we present the unified filtering method for RSSI measurement data. As the results of filtering, we can show the effectiveness of suggested method in practical positioning system of mobile operator.

Misclassified Area Detection Algorithm for Aerial LiDAR Digital Terrain Data (항공 라이다 수치지면자료의 오분류 영역 탐지 알고리즘)

  • Kim, Min-Chul;Noh, Myoung-Jong;Cho, Woo-Sug;Bang, Ki-In;Park, Jun-Ku
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.19 no.1
    • /
    • pp.79-86
    • /
    • 2011
  • Recently, aerial laser scanning technology has received full attention in constructing DEM(Digital Elevation Model). It is well known that the quality of DEM is mostly influenced by the accuracy of DTD(Digital Terrain Data) extracted from LiDAR(Light Detection And Ranging) raw data. However, there are always misclassified data in the DTD generated by automatic filtering process due to the limitation of automatic filtering algorithm and intrinsic property of LiDAR raw data. In order to eliminate the misclassified data, a manual filtering process is performed right after automatic filtering process. In this study, an algorithm that detects automatically possible misclassified data included in the DTD from automatic filtering process is proposed, which will reduce the load of manual filtering process. The algorithm runs on 2D grid data structure and makes use of several parameters such as 'Slope Angle', 'Slope DeltaH' and 'NNMaxDH(Nearest Neighbor Max Delta Height)'. The experimental results show that the proposed algorithm quite well detected the misclassified data regardless of the terrain type and LiDAR point density.

1D Wavelet Filtering for Groundroll Suppression in Land Seismic-Reflection Data

  • Sa, Jin-Hyeon;Lee, Jae-Eun;Kim, Sung-Soo;Kim, Ji-Soo
    • The Journal of Engineering Geology
    • /
    • v.27 no.4
    • /
    • pp.513-518
    • /
    • 2017
  • Groundroll is a coherent noise showing dispersive behavior in land seismic-reflection records and its rejection has been a stubborn problem in data processing because they severely degrade the continuities and resolution of reflection signals. Conventional processing schemes of attenuating noises are the kind of frequency filtering (i.e., bandpass and f-k) that uses the Fourier transform (FT) along the entire trace in the time domain. To suppress them in this study, 1D wavelet filtering (WT) that can control time-varying frequency properties is tested and performed in the land-based synthetic and field seismic data. The results are compared to the ones from conventional filtering techniques in terms of continuities and resolution of reflection events. This filtering technique enhanced the reflection events by effectively eliminating the dispersive groundroll and random noises with control of time-scale function on wavelet domain.

An Energy-Efficient Data Aggregation using Hierarchical Filtering in Sensor Network (센서 네트워크에서 계층적 필터링을 이용한 에너지 효율적인 데이터 집계연산)

  • Kim, Jin-Su;Park, Chan-Heum;Kim, Chong-Gun;Kang, Byung-Wook
    • Journal of the Korea Society of Computer and Information
    • /
    • v.12 no.1 s.45
    • /
    • pp.73-82
    • /
    • 2007
  • This paper proposes how to reduce the amount of data transmitted in each sensor and cluster head in order to lengthen the lifetime of sensor network by data aggregation of the continuous queries. The most important factor of refuting the sensor's energy dissipation is to reduce the amount of messages transmitted. The method proposed is basically to combine clustering, in-network data aggregation and hierarchical filtering. Hierarchical filtering is to divide sensor network by two tiers when filtering it. First tier performs filtering when transmitting the data from cluster member to cluster head, and second tier performs filtering when transmitting the data from cluster head to base station. This method is much more efficient and effective than the previous work. We show through various experiments that our scheme reduces the network traffic significantly and increases the network's lifetime than existing methods.

  • PDF

Handling Incomplete Data Problem in Collaborative Filtering System

  • Noh, Hyun-Ju;Kwak, Min-Jung;Han, In-Goo
    • Journal of Intelligence and Information Systems
    • /
    • v.9 no.2
    • /
    • pp.51-63
    • /
    • 2003
  • Collaborative filtering is one of the methodologies that are most widely used for recommendation system. It is based on a data matrix of each customer's preferences of products. There could be a lot of missing values in such preference data matrix. This incomplete data is one of the reasons to deteriorate the accuracy of recommendation system. There are several treatments to deal with the incomplete data problem such as case deletion and single imputation. Those approaches are simple and easy to implement but they may provide biased results. Multiple imputation method imputes m values for each missing value. It overcomes flaws of single imputation approaches through considering the uncertainty of missing values. The objective of this paper is to suggest multiple imputation-based collaborative filtering approach for recommendation system to improve the accuracy in prediction performance. The experimental works show that the proposed approach provides better performance than the traditional Collaborative filtering approach, especially in case that there are a lot of missing values in dataset used for recommendation system.

  • PDF

Implement of HLA-RTI Filtering Technique using Agent (에이전트를 사용한 HLA-RTI 필터링 기술의 구현)

  • 김용주;이정욱;김영찬
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2003.05a
    • /
    • pp.745-748
    • /
    • 2003
  • HLA-RTI is Middleware for the distribute simulation that developed in the US Department of Defense. This provides fast accomplishment speed and reliability than distribute simulation Middleware by transfer. However, DDM(Data Distribution Management) service is used as data filtering technology in the existing HLA-RTI. As for this, the problem that network traffic increases in data exchange between the mobility simulation objects is generated. it proposes applying agent technology to the mobility simulation object in order to solve these problems in this paper in this. And this paper applies that to practical simulation and analyzes performance between each data filtering technology with comparison.

  • PDF