• Title/Summary/Keyword: Entropy Filtering

Search Result 34, Processing Time 0.052 seconds

Optimal Associative Neighborhood Mining using Representative Attribute (대표 속성을 이용한 최적 연관 이웃 마이닝)

  • Jung Kyung-Yong
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.43 no.4 s.310
    • /
    • pp.50-57
    • /
    • 2006
  • In Electronic Commerce, the latest most of the personalized recommender systems have applied to the collaborative filtering technique. This method calculates the weight of similarity among users who have a similar preference degree in order to predict and recommend the item which hits to propensity of users. In this case, we commonly use Pearson Correlation Coefficient. However, this method is feasible to calculate a correlation if only there are the items that two users evaluated a preference degree in common. Accordingly, the accuracy of prediction falls. The weight of similarity can affect not only the case which predicts the item which hits to propensity of users, but also the performance of the personalized recommender system. In this study, we verify the improvement of the prediction accuracy through an experiment after observing the rule of the weight of similarity applying Vector similarity, Entropy, Inverse user frequency, and Default voting of Information Retrieval field. The result shows that the method combining the weight of similarity using the Entropy with Default voting got the most efficient performance.

Comparative Evaluation of User Similarity Weight for Improving Prediction Accuracy in Personalized Recommender System (개인화 추천 시스템의 예측 정확도 향상을 위한 사용자 유사도 가중치에 대한 비교 평가)

  • Jung Kyung-Yong;Lee Jung-Hyun
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.42 no.6
    • /
    • pp.63-74
    • /
    • 2005
  • In Electronic Commerce, the latest most of the personalized recommender systems have applied to the collaborative filtering technique. This method calculates the weight of similarity among users who have a similar preference degree in order to predict and recommend the item which hits to propensity of users. In this case, we commonly use Pearson Correlation Coefficient. However, this method is feasible to calculate a correlation if only there are the items that two users evaluated a preference degree in common. Accordingly, the accuracy of prediction falls. The weight of similarity can affect not only the case which predicts the item which hits to propensity of users, but also the performance of the personalized recommender system. In this study, we verify the improvement of the prediction accuracy through an experiment after observing the rule of the weight of similarity applying Vector similarity, Entropy, Inverse user frequency, and Default voting of Information Retrieval field. The result shows that the method combining the weight of similarity using the Entropy with Default voting got the most efficient performance.

Extracting Typical Group Preferences through User-Item Optimization and User Profiles in Collaborative Filtering System (사용자-상품 행렬의 최적화와 협력적 사용자 프로파일을 이용한 그룹의 대표 선호도 추출)

  • Ko Su-Jeong
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.7
    • /
    • pp.581-591
    • /
    • 2005
  • Collaborative filtering systems have problems involving sparsity and the provision of recommendations by making correlations between only two users' preferences. These systems recommend items based only on the preferences without taking in to account the contents of the items. As a result, the accuracy of recommendations depends on the data from user-rated items. When users rate items, it can be expected that not all users ran do so earnestly. This brings down the accuracy of recommendations. This paper proposes a collaborative recommendation method for extracting typical group preferences using user-item matrix optimization and user profiles in collaborative tittering systems. The method excludes unproven users by using entropy based on data from user-rated items and groups users into clusters after generating user profiles, and then extracts typical group preferences. The proposed method generates collaborative user profiles by using association word mining to reflect contents as well as preferences of items and groups users into clusters based on the profiles by using the vector space model and the K-means algorithm. To compensate for the shortcoming of providing recommendations using correlations between only two user preferences, the proposed method extracts typical preferences of groups using the entropy theory The typical preferences are extracted by combining user entropies with item preferences. The recommender system using typical group preferences solves the problem caused by recommendations based on preferences rated incorrectly by users and reduces time for retrieving the most similar users in groups.

A study of Image Compression Algorithm using DCT (DCT를 이용한 영상압축 알고리즘에 관한 연구)

  • 한동호;이준노
    • Journal of Biomedical Engineering Research
    • /
    • v.13 no.4
    • /
    • pp.323-330
    • /
    • 1992
  • A Study of Image Compression Algorithm using DCT This paper describes the system that implement a JPEG(Joint Photographic Experts Group) algorithm based on DCT(Discrete Cosine Transform) uslng CCD kameva, Image Grabber, and IBM PC. After cosine transforms the acquisited image, this algorithm quantize and entropy encode the coefficients by JPEG code table. The coefficients are reconstructed by the Huffman decoding, dequantized procedure, and Inverse cosine transform. The results obtained from the impleulented system are as follows. (1) For effcient storage and easy implementation, this system save Image as a PCX formal (2) Thls system get 7:1 compression ratio(3.8 RMSE value) without large distortion. (3) With a low pass filtering, thls system eliminate high frequency components and get 20% enhanced compression ratio. (4) Thls system enhance the reconstructed Image using histogram modeling.

  • PDF

User Simility Measurement Using Entropy and Default Voting Prediction in Collaborative Filtering (엔트로피와 Default Voting을 이용한 협력적 필터링에서의 사용자 유사도 측정)

  • 조선호;김진수;이정현
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2001.10b
    • /
    • pp.115-117
    • /
    • 2001
  • 기존의 인터넷 웹사이트에서는 사용자의 만족을 극대화시키기 위하여 사용자별로 개인화 된 서비스를 제공하는 협력적 필터링 방식을 적용하고 있다. 협력적 필터링 기술은 사용자의 취향에 맞는 아이템을 예측하여 추천하며, 비슷한 선호도를 가진 다른 사용자들과의 상관관계를 구하기 위하여 일반적으로 피어슨 상관계수를 많이 이용한다. 그러나, 피어슨 상관계수를 이용한 방법은 사용자가 평가를 한 아이템이 있을 때에만 상관관계를 구할 수 있다는 단점과 예측의 정확성이 떨어진다는 단점을 가지고 있다. 따라서, 본 논문에서는 피어슨 상관관계 기반 예측 기법을 보완하여 보다 정확한 사용자 유사도를 구하는 방법을 제안한다. 제안된 방법에서는 사용자들을 대상으로 사용자가 평가를 한 아이템의 선호도를 사용해서 엔트로피를 적용하였고, 사용자가 선호도를 표시하지 않은 상품에 대해서는 Default Voting 방법을 이용하여 보다 정확한 헙력적 필터링 방식을 구현하였다.

  • PDF

Feature Extraction in an Aerial Photography of Gimnyeong Sand Dune Area by Texture Filtering

  • Chang E.M.;Park K.;Jung I.K.
    • Proceedings of the KSRS Conference
    • /
    • 2004.10a
    • /
    • pp.613-616
    • /
    • 2004
  • To find the best way to distinguish sand dunes from urban building and rural patches, textural analysis has been performed in Kimnyeong sand dune, Jeju. An aerial photo was re-sampled into one-meter. Homomorphic filters were applied to the original sub-scene and then high-pass filtered one. The entropy filtered one proves to be the best extraction method after high pass filtered-homomorphic filters in urban areas. The spectral values of sand dune area were similar to open land in rural area. In contrast, the texture values of sand dune area are more homogeneous than those of open land in rural area.

  • PDF

A Study for Introducing a Method of Detecting and Recovering the Shadow Edge from Aerial Photos (항공영상에서 그림자 경계 탐색 및 복원 기법 연구)

  • Jung, Yong-Ju;Jang, Young-Woon;Choi, Yun-Woong;Cho, Gi-Sung
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.24 no.4
    • /
    • pp.327-334
    • /
    • 2006
  • The aerial photos need in a simple object such as cartography and ground cover classification and also in a social objects such as the city plan, environment, disaster, transportation etc. However, the shadow, which includes when taking the aerial photos, makes a trouble to interpret the ground information, and also users, who need the photos in their field tasks, have a restriction. Generally the shadow occurs by the building and surface topography, and the detail cause is by changing of the illumination in an area. For removing the shadow this study uses the single image and processes the image without the source of image and taking situation. Also, applying the entropy minimization method it generates the 1-D gray-scale invariant image for creating the shadow edge mask and using the Canny edge detection creates the shadow edge mask, and finally by filtering in Fourier frequency domain creates the intrinsic image which recovers the 3-D color information and removes the shadow.

Spatio-Temporal 3D Joint Noise Reduction Filter (시공간 3차원 결합 잡음제거 필터)

  • 홍성훈;홍성용
    • Journal of Korea Multimedia Society
    • /
    • v.5 no.2
    • /
    • pp.147-157
    • /
    • 2002
  • Noise in image sequences is visually offensive and may mask important image detail. In addition to degradation of visual quality, the noise pattern increases the entropy of the image, and thus hinders effective compression. This paper proposes a spatial and a temporal joint filters to reduce the noise by jointly connecting two adaptive noise reducers with different characteristics, and we also propose an IIR-type 3D noise reduction litter scheme connecting the spatial and the temporal joint filters. The proposed 3D IIR filter not only strongly removes noise in uniform image regions while preserving edges and details but also effectively suppresses temporal flicker caused by noise. Experimental results show that the proposed scheme improves subjective quality as well as objective quality as compared with the various noise filtering techniques.

  • PDF

Target Marketing Method on Specific Item Using Chi-Square Analysis and Item-based Collaborative Filtering (카이스퀘어 분석과 아이템기반 협력적 여과를 이용한 타겟마케팅 기법)

  • Kim, Wan-Seop;Lee, Soo-Won
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2005.07b
    • /
    • pp.607-609
    • /
    • 2005
  • 온라인 및 오프라인 상에서 추천시스템에 대한 요구가 커지고 있으며 이에 관련해 않은 연구가 이루어지고 있다. 추천시스템은 마케팅 활용의 관점에서 목표 상품에 대한 반응 가능성이 높은 고객군을 추천하는 타겟마케팅 추천시스템과 고객 개인별로 구매 가능성이 높은 상품을 추천하는 개인화 추천시스템으로 구분할 수 있다. 지금까지의 추천시스템에 관한 연구는 대부분 개인화 추천시스템의 효율 향상에 목표를 두고 있다. 그러나 기업의 타겟마케팅에 대한 요구를 적절히 지원하지 못하고 있어 타겟마케팅에 대한 연구가 필요하다. 본 연구에서는 상품별 구매 패턴을 이용하는 프로파일 기반 추천 방법을 제안하고 이 방법과 기존의 협력적 추천 방법을 결합하여 특정 상품에 반응 가능성이 높은 고객을 추천하는 방법을 제안한다. 프로파일 기반 추천에서는 카이스퀘어 검정을 사용하여 상품별로 구매 패턴에 영향을 미치는 요인을 추출하고 이를 이용하여 특징 고객군을 선별하여 전체 고객군과 특징 고객과의 엔트로피(Entropy)의 변이 정도를 예측값으로 사용한다. 실험결과, 프로파일 기반 추천과 협력적 추천을 결합하여 추천하는 방법은 한 가지 방법을 사용할 때 보다 좋은 추천 정확도를 나타내었다.

  • PDF

Development of Landslide Detection Algorithm Using Fully Polarimetric ALOS-2 SAR Data (Fully-Polarimetric ALOS-2 자료를 이용한 산사태 탐지 알고리즘 개발)

  • Kim, Minhwa;Cho, KeunHoo;Park, Sang-Eun;Cho, Jae-Hyoung;Moon, Hyoi;Han, Seung-hoon
    • Economic and Environmental Geology
    • /
    • v.52 no.4
    • /
    • pp.313-322
    • /
    • 2019
  • SAR (Synthetic Aperture Radar) remote sensing data is a very useful tool for near-real-time identification of landslide affected areas that can occur over a large area due to heavy rains or typhoons. This study aims to develop an effective algorithm for automatically delineating landslide areas from the polarimetric SAR data acquired after the landslide event. To detect landslides from SAR observations, reduction of the speckle effects in the estimation of polarimetric SAR parameters and the orthorectification of geometric distortions on sloping terrain are essential processing steps. Based on the experimental analysis, it was found that the IDAN filter can provide a better estimation of the polarimetric parameters. In addition, it was appropriate to apply orthorectification process after estimating polarimetric parameters in the slant range domain. Furthermore, it was found that the polarimetric entropy is the most appropriate parameters among various polarimetric parameters. Based on those analyses, we proposed an automatic landslide detection algorithm using the histogram thresholding of the polarimetric parameters with the aid of terrain slope information. The landslide detection algorithm was applied to the ALOS-2 PALSAR-2 data which observed landslide areas in Japan triggered by Typhoon in September 2011. Experimental results showed that the landslide areas were successfully identified by using the proposed algorithm with a detection rate of about 82% and a false alarm rate of about 3%.