• 제목/요약/키워드: Entropy Filtering

검색결과 34건 처리시간 0.024초

Improved Collaborative Filtering Using Entropy Weighting

  • Kwon, Hyeong-Joon
    • International Journal of Advanced Culture Technology
    • /
    • 제1권2호
    • /
    • pp.1-6
    • /
    • 2013
  • In this paper, we evaluate performance of existing similarity measurement metric and propose a novel method using user's preferences information entropy to reduce MAE in memory-based collaborative recommender systems. The proposed method applies a similarity of individual inclination to traditional similarity measurement methods. We experiment on various similarity metrics under different conditions, which include an amount of data and significance weighting from n/10 to n/60, to verify the proposed method. As a result, we confirm the proposed method is robust and efficient from the viewpoint of a sparse data set, applying existing various similarity measurement methods and Significance Weighting.

  • PDF

Applying Consistency-Based Trust Definition to Collaborative Filtering

  • Kim, Hyoung-Do
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제3권4호
    • /
    • pp.366-375
    • /
    • 2009
  • In collaborative filtering, many neighbors are needed to improve the quality and stability of the recommendation. The quality may not be good mainly due to the high similarity between two users not guaranteeing the same preference for products considered for recommendation. This paper proposes a consistency definition, rather than similarity, based on information entropy between two users to improve the recommendation. This kind of consistency between two users is then employed as a trust metric in collaborative filtering methods that select neighbors based on the metric. Empirical studies show that such collaborative filtering reduces the number of neighbors required to make the recommendation quality stable. Recommendation quality is also significantly improved.

Entropy-based Similarity Measures for Memory-based Collaborative Filtering

  • Kwon, Hyeong-Joon;Latchman, Haniph
    • International Journal of Internet, Broadcasting and Communication
    • /
    • 제5권2호
    • /
    • pp.5-10
    • /
    • 2013
  • We proposed a novel similarity measure using weighted difference entropy (WDE) to improve the performance of the CF system. The proposed similarity metric evaluates the entropy with a preference score difference between the common rated items of two users, and normalizes it based on the Gaussian, tanh and sigmoid function. We showed significant improvement of experimental results and environments. These experiments involved changing the number of nearest neighborhoods, and we presented experimental results for two data sets with different characteristics, and results for the quality of recommendation.

Forest Fire Damage Assessment Using UAV Images: A Case Study on Goseong-Sokcho Forest Fire in 2019

  • Yeom, Junho;Han, Youkyung;Kim, Taeheon;Kim, Yongmin
    • 한국측량학회지
    • /
    • 제37권5호
    • /
    • pp.351-357
    • /
    • 2019
  • UAV (Unmanned Aerial Vehicle) images can be exploited for rapid forest fire damage assessment by virtue of UAV systems' advantages. In 2019, catastrophic forest fire occurred in Goseong and Sokcho, Korea and burned 1,757 hectares of forests. We visited the town in Goseong where suffered the most severe damage and conducted UAV flights for forest fire damage assessment. In this study, economic and rapid damage assessment method for forest fire has been proposed using UAV systems equipped with only a RGB sensor. First, forest masking was performed using automatic elevation thresholding to extract forest area. Then ExG (Excess Green) vegetation index which can be calculated without near-infrared band was adopted to extract damaged forests. In addition, entropy filtering was applied to ExG for better differentiation between damaged and non-damaged forest. We could confirm that the proposed forest masking can screen out non-forest land covers such as bare soil, agriculture lands, and artificial objects. In addition, entropy filtering enhanced the ExG homogeneity difference between damaged and non-damaged forests. The automatically detected damaged forests of the proposed method showed high accuracy of 87%.

Using Kalman Filtering and Segmentation Techniques to Capture and Detect Cracks in Pavement

  • Hsu, C.J.;Chen, C.F.
    • 대한원격탐사학회:학술대회논문집
    • /
    • 대한원격탐사학회 2003년도 Proceedings of ACRS 2003 ISRS
    • /
    • pp.930-932
    • /
    • 2003
  • For this study we used a CCD video camera to capture the pavement image information via the computer. During investigation processing, the CCD video camera captured 10${\sim}$30 images per second. If the vehicle velocity is too fast, the collected images will be duplicated and if the velocity is too slow there will be a gapped between images. Therefore, in order to control the efficiency of the image grabber we should add accessory tools such as the Differential Global Positioning System (DGPS) and odometer. Furthermore, Kalman Filtering can also solve these problems. After the CCD video camera captured the pavement images, we used the Least-Squares method to eliminate images of gradation which have non-uniform surfaces due to the illumination at night. The Fuzzy Entropy method calculates images of threshold segments and creates binary images. Finally, the Object Labeling algorithm finds objects that are cracks or noises from the binary image based on volume pixels of the object. We used these algorithms and tested them, also providing some discussion and suggestions.

  • PDF

Dual Exposure Fusion with Entropy-based Residual Filtering

  • Heo, Yong Seok;Lee, Soochahn;Jung, Ho Yub
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제11권5호
    • /
    • pp.2555-2575
    • /
    • 2017
  • This paper presents a dual exposure fusion method for image enhancement. Images taken with a short exposure time usually contain a sharp structure, but they are dark and are prone to be contaminated by noise. In contrast, long-exposure images are bright and noise-free, but usually suffer from blurring artifacts. Thus, we fuse the dual exposures to generate an enhanced image that is well-exposed, noise-free, and blur-free. To this end, we present a new scale-space patch-match method to find correspondences between the short and long exposures so that proper color components can be combined within a proposed dual non-local (DNL) means framework. We also present a residual filtering method that eliminates the structure component in the estimated noise image in order to obtain a sharper and further enhanced image. To this end, the entropy is utilized to determine the proper size of the filtering window. Experimental results show that our method generates ghost-free, noise-free, and blur-free enhanced images from the short and long exposure pairs for various dynamic scenes.

LiDAR자료의 지면정보 추출기법의 정확도 평가 (Accuracy Assessment of Ground Information Extracting Method from LiDAR Data)

  • 최연웅;최내인;이준환;조기성
    • 대한공간정보학회지
    • /
    • 제14권4호통권38호
    • /
    • pp.19-26
    • /
    • 2006
  • 본 연구에서는 LiDAR 자료로부터의 지면정보 추출기법들에 대한 정확도를 평가하였다. 특히, 포인트 형태의 벡터자료인 LiDAR 원시자료를 직접 활용하는 기법과 정규격자형식의 DSM 형식으로 변형하여 활용하는 기법의 정확도를 비교하였다. 정규격자형식의 자료를 이용하는 방법으로는 경계추출 및 필터링 기법을 이용하는 방법, 평균필터링에 의하여 생성된 추세면을 이용하는 방법을 적용하였으며, 벡터구조의 원시LiDAR 자료를 직접 활용하는 기법으로써 Local Maxima 및 엔트로피를 이용하는 방법을 적용하였다. 또한, 수작업을 통하여 제작된 DEM 및 수치지도의 축척별 오차허용범위를 이용하여 정확도 평가를 수행하였으며, 경계검출 및 필터링, 추세면, Local Maxima, 엔트로피를 이용한 각 기법의 DEM의 평균 오차는 0.27m, 2.43m, 0.13m, 0.10m로써 엔트로피를 이용한 방법이 가장 높은 정확도를 나타내었다. 또한, 벡터형식의 LiDAR원시자료를 직접 이용하는 방법이 격자형식으로 변환하는 방법에 비하여 상대적으로 높은 정확도를 나타내었다.

  • PDF

엔트로피 가중치 및 SVD를 이용한 군집 특징 선택 (Cluster Feature Selection using Entropy Weighting and SVD)

  • 이영석;이수원
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제29권4호
    • /
    • pp.248-257
    • /
    • 2002
  • 군집화는 객체들의 특성을 분석하여 유사한 성질을 갖고 있는 객체들을 동일한 집단으로 분류하는 방법이다. 전자 상거래 자료처럼 차원 수가 많고 누락 값이 많은 자료의 경우 입력 자료의 차원축약, 잡음제거를 목적으로 SVD를 사용하여 군집화를 수행하는 것이 효과적이지만, SVD를 통해 변환된 자료는 원래의 속성 정보를 상실하기 때문에 군집 결과분석에서 원본 속성의 가치 해석이 어렵다. 따라서 본 연구는 군집화 수행 후 엔트로피 가중치 및 SVD를 이용하여 군집의 중요한 속성을 발견하기 위한 군집 특징 선택 기법 ENTROPY-SVD를 제안한다. ENTROPY-SVD는 자료의 속성들과 유사객체 군과의 묵시적인 은닉 구조를 활용하기 위하여 SVD를 이용하고 유사객체 군에 포함된 응집도가 높은 속성들을 발견하기 위하여 엔트로피 가중치를 사용한다. 또한 ENTROPY-SVD를 적용한 모델 기반의 협력적 여과기법의 추천 시스템 CFS-CF를 제안하고 그 효용성 및 효과를 평가한다.

Image Deblocking Scheme for JPEG Compressed Images Using an Adaptive-Weighted Bilateral Filter

  • Wang, Liping;Wang, Chengyou;Huang, Wei;Zhou, Xiao
    • Journal of Information Processing Systems
    • /
    • 제12권4호
    • /
    • pp.631-643
    • /
    • 2016
  • Due to the block-based discrete cosine transform (BDCT), JPEG compressed images usually exhibit blocking artifacts. When the bit rates are very low, blocking artifacts will seriously affect the image's visual quality. A bilateral filter has the features for edge-preserving when it smooths images, so we propose an adaptive-weighted bilateral filter based on the features. In this paper, an image-deblocking scheme using this kind of adaptive-weighted bilateral filter is proposed to remove and reduce blocking artifacts. Two parameters of the proposed adaptive-weighted bilateral filter are adaptive-weighted so that it can avoid over-blurring unsmooth regions while eliminating blocking artifacts in smooth regions. This is achieved in two aspects: by using local entropy to control the level of filtering of each single pixel point within the image, and by using an improved blind image quality assessment (BIQA) to control the strength of filtering different images whose blocking artifacts are different. It is proved by our experimental results that our proposed image-deblocking scheme provides good performance on eliminating blocking artifacts and can avoid the over-blurring of unsmooth regions.

Strategies for Selecting Initial Item Lists in Collaborative Filtering Recommender Systems

  • Lee, Hong-Joo;Kim, Jong-Woo;Park, Sung-Joo
    • Management Science and Financial Engineering
    • /
    • 제11권3호
    • /
    • pp.137-153
    • /
    • 2005
  • Collaborative filtering-based recommendation systems make personalized recommendations based on users' ratings on products. Recommender systems must collect sufficient rating information from users to provide relevant recommendations because less user rating information results in poorer performance of recommender systems. To learn about new users, recommendation systems must first present users with an initial item list. In this study, we designed and analyzed seven selection strategies including the popularity, favorite, clustering, genre, and entropy methods. We investigated how these strategies performed using MovieLens, a public dataset. While the favorite and popularity methods tended to produce the highest average score and greatest average number of ratings, respectively, a hybrid of both favorite and popularity methods or a hybrid of demographic, favorite, and popularity methods also performed within acceptable ranges for both rating scores and numbers of ratings.