• Title/Summary/Keyword: Data sparsity

Search Result 174, Processing Time 0.025 seconds

Multipath Ghosts in Through-the-Wall Radar Imaging: Challenges and Solutions

  • Abdalla, Abdi T.;Alkhodary, Mohammad T.;Muqaibel, Ali H.
    • ETRI Journal
    • /
    • v.40 no.3
    • /
    • pp.376-388
    • /
    • 2018
  • In through-the-wall radar imaging (TWRI), the presence of front and side walls causes multipath propagation, which creates fake targets called multipath ghosts. They populate the scene and reduce the probability of correct target detection, classification, and localization. In modern TWRI, specular multipath exploitation has received considerable attention for reducing the effects of multipath ghosts. However, this exploitation is challenged by the requirements of the reflecting geometry, which is not always available. Currently, the demand for a high radar image resolution dictates the use of a large aperture and wide bandwidth. This results in a large amount of data. To tackle this problem, compressive sensing (CS) is applied to TWRI. With CS, only a fraction of the data are used to produce a high-quality image, provided that the scene is sparse. However, owing to multipath ghosts, the scene sparsity is highly deteriorated; hence, the performance of the CS algorithms is compromised. This paper presents and discusses the adverse effects of multipath ghosts in TWRI. It describes the physical formation of ghosts, their challenges, and existing suppression techniques.

Decomposition of Interference Hyperspectral Images Based on Split Bregman Iteration

  • Wen, Jia;Geng, Lei;Wang, Cailing
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.7
    • /
    • pp.3338-3355
    • /
    • 2018
  • Images acquired by Large Aperture Static Imaging Spectrometer (LASIS) exhibit obvious interference stripes, which are vertical and stationary due to the special imaging principle of interference hyperspectral image (IHI) data. As the special characteristics above will seriously affect the intrinsic structure and sparsity of IHI, decomposition of IHI has drawn considerable attentions of many scientists and lots of efforts have been made. Although some decomposition methods for interference hyperspectral data have been proposed to solve the above problem of interference stripes, too many times of iteration are necessary to get an optimal solution, which will severely affect the efficiency of application. A novel algorithm for decomposition of interference hyperspectral images based on split Bregman iteration is proposed in this paper, compared with other decomposition methods, numerical experiments have proved that the proposed method will be much more efficient and can reduce the times of iteration significantly.

A Study of Recommendation System Using Association Rule and Weighted Preference (연관규칙과 가중 선호도를 이용한 추천시스템 연구)

  • Moon, Song Chul;Cho, Young-Sung
    • Journal of Information Technology Services
    • /
    • v.13 no.3
    • /
    • pp.309-321
    • /
    • 2014
  • Recently, due to the advent of ubiquitous computing and the spread of intelligent portable device such as smart phone, iPad and PDA has been amplified, a variety of services and the amount of information has also increased fastly. It is becoming a part of our common life style that the demands for enjoying the wireless internet are increasing anytime or anyplace without any restriction of time and place. And also, the demands for e-commerce and many different items on e-commerce and interesting of associated items are increasing. Existing collaborative filtering (CF), explicit method, can not only reflect exact attributes of item, but also still has the problem of sparsity and scalability, though it has been practically used to improve these defects. In this paper, using a implicit method without onerous question and answer to the users, not used user's profile for rating to reduce customers' searching effort to find out the items with high purchasability, it is necessary for us to analyse the segmentation of customer and item based on customer data and purchase history data, which is able to reflect the attributes of the item in order to improve the accuracy of recommendation. We propose the method of recommendation system using association rule and weighted preference so as to consider many different items on e-commerce and to refect the profit/weight/importance of attributed of a item. To verify improved performance of proposing system, we make experiments with dataset collected in a cosmetic internet shopping mall.

Classifying Instantaneous Cognitive States from fMRI using Discriminant based Feature Selection and Adaboost

  • Vu, Tien Duong;Yang, Hyung-Jeong;Do, Luu Ngoc;Thieu, Thao Nguyen
    • Smart Media Journal
    • /
    • v.5 no.1
    • /
    • pp.30-37
    • /
    • 2016
  • In recent decades, the study of human brain function has dramatically increased thanks to the advent of Functional Magnetic Resonance Imaging. This is a powerful tool which provides a deep view of the activities of the brain. From fMRI data, the neuroscientists analyze which parts of the brain have responsibility for a particular action and finding the common pattern representing each state involved in these tasks. This is one of the most challenges in neuroscience area because of noisy, sparsity of data as well as the differences of anatomical brain structure of each person. In this paper, we propose the use of appropriate discriminant methods, such as Fisher Discriminant Ratio and hypothesis testing, together with strong boosting ability of Adaboost classifier. We prove that discriminant methods are effective in classifying cognitive states. The experiment results show significant better accuracy than previous works. We also show that it is possible to train a successful classifier without prior anatomical knowledge and use only a small number of features.

Cross-Product Category User Profiling for E-Commerce Personalized Recommendation (전자상거래 개인화 추천을 위한 상품 카테고리 중립적 사용자 프로파일링)

  • Park, Soo-Hwan;Lee, Hong-Joo;Cho, Nam-Jae;Kim, Jong-Woo
    • Asia pacific journal of information systems
    • /
    • v.16 no.3
    • /
    • pp.159-176
    • /
    • 2006
  • Collaborative filtering is one of the popular techniques for personalized recommendation in e-commerce. In collaborative filtering, user profiles are usually managed per product category in order to reduce data sparsity. Product diversification of Internet storefronts and multiple product category sales of e-commerce portals require cross-product category usage of user profiles in order to overcome the cold start problem of collaborative filtering. In this paper, we study the feasibility of cross-product category usage of user profiles, and suggest a method to improve recommendation performance of cross-product category user profiling. First, we investigate whether user profiles on a product category can be used to recommend products in other product categories. Furthermore, a way of utilizing user profiles selectively is suggested to increase recommendation performance of cross-product category user profiling. The feasibility of cross-product category user profiling and the usefulness of the proposed method are tested with real click stream data of an Internet storefront which sells multiple product categories including books, music CDs, and DVDs. The experiment results show that user profiles on a product category can be used to recommend products in other product categories. Also, the selective usage of user profiles based on correlations between subcategories of two product categories provides better performance than the whole usage of user profiles.

Study on Tag, Trust and Probability Matrix Factorization Based Social Network Recommendation

  • Liu, Zhigang;Zhong, Haidong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.5
    • /
    • pp.2082-2102
    • /
    • 2018
  • In recent years, social network related applications such as WeChat, Facebook, Twitter and so on, have attracted hundreds of millions of people to share their experience, plan or organize, and attend social events with friends. In these operations, plenty of valuable information is accumulated, which makes an innovative approach to explore users' preference and overcome challenges in traditional recommender systems. Based on the study of the existing social network recommendation methods, we find there is an abundant information that can be incorporated into probability matrix factorization (PMF) model to handle challenges such as data sparsity in many recommender systems. Therefore, the research put forward a unified social network recommendation framework that combine tags, trust between users, ratings with PMF. The uniformed method is based on three existing recommendation models (SoRecUser, SoRecItem and SoRec), and the complexity analysis indicates that our approach has good effectiveness and can be applied to large-scale datasets. Furthermore, experimental results on publicly available Last.fm dataset show that our method outperforms the existing state-of-art social network recommendation approaches, measured by MAE and MRSE in different data sparse conditions.

PCRM: Increasing POI Recommendation Accuracy in Location-Based Social Networks

  • Liu, Lianggui;Li, Wei;Wang, Lingmin;Jia, Huiling
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.12 no.11
    • /
    • pp.5344-5356
    • /
    • 2018
  • Nowadays with the help of Location-Based Social Networks (LBSNs), users of Point-of-Interest (POI) recommendation service in LBSNs are able to publish their geo-tagged information and physical locations in the form of sign-ups and share their experiences with friends on POI, which can help users to explore new areas and discover new points-of-interest, and promote advertisers to push mobile ads to target users. POI recommendation service in LBSNs is attracting more and more attention from all over the world. Due to the sparsity of users' activity history data set and the aggregation characteristics of sign-in area, conventional recommendation algorithms usually suffer from low accuracy. To address this problem, this paper proposes a new recommendation algorithm based on a novel Preference-Content-Region Model (PCRM). In this new algorithm, three kinds of information, that is, user's preferences, content of the Point-of-Interest and region of the user's activity are considered, helping users obtain ideal recommendation service everywhere. We demonstrate that our algorithm is more effective than existing algorithms through extensive experiments based on an open Eventbrite data set.

Effective Pre-rating Method Based on Users' Dichotomous Preferences and Average Ratings Fusion for Recommender Systems

  • Cheng, Shulin;Wang, Wanyan;Yang, Shan;Cheng, Xiufang
    • Journal of Information Processing Systems
    • /
    • v.17 no.3
    • /
    • pp.462-472
    • /
    • 2021
  • With an increase in the scale of recommender systems, users' rating data tend to be extremely sparse. Some methods have been utilized to alleviate this problem; nevertheless, it has not been satisfactorily solved yet. Therefore, we propose an effective pre-rating method based on users' dichotomous preferences and average ratings fusion. First, based on a user-item ratings matrix, a new user-item preference matrix was constructed to analyze and model user preferences. The items were then divided into two categories based on a parameterized dynamic threshold. The missing ratings for items that the user was not interested in were directly filled with the lowest user rating; otherwise, fusion ratings were utilized to fill the missing ratings. Further, an optimized parameter λ was introduced to adjust their weights. Finally, we verified our method on a standard dataset. The experimental results show that our method can effectively reduce the prediction error and improve the recommendation quality. As for its application, our method is effective, but not complicated.

Improving Web Service Recommendation using Clustering with K-NN and SVD Algorithms

  • Weerasinghe, Amith M.;Rupasingha, Rupasingha A.H.M.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.5
    • /
    • pp.1708-1727
    • /
    • 2021
  • In the advent of the twenty-first century, human beings began to closely interact with technology. Today, technology is developing, and as a result, the world wide web (www) has a very important place on the Internet and the significant task is fulfilled by Web services. A lot of Web services are available on the Internet and, therefore, it is difficult to find matching Web services among the available Web services. The recommendation systems can help in fixing this problem. In this paper, our observation was based on the recommended method such as the collaborative filtering (CF) technique which faces some failure from the data sparsity and the cold-start problems. To overcome these problems, we first applied an ontology-based clustering and then the k-nearest neighbor (KNN) algorithm for each separate cluster group that effectively increased the data density using the past user interests. Then, user ratings were predicted based on the model-based approach, such as singular value decomposition (SVD) and the predictions used for the recommendation. The evaluation results showed that our proposed approach has a less prediction error rate with high accuracy after analyzing the existing recommendation methods.

Issues and Challenges in the Extraction and Mapping of Linked Open Data Resources with Recommender Systems Datasets

  • Nawi, Rosmamalmi Mat;Noah, Shahrul Azman Mohd;Zakaria, Lailatul Qadri
    • Journal of Information Science Theory and Practice
    • /
    • v.9 no.2
    • /
    • pp.66-82
    • /
    • 2021
  • Recommender Systems have gained immense popularity due to their capability of dealing with a massive amount of information in various domains. They are considered information filtering systems that make predictions or recommendations to users based on their interests and preferences. The more recent technology, Linked Open Data (LOD), has been introduced, and a vast amount of Resource Description Framework data have been published in freely accessible datasets. These datasets are connected to form the so-called LOD cloud. The need for semantic data representation has been identified as one of the next challenges in Recommender Systems. In a LOD-enabled recommendation framework where domain awareness plays a key role, the semantic information provided in the LOD can be exploited. However, dealing with a big chunk of the data from the LOD cloud and its integration with any domain datasets remains a challenge due to various issues, such as resource constraints and broken links. This paper presents the challenges of interconnecting and extracting the DBpedia data with the MovieLens 1 Million dataset. This study demonstrates how LOD can be a vital yet rich source of content knowledge that helps recommender systems address the issues of data sparsity and insufficient content analysis. Based on the challenges, we proposed a few alternatives and solutions to some of the challenges.