• Title/Summary/Keyword: sparse

Search Result 1,173, Processing Time 0.026 seconds

Feature Extraction via Sparse Difference Embedding (SDE)

  • Wan, Minghua;Lai, Zhihui
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.7
    • /
    • pp.3594-3607
    • /
    • 2017
  • The traditional feature extraction methods such as principal component analysis (PCA) cannot obtain the local structure of the samples, and locally linear embedding (LLE) cannot obtain the global structure of the samples. However, a common drawback of existing PCA and LLE algorithm is that they cannot deal well with the sparse problem of the samples. Therefore, by integrating the globality of PCA and the locality of LLE with a sparse constraint, we developed an improved and unsupervised difference algorithm called Sparse Difference Embedding (SDE), for dimensionality reduction of high-dimensional data in small sample size problems. Significantly differing from the existing PCA and LLE algorithms, SDE seeks to find a set of perfect projections that can not only impact the locality of intraclass and maximize the globality of interclass, but can also simultaneously use the Lasso regression to obtain a sparse transformation matrix. This characteristic makes SDE more intuitive and more powerful than PCA and LLE. At last, the proposed algorithm was estimated through experiments using the Yale and AR face image databases and the USPS handwriting digital databases. The experimental results show that SDE outperforms PCA LLE and UDP attributed to its sparse discriminating characteristics, which also indicates that the SDE is an effective method for face recognition.

Weighted Collaborative Representation and Sparse Difference-Based Hyperspectral Anomaly Detection

  • Wang, Qianghui;Hua, Wenshen;Huang, Fuyu;Zhang, Yan;Yan, Yang
    • Current Optics and Photonics
    • /
    • v.4 no.3
    • /
    • pp.210-220
    • /
    • 2020
  • Aiming at the problem that the Local Sparse Difference Index algorithm has low accuracy and low efficiency when detecting target anomalies in a hyperspectral image, this paper proposes a Weighted Collaborative Representation and Sparse Difference-Based Hyperspectral Anomaly Detection algorithm, to improve detection accuracy for a hyperspectral image. First, the band subspace is divided according to the band correlation coefficient, which avoids the situation in which there are multiple solutions of the sparse coefficient vector caused by too many bands. Then, the appropriate double-window model is selected, and the background dictionary constructed and weighted according to Euclidean distance, which reduces the influence of mixing anomalous components of the background on the solution of the sparse coefficient vector. Finally, the sparse coefficient vector is solved by the collaborative representation method, and the sparse difference index is calculated to complete the anomaly detection. To prove the effectiveness, the proposed algorithm is compared with the RX, LRX, and LSD algorithms in simulating and analyzing two AVIRIS hyperspectral images. The results show that the proposed algorithm has higher accuracy and a lower false-alarm rate, and yields better results.

Constrained Sparse Concept Coding algorithm with application to image representation

  • Shu, Zhenqiu;Zhao, Chunxia;Huang, Pu
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.9
    • /
    • pp.3211-3230
    • /
    • 2014
  • Recently, sparse coding has achieved remarkable success in image representation tasks. In practice, the performance of clustering can be significantly improved if limited label information is incorporated into sparse coding. To this end, in this paper, a novel semi-supervised algorithm, called constrained sparse concept coding (CSCC), is proposed for image representation. CSCC considers limited label information into graph embedding as additional hard constraints, and hence obtains embedding results that are consistent with label information and manifold structure information of the original data. Therefore, CSCC can provide a sparse representation which explicitly utilizes the prior knowledge of the data to improve the discriminative power in clustering. Besides, a kernelized version of our proposed CSCC, namely kernel constrained sparse concept coding (KCSCC), is developed to deal with nonlinear data, which leads to more effective clustering performance. The experimental evaluations on the MNIST, PIE and Yale image sets show the effectiveness of our proposed algorithms.

Sparse decision feedback equalization for underwater acoustic channel based on minimum symbol error rate

  • Wang, Zhenzhong;Chen, Fangjiong;Yu, Hua;Shan, Zhilong
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.13 no.1
    • /
    • pp.617-627
    • /
    • 2021
  • Underwater Acoustic Channels (UAC) have inherent sparse characteristics. The traditional adaptive equalization techniques do not utilize this feature to improve the performance. In this paper we consider the Variable Adaptive Subgradient Projection (V-ASPM) method to derive a new sparse equalization algorithm based on the Minimum Symbol Error Rate (MSER) criterion. Compared with the original MSER algorithm, our proposed scheme adds sparse matrix to the iterative formula, which can assign independent step-sizes to the equalizer taps. How to obtain such proper sparse matrix is also analyzed. On this basis, the selection scheme of the sparse matrix is obtained by combining the variable step-sizes and equalizer sparsity measure. We call the new algorithm Sparse-Control Proportional-MSER (SC-PMSER) equalizer. Finally, the proposed SC-PMSER equalizer is embedded into a turbo receiver, which perform turbo decoding, Digital Phase-Locked Loop (DPLL), time-reversal receiving and multi-reception diversity. Simulation and real-field experimental results show that the proposed algorithm has better performance in convergence speed and Bit Error Rate (BER).

SPLITTING METHOD OF DENSE COLUMNS IN SPARSE LINEAR SYSTEMS AND ITS IMPLEMENTATION

  • Oh, Seyoung;Kwon, Sun Joo
    • Journal of the Chungcheong Mathematical Society
    • /
    • v.10 no.1
    • /
    • pp.147-159
    • /
    • 1997
  • It is important to solve the large sparse linear system appeared in many application field such as $AA^Ty={\beta}$ efficiently. In solving this linear system, the sparse solver using the splitting method for the relatively dense column is experimentally better than the direct solver using the Cholesky method.

  • PDF

Effect of Sparse Decomposition on Various ICA Algorithms With Application to Image Data

  • Khan, Asif;Kim, In-Taek
    • Proceedings of the IEEK Conference
    • /
    • 2008.06a
    • /
    • pp.967-968
    • /
    • 2008
  • In this paper we demonstrate the effect of sparse decomposition on various Independent Component Analysis (ICA) algorithms for separating simultaneous linear mixture of independent 2-D signals (images). We will show using simulated results that sparse decomposition before Kernel ICA (Sparse Kernel ICA) algorithm produces the best results as compared to other ICA algorithms.

  • PDF

A Study on the Optimization Design for Amplification Circuit using Sparse Matrix (Sparse 행렬을 이용한 증폭회로의 최적설계에 관한 연구)

  • 강순덕;마경희
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.5 no.1
    • /
    • pp.60-69
    • /
    • 1980
  • The computerized analysis of complicated circuits requires large memory capacity and considerable length of time. In order to enhance the efficiency of memory capacity and the executing time, Sparse Matrix is applied to the solution of simultaneous equations required for the analysis of amplification circuit. The optimization Subroutine, FMFP is utilized for the decision of optimum element parameters of an equalizer amplifier.

  • PDF

A SPARSE APPROXIMATE INVERSE PRECONDITIONER FOR NONSYMMETRIC POSITIVE DEFINITE MATRICES

  • Salkuyeh, Davod Khojasteh
    • Journal of applied mathematics & informatics
    • /
    • v.28 no.5_6
    • /
    • pp.1131-1141
    • /
    • 2010
  • We develop an algorithm for computing a sparse approximate inverse for a nonsymmetric positive definite matrix based upon the FFAPINV algorithm. The sparse approximate inverse is computed in the factored form and used to work with some Krylov subspace methods. The preconditioner is breakdown free and, when used in conjunction with Krylov-subspace-based iterative solvers such as the GMRES algorithm, results in reliable solvers. Some numerical experiments are given to show the efficiency of the preconditioner.

A Study on the Sparse Channel Estimation Technique in Underwater Acoustic Channel (수중음향채널에서 Sparse 채널 추정 기법에 관한 연구)

  • Gwun, Byung-Chul;Lee, Oi-Hyung;Kim, Ki-Man
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.18 no.5
    • /
    • pp.1061-1066
    • /
    • 2014
  • Transmission characteristics of the sound propagation is very complicate and sparse in shallow water. To increase the performance of underwater acoustic communication system, lots of channel estimation technique has been proposed. In this paper, we proposed the channel estimation based on LMS(Least Mean Square) algorithm which has faster convergence speed than conventional sparse-aware LMS algorithms. The proposed method combines $L_p$-norm LMS with soft decision process. Simulation was performed by using the sound velocity profile which acquired in real sea trial. As a result, we confirmed that the proposed method shows the improved performance and faster convergence speed than conventional methods.

Image Reconstruction of Sinogram Restoration using Inpainting method in Sparse View CT (Sparse view CT에서 inpainting 방법을 이용한 사이노그램 복원의 영상 재구성)

  • Kim, Daehong;Baek, Cheol-Ha
    • Journal of the Korean Society of Radiology
    • /
    • v.11 no.7
    • /
    • pp.655-661
    • /
    • 2017
  • Sparse view CT has been widely used to reduce radiation dose to patient in radiation therapy. In this work, we performed sinogram restoration from sparse sampling data by using inpainting method for simulation and experiment. Sinogram restoration was performed in accordance with sampling angle and restoration method, and their results were validated with root mean square error (RMSE) and image profiles. Simulation and experiment are designed to fan beam scan for various projection angles. Sparse data in sinogram were restored by using linear interpolation and inpainting method. Then, the restored sinogram was reconstructed with filtered backprojection (FBP) algorithm. The results showed that RMSE and image profiles were depended on the projection angles and restoration method. Based on the simulation and experiment, we found that inpainting method could be improved for sinogram restoration in comparison to linear interpolation method for estimating RMSE and image profiles.