• Title/Summary/Keyword: covariance thresholding

Search Result 4, Processing Time 0.017 seconds

Comparison of covariance thresholding methods in gene set analysis

  • Park, Sora;Kim, Kipoong;Sun, Hokeun
    • Communications for Statistical Applications and Methods
    • /
    • v.29 no.5
    • /
    • pp.591-601
    • /
    • 2022
  • In gene set analysis with microarray expression data, a group of genes such as a gene regulatory pathway and a signaling pathway is often tested if there exists either differentially expressed (DE) or differentially co-expressed (DC) genes between two biological conditions. Recently, a statistical test based on covariance estimation have been proposed in order to identify DC genes. In particular, covariance regularization by hard thresholding indeed improved the power of the test when the proportion of DC genes within a biological pathway is relatively small. In this article, we compare covariance thresholding methods using four different regularization penalties such as lasso, hard, smoothly clipped absolute deviation (SCAD), and minimax concave plus (MCP) penalties. In our extensive simulation studies, we found that both SCAD and MCP thresholding methods can outperform the hard thresholding method when the proportion of DC genes is extremely small and the number of genes in a biological pathway is much greater than a sample size. We also applied four thresholding methods to 3 different microarray gene expression data sets related with mutant p53 transcriptional activity, and epithelium and stroma breast cancer to compare genetic pathways identified by each method.

A Comparative Study of Covariance Matrix Estimators in High-Dimensional Data (고차원 데이터에서 공분산행렬의 추정에 대한 비교연구)

  • Lee, DongHyuk;Lee, Jae Won
    • The Korean Journal of Applied Statistics
    • /
    • v.26 no.5
    • /
    • pp.747-758
    • /
    • 2013
  • The covariance matrix is important in multivariate statistical analysis and a sample covariance matrix is used as an estimator of the covariance matrix. High dimensional data has a larger dimension than the sample size; therefore, the sample covariance matrix may not be suitable since it is known to perform poorly and event not invertible. A number of covariance matrix estimators have been recently proposed with three different approaches of shrinkage, thresholding, and modified Cholesky decomposition. We compare the performance of these newly proposed estimators in various situations.

Supercompact Multiwavelets for Three Dimensional Flow Field Simulation (3차원 유동 시뮬레이션을 위한 Supercompact 다중 웨이블릿)

  • Yang, Seung-Cheol;Lee, Do-Hyung
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.33 no.12
    • /
    • pp.18-25
    • /
    • 2005
  • This paper presents a supercompact multi-wavelet scheme and its application to fluid simulation data. The supercompact wavelet method is an appropriate wavelet for fluid simulation data in the sense that it can provide compact support and avoid unnecessary interaction with remotely located data (e.g. across a shock discontinuity or vortices). thresholding for data compression is applied based on a covariance vector structure of multi-wavelets. The extension of this scheme to three dimensions is analyzed. The numerical tests demonstrate that it can allow various analytic advantages as well as large data compression ratios in actual practice.

Nonlinear matching measure for the analysis of on-off type microarray image (온-오프 형태의 DNA 마이크로어레이 영상 분석을 위한 비선형 정합도)

  • Ryu Mun ho;Kim Jong dae
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.3C
    • /
    • pp.112-118
    • /
    • 2005
  • In this paper, we propose a new nonlinear matching measure for automatic analysis of the on-off type DNA microarray images in which the hybridized spots are detected by the template matching method. The proposed measure is obtained by binary-thresholding over the whole template region and taking the number of white pixels inside the spotted area. This measure is compared with the normalized covariance in terms of the classification ability of the successfulness of the locating markers. The proposed measure is evaluated for the scanned images of HPV DNA microarrays where the marker locating is a critical issue because of the small number of spots. The targeting spots of HPV DNA chips are designed for genotyping 22 types of the human papilloma virus(HPV). The proposed measure is proven to give more discriminative response reducing the miss cases of the successful marker locating.