• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2006.11a
• /
• pp.175-178
• /
• 2006

본 논문에서는 주요성분분석과 상호정보 추정을 조합한 입력변수선택 기법을 제안하였다. 여기서 주요성분분석은 2차원 통계성을 이용하여 입력변수 간의 독립성을 찾기 위함이고, 상호정보의 추정은 적응적 분할을 이용하여 입력변수의 확률밀도함수를 계산함으로써 변수상호간의 종속성을 좀더 정확하게 측정하기 위함이다. 제안된 기법을 인위적으로 제시된 각 500개의 샘플을 가지는 6개의 독립신호와 1개의 종속신호를 대상으로 실험한 결과, 빠르고 정확한 변수의 선택이 이루어짐을 확인하였다.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.4
• /
• pp.511-518
• /
• 2007

This paper presents an efficient face recognition method by using both centroid shift and mutual information estimation of images. The centroid shift is to move an image to center coordinate calculated by first moment, which is applied to improve the recognition performance by excluding the needless backgrounds in face image. The mutual information which is a measurements of correlations, is applied to efficiently measure the similarity between images. Adaptive partition mutual information(AP-MI) estimation is especially applied to find an accurate dependence information by equally partitioning the samples of input image for calculating the probability density function(PDF). The proposed method has been applied to the problem for recognizing the 48 face images(12 persons * 4 scenes) of 64*64 pixels. The experimental results show that the proposed method has a superior recognition performances(speed, rate) than a conventional method without centroid shift. The proposed method has also robust performance to changes of facial expression, position, and angle, etc. respectively.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.2
• /
• pp.220-225
• /
• 2007

This paper presents an efficient input variable selection method using both principal component analysis(PCA) and adaptive partition mutual information(AP-MI) estimation. PCA which is based on 2nd order statistics, is applied to prevent a overestimation by quickly removing the dependence between input variables. AP-MI estimation is also applied to estimate an accurate dependence information by equally partitioning the samples of input variable for calculating the probability density function. The proposed method has been applied to 2 problems for selecting the input variables, which are the 7 artificial signals of 500 samples and the 24 environmental pollution signals of 55 samples, respectively. The experimental results show that the proposed methods has a fast and accurate selection performance. The proposed method has also respectively better performance than AP-MI estimation without the PCA and regular partition MI estimation.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2006.11a
• /
• pp.605-608
• /
• 2006

본 논문에서는 고정점 알고리즘의 독립성분분석과 상호정보 추정을 조합한 입력변수선택 기법을 제안하였다. 여기서 뉴우턴법에 기반을 둔 빠른 분석성능을 가지는 고정점 알고리즘의 독립성분분석은 입력변수 간의 독립성을 빠르게 찾기 위함이고, 입력변수의 확률밀도함수의 계산을 위해 적응적 분할을 이용한 상호정보의 추정은 변수상호간 종속성을 좀 더 정확하게 정량화하기 위함이다. 제안된 기법을 인위적으로 제시된 각 500개의 샘플을 가지는 6개의 독립신호와 1개의 종속신호를 대상으로 실험한 결과 빠르고 정확한 변수의 선택이 이루어짐을 확인하였다.

• Journal of the Korea Computer Graphics Society
• /
• v.7 no.1
• /
• pp.37-49
• /
• 2001

We propose an optimization of mutual information for multiresolution image registration to represent useful information as integrated form obtaining from complementary information of multi modality images. The method applies mutual information as cost function to measure the statistical dependency or information redundancy between the image intensities of corresponding pixels in both images, which is assumed to be maximal if the images are geometrically aligned. As experimental results we validate visual inspection for accuracy, changning initial condition and addictive noise for robustness. Since our method uses the native image rather than prior feature extraction, few user interaction is required to perform the registration. In addition it leads to robust density estimation and convergence as applying non-parametric density estimation and stochastic multiresolution optimization.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.16 no.5
• /
• pp.525-530
• /
• 2006

This paper presents an efficient input variable selection method using both fixed-point independent component analysis(FP-ICA) and adaptive partition mutual information(AP-MI) estimation. FP-ICA which is based on secant method, is applied to quickly find the independence between input variables. AP-MI estimation is also applied to estimate an accurate dependence information by equally partitioning the samples of input variable for calculating the probability density function(PDF). The proposed method has been applied to 2 problems for selecting the input variables, which are the 7 artificial signals of 500 samples and the 24 environmental pollution signals of 55 samples, respectively The experimental results show that the proposed methods has a fast and accurate selection performance. The proposed method has also respectively better performance than AP-MI estimation without the FP-ICA and regular partition MI estimation.

• Journal of the Korean Data and Information Science Society
• /
• v.25 no.5
• /
• pp.1079-1094
• /
• 2014

In this paper, we study efficient gene selection methods by using conditional mutual information. We suggest gene selection methods using conditional mutual information based on semiparametric methods utilizing multivariate normal distribution and Edgeworth approximation. We compare our suggested methods with other methods such as mutual information filter, SVM-RFE, Cai et al. (2009)'s gene selection (MIGS-original) in SVM classification. By these experiments, we show that gene selection methods using conditional mutual information based on semiparametric methods have better performance than mutual information filter. Furthermore, we show that they take far less computing time than Cai et al. (2009)'s gene selection but have similar performance.

• Journal of Satellite, Information and Communications
• /
• v.8 no.4
• /
• pp.37-42
• /
• 2013

In this paper, we propose a compensation method of a non-ideal antenna array and a computationally efficient estimation method of the direction of arrival (DOA) for the antenna array. For DOA estimation, an antenna array is essential. By using the phase difference between the output signals of antennas, we can derive the DOA. In practice, however, mutual coupling between the elements of an antenna array change the beam pattern of each element and degrade the performance of DOA estimation. In the proposed method, we first estimate the DOA for the mid-subarray of the array, where all elements undergo relatively same coupling effect. We use the estimation of signal parameters via rotational invariance techniques (ESPRIT) algorithm to estimate the DOA. Then, we expand the array based on the estimated DOA by compensating the coupling effect. Simulation results show that the proposed method is effective when jamming to noise power ratio (JNR)is relative low.

• Communications for Statistical Applications and Methods
• /
• v.15 no.6
• /
• pp.977-991
• /
• 2008

This study is about the k-nearest neighbor-based approach for the estimation of mutual information when the type of target variable is categorical and continuous. The results of Monte-Carlo simulation and experiments with real-world data show that k=1 is preferable. In practical application with real world data, our study shows that jittering and bootstrapping is needed.

• The Korean Journal of Applied Statistics
• /
• v.21 no.2
• /
• pp.301-312
• /
• 2008

Mutual information is a measure of association of explanatory variable for predicting target variable. It is used for variable ranking and variable subset selection. This study is about the Sample-spacing approach which can be used for the estimation of mutual information from data consisting of continuous explanation variables and categorical target variable without estimating a joint probability density function. The results of Monte-Carlo simulation and experiments with real-world data show that m = 1 is preferable in using Sample-spacing.