• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.46 no.2
• /
• pp.78-88
• /
• 2009

In many face recognition problems, the number of available images is limited compared to the dimension of the input space which is usually equal to the number of pixels. This problem is called as the 'small sample size' problem and regularization methods are typically used to solve this problem in feature extraction methods such as LDA. By using regularization methods, the modified within class matrix becomes nonsingu1ar and LDA can be performed in its original form. However, in the process of adding a scaled version of the identity matrix to the original within scatter matrix, the scale factor should be set heuristically and the performance of the recognition system depends on highly the value of the scalar factor. By using the proposed resampling method, we can generate a set of images similar to but slightly different from the original image. With the increased number of images, the small sample size problem is alleviated and the classification performance increases. Unlike regularization method, the resampling method does not suffer from the heuristic setting of the parameter producing better performance.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.10
• /
• pp.75-80
• /
• 2017

In this paper, we describe the effect of the regularization method and the network with identity mapping on the performance of the activation functions in deep convolutional neural networks. The activation functions act as nonlinear transformation. In early convolutional neural networks, a sigmoid function was used. To overcome the problem of the existing activation functions such as gradient vanishing, various activation functions were developed such as ReLU, Leaky ReLU, parametric ReLU, and ELU. To solve the overfitting problem, regularization methods such as dropout and batch normalization were developed on the sidelines of the activation functions. Additionally, data augmentation is usually applied to deep learning to avoid overfitting. The activation functions mentioned above have different characteristics, but the new regularization method and the network with identity mapping were validated only using ReLU. Therefore, we have experimentally shown the effect of the regularization method and the network with identity mapping on the performance of the activation functions. Through this analysis, we have presented the tendency of the performance of activation functions according to regularization and identity mapping. These results will reduce the number of training trials to find the best activation function.

• Communications of the Korean Mathematical Society
• /
• v.12 no.1
• /
• pp.165-176
• /
• 1997

In order to overcome computational ill-posedness which arises when we solve the least square problems, nonlinear smoothing splines are used. The existence and the convergence on nonlinear smoothing spline are shown with numerical experiments.

• The Korean Journal of Applied Statistics
• /
• v.29 no.6
• /
• pp.1117-1128
• /
• 2016

In genetic association studies with high-dimensional genomic data, regularization procedures based on penalized likelihood are often applied to identify genes or genetic regions associated with diseases or traits. A network-based regularization procedure can utilize biological network information (such as genetic pathways and signaling pathways in genetic association studies) with an outstanding selection performance over other regularization procedures such as lasso and elastic-net. However, network-based regularization has a limitation because cannot be applied to high-dimension genomic data with a group structure. In this article, we propose to combine data dimension reduction techniques such as principal component analysis and a partial least square into network-based regularization for the analysis of high-dimensional genomic data with a group structure. The selection performance of the proposed method was evaluated by extensive simulation studies. The proposed method was also applied to real DNA methylation data generated from Illumina Innium HumanMethylation27K BeadChip, where methylation beta values of around 20,000 CpG sites over 12,770 genes were compared between 123 ovarian cancer patients and 152 healthy controls. This analysis was also able to indicate a few cancer-related genes.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.6
• /
• pp.25-32
• /
• 2004

We propose a hierarchical disparity estimation algorithm with edge-preserving energy-based regularization. Initial disparity vectors are obtained from downsampled stereo images using a feature-based region-dividing disparity estimation technique. Dense disparities are estimated from these initial vectors with shape-adaptive windows in full resolution images. Finally, the vector fields are regularized with the minimization of the energy functional which considers both fidelity and smoothness of the fields. The first two steps provide highly reliable disparity vectors, so that local minimum problem can be avoided in regularization step. The proposed algorithm generates accurate disparity map which is smooth inside objects while preserving its discontinuities in boundaries. Experimental results are presented to illustrate the capabilities of the proposed disparity estimation technique.

• Structural Monitoring and Maintenance
• /
• v.3 no.2
• /
• pp.115-127
• /
• 2016

It is a challenging problem of assessing the location and extent of structural damages with vibration measurements. In this paper, an improved Extended Kalman filter (EKF) with Tikhonov regularization is proposed to identify structural damages. The state vector of EKF consists of the initial values of modal coordinates and damage parameters of structural elements, therefore the recursive formulas of EKF are simplified and modal truncation technique can be used to reduce the dimension of the state vector. Then Tikhonov regularization is introduced into EKF to restrain the effect of the measurement noise for improving the solution of ill-posed inverse problems. Numerical simulations of a seven-story shear-beam structure and a simply-supported beam show that the proposed method has good robustness and can identify the single or multiple damages accurately with the unknown initial structural state.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.9
• /
• pp.4658-4679
• /
• 2017

Android is now the most popular smartphone platform and remains rapid growth. There are huge number of sensitive privacy information stored in Android devices. Kinds of methods have been proposed to detect Android malicious applications and protect the privacy information. In this work, we focus on extracting the fine-grained features to maximize the information of Android malware detection, and selecting the least joint features to minimize the number of features. Firstly, permissions and APIs, not only from Android permissions and SDK APIs but also from the developer-defined permissions and third-party library APIs, are extracted as features from the decompiled source codes. Secondly, feature selection methods, including information gain (IG), regularization and particle swarm optimization (PSO) algorithms, are used to analyze and utilize the correlation between the features to eliminate the redundant data, reduce the feature dimension and mine the useful joint features. Furthermore, regularization and PSO are integrated to create a new joint feature mining method. Experiment results show that the joint feature mining method can utilize the advantages of regularization and PSO, and ensure good performance and efficiency for Android malware detection.

• Journal of the Society of Naval Architects of Korea
• /
• v.36 no.4
• /
• pp.48-55
• /
• 1999

In this paper, the ill-posed inverse problem of surface waves caused by a two-dimensional pulsating pressure distribution on the free surface is studied using the regularization method. In order to exemplify the method, a cosine pressure distribution on a limited range of the undisturbed free surface is considered. By taking the resulting horizontal velocity as input data, the corresponding pressure is determined numerically by three different regularization schemes. It is found that the iterated Tikhonov method provides with the most accurate result, while solutions obtained from the Landweber-Friedman regularization are most stable.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.11 no.3
• /
• pp.965-970
• /
• 2010

In this paper, a iterative image restoration method is proposed to restore for noisy-blurred images. In conventional method, regularization is usually applied to all over the without considering the local characteristics of image. As a result, ringing artifacts appear in edge regions and the noise amplification is introduced in flat regions. To solvethis problem we proposed an adaptive regularization iterative restoration using directional regularization operator considering edges in four directions and the regularization operator with no direction for flat regions. We verified that the proposed methods showed better results in the suppression of the noise amplification in flat regions, and introduced less ringing artifacts in edge regions. As a result it showed visually better image and improved better ISNR further than the conventional methods.

• Structural Engineering and Mechanics
• /
• v.82 no.6
• /
• pp.771-783
• /
• 2022

Structural damage identification (SDI) methods have been proposed to monitor the safety of structures. However, the traditional SDI methods using modal parameters, such as natural frequencies and mode shapes, are not sensitive enough to structural damage. To tackle this problem, this paper proposes a new SDI method based on transmissibility assurance criterion (TAC) and weighted Schatten-p norm regularization. Firstly, the transmissibility function (TF) has been proved a useful damage index, which can effectively detect structural damage under unknown excitations. Inspired by the modal assurance criterion (MAC), TF and MAC are combined to construct a new damage index, so called as TAC, which is introduced into the objective function together with modal parameters. In addition, the weighted Schatten-p norm regularization method is adopted to improve the ill-posedness of the SDI inverse problem. To evaluate the effectiveness of the proposed method, some numerical simulations and experimental studies in laboratory are carried out. The results show that the proposed method has a high SDI accuracy, especially for weak damages of structures, it can precisely achieve damage locations and quantifications with a good robustness.