• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.6
• /
• pp.735-740
• /
• 2012

In this paper, we introduce design methodologies of polynomial radial basis function neural network classifier with the aid of Principal Component Analysis(PCA) and Linear Discriminant Analysis(LDA). By minimizing the information loss of given data, Feature data is obtained through preprocessing of PCA and LDA and then this data is used as input data of RBFNNs. The hidden layer of RBFNNs is built up by Fuzzy C-Mean(FCM) clustering algorithm instead of receptive fields and linear polynomial function is used as connection weights between hidden and output layer. In order to design optimized classifier, the structural and parametric values such as the number of eigenvectors of PCA and LDA, and fuzzification coefficient of FCM algorithm are optimized by Artificial Bee Colony(ABC) optimization algorithm. The proposed classifier is applied to some machine learning datasets and its result is compared with some other classifiers.

• Communications for Statistical Applications and Methods
• /
• v.28 no.1
• /
• pp.21-37
• /
• 2021

There is a direct connection between linear discriminant analysis (LDA) and linear regression since the direction vector of the LDA can be obtained by the least square estimation. The connection motivates the penalized LDA when the model is high-dimensional where the number of predictive variables is larger than the sample size. In this paper, we study the penalized LDA for a class of penalties, called the moderately clipped LASSO (MCL), which interpolates between the least absolute shrinkage and selection operator (LASSO) and minimax concave penalty. We prove that the MCL penalized LDA correctly identifies the sparsity of the Bayes direction vector with probability tending to one, which is supported by better finite sample performance than LASSO based on concrete numerical studies.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.7
• /
• pp.3194-3216
• /
• 2018

Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

• Journal of Korea Multimedia Society
• /
• v.16 no.11
• /
• pp.1338-1347
• /
• 2013

Face recognition is a science of automatically identifying individuals based their unique facial features. In order to avoid overfitting and reduce the computational reduce the computational burden, a new face recognition algorithm using PCA-fisher linear discriminant (PCA-FLD) and fuzzy radial basis function neural network (RBFNN) is proposed in this paper. First, face features are extracted by the principal component analysis (PCA) method. Then, the extracted features are further processed by the Fisher's linear discriminant technique to acquire lower-dimensional discriminant patterns, the processed features will be considered as the input of the fuzzy RBFNN. As a widely applied algorithm in fuzzy RBF neural network, BP learning algorithm has the low rate of convergence, therefore, an improved learning algorithm based on Levenberg-Marquart (L-M) for fuzzy RBF neural network is introduced in this paper, which combined the Gradient Descent algorithm with the Gauss-Newton algorithm. Experimental results on the ORL face database demonstrate that the proposed algorithm has satisfactory performance and high recognition rate.

• Women's Health Nursing
• /
• v.4 no.1
• /
• pp.123-138
• /
• 1998

The purpose of this study was to describe perimenstrual symptom severity levels and perimenstrual distress patterns of women. The study performed the discriminant analysis in which included seven factors : age, pariety, social support, menstrual socialization(mother's symptom, sister's symptom, and menstrual effect), attitude of sex role and depression. The subjects were 283 women that they were not pregnant or lactating, had at least one period in past three months, would understand the purpose of study and willingly accepted the participation. The data analysis was done by pc-SAS program after data collection from Nov. 20, 1997 to Dec. 18, 1997. The descriptive analysis was done to explore general characteristics of the subjects and the stepwise discriminant analysis was done to verify factors in relation to perimenstrual symptom severity levels(severe vs mild menstrual symptom group) and perimenstrual distress patterns(spasmodic vs congestive menstrual symptom group). The instruments were selected for this study from Interpersonal Support Evaluation List(ISEL) by Cohen and Hoberman(1983), Center for Epidemic Studies Depression(CES-D) by Radloff(1977), and Sex Role Attitude Scale by Yunok Suh(1995), Mother's symptom and sister's symptom measurements by Woods, Mitchell & Lentz(1995), and menstrual effect by Brooks-Gun & Ruble(1980). The major findings of this study are as follows : 1. Of the 283 women, 93 women(32.9%) were assessed to severe perimenstrual symptom group and 190 women(67.1%) were assessed to mild perimenstrual symptom group. Results from the stepwise discriminant analysis showed three factors, such as depression, menstrual effect, and age, significantly related to perimenstrual symptom severity and they explained 20% of the total variance. The linear discriminant equation included three factors related to perimenstrual symptom groups was showed(Z=1.445 depression+0.174 menstrual effect-0.054 age). The cutting score(Z) was 2.809. We classified the severe perimenstrual symptom group by more than the cutting score 2.809 and the mild perimenstrual symptom by less or equal than the cutting score 2.809. The correctedness of posterior probability from discriminant equation was 72% as two perimenstrual symptom group classifications. 2. Of the 264 women, 139 women(52.7%) were assessed to spasmodic perimenstrual distress group and women(47.3%) were assessed to congestive perimenstrual distress group. Results from the stepwise discriminant analysis showed two factors, such as depression, age, significantly related to perimenstrual distress groups and they explained 8% of the total variance. The linear discriminant equation included two factors related to perimenstrual distress group was showed(Z=-0.084 age-0.776 depression). The cutting score(Z) was -3.759. We classified the spasmodic perimenstrual distress group by more than cutting score -3.759 and the congestive perimenstrual distress group by less or equal than cutting score -3.759. The correctedness of posterior probability from discriminant equation was 65% as two perimenstrual distress group classifications.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.3
• /
• pp.1243-1263
• /
• 2018

The two-stage linear discrimination analysis (TSLDA) is a feature extraction technique to solve the small size sample problem in the field of image recognition. The TSLDA has retained all subspace information of the between-class scatter and within-class scatter. However, the feature information in the four subspaces may not be entirely beneficial for classification, and the regularization procedure for eliminating singular metrics in TSLDA has higher time complexity. In order to address these drawbacks, this paper proposes an improved two-stage linear discriminant analysis (Improved TSLDA). The Improved TSLDA proposes a selection and compression method to extract superior feature information from the four subspaces to constitute optimal projection space, where it defines a single Fisher criterion to measure the importance of single feature vector. Meanwhile, Improved TSLDA also applies an approximation matrix method to eliminate the singular matrices and reduce its time complexity. This paper presents comparative experiments on five face databases and one handwritten digit database to validate the effectiveness of the Improved TSLDA.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.2
• /
• pp.252-258
• /
• 2007

In this paper, a face recognition algorithm system using Principal Component Analysis (PCA) is proposed. The algorithm recognized a person by comparing characteristics (features) of the face to those of known individuals of Intelligent Control Laboratory (ICONL) face database. Simulations are carried out to investigate the algorithm recognition performance, which classified the face as a face or non-face and then classified it as known or unknown one. Particularly, a Principal Components of Linear Discriminant Analysis (PCA + LDA) face recognition algorithm is also proposed in order to confirm the recognition performances and the adaptability of a proposed PCA for a certain specific system.

• Bulletin of the Korean Chemical Society
• /
• v.9 no.4
• /
• pp.223-231
• /
• 1988

Some pattern recognition methods have been used to characterize Korean ancient porcelainsherds using their elemental composition as analyzed by instrumental neutron activation analysis. A combination of analytical data by means of statistical linear discriminant analysis(SLDA) has resulted in removal of redundant variables, optimal linear combination of meaningful variables and formulation of classification rules. The plot in the first-to-second discriminant scores has shown that the three distinct territorial regions exist among porcelainsherds of Kyungki, Chunbuk-Chungnam, and Chunnam, with respective efficiencies of 20/30, 22/27 and 14/15. Similar regions have been found to exist among punchong porcelain and ceradonsherds of Kyungki, Chungnam and Chunbuk, with respective efficiencies of 7/9, 15/16 and 6/6. Classification has been further attempted by statistical isolinear multiple component analysis(SIMCA), using the sample set selected appropriately through SLDA as training set. For this purpose, all analytical data have been used. An agreement has generally been found between two methods, i.e., SLDA and SIMCA.

• Smart Media Journal
• /
• v.7 no.4
• /
• pp.90-98
• /
• 2018

A Multilinear LDA Method of Tensor Representation for ECG Signal Based Individual Identification Electrocardiogram signals, included in the cardiac electrical activity, are often analyzed and used for various purposes such as heart rate measurement, heartbeat rhythm test, heart abnormality diagnosis, emotion recognition and biometrics. The objective of this paper is to perform individual identification operation based on Multilinear Linear Discriminant Analysis (MLDA) with the tensor feature. The MLDA can solve dimensional aspects of classification problems in high-dimensional tensor, and correlated subspaces can be used to distinguish between different classes. In order to evaluate the performance, we used MPhysionet's MIT-BIH database. The experimental results on this database showed that the individual identification by MLDA outperformed that by PCA and LDA.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.20 no.2
• /
• pp.18-26
• /
• 1992

The purpose of this study is to suggest a method for identifying target markets of potential urban park users by their sociodemographic variables. Data was classified into(ⅰ) users vs. nonusers ; (ⅱ) of chosen three urban parks ; or(ⅲ) users of each urban park then analyzed by discriminant analysis. The results showed that linear combination of selected sociodemographic variables could be used for identifying target markets in some cases. In general, season and sex were the most powerful discriminant variables. But the other cases were not satisfactory. The weak points of this study due to adapting secondary data for analysis were discussed.