• 제어로봇시스템학회논문지
• /
• 제17권8호
• /
• pp.731-738
• /
• 2011

In this paper, we introduce an advanced architecture of K-Means clustering-based polynomial Radial Basis Function Neural Networks (p-RBFNNs) designed with the aid of SSOA (Space Search Optimization Algorithm) and develop a comprehensive design methodology supporting their construction. In order to design the optimized p-RBFNNs, a center value of each receptive field is determined by running the K-Means clustering algorithm and then the center value and the width of the corresponding receptive field are optimized through SSOA. The connections (weights) of the proposed p-RBFNNs are of functional character and are realized by considering three types of polynomials. In addition, a WLSE (Weighted Least Square Estimation) is used to estimate the coefficients of polynomials (serving as functional connections of the network) of each node from output node. Therefore, a local learning capability and an interpretability of the proposed model are improved. The proposed model is illustrated with the use of nonlinear function, NOx called Machine Learning dataset. A comparative analysis reveals that the proposed model exhibits higher accuracy and superb predictive capability in comparison to some previous models available in the literature.

• 전기학회논문지
• /
• 제61권5호
• /
• pp.744-752
• /
• 2012

In this study, the Polynomial-based Radial Basis Function Neural Networks is proposed as an one of the recognition part of overall face recognition system that consists of two parts such as the preprocessing part and recognition part. The design methodology and procedure of the proposed pRBFNNs are presented to obtain the solution to high-dimensional pattern recognition problems. In data preprocessing part, Principal Component Analysis(PCA) which is generally used in face recognition, which is useful to express some classes using reduction, since it is effective to maintain the rate of recognition and to reduce the amount of data at the same time. However, because of there of the whole face image, it can not guarantee the detection rate about the change of viewpoint and whole image. Thus, to compensate for the defects, Linear Discriminant Analysis(LDA) is used to enhance the separation of different classes. In this paper, we combine the PCA&LDA algorithm and design the optimized pRBFNNs for recognition module. The proposed pRBFNNs architecture consists of three functional modules such as the condition part, the conclusion part, and the inference part as fuzzy rules formed in 'If-then' format. In the condition part of fuzzy rules, input space is partitioned with Fuzzy C-Means clustering. In the conclusion part of rules, the connection weight of pRBFNNs is represented as two kinds of polynomials such as constant, and linear. The coefficients of connection weight identified with back-propagation using gradient descent method. The output of the pRBFNNs model is obtained by fuzzy inference method in the inference part of fuzzy rules. The essential design parameters (including learning rate, momentum coefficient and fuzzification coefficient) of the networks are optimized by means of Differential Evolution. The proposed pRBFNNs are applied to face image(ex Yale, AT&T) datasets and then demonstrated from the viewpoint of the output performance and recognition rate.

• 전기학회논문지
• /
• 제62권4호
• /
• pp.544-553
• /
• 2013

In this paper, we propose the pattern classifier of Radial Basis Function Neural Networks(RBFNNs) for diagnosis of 3-phase partial discharge. Conventional methods map the partial discharge/noise data on 3-PARD map, and decide whether the partial discharge occurs or not from 3-phase or neutral point. However, it is decided based on his own subjective knowledge of skilled experter. In order to solve these problems, the mapping of data as well as the classification of phases are considered by using the general 3-PARD map and PA method, and the identification of phases occurring partial discharge/noise discharge is done. In the sequel, the type of partial discharge occurring on arbitrary random phase is classified and identified by fuzzy clustering-based polynomial Radial Basis Function Neural Networks(RBFNN) classifier. And by identifying the learning rate, momentum coefficient, and fuzzification coefficient of FCM fuzzy clustering with the aid of PSO algorithm, the RBFNN classifier is optimized. The virtual simulated data and the experimental data acquired from practical field are used for performance estimation of 3-phase partial discharge pattern classifier.

• 제어로봇시스템학회논문지
• /
• 제16권12호
• /
• pp.1150-1158
• /
• 2010

In this study, the Polynomial-based Radial Basis Function Neural Networks is proposed as one of the recognition part of overall face recognition system that consists of two parts such as the preprocessing part and recognition part. The design methodology and procedure of the proposed pRBFNNs are presented to obtain the solution to high-dimensional pattern recognition problem. First, in preprocessing part, we use a CCD camera to obtain a picture frame in real-time. By using histogram equalization method, we can partially enhance the distorted image influenced by natural as well as artificial illumination. We use an AdaBoost algorithm proposed by Viola and Jones, which is exploited for the detection of facial image area between face and non-facial image area. As the feature extraction algorithm, PCA method is used. In this study, the PCA method, which is a feature extraction algorithm, is used to carry out the dimension reduction of facial image area formed by high-dimensional information. Secondly, we use pRBFNNs to identify the ID by recognizing unique pattern of each person. The proposed pRBFNNs architecture consists of three functional modules such as the condition part, the conclusion part, and the inference part as fuzzy rules formed in 'If-then' format. In the condition part of fuzzy rules, input space is partitioned with Fuzzy C-Means clustering. In the conclusion part of rules, the connection weight of pRBFNNs is represented as three kinds of polynomials such as constant, linear, and quadratic. Coefficients of connection weight identified with back-propagation using gradient descent method. The output of pRBFNNs model is obtained by fuzzy inference method in the inference part of fuzzy rules. The essential design parameters (including learning rate, momentum coefficient and fuzzification coefficient) of the networks are optimized by means of the Particle Swarm Optimization. The proposed pRBFNNs are applied to real-time face recognition system and then demonstrated from the viewpoint of output performance and recognition rate.

• 전자공학회논문지
• /
• 제50권1호
• /
• pp.225-231
• /
• 2013

본 연구에서는 PCA알고리즘을 이용한 최적 pRBFNNs 기반 나이트비전 얼굴인식 시스템을 설계 하고자 한다. 조명이 없는 주위 상태 하에서 조도가 낮기 때문에 CCD 카메라를 이용하여 영상을 획득하는 것이 어렵다. 본 논문에서는 낮은 조도에 의해 왜곡된 이미지의 품질을 나이트 비전 카메라와 히스토그램 평활화를 사용하여 향상시킨다. 그리고 얼굴과 비얼굴 이미지 영역 사이에서 얼굴 이미지를 검출하기 위하여 Ada-Boost 알고리즘을 사용한다. 추출된 고차원 특징 데이터를 저차원의 특징 데이터로 변환하기 위하여 데이터 차원축소 기법인 주성분 분석법(Principal Components Analysis; PCA)을 사용한다. 또한 인식 모듈로서 pRBFNNs(Polynomial- based Radial Basis Function Neural Networks) 패턴분류기를 소개한다. 제안된 다항식 기반 RBFNNs은 조건부, 결론부, 추론부 세 가지의 기능적 모듈로 구성되어 있다. 조건부는 FCM (Fuzzy C-means) 클러스터링을 사용하여 입력공간을 분할하고, 결론부는 분할된 로컬 영역을 다항식 함수로 표현한다. 그리고 차분진화 (Differential Evolution; DE) 알고리즘을 사용하여 모델의 파라미터를 최적화 한다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2011년도 제42회 하계학술대회
• /
• pp.1960-1961
• /
• 2011

얼굴 인식에서 가장 많이 사용되고 있는 PCA(Principal Component Analysis)는 고차원의 얼굴 데이터를 낮은 차원으로 표현할 수 있다는 장점이 있다. LDA(Linear Discriminant Analysis)는 서로 다른 데이터를 잘 분리할 수 있으며, 얼굴 인식에서 우수한 성능을 보인다. 본 연구에서는 서로의 장점을 결합하여 PCA와 LDA를 혼합, 적용하였다. 고차원의 얼굴데이터를 PCA로 차원 축소한 후 LDA를 이용해 더욱 효과적인 분류가 되어 얼굴 인식률을 향상시킨다. 인식 모듈로는 pRBFNN(Polynomial Based Radial Basis Function Neural Networks) 모델을 구축하여 고차원 패턴인식 문제에 대한 해결책을 제시하고자 한다. 그리고 제안된 패턴분류기는 얼굴 데이터를 사용하여 성능을 확인한다.

• 전기학회논문지
• /
• 제62권4호
• /
• pp.554-561
• /
• 2013

In this paper, we introduce a modeling and a process simulator developed with the aid of pRBFNNs for activated sludge process in the sewage treatment system. Activated sludge process(ASP) of sewage treatment system facilities is a process that handles biological treatment reaction and is a very complex system with non-linear characteristics. In this paper, we carry out modeling by using essential ASP factors such as water effluent quality, the manipulated value of various pumps, and water inflow quality, and so on. Intelligent algorithms used for constructing process simulator are developed by considering multi-output polynomial radial basis function Neural Networks(pRBFNNs) as well as Fuzzy C-Means clustering and Particle Swarm Optimization. Here, the apexes of the antecedent gaussian functions of fuzzy rules are decided by C-means clustering algorithm and the apexes of the consequent part of fuzzy rules are learned by using back-propagation based on gradient decent method. Also, the parameters related to the fuzzy model are optimized by means of particle swarm optimization. The coefficients of the consequent polynomial of fuzzy rules and performance index are considered by the Least Square Estimation and Mean Squared Error. The descriptions of developed process simulator architecture and ensuing operation method are handled.

• 한국지능시스템학회논문지
• /
• 제22권6호
• /
• pp.748-753
• /
• 2012

본 논문에서는 최적 pRBFNNs 패턴분류기 기반 3차원 스캐너를 이용한 얼굴인식 알고리즘을 설계한다. 일반적으로 2차원 영상을 이용한 얼굴인식 시스템은 사진의 명암도를 이용하여 얼굴의 특징을 추출하게 된다. 그렇기 때문에 빛이나 조명, 또는 얼굴 포즈와 같은 환경 변화들은 시스템의 성능을 저하시킨다. 따라서 본 논문에서 제안된 얼굴인식 알고리즘은 2차원 얼굴인식 시스템의 한계를 극복하기 위하여 3차원 스캐너를 사용하여 설계한다. 먼저 3차원 스캐너를 이용하여 얼굴 형상을 스캔하고 스캔된 얼굴 형상은 포즈 보상 과정을 통하여 정면으로 변환된다. 그 후에 Point Signature 기법을 사용하여 얼굴의 깊이 정보를 추출하고 마지막으로 고차원 패턴인식 문제에 대한 해결을 위하여 최적화된 pRBFNNs (Polynomial-based Radial Basis Function Neural Networks) 모델을 사용하여 인식성능을 확인한다.

• 전자공학회논문지
• /
• 제51권1호
• /
• pp.195-201
• /
• 2014

본 연구에서는 $(2D)^2PCA$ 알고리즘을 이용한 pRBFNNs 패턴분류기 기반 얼굴인식 시스템을 설계하였다. 기존의 1차원 PCA는 행과 열의 곱으로 표현한 이미지의 차원을 축소한다. 하지만 $(2D)^2PCA$(2-Directional 2-Dimensional Principal Components Analysis)는 이미지의 행과 열에서 각각 차원축소를 수행한다. 그 다음 제안된 지능형 패턴분류기로 축소된 이미지를 사용하여 성능을 평가한다. (pRBFNNs)로 성능 평가를 한다. 제안된 다항식 기반 RBFNNs은 조건부, 결론부, 추론부 세가지의 기능적 모듈로 구성되어 있고 조건는 퍼지 클러스터링을 사용하여 입력 공간을 분할하고, 결론부는 RBFNNs의 연결가중치로 일차 선형식으로 표현한다. 또한 차분진화 알고리즘을 이용하여 제안된 분류기의 파라미터, 즉 입력의 수, 퍼지 클러스터링의 퍼지화 계수를 최적화 한다. 얼굴인식에 많이 사용되는 Yale과 AT&T를 사용하여 인식률을 평가하였다. 실험 평가를 위해 IC&CI 연구실 데이터를 추가하여 실험하였다.

• 전기학회논문지
• /
• 제66권2호
• /
• pp.416-424
• /
• 2017

In this study, we propose a design of digits recognition system based on RBFNNs through a comparative study of pre-processing algorithms in order to recognize digits in handwritten. Histogram of Oriented Gradient(HOG) is used to get the features of digits in the proposed digits recognition system. In the pre-processing part, a dimensional reduction is executed by using Principal Component Analysis(PCA) and (2D)2PCA which are widely adopted methods in order to minimize a loss of the information during the reduction process of feature space. Also, The architecture of radial basis function neural networks consists of three functional modules such as condition, conclusion, and inference part. In the condition part, the input space is partitioned with the use of fuzzy clustering realized by means of the Fuzzy C-Means algorithm. Also, it is used instead of gaussian function to consider the characteristic of input data. In the conclusion part, the connection weights are used as the extended type of polynomial expression such as constant, linear, quadratic and modified quadratic. By using MNIST handwritten digit benchmarking database, experimental results show the effectiveness and efficiency of proposed digit recognition system when compared with other studies.