• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.19 no.12
• /
• pp.2418-2425
• /
• 1994

Although the error backpropagation(EBP) algorithm based on the gradient descent method is a widely-used learning algorithm of neural networks, learning sometimes takes a long time to acquire accuracy. This paper develops a novel learning method to alleviate the problems of EBP algorithm such as local minima, slow speed, and size of structure and thus to improve performance by adopting other new networks. Gaussian Potential Function networks(GPFN), in parallel with multilayer neural networks. Empirical simulations show the efficacy of the proposed algorithm in function approximation, which enables us to train networks faster with the better generalization capabilities.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.120-123
• /
• 1997

This paper presents models of fuzzy inference systems that can be built from a set of input-output training data pairs through hybrid structure-parameter learning. Fuzzy inference systems has the difficulty of parameter learning. Here we develop a coding format to determine a fuzzy neural network(FNN) model by chromosome in a genetic algorithm(GA) and present systematic approach to identify the parameters and structure of FNN. The proposed FNN can automatically identify the fuzzy rules and tune the membership functions by modifying the connection weights of the networks using the GA and the back-propagation learning algorithm. In order to show effectiveness of it we simulate and compare with conventional methods.

• Proceedings of the Korea Inteligent Information System Society Conference
• /
• 1999.10a
• /
• pp.323-335
• /
• 1999

In this paper, we propose a new hybrid model of artificial neural networks(ANNs) and genetic algorithm (GA) to optimal feature transformation and feature weighting. Previous research proposed several variants of hybrid ANNs and GA models including feature weighting, feature subset selection and network structure optimization. Among the vast majority of these studies, however, ANNs did not learn the patterns of data well, because they employed GA for simple use. In this study, we incorporate GA in a simultaneous manner to improve the learning and generalization ability of ANNs. In this study, GA plays role to optimize feature weighting and feature transformation simultaneously. Globally optimized feature weighting overcome the well-known limitations of gradient descent algorithm and globally optimized feature transformation also reduce the dimensionality of the feature space and eliminate irrelevant factors in modeling ANNs. By this procedure, we can improve the performance and enhance the generalisability of ANNs.

• 제어로봇시스템학회:학술대회논문집
• /
• 1997.10a
• /
• pp.442-445
• /
• 1997

We present a hybrid self-tuning method of fuzzy inference systems with hyper elliptic Gaussian membership functions using genetic algorithm(GA) and back-propagation algorithm. The proposed self-tuning method has two phases : one is the coarse tuning process based on GA and the other is the fine tuning process based on back-propagation. But the parameters which is obtained by a GA are near optimal solutions. In order to solve the problem in GA applications, it uses a back-propagation algorithm, which is one of learning algorithms in neural networks, to finely tune the parameters obtained by a GA. We provide Box-Jenkins time series to evaluate the advantage and effectiveness of the proposed approach and compare with the conventional method.

• Journal of the Korean Society for Precision Engineering
• /
• v.16 no.11
• /
• pp.158-165
• /
• 1999

It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. To identify the location and depth of a crack in a structure, a method is presented in this paper which uses hybrid neuro-genetic technique. Feed-forward multilayer neural networks trained by back-propagation are used to learn the input)the location and dept of a crack)-output(the structural eigenfrequencies) relation of the structural system. With this neural network and genetic algorithm, it is possible to formulate the inverse problem. Neural network training algorithm is the back propagation algorithm with the momentum method to attain stable convergence in the training process and with the adaptive learning rate method to speed up convergence. Finally, genetic algorithm is used to fine the minimum square error.

• Journal of the Institute of Convergence Signal Processing
• /
• v.14 no.1
• /
• pp.57-61
• /
• 2013

A hybrid genetic algorithm based learning method for the morphological neural networks (MNN) is proposed. The morphological neural networks are based on max-plus algebra, therefore, it is difficult to optimize the coefficients of MNN by the learning method with derivative operations. In order to solve the difficulty, a hybrid genetic algorithm based learning method to optimize the coefficients of MNN is used. Through the image compression/reconstruction experiment using test images extracted from standard image database(SIDBA), it is confirmed that the quality of the reconstructed images obtained by the proposed method is better than that obtained by the conventional neural networks.

• Proceedings of the Korean Operations and Management Science Society Conference
• /
• 1995.04a
• /
• pp.587-599
• /
• 1995

This paper proposes a method for pattern recognition using spectral analysis and a hybrid genetic-neural-fuzzy networks. The feature vectors using spectral analysis on contour sequences of 2-D images are extracted, and the vectors are not effected by translation, rotation and scale variance. A combined model using the advantages of conventional method is proposed, those are supervised learning BP, global searching genetic algorithm, and unsupervised learning fuzzy c-method. The proposed method is applied to 10 aircraft recognition to confirm the performance of the method. The experimental results show that the proposed method is better accuracy than conventional method using BP or fuzzy c-method, and learning speed is enhanced.

• Journal of Information Processing Systems
• /
• v.18 no.1
• /
• pp.146-158
• /
• 2022

With the success of the digital economy and the rapid development of its technology, network security has received increasing attention. Intrusion detection technology has always been a focus and hotspot of research. A hybrid model that combines particle swarm optimization (PSO) and kernel extreme learning machine (KELM) is presented in this work. Continuous-valued PSO and binary PSO (BPSO) are adopted together to determine the parameter combination and the feature subset. A fitness function based on the detection rate and the number of selected features is proposed. The results show that the method can simultaneously determine the parameter values and select features. Furthermore, competitive or better accuracy can be obtained using approximately one quarter of the raw input features. Experiments proved that our method is slightly better than the genetic algorithm-based KELM model.

• Proceedings of the KIEE Conference
• /
• 1997.11a
• /
• pp.600-602
• /
• 1997

In this study, a hybrid neural net consisting of an Adaptive LVQ(ALVQ) algorithm and MLP is proposed to perform speaker identification task. ALVQ is a new learning procedure using adaptively feature vector sequence instead of only one feature vector in training codebooks initialized by LBG algorithm and the optimization criterion of this method is consistent with the speaker classification decision rule. ALVQ aims at providing a compressed, geometrically consistent data representation. It is fit to cover irregular data distributions and computes the distance of the input vector sequence from its nodes. On the other hand, MLP aim at a data representation to fit to discriminate patterns belonging to different classes. It has been shown that MLP nets can approximate Bayesian "optimal" classifiers with high precision, and their output values can be related a-posteriori class probabilities. The different characteristics of these neural models make it possible to devise hybrid neural net systems, consisting of classification modules based on these two different philosophies. The proposed method is compared with LBG algorithm, LVQ algorithm and MLP for performance.

• Journal of the Korean Crystal Growth and Crystal Technology
• /
• v.31 no.6
• /
• pp.258-263
• /
• 2021

ZnO varistor is a semiconductor device which can serve to protect the circuit from surge voltage because its non-linear I-V characteristics by controlling the microstructure of grain and grain boundaries. In order to obtain desired electrical properties, it is important to control microstructure evolution during the sintering process. In this research, we defined a dataset composed of process conditions of sintering and relative permittivity of sintered body, and collected experimental dataset with DOE. Meta-models can predict permittivity were developed by learning the collected experimental dataset on various machine learning algorithms. By utilizing the meta-model, we can derive optimized sintering conditions that could show the maximum permittivity from the numerical-based HMA (Hybrid Metaheuristic Algorithm) optimization algorithm. It is possible to search the optimal process conditions with minimum number of experiments if meta-model-based optimization is applied to ceramic processing.