• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• 제22권1호
• /
• pp.1-13
• /
• 2018

Boosting, one of the most successful algorithms for supervised learning, searches the most accurate weighted sum of weak classifiers. The search corresponds to a convex programming with non-negativity and affine constraint. In this article, we propose a novel Conjugate Gradient algorithm with the Modified Polak-Ribiera-Polyak conjugate direction. The convergence of the algorithm is proved and we report its successful applications to boosting.

• 한국IT서비스학회지
• /
• 제15권4호
• /
• pp.85-95
• /
• 2016

Recently, deep learning and machine learning have attracted considerable attention and many supporting frameworks appeared. In artificial intelligence field, a large body of research is underway to apply the relevant knowledge for complex problem-solving, necessitating the application of various learning algorithms and training methods to artificial intelligence systems. In addition, there is a dearth of performance evaluation of decision making agents. The decision making agent that can find optimal solutions by using reinforcement learning methods designed through this research can collect raw pixel data observed from dynamic environments and make decisions by itself based on the data. The decision making agent uses convolutional neural networks to classify situations it confronts, and the data observed from the environment undergoes preprocessing before being used. This research represents how the convolutional neural networks and the decision making agent are configured, analyzes learning performance through a value-based algorithm and a policy-based algorithm : a Deep Q-Networks and a Policy Gradient, sets forth their differences and demonstrates how the convolutional neural networks affect entire learning performance when using pixel data. This research is expected to contribute to the improvement of artificial intelligence systems which can efficiently find optimal solutions by using features extracted from raw pixel data.

• 한국음향학회:학술대회논문집
• /
• 한국음향학회 1991년도 학술발표회 논문집
• /
• pp.38-41
• /
• 1991

RLS algorithms are required for applications to adaptive line enhancers, adaptive equalizers for voiceband telephone and HF modems, and wide-badn digital spectrum mobile raio in which their convergence time and tracking speed are significant. The fast QR RLS algorithm satisfies above the requirements. Its computational complexity is linearly proportional to the tap number of a filter, N and its performance remains numerically stable. From the result of simumulation, the fast QR RLS algorithm represented Cioffi is better than gradient based algorithm in its initial performance when being applied to an adaptive line enhancer for cancelling noise.

• Journal of Mechanical Science and Technology
• /
• 제16권8호
• /
• pp.1033-1038
• /
• 2002

Genetic alsorithm (GA) , compared to the gradient-based optimization, has advantages of convergence to a global optimized solution. The genetic algorithm requires so many number of analyses that may cause high computational cost for genetic search. This paper proposes a personal computer network programming based on TCP/IP protocol and client-server model using socket, to improve processing speed of the genetic algorithm for optimization of composite laminated structures. By distributed processing for the generated population, improvement in processing speed has been obtained. Consequently, usage of network-based genetic algorithm with the faster network communication speed will be a very valuable tool for the discrete optimization of large scale and complex structures requiring high computational cost.

• Journal of the Optical Society of Korea
• /
• 제19권1호
• /
• pp.45-54
• /
• 2015

In this study, a novel parallel wavefront correction system architecture is proposed, and a model-based tabu search (MBTS) algorithm is introduced for this new system to compensate wavefront aberration caused by atmospheric turbulence in a free-space optical (FSO) communication system. The algorithm flowchart is presented, and a simple hypothetical design for the parallel correction system with multiple adaptive optical (AO) subsystems is given. The simulated performance of MBTS for an AO-FSO system is analyzed. The results indicate that the proposed algorithm offers better performance in wavefront aberration compensation, coupling efficiency, and convergence speed than a stochastic parallel gradient descent (SPGD) algorithm.

• 전력전자학회:학술대회논문집
• /
• 전력전자학회 1999년도 전력전자학술대회 논문집
• /
• pp.526-530
• /
• 1999

This paper presents a newly developed speed sensorless drive using Neural Network algorithm. Neural Network algorithm can be divided into three categories. In the first one, a Back Propagation-based NN algorithm is well-known to gradient descent method. In the second scheme, a Extended Kalman Filter-based NN algorithm has just the time varying learning rate. In the last scheme, a Recursive Least Square-based NN algorithm is faster and more stable than the classical back-propagation algorithm for training multilayer perceptrons. The number of iterations required to converge and the mean-squared error between the desired and actual outputs is compared with respect to each method. The theoretical analysis and experimental results are discussed.

• International Journal of Computer Science & Network Security
• /
• 제21권1호
• /
• pp.40-48
• /
• 2021

Content-Based Image Retrieval (CBIR) system plays a vital role to retrieve the relevant images as per the user perception from the huge database is a challenging task. Images are represented is to employ a combination of low-level features as per their visual content to form a feature vector. To reduce the search time of a large database while retrieving images, a novel image retrieval technique based on feature dimensionality reduction is being proposed with the exploit of metaheuristic optimization techniques based on Genetic Algorithm (GA), Extended Binary Cuckoo Search (EBCS) and Whale Optimization Algorithm (WOA). Each image in the database is indexed using a feature vector comprising of fuzzified based color histogram descriptor for color and Median binary pattern were derived in the color space from HSI for texture feature variants respectively. Finally, results are being compared in terms of Precision, Recall, F-measure, Accuracy, and error rate with benchmark classification algorithms (Linear discriminant analysis, CatBoost, Extra Trees, Random Forest, Naive Bayes, light gradient boosting, Extreme gradient boosting, k-NN, and Ridge) to validate the efficiency of the proposed approach. Finally, a ranking of the techniques using TOPSIS has been considered choosing the best feature selection technique based on different model parameters.

• 한국해양공학회지
• /
• 제20권6호
• /
• pp.61-66
• /
• 2006

Two iterative solvers are applied to solve the modified mild slope equation. The elliptic formulation of the governing equation is selected for numerical treatment because it is partly suited for complex wave fields, like those encountered inside harbors. The requirement that the computational model should be capable of dealing with a large problem domain is addressed by implementing and testing two iterative solvers, which are based on the Stabilized Bi-Conjugate Gradient Method (BiCGSTAB) and Generalized Conjugate Gradient Method (GCGM). The characteristics of the solvers are compared, using the results for Berkhoff's shoal test, used widely as a benchmark in coastal modeling. It is shown that the GCGM algorithm has a better convergence rate than BiCGSTAB, and preconditioning of these algorithms gives more than half a reduction of computational cost.

• 한국의학물리학회지:의학물리
• /
• 제9권4호
• /
• pp.201-206
• /
• 1998

세기변조방사선치료 (Intensity Modulation Radiation Therapy; IMRT) 의 치료계획 목적으로 사용하기 위한 선량최적화 방법을 Gradient based algorithm을 이용하여 개발하였다. 환자의 치료 관심 부위를 포함하는 약 10-30 CT 단면에 대하여 각 단면 별로 선량최적화를 실시하였고, 장기별로 최대 허용선량을 지정하였으며, 표적의 선량은 100$\pm$5 %로 제한하였다. beamlet의 크기는 8$\times$8 $cm^2$으로 제한하였고, beam size가 크지 않으므로 beam diverge는 고려하지 않았다. beamlet 하나가 만드는 선량분포를 미리 계산한 후, 선량중첩방식으로 전체 선량분포를 계산하였다. 고정된 동일평면에 대하여 5방향에서 입사하는 빔에 대한 최적화를 실시하였으며, 그 효용성을 비교하기 위해, 1, 3, 5, 7, 9 방향에 입사하는 빔과 최적화지수를 구하였다. 선량최적화에 소요되는 시간은 대체로 slice 수에 비례하였으며, 계산시간과 최적화지수를 비교할 때 빔의 개수가 3-7개 일 때 가장 적합하였다. 다중단면에 대한 선량최적화를 beam divergence를 고려하지 않을 때, 단일 단면에 대한 선량최적화를 반복 시행함으로써 얻을 수 있었다. 선량최적화의 결과가 선량중심의 위치에 따라 민감하게 변하는 경우가 발생하였으며, 이를 개선하기 위해서는 선량중심의 최적화가 개발될 필요성이 있었다.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 1999년도 하계종합학술대회 논문집
• /
• pp.460-463
• /
• 1999

In this paper, we proposed an block-based evolvable neural network(BENN). The BENN can optimize it＇s structure and weights simultaneously. It can be easily implemented by FPGA whose connection and internal functionality can be reconfigured. To solve the local minima problem that is caused gradient descent learning algorithm, genetic algorithms are applied for optimizing the proposed evolvable neural network model.