• Title/Summary/Keyword: Optimal weights

Search Result 398, Processing Time 0.026 seconds

A Simple Approach of Improving Back-Propagation Algorithm

  • Zhu, H.;Eguchi, K.;Tabata, T.;Sun, N.
    • Proceedings of the IEEK Conference
    • /
    • 2000.07b
    • /
    • pp.1041-1044
    • /
    • 2000
  • The enhancement to the back-propagation algorithm presented in this paper has resulted from the need to extract sparsely connected networks from networks employing product terms. The enhancement works in conjunction with the back-propagation weight update process, so that the actions of weight zeroing and weight stimulation enhance each other. It is shown that the error measure, can also be interpreted as rate of weight change (as opposed to ${\Delta}W_{ij}$), and consequently used to determine when weights have reached a stable state. Weights judged to be stable are then compared to a zero weight threshold. Should they fall below this threshold, then the weight in question is zeroed. Simulation of such a system is shown to return improved learning rates and reduce network connection requirements, with respect to the optimal network solution, trained using the normal back-propagation algorithm for Multi-Layer Perceptron (MLP), Higher Order Neural Network (HONN) and Sigma-Pi networks.

  • PDF

Improvement of Self Organizing Maps using Gap Statistic and Probability Distribution

  • Jun, Sung-Hae
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.8 no.2
    • /
    • pp.116-120
    • /
    • 2008
  • Clustering is a method for unsupervised learning. General clustering tools have been depended on statistical methods and machine learning algorithms. One of the popular clustering algorithms based on machine learning is the self organizing map(SOM). SOM is a neural networks model for clustering. SOM and extended SOM have been used in diverse classification and clustering fields such as data mining. But, SOM has had a problem determining optimal number of clusters. In this paper, we propose an improvement of SOM using gap statistic and probability distribution. The gap statistic was introduced to estimate the number of clusters in a dataset. We use gap statistic for settling the problem of SOM. Also, in our research, weights of feature nodes are updated by probability distribution. After complete updating according to prior and posterior distributions, the weights of SOM have probability distributions for optima clustering. To verify improved performance of our work, we make experiments compared with other learning algorithms using simulation data sets.

Evolving Neural Network Controller for Stabilization of Inverted Pendulum System (도립 진자 시스템의 안정화를 위한 진화형 신경회로망 제어기)

  • Sim, Yeong-Jin;Lee, Jun-Tak
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.49 no.3
    • /
    • pp.157-163
    • /
    • 2000
  • In this paper, an Evolving Neural Network Controller(ENNC) which its structure and its connection weights are optimized simultaneously by Real Variable Elitist Genetic Algoithm(RVEGA) was presented for stabilization of an Inverter Pendulum(IP) system with nonlinearity. This proposed ENNC was described by a simple genetic chromosome. And the deletion of neuron, the determinations of input or output neuron, the deleted neuron and the activation functions types are given according to the various flag types. Therefore, the connection weights, its structure and the neuron types in the given ENNC can be optimized by the proposed evolution strategy. Through the simulations, we showed that the finally acquired optimal ENNC was successfully applied to the stabilization control of an IP system.

  • PDF

A Study on Stabilization Control of Inverted Pendulum System using Evolving Neural Network Controller (진화 신경회로망 제어기를 이용한 도립진자 시스템의 안정화 제어에 관한 연구)

  • 김민성;정종원;성상규;박현철;심영진;이준탁
    • Proceedings of the Korean Society of Marine Engineers Conference
    • /
    • 2001.05a
    • /
    • pp.243-248
    • /
    • 2001
  • The stabilization control of Inverted Pendulum(IP) system is difficult because of its nonlinearity and structural unstability. Thus, in this paper, an Evolving Neural Network Controller(ENNC) without Error Back Propagation(EBP) is presented. An ENNC is described simply by genetic representation using an encoding strategy for types and slope values of each active functions, biases, weights and so on. By an evolutionary programming which has three genetic operation; selection, crossover and mutation, the predetermine controller is optimally evolved by updating simultaneously the connection patterns and weights of the neural networks. The performances of the proposed ENNC(PENNC) are compared with the ones of conventional optimal controller and the conventional evolving neural network controller(CENNC) through the simulation and experimental results. And we showed that the finally optimized PENNC was very useful in the stabilization control of an IP system.

  • PDF

A study on correspondence problem of stereo vision system using self-organized neural network

  • Cho, Y.B.;Gweon, D.G.
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.10 no.4
    • /
    • pp.170-179
    • /
    • 1993
  • In this study, self-organized neural network is used to solve the vorrespondence problem of the axial stereo image. Edge points are extracted from a pair of stereo images and then the edge points of rear image are assined to the output nodes of neural network. In the matching process, the two input nodes of neural networks are supplied with the coordi- nates of the edge point selected randomly from the front image. This input data activate optimal output node and its neighbor nodes whose coordinates are thought to be correspondence point for the present input data, and then their weights are allowed to updated. After several iterations of updating, the weights whose coordinates represent rear edge point are converged to the coordinates of the correspondence points in the front image. Because of the feature map properties of self-organized neural network, noise-free and smoothed depth data can be achieved.

  • PDF

Optimal Moving Pattern Mining using Frequency of Sequence and Weights (시퀀스 빈발도와 가중치를 이용한 최적 이동 패턴 탐사)

  • Lee, Yon-Sik;Park, Sung-Sook
    • Journal of Internet Computing and Services
    • /
    • v.10 no.5
    • /
    • pp.79-93
    • /
    • 2009
  • For developing the location based service which is individualized and specialized according to the characteristic of the users, the spatio-temporal pattern mining for extracting the meaningful and useful patterns among the various patterns of the mobile object on the spatio-temporal area is needed. Thus, in this paper, as the practical application toward the development of the location based service in which it is able to apply to the real life through the pattern mining from the huge historical data of mobile object, we are proposed STOMP(using Frequency of sequence and Weight) that is the new mining method for extracting the patterns with spatial and temporal constraint based on the problems of mining the optimal moving pattern which are defined in STOMP(F)[25]. Proposed method is the pattern mining method compositively using weighted value(weights) (a distance, the time, a cost, and etc) for our previous research(STOMP(F)[25]) that it uses only the pattern frequent occurrence. As to, it is the method determining the moving pattern in which the pattern frequent occurrence is above special threshold and the weight is most a little bit required among moving patterns of the object as the optimal path. And also, it can search the optimal path more accurate and faster than existing methods($A^*$, Dijkstra algorithm) or with only using pattern frequent occurrence due to less accesses to nodes by using the heuristic moving history.

  • PDF

A Study of the Influence of Choice of Record Fields on Retrieval Performance in the Bibliographic Database (서지 데이터베이스에서의 레코드 필드 선택이 검색 성능에 미치는 영향에 관한 연구)

  • Heesop Kim
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.35 no.4
    • /
    • pp.97-122
    • /
    • 2001
  • This empirical study investigated the effect of choice of record field(s) upon which to search on retrieval performance for a large operational bibliographic database. The query terms used in the study were identified algorithmically from each target set in four different ways: (1) controlled terms derived from index term frequency weights, (2) uncontrolled terms derived from index term frequency weights. (3) controlled terms derived from inverse document frequency weights, and (4) uncontrolled terms based on universe document frequency weights. Su potable choices of record field were recognised. Using INSPEC terminology, these were the fields: (1) Abstract. (2) 'Anywhere'(i.e., ail fields). (3) Descriptors. (4) Identifiers, (5) 'Subject'(i.e., 'Descriptors' plus Identifiers'). and (6) Title. The study was undertaken in an operational web-based IR environment using the INSPEC bibliographic database. The retrieval performances were evaluated using D measure (bivariate in Recall and Precision). The main findings were that: (1) there exist significant differences in search performance arising from choice of field, using 'mean performance measure' as the criterion statistic; (2) the rankings of field-choices for each of these performance measures is sensitive to the choice of query : and (3) the optimal choice of field for the D-measure is Title.

  • PDF

Optimal Design of Skin and Stiffener of Stiffened Composite Shells Using Genetic Algorithms (유전자 기법을 이용한 복합재 보강구조물 외피 및 보강재의 적층각 최적설계)

  • Yoon, I.S.;Choi, H.S.;Kim, C.
    • Proceedings of the Korean Society For Composite Materials Conference
    • /
    • 2002.10a
    • /
    • pp.233-236
    • /
    • 2002
  • An efficient method was developed in this study to obtain optimal stacking sequences, thicknesses, and minimum weights of stiffened laminated composite shells under combined loading conditions and stiffener layouts using genetic algorithms (GAs) and finite element analyses. Among many parameters in designing composite laminates determining a optimal stacking sequence that may be formulated as an integer programming problem is a primary concern. Of many optimization algorithms, GAs are powerful methodology for the problem with discrete variables. In this paper the optimal stacking sequence was determined, which gives the maximum critical buckling load factor and the minimum weight as well. To solve this problem, both the finite element analysis by ABAQUS and the GA-based optimization procedure have been implemented together with an interface code. Throughout many parametric studies using this analysis tool, the influences of stiffener sizes and three different types of stiffener layouts on the stacking sequence changes were throughly investigated subjected to various combined loading conditions.

  • PDF

An optimal classification method for risk assessment of water inrush in karst tunnels based on grey system theory

  • Zhou, Z.Q.;Li, S.C.;Li, L.P.;Shi, S.S.;Xu, Z.H.
    • Geomechanics and Engineering
    • /
    • v.8 no.5
    • /
    • pp.631-647
    • /
    • 2015
  • Engineers may encounter unpredictable cavities, sinkholes and karst conduits while tunneling in karst area, and water inrush disaster frequently occurs and endanger the construction safety, resulting in huge casualties and economic loss. Therefore, an optimal classification method based on grey system theory (GST) is established and applied to accurately predict the occurrence probability of water inrush. Considering the weights of evaluation indices, an improved formula is applied to calculate the grey relational grade. Two evaluation indices systems are proposed for risk assessment of water inrush in design stage and construction stage, respectively, and the evaluation indices are quantitatively graded according to four risk grades. To verify the accuracy and feasibility of optimal classification method, comparisons of the evaluation results derived from the aforementioned method and attribute synthetic evaluation system are made. Furthermore, evaluation of engineering practice is carried through with the Xiakou Tunnel as a case study, and the evaluation result is generally in good agreement with the field-observed result. This risk assessment methodology provides a powerful tool with which engineers can systematically evaluate the risk of water inrush in karst tunnels.

Acoustic Signal based Optimal Route Selection Problem: Performance Comparison of Multi-Attribute Decision Making methods

  • Borkar, Prashant;Sarode, M.V.;Malik, L. G.
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.2
    • /
    • pp.647-669
    • /
    • 2016
  • Multiple attribute for decision making including user preference will increase the complexity of route selection process. Various approaches have been proposed to solve the optimal route selection problem. In this paper, multi attribute decision making (MADM) algorithms such as Simple Additive Weighting (SAW), Weighted Product Method (WPM), Analytic Hierarchy Process (AHP) method and Total Order Preference by Similarity to the Ideal Solution (TOPSIS) methods have been proposed for acoustic signature based optimal route selection to facilitate user with better quality of service. The traffic density state conditions (very low, low, below medium, medium, above medium, high and very high) on the road segment is the occurrence and mixture weightings of traffic noise signals (Tyre, Engine, Air Turbulence, Exhaust, and Honks etc) is considered as one of the attribute in decision making process. The short-term spectral envelope features of the cumulative acoustic signals are extracted using Mel-Frequency Cepstral Coefficients (MFCC) and Adaptive Neuro-Fuzzy Classifier (ANFC) is used to model seven traffic density states. Simple point method and AHP has been used for calculation of weights of decision parameters. Numerical results show that WPM, AHP and TOPSIS provide similar performance.