• 한국지능정보시스템학회:학술대회논문집
• /
• 한국지능정보시스템학회 2001년도 The Pacific Aisan Confrence On Intelligent Systems 2001
• /
• pp.30-33
• /
• 2001

The number of hidden neurons of the feed-forward neural networks is generally decided on the basis of experience. The method usually results in the lack or redundancy of hidden neurons, and causes the shortage of capacity for storing information of learning overmuch. This research proposes a new method for optimizing the number of hidden neurons bases on information entropy, Firstly, an initial neural network with enough hidden neurons should be trained by a set of training samples. Second, the activation values of hidden neurons should be calculated by inputting the training samples that can be identified correctly by the trained neural network. Third, all kinds of partitions should be tried and its information gain should be calculated, and then a decision-tree correctly dividing the whole sample space can be constructed. Finally, the important and related hidden neurons that are included in the tree can be found by searching the whole tree, and other redundant hidden neurons can be deleted. Thus, the number of hidden neurons can be decided. In the case of building a neural network with the best number of hidden units for tea quality evaluation, the proposed method is applied. And the result shows that the method is effective

• Wind and Structures
• /
• 제18권6호
• /
• pp.619-631
• /
• 2014

This paper proposes new criteria to fix hidden neuron in Multilayer Perceptron Networks for wind speed prediction in renewable energy systems. To fix hidden neurons, 101 various criteria are examined based on the estimated mean squared error. The results show that proposed approach performs better in terms of testing mean squared errors. The convergence analysis is performed for the various proposed criteria. Mean squared error is used as an indicator for fixing neuron in hidden layer. The proposed criteria find solution to fix hidden neuron in neural networks. This approach is effective, accurate with minimal error than other approaches. The significance of increasing the number of hidden neurons in multilayer perceptron network is also analyzed using these criteria. To verify the effectiveness of the proposed method, simulations were conducted on real time wind data. Simulations infer that with minimum mean squared error the proposed approach can be used for wind speed prediction in renewable energy systems.

• 한국콘텐츠학회논문지
• /
• 제3권3호
• /
• pp.98-102
• /
• 2003

다층퍼셉트론의 중간층 뉴런이 지닌 역할을 정보처리의 관점에서 밝혀내기 위해서, 이 논문에서는 중간층 뉴런의 가중치 합들 간의 상관계수가 비선형 변환에 의해 감소하게 됨을 증명하였다. 고립단어 인식을 다층퍼셉트론에 학습시킨 경우의 시뮬레이션으로 이러한 증명이 맞음도 보였다. 이 결과로부터 중간층 뉴런이 지닌 비선형 변환은 정보의 중복을 감소시키는 효과가 있음을 알 수 있다.

• 산업기술연구
• /
• 제41권1호
• /
• pp.1-6
• /
• 2021

Fly ash and silica fume belong to industry by-products that can be used to produce concrete. This study shows the model of a neural network to evaluate the strength development of blended concrete containing fly ash and silica fume. The neural network model has four input parameters, such as fly ash replacement content, silica fume replacement content, water/binder ratio, and ages. Strength is the output variable of neural network. Based on the backpropagation algorithm, the values of elements in the hidden layer of neural network are determined. The number of neurons in the hidden layer is confirmed based on trial calculations. We find (1) neural network can give a reasonable evaluation of the strength development of composite concrete. Neural network can reflect the improvement of strength due to silica fume additions and can consider the reductions of strength as water/binder increases. (2) When the number of neurons in the hidden layer is five, the prediction results show more accuracy than four neurons in the hidden layer. Moreover, five neurons in the hidden layer can reproduce the strength crossover between fly ash concrete and plain concrete. Summarily, the neural network-based model is valuable for design sustainable composite concrete containing silica fume and fly ash.

• Structural Engineering and Mechanics
• /
• 제13권2호
• /
• pp.187-209
• /
• 2002

The infrastructure system in the United States has been aging faster than the resource available to restore them. Therefore decision for allocating the resources is based in part on the condition of the structural system. This paper proposes to use neural network to predict the overall rating of the structural system because of the successful applications of neural network to other fields which require a "symptom-diagnostic" type relationship. The goal of this paper is to illustrate the potential of using neural network in civil engineering applications and, particularly, in bridge evaluations. Data collected by the Tennessee Department of Transportation were used as "test bed" for the study. Multi-layer feed forward networks were developed using the Levenberg-Marquardt training algorithm. All the neural networks consisted of at least one hidden layer of neurons. Hyperbolic tangent transfer functions were used in the first hidden layer and log-sigmoid transfer functions were used in the subsequent hidden and output layers. The best performing neural network consisted of three hidden layers. This network contained three neurons in the first hidden layer, two neurons in the second hidden layer and one neuron in the third hidden layer. The neural network performed well based on a target error of 10%. The results of this study indicate that the potential for using neural networks for the evaluation of infrastructure systems is very good.

• International Journal of Control, Automation, and Systems
• /
• 제3권2호
• /
• pp.202-210
• /
• 2005

This paper presents a new neural network control for nonlinear bridge systems with earthquake excitation. We design multi-layer neural network controllers with a single hidden layer. The selection of an optimal number of neurons in the hidden layer is an important design step for control performance. To select an optimal number of hidden neurons, we progressively add one hidden neuron and observe the change in a performance measure given by the weighted sum of the system error and the control force. The number of hidden neurons which minimizes the performance measure is selected for implementation. A neural network was trained for mitigating vibrations of bridge systems caused by El Centro earthquake. We applied the proposed control approach to a single-degree-of-freedom (SDOF) and a two-degree-of-freedom (TDOF) bridge system. We assessed the robustness of the control system using randomly generated earthquake excitations which were not used in training the neural network. Our results show that the neural network controller drastically mitigates the effect of the disturbance.

• 지능정보연구
• /
• 제10권2호
• /
• pp.53-63
• /
• 2004

순환 케스케이드 코릴레이션(Recurrent Cascade Correlation(RCC))은 감독에 의하여 학습하는 알고리즘이고 네트워크의 크기와 형태는 자동으로 이루어진다. RCC는 새로운 은닉뉴런들이 한 충에 하나씩 순서대로 네트워크에 삽입되기 때문에 다층구조를 형성하고 2계(Second Order) RCC는 새로운 은닉뉴런들이 한 층에만 순서대로 생성되어 나열되므로 2층 구조를 형성한다. 따라서 이러한 은닉뉴런들끼리는 서로 연결하지 않는다. 이 논문에서는 RCC와 2계 RCC의 조합을 통한 RCC 네트워크의 일반화를 소개한다. 새로운 RCC 알고리즘은 은닉뉴런이 네트워크에 첨가될 때마다 네트워크가 수직성장 또는 수평성장을 해야 하는지를 스스로 결정한다. 또한 뉴런의 활성화를 위한 새로운 활성화함수를 소개하고 기존의 sigmoid, tanh 함수와 함께 사용하여 모스 벤치마크 문제에 관하여 실험하였다. 이러한 활성화 함수들을 사용한 RCC 네트워크의 일반화 실험에서 은닉뉴런의 숫자가 감소하였음을 알 수 있다.

• 한국정밀공학회지
• /
• 제28권7호
• /
• pp.814-820
• /
• 2011

It takes long time in numerical simulation because structural design for tire requires the nonlinear material property. Neural networks has been widely studied to engineering design to reduce numerical computation time. The numbers of hidden layer, hidden layer neuron and training data have been considered as the structural design variables of neural networks. In application of neural networks to optimize design, there are a few studies about arrangement method of input layer neurons. To investigate the effect of input layer neuron arrangement on neural networks, the variables of tire contour design and tension in bead area were assigned to inputs and output for neural networks respectively. Design variables arrangement in input layer were determined by main effect analysis. The number of hidden layer, the number of hidden layer neuron and the number of training data and so on have been considered as the structural design variables of neural networks. In application to optimization design problem of neural networks, there are few studies about arrangement method of input layer neurons. To investigate the effect of arrangement of input neurons on neural network learning tire contour design parameters and tension in bead area were assigned to neural input and output respectively. Design variables arrangement in input layer was determined by main effect analysis.

• 전자공학회논문지B
• /
• 제31B권8호
• /
• pp.211-218
• /
• 1994

In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

• 대한산업공학회지
• /
• 제24권1호
• /
• pp.23-35
• /
• 1998

This article presents a network flow analysis to form flexible machine cells with minimum intercellular part moves and a neural network model to form part families. The operational sequences and production quantity of the part, and the number of cells and the cell size are taken into considerations for a 0-1 quadratic programming formulation and a network flow based solution procedure is developed. After designing the machine cells, a neural network approach for the integration of part families and the automatic assignment of new parts to the existing cells is proposed. A multi-layer backpropagation network with one hidden layer is used. Experimental results with varying number of neurons in hidden layer to evaluate the role of hidden neurons in the network learning performance are also presented. The comprehensive methodology developed in this article is appropriate for solving large-scale industrial applications without building the knowledge-based expert rule for the cellular manufacturing environment.