• Title/Summary/Keyword: Hidden Neurons

Search Result 133, Processing Time 0.019 seconds

Concurrent Modeling of Magnetic Field Parameters, Crystalline Structures, and Ferromagnetic Dynamic Critical Behavior Relationships: Mean-Field and Artificial Neural Network Projections

  • Laosiritaworn, Yongyut;Laosiritaworn, Wimalin
    • Journal of Magnetics
    • /
    • v.19 no.4
    • /
    • pp.315-322
    • /
    • 2014
  • In this work, Artificial Neural Network (ANN) was used to model the dynamic behavior of ferromagnetic hysteresis derived from performing the mean-field analysis on the Ising model. The effect of field parameters and system structure (via coordination number) on dynamic critical points was elucidated. The Ising magnetization equation was drawn from mean-field picture where the steady hysteresis loops were extracted, and series of the dynamic critical points for constructing dynamic phase-diagram were depicted. From the dynamic critical points, the field parameters and the coordination number were treated as inputs whereas the dynamic critical temperature was considered as the output of the ANN. The input-output datasets were divided into training, validating and testing datasets. The number of neurons in hidden layer was varied in structuring ANN network with highest accuracy. The network was then used to predict dynamic critical points of the untrained input. The predicted and the targeted outputs were found to match well over an extensive range even for systems with different structures and field parameters. This therefore confirms the ANN capabilities and indicates the ANN ability in modeling the ferromagnetic dynamic hysteresis behavior for establishing the dynamic-phase-diagram.

Cancer Prediction Based on Radical Basis Function Neural Network with Particle Swarm Optimization

  • Yan, Xiao-Bo;Xiong, Wei-Qing;Hu, Liang;Zhao, Kuo
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.15 no.18
    • /
    • pp.7775-7780
    • /
    • 2014
  • This paper addresses cancer prediction based on radial basis function neural network optimized by particle swarm optimization. Today, cancer hazard to people is increasing, and it is often difficult to cure cancer. The occurrence of cancer can be predicted by the method of the computer so that people can take timely and effective measures to prevent the occurrence of cancer. In this paper, the occurrence of cancer is predicted by the means of Radial Basis Function Neural Network Optimized by Particle Swarm Optimization. The neural network parameters to be optimized include the weight vector between network hidden layer and output layer, and the threshold of output layer neurons. The experimental data were obtained from the Wisconsin breast cancer database. A total of 12 experiments were done by setting 12 different sets of experimental result reliability. The findings show that the method can improve the accuracy, reliability and stability of cancer prediction greatly and effectively.

Performance Analysis of Artificial Neural Network for Expanding the Ionospheric Correction Coverage of GNSS (위성항법시스템의 전리층 보정 가능 영역 확장을 위한 인공 신경망의 성능 분석)

  • Ryu, Gyeong-don;So, Hyoungmin;Park, Heung-won
    • Journal of Advanced Navigation Technology
    • /
    • v.22 no.5
    • /
    • pp.409-414
    • /
    • 2018
  • Extrapolating the correction information of ionosphere is essential for expanding wide area differential GPS (WADGPS) service area beyond the reference station network. In this paper, design and analysis of the artificial neural network for expanding the ionospheric correction region will be proposed. First, analysis about influence of each input of neural network were performed. The inputs are the day/year periodic function, sunspot number, and geomagnetic index (Ap). Second, performance analysis with respect to the number of hidden layers and neurons in the neural network is shown. As a result, estimation of total electron contents (TEC) on the high/low latitude regions in solar max(2014) are displayed.

Structure optimization of neural network using co-evolution (공진화를 이용한 신경회로망의 구조 최적화)

  • 전효병;김대준;심귀보
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.4
    • /
    • pp.67-75
    • /
    • 1998
  • In general, Evoluationary Algorithm(EAs) are refered to as methods of population-based optimization. And EAs are considered as very efficient methods of optimal sytem design because they can provice much opportunity for obtaining the global optimal solution. This paper presents a co-evolution scheme of artifical neural networks, which has two different, still cooperatively working, populations, called as a host popuation and a parasite population, respectively. Using the conventional generatic algorithm the host population is evolved in the given environment, and the parastie population composed of schemata is evolved to find useful schema for the host population. the structure of artificial neural network is a diagonal recurrent neural netork which has self-feedback loops only in its hidden nodes. To find optimal neural networks we should take into account the structure of the neural network as well as the adaptive parameters, weight of neurons. So we use the genetic algorithm that searches the structure of the neural network by the co-evolution mechanism, and for the weights learning we adopted the evolutionary stategies. As a results of co-evolution we will find the optimal structure of the neural network in a short time with a small population. The validity and effectiveness of the proposed method are inspected by applying it to the stabilization and position control of the invered-pendulum system. And we will show that the result of co-evolution is better than that of the conventioal genetic algorithm.

  • PDF

Hybridized dragonfly, whale and ant lion algorithms in enlarged pile's behavior

  • Ye, Xinyu;Lyu, Zongjie;Foong, Loke Kok
    • Smart Structures and Systems
    • /
    • v.25 no.6
    • /
    • pp.765-778
    • /
    • 2020
  • The present study intends to find a proper solution for the estimation of the physical behaviors of enlarged piles through a combination of small-scale laboratory tests and a hybrid computational predictive intelligence process. In the first step, experimental program is completed considering various critical influential factors. The results of the best multilayer perceptron (MLP)-based predictive network was implemented through three mathematical-based solutions of dragonfly algorithm (DA), whale optimization algorithm (WOA), and ant lion optimization (ALO). Three proposed models, after convergence analysis, suggested excellent performance. These analyses varied based on neurons number (e.g., in the basis MLP hidden layer) and of course, the level of its complexity. The training R2 results of the best hybrid structure of DA-MLP, WOA-MLP, and ALO-MLP were 0.996, 0.996, and 0.998 where the testing R2 was 0.995, 0.985, and 0.998, respectively. Similarly, the training RMSE of 0.046, 0.051, and 0.034 were obtained for the training and testing datasets of DA-MLP, WOA-MLP, and ALO-MLP techniques, while the testing RMSE of 0.088, 0.053, and 0.053, respectively. This obtained result demonstrates the excellent prediction from the optimized structure of the proposed models if only population sensitivity analysis performs. Indeed, the ALO-MLP was slightly better than WOA-MLP and DA-MLP methods.

Modeling High Power Semiconductor Device Using Backpropagation Neural Network (역전파 신경망을 이용한 고전력 반도체 소자 모델링)

  • Kim, Byung-Whan;Kim, Sung-Mo;Lee, Dae-Woo;Roh, Tae-Moon;Kim, Jong-Dae
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.5
    • /
    • pp.290-294
    • /
    • 2003
  • Using a backpropagation neural network (BPNN), a high power semiconductor device was empirically modeled. The device modeled is a n-LDMOSFET and its electrical characteristics were measured with a HP4156A and a Tektronix curve tracer 370A. The drain-source current $(I_{DS})$ was measured over the drain-source voltage $(V_{DS})$ ranging between 1 V to 200 V at each gate-source voltage $(V_{GS}).$ For each $V_{GS},$ the BPNN was trained with 100 training data, and the trained model was tested with another 100 test data not pertaining to the training data. The prediction accuracy of each $V_{GS}$ model was optimized as a function of training factors, including training tolerance, number of hidden neurons, initial weight distribution, and two gradients of activation functions. Predictions from optimized models were highly consistent with actual measurements.

Two Layer Multiquadric-Biharmonic Artificial Neural Network for Area Quasigeoid Surface Approximation with GPS-Levelling Data

  • Deng, Xingsheng;Wang, Xinzhou
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • v.2
    • /
    • pp.101-106
    • /
    • 2006
  • The geoidal undulations are needed for determining the orthometric heights from the Global Positioning System GPS-derived ellipsoidal heights. There are several methods for geoidal undulation determination. The paper presents a method employing a simple architecture Two Layer Multiquadric-Biharmonic Artificial Neural Network (TLMB-ANN) to approximate an area of 4200 square kilometres quasigeoid surface with GPS-levelling data. Hardy’s Multiquadric-Biharmonic functions is used as the hidden layer neurons’ activation function and Levenberg-Marquardt algorithm is used to train the artificial neural network. In numerical examples five surfaces were compared: the gravimetric geometry hybrid quasigeoid, Support Vector Machine (SVM) model, Hybrid Fuzzy Neural Network (HFNN) model, Traditional Three Layer Artificial Neural Network (ANN) with tanh activation function and TLMB-ANN surface approximation. The effectiveness of TLMB-ANN surface approximation depends on the number of control points. If the number of well-distributed control points is sufficiently large, the results are similar with those obtained by gravity and geometry hybrid method. Importantly, TLMB-ANN surface approximation model possesses good extrapolation performance with high precision.

  • PDF

Structural Design of Radial Basis Function-based Polynomial Neural Networks by Using Multiobjective Particle Swarm Optimization (다중 목적 입자 군집 최적화 알고리즘 이용한 방사형 기저 함수 기반 다항식 신경회로망 구조 설계)

  • Kim, Wook-Dong;Oh, Sung-Kwun
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.61 no.1
    • /
    • pp.135-142
    • /
    • 2012
  • In this paper, we proposed a new architecture called radial basis function-based polynomial neural networks classifier that consists of heterogeneous neural networks such as radial basis function neural networks and polynomial neural networks. The underlying architecture of the proposed model equals to polynomial neural networks(PNNs) while polynomial neurons in PNNs are composed of Fuzzy-c means-based radial basis function neural networks(FCM-based RBFNNs) instead of the conventional polynomial function. We consider PNNs to find the optimal local models and use RBFNNs to cover the high dimensionality problems. Also, in the hidden layer of RBFNNs, FCM algorithm is used to produce some clusters based on the similarity of given dataset. The proposed model depends on some parameters such as the number of input variables in PNNs, the number of clusters and fuzzification coefficient in FCM and polynomial type in RBFNNs. A multiobjective particle swarm optimization using crowding distance (MoPSO-CD) is exploited in order to carry out both structural and parametric optimization of the proposed networks. MoPSO is introduced for not only the performance of model but also complexity and interpretability. The usefulness of the proposed model as a classifier is evaluated with the aid of some benchmark datasets such as iris and liver.

A study on the prediction of injection pressure and weight of injection-molded product using Artificial Neural Network (Artificial Neural Network를 이용한 사출압력과 사출성형품의 무게 예측에 대한 연구)

  • Yang, Dong-Cheol;Kim, Jong-Sun
    • Design & Manufacturing
    • /
    • v.13 no.3
    • /
    • pp.53-58
    • /
    • 2019
  • This paper presents Artificial Neural Network(ANN) method to predict maximum injection pressure of injection molding machine and weights of injection molding products. 5 hidden layers with 10 neurons is used in the ANN. The ANN was conducted with 5 Input parameters and 2 response data. The input parameters, i.e., melt temperature, mold temperature, fill time, packing pressure, and packing time were selected. The combination of the orthogonal array L27 data set and 23 randomly generated data set were applied in order to train and test for ANN. According to the experimental result, error of the ANN for weights was $0.49{\pm}0.23%$. In case of maximum injection pressure, error of the ANN was $1.40{\pm}1.19%$. This value showed that ANN can be successfully predict the injection pressure and the weights of injection molding products.

Prediction of Upset Length and Upset Time in Inertia Friction Welding Process Using Deep Neural Network (관성 마찰용접 공정에서 심층 신경망을 이용한 업셋 길이와 업셋 시간의 예측)

  • Yang, Young-Soo;Bae, Kang-Yul
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.11
    • /
    • pp.47-56
    • /
    • 2019
  • A deep neural network (DNN) model was proposed to predict the upset in the inertia friction welding process using a database comprising results from a series of FEM analyses. For the database, the upset length, upset beginning time, and upset completion time were extracted from the results of the FEM analyses obtained with various of axial pressure and initial rotational speed. A total of 35 training sets were constructed to train the proposed DNN with 4 hidden layers and 512 neurons in each layer, which can relate the input parameters to the welding results. The mean of the summation of squared error between the predicted results and the true results can be constrained to within 1.0e-4 after the training. Further, the network model was tested with another 10 sets of welding input parameters and results for comparison with FEM. The test showed that the relative error of DNN was within 2.8% for the prediction of upset. The results of DNN application revealed that the model could effectively provide welding results with respect to the exactness and cost for each combination of the welding input parameters.