• Title/Summary/Keyword: Multi-layer neural network

Search Result 512, Processing Time 0.032 seconds

Web access prediction based on parallel deep learning

  • Togtokh, Gantur;Kim, Kyung-Chang
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.11
    • /
    • pp.51-59
    • /
    • 2019
  • Due to the exponential growth of access information on the web, the need for predicting web users' next access has increased. Various models such as markov models, deep neural networks, support vector machines, and fuzzy inference models were proposed to handle web access prediction. For deep learning based on neural network models, training time on large-scale web usage data is very huge. To address this problem, deep neural network models are trained on cluster of computers in parallel. In this paper, we investigated impact of several important spark parameters related to data partitions, shuffling, compression, and locality (basic spark parameters) for training Multi-Layer Perceptron model on Spark standalone cluster. Then based on the investigation, we tuned basic spark parameters for training Multi-Layer Perceptron model and used it for tuning Spark when training Multi-Layer Perceptron model for web access prediction. Through experiments, we showed the accuracy of web access prediction based on our proposed web access prediction model. In addition, we also showed performance improvement in training time based on our spark basic parameters tuning for training Multi-Layer Perceptron model over default spark parameters configuration.

Application of Neural Network for the Intelligent Control of Computer Aided Testing and Adjustment System (자동조정기능의 지능형제어를 위한 신경회로망 응용)

  • 구영모;이승구;이영민;우광방
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.30B no.1
    • /
    • pp.79-89
    • /
    • 1993
  • This paper deals with a computer aided control of an adjustment process for the complete electronic devices by means of an application of artificial neural network and an implementation of neuro-controller for intelligent control. Multi-layer neural network model is employed as artificial neural network with the learning method of the error back propagation. Information initially available from real plant under control are the initial values of plant output, and the augmented plant input and its corresponding plant output at that time. For the intelligent control of adjustment process utilizing artificial neural network, the neural network emulator (NNE) and the neural network controller(NNC) are developed. The initial weights of each neural network are determined through off line learning for the given product and it is also employed to cope with environments of the another product by on line learning. Computer simulation, as well as the application to the real situation of proposed intelligent control system is investigated.

  • PDF

A Study on the Rainfall Forecasting Using Neural Network Model in Nakdong River Basin - A Comparison with Multivariate Model- (낙동강유역에서 신경망 모델을 이용한 강우예측에 관한 연구 - 다변량 모델과의 비교 -)

  • Cho, Hyeon-Kyeong;Lee, Jeung-Seok
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.2 no.2
    • /
    • pp.51-59
    • /
    • 1999
  • This study aims at the development of the techniques for the rainfall forecasting in river basins by applying neural network theory and compared with results of Multivariate Model (MVM). This study forecasts rainfall and compares with a observed values in the San Chung gauging stations of Nakdong river basin for the rainfall forecasting of river basin by proposed Neural Network Model(NNM). For it, a multi-layer Neural Network is constructed to forecast rainfall. The neural network learns continuous-valued input and output data. The result of rainfall forecasting by the Neural Network Model is superior to the results of Multivariate Model for rainfall forecasting in the river basin. So I think that the Neural Network Model is able to be much more reliable in the rainfall forecasting.

  • PDF

Shear Capacity of Reinforced Concrete Beams Using Neural Network

  • Yang, Keun-Hyeok;Ashour, Ashraf F.;Song, Jin-Kyu
    • International Journal of Concrete Structures and Materials
    • /
    • v.1 no.1
    • /
    • pp.63-73
    • /
    • 2007
  • Optimum multi-layered feed-forward neural network (NN) models using a resilient back-propagation algorithm and early stopping technique are built to predict the shear capacity of reinforced concrete deep and slender beams. The input layer neurons represent geometrical and material properties of reinforced concrete beams and the output layer produces the beam shear capacity. Training, validation and testing of the developed neural network have been achieved using 50%, 25%, and 25%, respectively, of a comprehensive database compiled from 631 deep and 549 slender beam specimens. The predictions obtained from the developed neural network models are in much better agreement with test results than those determined from shear provisions of different codes, such as KBCS, ACI 318-05, and EC2. The mean and standard deviation of the ratio between predicted using the neural network models and measured shear capacities are 1.02 and 0.18, respectively, for deep beams, and 1.04 and 0.17, respectively, for slender beams. In addition, the influence of different parameters on the shear capacity of reinforced concrete beams predicted by the developed neural network shows consistent agreement with those experimentally observed.

Efficient Implementation of Convolutional Neural Network Using CUDA (CUDA를 이용한 Convolutional Neural Network의 효율적인 구현)

  • Ki, Cheol-Min;Cho, Tai-Hoon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.6
    • /
    • pp.1143-1148
    • /
    • 2017
  • Currently, Artificial Intelligence and Deep Learning are rising as hot social issues, and these technologies are applied to various fields. A good method among the various algorithms in Artificial Intelligence is Convolutional Neural Networks. Convolutional Neural Network is a form that adds Convolution Layers to Multi Layer Neural Network. If you use Convolutional Neural Networks for small amount of data, or if the structure of layers is not complicated, you don't have to pay attention to speed. But the learning should take long time when the size of the learning data is large and the structure of layers is complicated. In these cases, GPU-based parallel processing is frequently needed. In this paper, we developed Convolutional Neural Networks using CUDA, and show that its learning is faster and more efficient than learning using some other frameworks or programs.

Neural Network Training Using a GMDH Type Algorithm

  • Pandya, Abhijit S.;Gilbar, Thomas;Kim, Kwang-Baek
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.1
    • /
    • pp.52-58
    • /
    • 2005
  • We have developed a Group Method of Data Handling (GMDH) type algorithm for designing multi-layered neural networks. The algorithm is general enough that it will accept any number of inputs and any sized training set. Each neuron of the resulting network is a function of two of the inputs to the layer. The equation for each of the neurons is a quadratic polynomial. Several forms of the equation are tested for each neuron to make sure that only the best equation of two inputs is kept. All possible combinations of two inputs to each layer are also tested. By carefully testing each resulting neuron, we have developed an algorithm to keep only the best neurons at each level. The algorithm's goal is to create as accurate a network as possible while minimizing the size of the network. Software was developed to train and simulate networks using our algorithm. Several applications were modeled using our software, and the result was that our algorithm succeeded in developing small, accurate, multi-layer networks.

Neural network simulator for semiconductor manufacturing : Case study - photolithography process overlay parameters (신경망을 이용한 반도체 공정 시뮬레이터 : 포토공정 오버레이 사례연구)

  • Park Sanghoon;Seo Sanghyok;Kim Jihyun;Kim Sung-Shick
    • Journal of the Korea Society for Simulation
    • /
    • v.14 no.4
    • /
    • pp.55-68
    • /
    • 2005
  • The advancement in semiconductor technology is leading toward smaller critical dimension designs and larger wafer manufactures. Due to such phenomena, semiconductor industry is in need of an accurate control of the process. Photolithography is one of the key processes where the pattern of each layer is formed. In this process, precise superposition of the current layer to the previous layer is critical. Therefore overlay parameters of the semiconductor photolithography process is targeted for this research. The complex relationship among the input parameters and the output metrologies is difficult to understand and harder yet to model. Because of the superiority in modeling multi-nonlinear relationships, neural networks is used for the simulator modeling. For training the neural networks, conjugate gradient method is employed. An experiment is performed to evaluate the performance among the proposed neural network simulator, stepwise regression model, and the currently practiced prediction model from the test site.

  • PDF

The Design of Genetically Optimized Multi-layer Fuzzy Neural Networks

  • Park, Byoung-Jun;Park, Keon-Jun;Lee, Dong-Yoon;Oh, Sung-Kwun
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.14 no.5
    • /
    • pp.660-665
    • /
    • 2004
  • In this study, a new architecture and comprehensive design methodology of genetically optimized Multi-layer Fuzzy Neural Networks (gMFNN) are introduced and a series of numeric experiments are carried out. The gMFNN architecture results from a synergistic usage of the hybrid system generated by combining Fuzzy Neural Networks (FNN) with Polynomial Neural Networks (PNN). FNN contributes to the formation of the premise part of the overall network structure of the gMFNN. The consequence part of the gMFNN is designed using PNN. The optimization of the FNN is realized with the aid of a standard back-propagation learning algorithm and genetic optimization. The development of the PNN dwells on the extended Group Method of Data Handling (GMDH) method and Genetic Algorithms (GAs). To evaluate the performance of the gMFNN, the models are experimented with the use of a numerical example.

A Study on the Phoneme Segmentation Using Neural Network (신경망을 이용한 음소분할에 관한 연구)

  • 이광석;이광진;조신영;허강인;김명기
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.17 no.5
    • /
    • pp.472-481
    • /
    • 1992
  • In this paper, we proposed a method of segmenting speech signal by neural network and its validity is proved by computer simulation. The neural network Is composed of multi layer perceptrons with one hidden layer. The matching accuracies of the proposed algorithm are measured for continuous vowel and place names. The resulting average matching accuracy is 100% for speaker-dependent case, 99.5% for speaker-independent case and 94.5% for each place name when the neural network 1,; trained for 6 place names simultaneously.

  • PDF

Predictive Modeling of River Water Quality Factors Using Artificial Neural Network Technique - Focusing on BOD and DO- (인공신경망기법을 이용한 하천수질인자의 예측모델링 - BOD와 DO를 중심으로-)

  • 조현경
    • Journal of Environmental Science International
    • /
    • v.9 no.6
    • /
    • pp.455-462
    • /
    • 2000
  • This study aims at the development of the model for a forecasting of water quality in river basins using artificial neural network technique. Water quality by Artificial Neural Network Model forecasted and compared with observed values at the Sangju q and Dalsung stations in Nakdong river basin. For it, a multi-layer neural network was constructed to forecast river water quality. The neural network learns continuous-valued input and output data. Input data was selected as BOD, CO discharge and precipitation. As a result, it showed that method III of three methods was suitable more han other methods by statistical test(ME, MSE, Bias and VER). Therefore, it showed that Artificial Neural Network Model was suitable for forecasting river water quality.

  • PDF