• Title/Summary/Keyword: forward neural network

Search Result 272, Processing Time 0.03 seconds

System Identification of Nonlinear System using Local Time Delayed Recurrent Neural Network (지역시간지연 순환형 신경회로망을 이용한 비선형 시스템 규명)

  • Chong, K.T.;Hong, D.P.
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.12 no.6
    • /
    • pp.120-127
    • /
    • 1995
  • A nonlinear empirical state-space model of the Artificial Neural Network(ANN) has been developed. The nonlinear model structure incorporates characteristic, so as to enable identification of the transient response, as well as the steady-state response of a dynamic system. A hybrid feedfoward/feedback neural network, namely a Local Time Delayed Recurrent Multi-layer Perception(RMLP), is the model structure developed in this paper. RMLP is used to identify nonlinear dynamic system in an input/output sense. The feedfoward protion of the network architecture provides with the well-known curve fitting factor, while local recurrent and cross-talk connections provides the dynamics of the system. A dynamic learning algorithm is used to train the proposed network in a supervised manner. The derived dynamic learning algorithm exhibit a computationally desirable characteristic; both network sweep involved in the algorithm are performed forward, enhancing its parallel implementation. RMLP state-space and its associate learning algorithm is demonstrated through a simple examples. The simulation results are very encouraging.

  • PDF

Design of hetero-hybridized feed-forward neural networks with information granules using evolutionary algorithm

  • Roh Seok-Beom;Oh Sung-Kwun;Ahn Tae-Chon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2005.11a
    • /
    • pp.483-487
    • /
    • 2005
  • We introduce a new architecture of hetero-hybridized feed-forward neural networks composed of fuzzy set-based polynomial neural networks (FSPNN) and polynomial neural networks (PM) that are based on a genetically optimized multi-layer perceptron and develop their comprehensive design methodology involving mechanisms of genetic optimization and Information Granulation. The construction of Information Granulation based HFSPNN (IG-HFSPNN) exploits fundamental technologies of Computational Intelligence(Cl), namely fuzzy sets, neural networks, and genetic algorithms(GAs) and Information Granulation. The architecture of the resulting genetically optimized Information Granulation based HFSPNN (namely IG-gHFSPNN) results from a synergistic usage of the hybrid system generated by combining new fuzzy set based polynomial neurons (FPNs)-based Fuzzy Neural Networks(PM) with polynomial neurons (PNs)-based Polynomial Neural Networks(PM). The design of the conventional genetically optimized HFPNN exploits the extended Group Method of Data Handling(GMDH) with some essential parameters of the network being tuned by using Genetie Algorithms throughout the overall development process. However, the new proposed IG-HFSPNN adopts a new method called as Information Granulation to deal with Information Granules which are included in the real system, and a new type of fuzzy polynomial neuron called as fuzzy set based polynomial neuron. The performance of the IG-gHFPNN is quantified through experimentation.

  • PDF

Compensation of a Squint Free Phased Array Antenna System using Artificial Neural Networks

  • Kim, Young-Ki;Jeon, Do-Hong;Park, Chiyeon
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.4 no.2
    • /
    • pp.182-186
    • /
    • 2004
  • This paper describes an advanced compensation for non-linear functions designed to remove steering aberrations from phased array antennas. This system alters the steering command applied to the antenna in a way that the appropriate angle commands are given to the array steering software for the antenna to point to the desired position instead of squinting. Artificial neural networks are used to develop the inverse function necessary to correct the aberration. Also a straightforward antenna steering function is implemented with neural networks for the 9-term polynomials of forward steering function. In all cases the aberration is removed resulting in small RMS angular errors across the operational angle space when the actual antenna position is compared with the desired position. The use of neural network model provides a method of producing a non-linear system that can correct antenna performance and demonstrates the feasibility of generating an inverse steering algorithm.

Prediction of ship power based on variation in deep feed-forward neural network

  • Lee, June-Beom;Roh, Myung-Il;Kim, Ki-Su
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.13 no.1
    • /
    • pp.641-649
    • /
    • 2021
  • Fuel oil consumption (FOC) must be minimized to determine the economic route of a ship; hence, the ship power must be predicted prior to route planning. For this purpose, a numerical method using test results of a model has been widely used. However, predicting ship power using this method is challenging owing to the uncertainty of the model test. An onboard test should be conducted to solve this problem; however, it requires considerable resources and time. Therefore, in this study, a deep feed-forward neural network (DFN) is used to predict ship power using deep learning methods that involve data pattern recognition. To use data in the DFN, the input data and a label (output of prediction) should be configured. In this study, the input data are configured using ocean environmental data (wave height, wave period, wave direction, wind speed, wind direction, and sea surface temperature) and the ship's operational data (draft, speed, and heading). The ship power is selected as the label. In addition, various treatments have been used to improve the prediction accuracy. First, ocean environmental data related to wind and waves are preprocessed using values relative to the ship's velocity. Second, the structure of the DFN is changed based on the characteristics of the input data. Third, the prediction accuracy is analyzed using a combination comprising five hyperparameters (number of hidden layers, number of hidden nodes, learning rate, dropout, and gradient optimizer). Finally, k-means clustering is performed to analyze the effect of the sea state and ship operational status by categorizing it into several models. The performances of various prediction models are compared and analyzed using the DFN in this study.

Increasing Spatial Resolution of Remotely Sensed Image using HNN Super-resolution Mapping Combined with a Forward Model

  • Minh, Nguyen Quang;Huong, Nguyen Thi Thu
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.31 no.6_2
    • /
    • pp.559-565
    • /
    • 2013
  • Spatial resolution of land covers from remotely sensed images can be increased using super-resolution mapping techniques for soft-classified land cover proportions. A further development of super-resolution mapping technique is downscaling the original remotely sensed image using super-resolution mapping techniques with a forward model. In this paper, the model for increasing spatial resolution of remote sensing multispectral image is tested with real SPOT 5 imagery at 10m spatial resolution for an area in Bac Giang Province, Vietnam in order to evaluate the feasibility of application of this model to the real imagery. The soft-classified land cover proportions obtained using a fuzzy c-means classification are then used as input data for a Hopfield neural network (HNN) to predict the multispectral images at sub-pixel spatial resolution. The 10m SPOT multispectral image was improved to 5m, 3,3m and 2.5m and compared with SPOT Panchromatic image at 2.5m resolution for assessment.Visually, the resulted image is compared with a SPOT 5 panchromatic image acquired at the same time with the multispectral data. The predicted image is apparently sharper than the original coarse spatial resolution image.

A study on Forecasting The Operational Continuous Ability in Battalion Defensive Operations using Artificial Neural Network (인공신경망을 이용한 대대전투간 작전지속능력 예측)

  • Shim, Hong-Gi;Kim, Sheung-Kown
    • Journal of Intelligence and Information Systems
    • /
    • v.14 no.3
    • /
    • pp.25-39
    • /
    • 2008
  • The objective of this study is to forecast the operational continuous ability using Artificial Neural Networks in battalion defensive operation for the commander decision making support. The forecasting of the combat result is one of the most complex issue in military science. However, it is difficult to formulate a mathematical model to evaluate the combat power of a battalion in defensive operation since there are so many parameters and high temporal and spatial variability among variables. So in this study, we used company combat power level data in Battalion Command in Battle Training as input data and used Feed-Forward Multilayer Perceptrons(MLP) and General Regression Neural Network (GRNN) to evaluate operational continuous ability. The results show 82.62%, 85.48% of forecasting ability in spite of non-linear interactions among variables. We think that GRNN is a suitable technique for real-time commander's decision making and evaluation of the commitment priority of troops in reserve.

  • PDF

Intelligent IIR Filter based Multiple-Channel ANC Systems (지능형 IIR 필터 기반 다중 채널 ANC 시스템)

  • Cho, Hyun-Cheol;Yeo, Dae-Yeon;Lee, Young-Jin;Lee, Kwon-Soon
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.12
    • /
    • pp.1220-1225
    • /
    • 2010
  • This paper proposes a novel active noise control (ANC) approach that uses an IIR filter and neural network techniques to effectively reduce interior noise. We construct a multiple-channel IIR filter module which is a linearly augmented framework with a generic IIR model to generate a primary control signal. A three-layer perceptron neural network is employed for establishing a secondary-path model to represent air channels among noise fields. Since the IIR module and neural network are connected in series, the output of an IIR filter is transferred forward to the neural model to generate a final ANC signal. A gradient descent optimization based learning algorithm is analytically derived for the optimal selection of the ANC parameter vectors. Moreover, re-estimation of partial parameter vectors in the ANC system is proposed for online learning. Lastly, we present the results of a numerical study to test our ANC methodology with realistic interior noise measurement obtained from Korean railway trains.

Design of PID adaptive control system combining Genetic Algorithms and Neural Network (유전알고리즘과 신경망을 결합한 PID 적응제어 시스템의 설계)

  • 조용갑;박재형;박윤명;서현재;최부귀
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.3 no.1
    • /
    • pp.105-111
    • /
    • 1999
  • This Paper is about how to deside the best parameter of PID controller, using Genetic Algorithms and Neural Networks. Control by Genetic Algorithms, which is off-line pass, has weakness for disturbance. So we want to improve like followings by adding Neural Network to controller and putting it on line. First we find PID parameter by Genetic Algorithms in forward pass of Neural Network and set the best output condition according to the increasing number of generation. Second, we explain the adaptability for disturbance with simulation by correcting parameter by backpropagation learning rule by using the learning ability of Neural Network.

  • PDF

Study on Fast-Changing Mixed-Modulation Recognition Based on Neural Network Algorithms

  • Jing, Qingfeng;Wang, Huaxia;Yang, Liming
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.12
    • /
    • pp.4664-4681
    • /
    • 2020
  • Modulation recognition (MR) plays a key role in cognitive radar, cognitive radio, and some other civilian and military fields. While existing methods can identify the signal modulation type by extracting the signal characteristics, the quality of feature extraction has a serious impact on the recognition results. In this paper, an end-to-end MR method based on long short-term memory (LSTM) and the gated recurrent unit (GRU) is put forward, which can directly predict the modulation type from a sampled signal. Additionally, the sliding window method is applied to fast-changing mixed-modulation signals for which the signal modulation type changes over time. The recognition accuracy on training datasets in different SNR ranges and the proportion of each modulation method in misclassified samples are analyzed, and it is found to be reasonable to select the evenly-distributed and full range of SNR data as the training data. With the improvement of the SNR, the recognition accuracy increases rapidly. When the length of the training dataset increases, the neural network recognition effect is better. The loss function value of the neural network decreases with the increase of the training dataset length, and then tends to be stable. Moreover, when the fast-changing period is less than 20ms, the error rate is as high as 50%. As the fast-changing period is increased to 30ms, the error rates of the GRU and LSTM neural networks are less than 5%.

Estimating chlorophyll-A concentration in the Caspian Sea from MODIS images using artificial neural networks

  • Boudaghpour, Siamak;Moghadam, Hajar Sadat Alizadeh;Hajbabaie, Mohammadreza;Toliati, Seyed Hamidreza
    • Environmental Engineering Research
    • /
    • v.25 no.4
    • /
    • pp.515-521
    • /
    • 2020
  • Nowadays, due to various pollution sources, it is essential for environmental scientists to monitor water quality. Phytoplanktons form the end of the food chain in water bodies and are one of the most important biological indicators in water pollution studies. Chlorophyll-A, a green pigment, is found in all phytoplankton. Chlorophyll-A concentration indicates phytoplankton biomass directly. Therefore, Chlorophyll-A is an indirect indicator of pollutants, including phosphorus and nitrogen, and their refinement and control are important. The present study, Moderate Resolution Imaging Spectroradiometer (MODIS) satellite images were used to estimate the chlorophyll-A concentration in southern coastal waters in the Caspian Sea. For this purpose, Multi-layer perceptron neural networks (NNs) were applied which contained three and four feed-forward layers. The best three-layer NN has 15 neurons in its hidden layer and the best four-layer one has 5 in each. The three- and four- layer networks both resulted in similar root mean square errors (RMSE), 0.1($\frac{{\mu}g}{l}$), however, the four-layer NNs proved superior in terms of R2 and also required less training data. Accordingly, a four-layer feed-forward NN with 5 neurons in each hidden layer, is the best network structure for estimating Chlorophyll-A concentration in the southern coastal waters of the Caspian Sea.