• 제목/요약/키워드: FFNN

검색결과 20건 처리시간 0.021초

The ensemble approach in comparison with the diverse feature selection techniques for estimating NPPs parameters using the different learning algorithms of the feed-forward neural network

  • Moshkbar-Bakhshayesh, Khalil
    • Nuclear Engineering and Technology
    • /
    • 제53권12호
    • /
    • pp.3944-3951
    • /
    • 2021
  • Several reasons such as no free lunch theorem indicate that there is not a universal Feature selection (FS) technique that outperforms other ones. Moreover, some approaches such as using synthetic dataset, in presence of large number of FS techniques, are very tedious and time consuming task. In this study to tackle the issue of dependency of estimation accuracy on the selected FS technique, a methodology based on the heterogeneous ensemble is proposed. The performance of the major learning algorithms of neural network (i.e. the FFNN-BR, the FFNN-LM) in combination with the diverse FS techniques (i.e. the NCA, the F-test, the Kendall's tau, the Pearson, the Spearman, and the Relief) and different combination techniques of the heterogeneous ensemble (i.e. the Min, the Median, the Arithmetic mean, and the Geometric mean) are considered. The target parameters/transients of Bushehr nuclear power plant (BNPP) are examined as the case study. The results show that the Min combination technique gives the more accurate estimation. Therefore, if the number of FS techniques is m and the number of learning algorithms is n, by the heterogeneous ensemble, the search space for acceptable estimation of the target parameters may be reduced from n × m to n × 1. The proposed methodology gives a simple and practical approach for more reliable and more accurate estimation of the target parameters compared to the methods such as the use of synthetic dataset or trial and error methods.

Developing an approach for fast estimation of range of ion in interaction with material using the Geant4 toolkit in combination with the neural network

  • Khalil Moshkbar-Bakhshayesh;Soroush Mohtashami
    • Nuclear Engineering and Technology
    • /
    • 제54권11호
    • /
    • pp.4209-4214
    • /
    • 2022
  • Precise modelling of the interaction of ions with materials is important for many applications including material characterization, ion implantation in devices, thermonuclear fusion, hadron therapy, secondary particle production (e.g. neutron), etc. In this study, a new approach using the Geant4 toolkit in combination with the Bayesian regularization (BR) learning algorithm of the feed-forward neural network (FFNN) is developed to estimate the range of ions in materials accurately and quickly. The different incident ions at different energies are interacted with the target materials. The Geant4 is utilized to model the interactions and to calculate the range of the ions. Afterward, the appropriate architecture of the FFNN-BR with the relevant input features is utilized to learn the modelled ranges and to estimate the new ranges for the new cases. The notable achievements of the proposed approach are: 1- The range of ions in different materials is given as quickly as possible and the time required for estimating the ranges can be neglected (i.e. less than 0.01 s by a typical personal computer). 2- The proposed approach can generalize its ability for estimating the new untrained cases. 3- There is no need for a pre-made lookup table for the estimation of the range values.

Mortality Prediction of Older Adults Admitted to the Emergency Department (응급실 방문 노인 환자의 사망률 예측)

  • Park, Junhyeok;Lee, Songwook
    • KIPS Transactions on Software and Data Engineering
    • /
    • 제7권7호
    • /
    • pp.275-280
    • /
    • 2018
  • As the global population becomes aging, the demand for health services for the elderly is expected to increase. In particular, The elderly visiting the emergency department sometimes have complex medical, social, and physical problems, such as having a variety of illnesses or complaints of unusual symptoms. The proposed system is designed to predict the mortality of the elderly patients who are over 65 years old and have admitted the emergency department. For mortality prediction, we compare the support vector machines and Feed Forward Neural Network (FFNN) trained with medical data such as age, sex, blood pressure, body temperature, etc. The results of the FFNN with a hidden layer are best in the mortality prediction, and F1 score and the AUC is 52.0%, 88.6% respectively. If we improve the performance of the proposed system by extracting better medical features, we will be able to provide better medical services through an effective and quick allocation of medical resources for the elderly patients visiting the emergency department.

A Deep Learning Model for Disaster Alerts Classification

  • Park, Soonwook;Jun, Hyeyoon;Kim, Yoonsoo;Lee, Soowon
    • Journal of the Korea Society of Computer and Information
    • /
    • 제26권12호
    • /
    • pp.1-9
    • /
    • 2021
  • Disaster alerts are text messages sent by government to people in the area in the event of a disaster. Since the number of disaster alerts has increased, the number of people who block disaster alerts is increasing as many unnecessary disaster alerts are being received. To solve this problem, this study proposes a deep learning model that automatically classifies disaster alerts by disaster type, and allows only necessary disaster alerts to be received according to the recipient. The proposed model embeds disaster alerts via KoBERT and classifies them by disaster type with LSTM. As a result of classifying disaster alerts using 3 combinations of parts of speech: [Noun], [Noun + Adjective + Verb] and [All parts], and 4 classification models: Proposed model, Keyword classification, Word2Vec + 1D-CNN and KoBERT + FFNN, the proposed model achieved the highest performance with 0.988954 accuracy.

Analysis of streamflow prediction performance by various deep learning schemes

  • Le, Xuan-Hien;Lee, Giha
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 한국수자원학회 2021년도 학술발표회
    • /
    • pp.131-131
    • /
    • 2021
  • Deep learning models, especially those based on long short-term memory (LSTM), have presented their superiority in addressing time series data issues recently. This study aims to comprehensively evaluate the performance of deep learning models that belong to the supervised learning category in streamflow prediction. Therefore, six deep learning models-standard LSTM, standard gated recurrent unit (GRU), stacked LSTM, bidirectional LSTM (BiLSTM), feed-forward neural network (FFNN), and convolutional neural network (CNN) models-were of interest in this study. The Red River system, one of the largest river basins in Vietnam, was adopted as a case study. In addition, deep learning models were designed to forecast flowrate for one- and two-day ahead at Son Tay hydrological station on the Red River using a series of observed flowrate data at seven hydrological stations on three major river branches of the Red River system-Thao River, Da River, and Lo River-as the input data for training, validation, and testing. The comparison results have indicated that the four LSTM-based models exhibit significantly better performance and maintain stability than the FFNN and CNN models. Moreover, LSTM-based models may reach impressive predictions even in the presence of upstream reservoirs and dams. In the case of the stacked LSTM and BiLSTM models, the complexity of these models is not accompanied by performance improvement because their respective performance is not higher than the two standard models (LSTM and GRU). As a result, we realized that in the context of hydrological forecasting problems, simple architectural models such as LSTM and GRU (with one hidden layer) are sufficient to produce highly reliable forecasts while minimizing computation time because of the sequential data nature.

  • PDF

Development of a Runoff Forecasting Model Using Artificial Intelligence (인공지능기법을 이용한 홍수량 선행예측 모형의 개발)

  • Lim Kee-Seok;Heo Chang-Hwan
    • Journal of Environmental Science International
    • /
    • 제15권2호
    • /
    • pp.141-155
    • /
    • 2006
  • This study is aimed at the development of a runoff forecasting model to solve the uncertainties occurring in the process of rainfall-runoff modeling and improve the modeling accuracy of the stream runoff forecasting, The study area is the downstream of Naeseung-chun. Therefore, time-dependent data was obtained from the Wolpo water level gauging station. 11 and 2 out of total 13 flood events were selected for the training and testing set of model. The model performance was improved as the measuring time interval$(T_m)$ was smaller than the sampling time interval$(T_s)$. The Neuro-Fuzzy(NF) and TANK models can give more accurate runoff forecasts up to 4 hours ahead than the Feed Forward Multilayer Neural Network(FFNN) model in standard above the Determination coefficient$(R^2)$ 0.7.

Efficient Markov Chain Monte Carlo for Bayesian Analysis of Neural Network Models

  • Paul E. Green;Changha Hwang;Lee, Sangbock
    • Journal of the Korean Statistical Society
    • /
    • 제31권1호
    • /
    • pp.63-75
    • /
    • 2002
  • Most attempts at Bayesian analysis of neural networks involve hierarchical modeling. We believe that similar results can be obtained with simpler models that require less computational effort, as long as appropriate restrictions are placed on parameters in order to ensure propriety of posterior distributions. In particular, we adopt a model first introduced by Lee (1999) that utilizes an improper prior for all parameters. Straightforward Gibbs sampling is possible, with the exception of the bias parameters, which are embedded in nonlinear sigmoidal functions. In addition to the problems posed by nonlinearity, direct sampling from the posterior distributions of the bias parameters is compounded due to the duplication of hidden nodes, which is a source of multimodality. In this regard, we focus on sampling from the marginal posterior distribution of the bias parameters with Markov chain Monte Carlo methods that combine traditional Metropolis sampling with a slice sampler described by Neal (1997, 2001). The methods are illustrated with data examples that are largely confined to the analysis of nonparametric regression models.

Edge Computing based Industrial Field Worker's Behavior Analysis System using Deep Learning (딥러닝을 활용한 엣지 컴퓨팅 기반 산업현장 작업자 행동 분석 시스템)

  • Lee, Se-Hoon;Bak, Jeong-Jun;Lee, Tae-Hyeong
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 한국컴퓨터정보학회 2020년도 제61차 동계학술대회논문집 28권1호
    • /
    • pp.63-64
    • /
    • 2020
  • 본 논문에서는 딥러닝을 이용한 작업자 위험 행동 모니터링 선행 연구에 기반해, 엣지 컴퓨팅 기반 딥러닝을 사용하여 클라우드에 대한 의존성 문제를 해결하였다. 작업자는 IoT 안전벨트와 영상 전송 안전모를 통해 정보를 수집, 처리한다. 또한 LSTM 방식에서 개량된 필터를 통한 FFNN 딥러닝 방법을 사용하여 작업자 위험 행동 패턴 분석을 하며 선행 연구의 작업자 행동 모니터링 시스템을 엣지 컴퓨팅 기반 위에서 구현하였다.

  • PDF

A Recommender System Model Using a Neural Network Based on the Self-Product Image Congruence

  • Kang, Joo Hee;Lee, Yoon-Jung
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • 제44권3호
    • /
    • pp.556-571
    • /
    • 2020
  • This study predicts consumer preference for social clothing at work, excluding uniforms using the self-product congruence theory that also establishes a model to predict the preference for recommended products that match the consumer's own image. A total of 490 Korean male office workers participated in this study. Participants' self-image and the product images of 20 apparel items were measured using nine adjective semantic scales (namely elegant, stable, sincere, refined, intense, luxury, bold, conspicuous, and polite). A model was then constructed to predict the consumer preferences using a neural network with Python and TensorFlow. The resulting Predict Preference Model using Product Image (PPMPI) was trained using product image and the preference of each product. Current research confirms that product preference can be predicted by the self-image instead of by entering the product image. The prediction accuracy rate of the PPMPI was over 80%. We used 490 items of test data consisting of self-images to predict the consumer preferences for using the PPMPI. The test of the PPMPI showed that the prediction rate differed depending on product attributes. The prediction rate of work apparel with normative images was over 70% and higher than for other forms of apparel.

Prediction of rock slope failure using multiple ML algorithms

  • Bowen Liu;Zhenwei Wang;Sabih Hashim Muhodir;Abed Alanazi;Shtwai Alsubai;Abdullah Alqahtani
    • Geomechanics and Engineering
    • /
    • 제36권5호
    • /
    • pp.489-509
    • /
    • 2024
  • Slope stability analysis and prediction are of critical importance to geotechnical engineers, given the severe consequences associated with slope failure. This research endeavors to forecast the factor of safety (FOS) for slopes through the implementation of six distinct ML techniques, including back propagation neural networks (BPNN), feed-forward neural networks (FFNN), Takagi-Sugeno fuzzy system (TSF), gene expression programming (GEP), and least-square support vector machine (Ls-SVM). 344 slope cases were analyzed, incorporating a variety of geometric and shear strength parameters measured through the PLAXIS software alongside several loss functions to assess the models' performance. The findings demonstrated that all models produced satisfactory results, with BPNN and GEP models proving to be the most precise, achieving an R2 of 0.86 each and MAE and MAPE rates of 0.00012 and 0.00002 and 0.005 and 0.004, respectively. A Pearson correlation and residuals statistical analysis were carried out to examine the importance of each factor in the prediction, revealing that all considered geomechanical features are significantly relevant to slope stability. However, the parameters of friction angle and slope height were found to be the most and least significant, respectively. In addition, to aid in the FOS computation for engineering challenges, a graphical user interface (GUI) for the ML-based techniques was created.