• Title/Summary/Keyword: dynamic learning rate

Search Result 95, Processing Time 0.022 seconds

Improving Learning Performance of Support Vector Machine using the Kernel Relaxation and the Dynamic Momentum (Kernel Relaxation과 동적 모멘트를 조합한 Support Vector Machine의 학습 성능 향상)

  • Kim, Eun-Mi;Lee, Bae-Ho
    • The KIPS Transactions:PartB
    • /
    • v.9B no.6
    • /
    • pp.735-744
    • /
    • 2002
  • This paper proposes learning performance improvement of support vector machine using the kernel relaxation and the dynamic momentum. The dynamic momentum is reflected to different momentum according to current state. While static momentum is equally influenced on the whole, the proposed dynamic momentum algorithm can control to the convergence rate and performance according to the change of the dynamic momentum by training. The proposed algorithm has been applied to the kernel relaxation as the new sequential learning method of support vector machine presented recently. The proposed algorithm has been applied to the SONAR data which is used to the standard classification problems for evaluating neural network. The simulation results of proposed algorithm have better the convergence rate and performance than those using kernel relaxation and static momentum, respectively.

A study on interrelation between the structure of a Plant and the str neural network emulator and the learning rate (플랜트구조와 신경망에뮬레이터의 구조 및 학습시간과의 관계)

  • Pae, Chang-Han;Lee, Kwang-Won
    • Proceedings of the KIEE Conference
    • /
    • 1997.07b
    • /
    • pp.386-389
    • /
    • 1997
  • Error-backpropagation has been used in the bulk of Practical applications for neural networks. While an emulator, a multilayered neural network, learns to identify the system's dynamic characteristics. There is, however, no concrete theoretical results about the structure of a plant and the structure of a multilayered neural network and the learning rate. The paper investigates the relation between structure of a plant and a multilayered network and learning rate. Simulation study shows that the plant signal with a short period and a fast sam time is preferable for learning of the network emulator.

  • PDF

DLDW: Deep Learning and Dynamic Weighing-based Method for Predicting COVID-19 Cases in Saudi Arabia

  • Albeshri, Aiiad
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.9
    • /
    • pp.212-222
    • /
    • 2021
  • Multiple waves of COVID-19 highlighted one crucial aspect of this pandemic worldwide that factors affecting the spread of COVID-19 infection are evolving based on various regional and local practices and events. The introduction of vaccines since early 2021 is expected to significantly control and reduce the cases. However, virus mutations and its new variant has challenged these expectations. Several countries, which contained the COVID-19 pandemic successfully in the first wave, failed to repeat the same in the second and third waves. This work focuses on COVID-19 pandemic control and management in Saudi Arabia. This work aims to predict new cases using deep learning using various important factors. The proposed method is called Deep Learning and Dynamic Weighing-based (DLDW) COVID-19 cases prediction method. Special consideration has been given to the evolving factors that are responsible for recent surges in the pandemic. For this purpose, two weights are assigned to data instance which are based on feature importance and dynamic weight-based time. Older data is given fewer weights and vice-versa. Feature selection identifies the factors affecting the rate of new cases evolved over the period. The DLDW method produced 80.39% prediction accuracy, 6.54%, 9.15%, and 7.19% higher than the three other classifiers, Deep learning (DL), Random Forest (RF), and Gradient Boosting Machine (GBM). Further in Saudi Arabia, our study implicitly concluded that lockdowns, vaccination, and self-aware restricted mobility of residents are effective tools in controlling and managing the COVID-19 pandemic.

Improved Rate of Convergence in Kohonen Network using Dynamic Gaussian Function (동적 가우시안 함수를 이용한 Kohonen 네트워크 수렴속도 개선)

  • Kil, Min-Wook;Lee, Geuk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.7 no.4
    • /
    • pp.204-210
    • /
    • 2002
  • The self-organizing feature map of Kohonen has disadvantage that needs too much input patterns in order to converge into the equilibrium state when it trains. In this paper we proposed the method of improving the convergence speed and rate of self-organizing feature map converting the interaction set into Dynamic Gaussian function. The proposed method Provides us with dynamic Properties that the deviation and width of Gaussian function used as an interaction function are narrowed in proportion to learning times and learning rates that varies according to topological position from the winner neuron. In this Paper. we proposed the method of improving the convergence rate and the degree of self-organizing feature map.

  • PDF

A NARX Dynamic Neural Network Platform for Small-Sat PDM (동적신경망 NARX 기반의 SAR 전력모듈 안전성 연구)

  • Lee, Hae-Jun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.6
    • /
    • pp.809-817
    • /
    • 2020
  • In the design and development process of Small-Sat power distribution and transmission module, the stability of dynamic resources was evaluated by a deep learning algorithm. The requirements for the stability evaluation consisted of the power distribution function of the power distribution module and demand module to the SAR radar in Small-Sat. To verify the performance of the switching power components constituting the power module PDM, the reliability was verified using a dynamic neural network. The adoption material of deep learning for reliability verification is the power distribution function of the payload to the power supplied from the small satellite main body. Modeling targets for verifying the performance of this function are output voltage (slew rate control), voltage error, and load power characteristics. First, to this end, the Coefficient Structure area was defined by modeling, and PCB modules were fabricated to compare stability and reliability. Second, Levenberg-Marquare based Two-Way NARX neural network Sigmoid Transfer was used as a deep learning algorithm.

Adaptive Control of the Nonlinear Systems Using Diagonal Recurrent Neural Networks (대각귀환 신경망을 이용한 비선형 적응 제어)

  • Ryoo, Dong-Wan;Lee, Young-Seog;Seo, Bo-Hyeok
    • Proceedings of the KIEE Conference
    • /
    • 1996.07b
    • /
    • pp.939-942
    • /
    • 1996
  • This paper presents a stable learning algorithm for diagonal recurrent neural network(DRNN). DRNN is applied to a problem of controlling nonlinear dynamical systems. A architecture of DRNN is a modified model of the Recurrent Neural Network(RNN) with one hidden layer, and the hidden layer is comprised of self-recurrent neurons. DRNN has considerably fewer weights than RNN. Since there is no interlinks amongs in the hidden layer. DRNN is dynamic mapping and is better suited for dynamical systems than static forward neural network. To guarantee convergence and for faster learning, an adaptive learning rate is developed by using Lyapunov function. The ability and effectiveness of identifying and controlling a nonlinear dynamic system using the proposed algorithm is demonstrated by computer simulation.

  • PDF

Analyzing the Influence of Spatial Sampling Rate on Three-dimensional Temperature-field Reconstruction

  • Shenxiang Feng;Xiaojian Hao;Tong Wei;Xiaodong Huang;Pan Pei;Chenyang Xu
    • Current Optics and Photonics
    • /
    • v.8 no.3
    • /
    • pp.246-258
    • /
    • 2024
  • In aerospace and energy engineering, the reconstruction of three-dimensional (3D) temperature distributions is crucial. Traditional methods like algebraic iterative reconstruction and filtered back-projection depend on voxel division for resolution. Our algorithm, blending deep learning with computer graphics rendering, converts 2D projections into light rays for uniform sampling, using a fully connected neural network to depict the 3D temperature field. Although effective in capturing internal details, it demands multiple cameras for varied angle projections, increasing cost and computational needs. We assess the impact of camera number on reconstruction accuracy and efficiency, conducting butane-flame simulations with different camera setups (6 to 18 cameras). The results show improved accuracy with more cameras, with 12 cameras achieving optimal computational efficiency (1.263) and low error rates. Verification experiments with 9, 12, and 15 cameras, using thermocouples, confirm that the 12-camera setup as the best, balancing efficiency and accuracy. This offers a feasible, cost-effective solution for real-world applications like engine testing and environmental monitoring, improving accuracy and resource management in temperature measurement.

The Effect of Segment Size on Quality Selection in DQN-based Video Streaming Services (DQN 기반 비디오 스트리밍 서비스에서 세그먼트 크기가 품질 선택에 미치는 영향)

  • Kim, ISeul;Lim, Kyungshik
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.10
    • /
    • pp.1182-1194
    • /
    • 2018
  • The Dynamic Adaptive Streaming over HTTP(DASH) is envisioned to evolve to meet an increasing demand on providing seamless video streaming services in the near future. The DASH performance heavily depends on the client's adaptive quality selection algorithm that is not included in the standard. The existing conventional algorithms are basically based on a procedural algorithm that is not easy to capture and reflect all variations of dynamic network and traffic conditions in a variety of network environments. To solve this problem, this paper proposes a novel quality selection mechanism based on the Deep Q-Network(DQN) model, the DQN-based DASH Adaptive Bitrate(ABR) mechanism. The proposed mechanism adopts a new reward calculation method based on five major performance metrics to reflect the current conditions of networks and devices in real time. In addition, the size of the consecutive video segment to be downloaded is also considered as a major learning metric to reflect a variety of video encodings. Experimental results show that the proposed mechanism quickly selects a suitable video quality even in high error rate environments, significantly reducing frequency of quality changes compared to the existing algorithm and simultaneously improving average video quality during video playback.

Prediction of Static and Dynamic Behavior of Truss Structures Using Deep Learning (딥러닝을 이용한 트러스 구조물의 정적 및 동적 거동 예측)

  • Sim, Eun-A;Lee, Seunghye;Lee, Jaehong
    • Journal of Korean Association for Spatial Structures
    • /
    • v.18 no.4
    • /
    • pp.69-80
    • /
    • 2018
  • In this study, an algorithm applying deep learning to the truss structures was proposed. Deep learning is a method of raising the accuracy of machine learning by creating a neural networks in a computer. Neural networks consist of input layers, hidden layers and output layers. Numerous studies have focused on the introduction of neural networks and performed under limited examples and conditions, but this study focused on two- and three-dimensional truss structures to prove the effectiveness of algorithms. and the training phase was divided into training model based on the dataset size and epochs. At these case, a specific data value was selected and the error rate was shown by comparing the actual data value with the predicted value, and the error rate decreases as the data set and the number of hidden layers increases. In consequence, it showed that it is possible to predict the result quickly and accurately without using a numerical analysis program when applying the deep learning technique to the field of structural analysis.

A Study on the Application of Biophilic Design Pattern in Educational space (아동 교육 공간의 바이오필릭 디자인 패턴 적용 분석)

  • Choi, Joo-young;Park, Sung-jun
    • Journal of the Korean Institute of Educational Facilities
    • /
    • v.27 no.3
    • /
    • pp.3-14
    • /
    • 2020
  • The purpose of this study is to discuss the planning direction of educational spaces to support children's healthy and creative learning based on bio_philic theory. This study analyzed the characteristics of the application of biophilic patterns in children's education space through case analysis. The conclusion of this study is summarized as follows. As a result of the analysis of children's classroom space, the pattern of 'A(Visual connection with nature), F(Dynamic & Diffuse Light), K(Prospect)' shows high application rate, but the pattern of 'C(Non-Rhythmic Sensory Stimuli), G(Connection with Natural Systems), I(Material Connection with Nature)' shows low application rate. In particular, there is a lack of connection with patterns such as hearing, smell, touch, taste stimulation and water experience, and curiosity through exploration of nature about 'B(Non-visual connection with nature), E(Presence of Water), N(Risk/Peril)' changes in nature and ecosystem. In the corridor and rest space, the pattern of 'A(Visual connection with nature), D(Thermal & Airflow Variability), F(Dynamic & Diffuse Light), G(Connection with Natural Systems), K(Prospect)' shows high application rate, but 'B(Non-visual connection with nature)' shows low application rate. In addition, the application of patterns related to the stimulation of curiosity through direct exploration of nature and the exploration of the patterns of 'E(Presence of Water), N(Risk/Peril)' is insufficient. Therefore, in the case of classroom spaces, the active use of nature as it is should be considered within the scope that does not cause visual confusion, and it should provide an area that can be experienced through the five senses. And corridors and rest spaces should be designed to introduce more active natural elements as spaces to recover stress caused by learning. In other words, the characteristics of children's education facilities need to be connected between classroom space, corridor, rest space and external space. This study is meaningful in that it analyzes and derives the application characteristics of 'biophilic design' which affects the 'Attention Restoration' of children's educational spaces through foreign cases.