• Title/Summary/Keyword: Optimal Learning Rates

Search Result 48, Processing Time 0.028 seconds

Optimal Learning Rates in Gradient Descent Training of Multilayer Perceptrons (다층퍼셉트론의 강하 학습을 위한 최적 학습률)

  • 오상훈
    • The Journal of the Korea Contents Association
    • /
    • v.4 no.3
    • /
    • pp.99-105
    • /
    • 2004
  • This paper proposes optimal learning rates in the gradient descent training of multilayer perceptrons, which are a separate learning rate for weights associated with each neuron and a separate one for assigning virtual hidden targets associated with each training pattern Effectiveness of the proposed error function was demonstrated for a handwritten digit recognition and an isolated-word recognition tasks and very fast learning convergence was obtained.

  • PDF

Deep Learning Based User Scheduling For Multi-User and Multi-Antenna Networks (다중 사용자 다중 안테나 네트워크를 위한 심화 학습기반 사용자 스케쥴링)

  • Ban, Tae-Won;Lee, Woongsup
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.8
    • /
    • pp.975-980
    • /
    • 2019
  • In this paper, we propose a deep learning-based scheduling scheme for user selection in multi-user multi-antenna networks which is considered one of key technologies for the next generation mobile communication systems. We obtained 90,000 data samples from the conventional optimal scheme to train the proposed neural network and verified the trained neural network to check if the trained neural network is over-fitted. Although the proposed neural network-based scheduling algorithm requires considerable complexity and time for training in the initial stage, it does not cause any extra complexity once it has been trained successfully. On the other hand, the conventional optimal scheme continuously requires the same complexity of computations for every scheduling. According to extensive computer-simulations, the proposed deep learning-based scheduling algorithm yields about 88~96% average sum-rates of the conventional scheme for SNRs lower than 10dB, while it can achieve optimal average sum-rates for SNRs higher than 10dB.

Area Extraction of License Plates Using an Artificial Neural Network

  • Kim, Hyun-Yul;Lee, Seung-Kyu;Lee, Geon-Wha;Park, Young-rok
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.7 no.4
    • /
    • pp.212-222
    • /
    • 2014
  • In the current study, the authors propose a method for extracting license plate regions by means of a neural network trained to output the plate's center of gravity. The method is shown to be effective. Since the learning pattern presentation positions are defined by random numbers, a different pattern is submitted to the neural network for learning each time, which enables it to form a neural network with high universality of coverage. The article discusses issues of the optimal learning surface for a license plate covered by the learning pattern, the effect of suppression learning of the number and pattern enlargement/reduction and of concentration value conversion. Results of evaluation tests based on pictures of 595 vehicles taken at an under-ground parking garage demonstrated detection rates of 98.5%, 98.7%, and 100%, respectively.

Artificial Neural Network Models for Optimal Start and Stop of Chiller and AHU (인공신경망 모델을 이용한 냉동기 및 공조기 최적 기동/정지 제어)

  • Park, SungHo;Ahn, Ki Uhn;Hwang, Aaron;Choi, Sunkyu;Park, Cheol Soo
    • Journal of the Architectural Institute of Korea Structure & Construction
    • /
    • v.35 no.2
    • /
    • pp.45-52
    • /
    • 2019
  • BEMS(Building Energy Management Systems) have been applied to office buildings and collect relevant building energy data, e.g. temperatures, mass flow rates and energy consumptions of building mechanical systems and indoor spaces. The aforementioned measured data can be beneficially utilized for developing data-driven machine learning models which can be then used as part of MPC(Model Predictive Control) and/or optimal control strategies. In this study, the authors developed ANN(Artificial Neural Network) models of an AHU (Air Handling Unit) and a chiller for a real-life office building using BEMS data. Based on the ANN models, the authors developed optimal control strategies, e.g. daily operation schedule with regard to optimal start and stop of the AHU and the chiller (500 RT). It was found that due to the optimal start and stop of the AHU and the chiller, 4.5% and 16.4% of operation hours of the AHU and the chiller could be saved, compared to an existing operation.

Fuzzy Learning Control for Multivariable Unstable System (불안정한 다변수 시스템에 대한 퍼지 학습제어)

  • 임윤규;정병묵;소범식
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.5 no.7
    • /
    • pp.808-813
    • /
    • 1999
  • A fuzzy learning method to control an unstable and multivariable system is presented in this paper, Because the multivariable system has generally a coupling effect between the inputs and outputs, it is difficult to find its modeling equation or parameters. If the system is unstable, initial condition rules are needed to make it stable because learning is nearly impossible. Therefore, this learning method uses the initial rules and introduces a cost function composed of the actual error and error-rate of each output without the modeling equation. To minimize the cost function, we experimentally got the Jacobian matrix in the operating point of the system. From the Jacobian matrix, we can find the direction of the convergence in the learning, and the optimal control rules are finally acquired when the fuzzy rules are updated by changing the portion of the errors and error rates.

  • PDF

An Improvement of AdaBoost using Boundary Classifier

  • Lee, Wonju;Cheon, Minkyu;Hyun, Chang-Ho;Park, Mignon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.23 no.2
    • /
    • pp.166-171
    • /
    • 2013
  • The method proposed in this paper can improve the performance of the Boosting algorithm in machine learning. The proposed Boundary AdaBoost algorithm can make up for the weak points of Normal binary classifier using threshold boundary concepts. The new proposed boundary can be located near the threshold of the binary classifier. The proposed algorithm improves classification in areas where Normal binary classifier is weak. Thus, the optimal boundary final classifier can decrease error rates classified with more reasonable features. Finally, this paper derives the new algorithm's optimal solution, and it demonstrates how classifier accuracy can be improved using the proposed Boundary AdaBoost in a simulation experiment of pedestrian detection using 10-fold cross validation.

Design of Fuzzy-Neural Networks Structure using HCM and Optimization Algorithm (HCM 및 최적 알고리즘을 이용한 퍼지-뉴럴네트워크구조의 설계)

  • Yoon, Ki-Chang;Park, Byoung-Jun;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.654-656
    • /
    • 1998
  • This paper presents an optimal identification method of nonlinear and complex system that is based on fuzzy-neural network(FNN). The FNN used simplified inference as fuzzy inference method and Error Back Propagation Algorithm as learning rule. And we use a HCM Algorithm to find initial parameters of membership function. And then to obtain optimal parameters, we use the genetic algorithm. Genetic algorithm is a random search algorithm which can find the global optimum without converging to local optimum. The parameters such as membership functions, learning rates and momentum coefficients are easily adjusted using the genetic algorithms. Also, the performance index with weighted value is introduced to achieve a meaningful balance between approximation and generalization abilities of the model. To evaluate the performance of the FNN, we use the time series data for 9as furnace and the sewage treatment process.

  • PDF

A study on Detecting the Safety helmet wearing using YOLOv5-S model and transfer learning

  • Kwak, NaeJoung;Kim, DongJu
    • International Journal of Advanced Culture Technology
    • /
    • v.10 no.1
    • /
    • pp.302-309
    • /
    • 2022
  • Occupational safety accidents are caused by various factors, and it is difficult to predict when and why they occur, and it is directly related to the lives of workers, so the interest in safety accidents is increasing every year. Therefore, in order to reduce safety accidents at industrial fields, workers are required to wear personal protective equipment. In this paper, we proposes a method to automatically check whether workers are wearing safety helmets among the protective equipment in the industrial field. It detects whether or not the helmet is worn using YOLOv5, a computer vision-based deep learning object detection algorithm. We transfer learning the s model among Yolov5 models with different learning rates and epochs, evaluate the performance, and select the optimal model. The selected model showed a performance of 0.959 mAP.

Design of Fuzzy-Neural Networks Structure using Optimization Algorithm and an Aggregate Weighted Performance Index (최적 알고리즘과 합성 성능지수에 의한 퍼지-뉴럴네트워크구조의 설계)

  • Yoon, Ki-Chan;Oh, Sung-Kwun;Park, Jong-Jin
    • Proceedings of the KIEE Conference
    • /
    • 1999.07g
    • /
    • pp.2911-2913
    • /
    • 1999
  • This paper suggest an optimal identification method to complex and nonlinear system modeling that is based on Fuzzy-Neural Network(FNN). The FNN modeling implements parameter identification using HCM algorithm and optimal identification algorithm structure combined with two types of optimization theories for nonlinear systems, we use a HCM Clustering Algorithm to find initial parameters of membership function. The parameters such as parameters of membership functions, learning rates and momentum coefficients are adjusted using optimal identification algorithm. The proposed optimal identification algorithm is carried out using both a genetic algorithm and the improved complex method. Also, an aggregate objective function(performance index) with weighted value is proposed to achieve a sound balance between approximation and generalization abilities of the model. To evaluate the performance of the proposed model, we use the time series data for gas furnace, the data of sewage treatment process and traffic route choice process.

  • PDF

Stable Intelligent Control of Chaotic Systems via Wavelet Neural Network

  • Choi, Jong-Tae;Choi, Yoon-Ho;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.316-321
    • /
    • 2003
  • This paper presents a design method of the wavelet neural network based controller using direct adaptive control method to deal with a stable intelligent control of chaotic systems. The various uncertainties, such as mechanical parametric variation, external disturbance, and unstructured uncertainty influence the control performance. However, the conventional control methods such as optimal control, adaptive control and robust control may not be feasible when an explicit, faithful mathematical model cannot be constructed. Therefore, an intelligent control system that is an on-line trained WNN controller based on direct adaptive control method with adaptive learning rates is proposed to control chaotic nonlinear systems whose mathematical models are not available. The adaptive learning rates are derived in the sense of discrete-type Lyapunov stability theorem, so that the convergence of the tracking error can be guaranteed in the closed-loop system. In the whole design process, the strict constrained conditions and prior knowledge of the controlled plant are not necessary due to the powerful learning ability of the proposed intelligent control system. The gradient-descent method is used for training a wavelet neural network controller of chaotic systems. Finally, the effectiveness and feasibility of the proposed control method is demonstrated with application to the chaotic systems.

  • PDF