• 제목/요약/키워드: Optimal Learning Rates

검색결과 48건 처리시간 0.027초

다층퍼셉트론의 강하 학습을 위한 최적 학습률 (Optimal Learning Rates in Gradient Descent Training of Multilayer Perceptrons)

  • 오상훈
    • 한국콘텐츠학회논문지
    • /
    • 제4권3호
    • /
    • pp.99-105
    • /
    • 2004
  • 이 논문은 다층퍼셉트론의 학습을 빠르게 하기 위한 최적 학습률을 제안한다. 이 학습률은 한 뉴런에 연결된 가중치들에 대한 학습률과, 중간층에 가상의 목표값을 설정하기 위한 학습률로 나타난다. 그 결과, 중간층 가중치의 최적 학습률은 가상의 중간층 목표값 할당 성분과 중간층 오차함수를 최소화 시키고자하는 성분의 곱으로 나타난다. 제안한 방법은 고립단어인식과 필기체 숫자 인식 문제의 시뮬레이션으로 효용성을 확인하였다.

  • PDF

다중 사용자 다중 안테나 네트워크를 위한 심화 학습기반 사용자 스케쥴링 (Deep Learning Based User Scheduling For Multi-User and Multi-Antenna Networks)

  • 반태원;이웅섭
    • 한국정보통신학회논문지
    • /
    • 제23권8호
    • /
    • pp.975-980
    • /
    • 2019
  • 본 논문에서는 차세대 이동통신 시스템의 핵심 요소 기술 중의 하나로 각광 받고 있는 다중 사용자 다중 안테나 네트워크에서 사용자 선택을 위한 심화 학습 기반 스케쥴링 기법을 제안한다. 제안된 신경망을 학습시키기 위하여 기존의 최적 방식을 통해서 90,000 데이터 샘플을 확보하였으며, 추가적인 10,000 데이터 샘플을 이용하여 최종 학습된 신경망의 과최적화 여부를 확인하였다. 제안된 신경망 기반의 스케쥴링 알고리즘은 초기 학습 시에는 상당한 복잡도와 학습 시간이 필요하지만, 일단 학습이 완료된 이후에는 추가적인 복잡도가 유발되지 않는 장점이 있다. 반면에, 기존의 최적 방식은 매 스케쥴링마다 동일한 복잡도의 계산이 지속적으로 요구된다. 다양한 컴퓨터 시뮬레이션 결과에 따르면, 제안된 심화 학습 기반의 스케쥴링 기법은 10dB 보다 낮은 SNR에서는 기존 최적 알고리즘의 약 88~96%에 이르는 평균 전송 속도의 합을 얻을 수 있으며, 10dB 이상의 SNR에서는 최적의 평균 전송 속도의 합을 얻을 수 있다.

Area Extraction of License Plates Using an Artificial Neural Network

  • Kim, Hyun-Yul;Lee, Seung-Kyu;Lee, Geon-Wha;Park, Young-rok
    • 한국정보전자통신기술학회논문지
    • /
    • 제7권4호
    • /
    • pp.212-222
    • /
    • 2014
  • In the current study, the authors propose a method for extracting license plate regions by means of a neural network trained to output the plate's center of gravity. The method is shown to be effective. Since the learning pattern presentation positions are defined by random numbers, a different pattern is submitted to the neural network for learning each time, which enables it to form a neural network with high universality of coverage. The article discusses issues of the optimal learning surface for a license plate covered by the learning pattern, the effect of suppression learning of the number and pattern enlargement/reduction and of concentration value conversion. Results of evaluation tests based on pictures of 595 vehicles taken at an under-ground parking garage demonstrated detection rates of 98.5%, 98.7%, and 100%, respectively.

인공신경망 모델을 이용한 냉동기 및 공조기 최적 기동/정지 제어 (Artificial Neural Network Models for Optimal Start and Stop of Chiller and AHU)

  • 박성호;안기언;황승호;최선규;박철수
    • 대한건축학회논문집:구조계
    • /
    • 제35권2호
    • /
    • pp.45-52
    • /
    • 2019
  • BEMS(Building Energy Management Systems) have been applied to office buildings and collect relevant building energy data, e.g. temperatures, mass flow rates and energy consumptions of building mechanical systems and indoor spaces. The aforementioned measured data can be beneficially utilized for developing data-driven machine learning models which can be then used as part of MPC(Model Predictive Control) and/or optimal control strategies. In this study, the authors developed ANN(Artificial Neural Network) models of an AHU (Air Handling Unit) and a chiller for a real-life office building using BEMS data. Based on the ANN models, the authors developed optimal control strategies, e.g. daily operation schedule with regard to optimal start and stop of the AHU and the chiller (500 RT). It was found that due to the optimal start and stop of the AHU and the chiller, 4.5% and 16.4% of operation hours of the AHU and the chiller could be saved, compared to an existing operation.

불안정한 다변수 시스템에 대한 퍼지 학습제어 (Fuzzy Learning Control for Multivariable Unstable System)

  • 임윤규;정병묵;소범식
    • 제어로봇시스템학회논문지
    • /
    • 제5권7호
    • /
    • pp.808-813
    • /
    • 1999
  • A fuzzy learning method to control an unstable and multivariable system is presented in this paper, Because the multivariable system has generally a coupling effect between the inputs and outputs, it is difficult to find its modeling equation or parameters. If the system is unstable, initial condition rules are needed to make it stable because learning is nearly impossible. Therefore, this learning method uses the initial rules and introduces a cost function composed of the actual error and error-rate of each output without the modeling equation. To minimize the cost function, we experimentally got the Jacobian matrix in the operating point of the system. From the Jacobian matrix, we can find the direction of the convergence in the learning, and the optimal control rules are finally acquired when the fuzzy rules are updated by changing the portion of the errors and error rates.

  • PDF

An Improvement of AdaBoost using Boundary Classifier

  • 이원주;천민규;현창호;박민용
    • 한국지능시스템학회논문지
    • /
    • 제23권2호
    • /
    • pp.166-171
    • /
    • 2013
  • The method proposed in this paper can improve the performance of the Boosting algorithm in machine learning. The proposed Boundary AdaBoost algorithm can make up for the weak points of Normal binary classifier using threshold boundary concepts. The new proposed boundary can be located near the threshold of the binary classifier. The proposed algorithm improves classification in areas where Normal binary classifier is weak. Thus, the optimal boundary final classifier can decrease error rates classified with more reasonable features. Finally, this paper derives the new algorithm's optimal solution, and it demonstrates how classifier accuracy can be improved using the proposed Boundary AdaBoost in a simulation experiment of pedestrian detection using 10-fold cross validation.

HCM 및 최적 알고리즘을 이용한 퍼지-뉴럴네트워크구조의 설계 (Design of Fuzzy-Neural Networks Structure using HCM and Optimization Algorithm)

  • 윤기찬;박병준;오성권
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1998년도 추계학술대회 논문집 학회본부 B
    • /
    • pp.654-656
    • /
    • 1998
  • This paper presents an optimal identification method of nonlinear and complex system that is based on fuzzy-neural network(FNN). The FNN used simplified inference as fuzzy inference method and Error Back Propagation Algorithm as learning rule. And we use a HCM Algorithm to find initial parameters of membership function. And then to obtain optimal parameters, we use the genetic algorithm. Genetic algorithm is a random search algorithm which can find the global optimum without converging to local optimum. The parameters such as membership functions, learning rates and momentum coefficients are easily adjusted using the genetic algorithms. Also, the performance index with weighted value is introduced to achieve a meaningful balance between approximation and generalization abilities of the model. To evaluate the performance of the FNN, we use the time series data for 9as furnace and the sewage treatment process.

  • PDF

A study on Detecting the Safety helmet wearing using YOLOv5-S model and transfer learning

  • Kwak, NaeJoung;Kim, DongJu
    • International Journal of Advanced Culture Technology
    • /
    • 제10권1호
    • /
    • pp.302-309
    • /
    • 2022
  • Occupational safety accidents are caused by various factors, and it is difficult to predict when and why they occur, and it is directly related to the lives of workers, so the interest in safety accidents is increasing every year. Therefore, in order to reduce safety accidents at industrial fields, workers are required to wear personal protective equipment. In this paper, we proposes a method to automatically check whether workers are wearing safety helmets among the protective equipment in the industrial field. It detects whether or not the helmet is worn using YOLOv5, a computer vision-based deep learning object detection algorithm. We transfer learning the s model among Yolov5 models with different learning rates and epochs, evaluate the performance, and select the optimal model. The selected model showed a performance of 0.959 mAP.

최적 알고리즘과 합성 성능지수에 의한 퍼지-뉴럴네트워크구조의 설계 (Design of Fuzzy-Neural Networks Structure using Optimization Algorithm and an Aggregate Weighted Performance Index)

  • 윤기찬;오성권;박종진
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 1999년도 하계학술대회 논문집 G
    • /
    • pp.2911-2913
    • /
    • 1999
  • This paper suggest an optimal identification method to complex and nonlinear system modeling that is based on Fuzzy-Neural Network(FNN). The FNN modeling implements parameter identification using HCM algorithm and optimal identification algorithm structure combined with two types of optimization theories for nonlinear systems, we use a HCM Clustering Algorithm to find initial parameters of membership function. The parameters such as parameters of membership functions, learning rates and momentum coefficients are adjusted using optimal identification algorithm. The proposed optimal identification algorithm is carried out using both a genetic algorithm and the improved complex method. Also, an aggregate objective function(performance index) with weighted value is proposed to achieve a sound balance between approximation and generalization abilities of the model. To evaluate the performance of the proposed model, we use the time series data for gas furnace, the data of sewage treatment process and traffic route choice process.

  • PDF

Stable Intelligent Control of Chaotic Systems via Wavelet Neural Network

  • Choi, Jong-Tae;Choi, Yoon-Ho;Park, Jin-Bae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2003년도 ICCAS
    • /
    • pp.316-321
    • /
    • 2003
  • This paper presents a design method of the wavelet neural network based controller using direct adaptive control method to deal with a stable intelligent control of chaotic systems. The various uncertainties, such as mechanical parametric variation, external disturbance, and unstructured uncertainty influence the control performance. However, the conventional control methods such as optimal control, adaptive control and robust control may not be feasible when an explicit, faithful mathematical model cannot be constructed. Therefore, an intelligent control system that is an on-line trained WNN controller based on direct adaptive control method with adaptive learning rates is proposed to control chaotic nonlinear systems whose mathematical models are not available. The adaptive learning rates are derived in the sense of discrete-type Lyapunov stability theorem, so that the convergence of the tracking error can be guaranteed in the closed-loop system. In the whole design process, the strict constrained conditions and prior knowledge of the controlled plant are not necessary due to the powerful learning ability of the proposed intelligent control system. The gradient-descent method is used for training a wavelet neural network controller of chaotic systems. Finally, the effectiveness and feasibility of the proposed control method is demonstrated with application to the chaotic systems.

  • PDF