• 제목/요약/키워드: steepest gradient descent

검색결과 34건 처리시간 0.027초

다층신경망을 이용한 디지털회로의 효율적인 결함진단 (An Efficient Fault-diagnosis of Digital Circuits Using Multilayer Neural Networks)

  • 조용현;박용수
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 1999년도 하계종합학술대회 논문집
    • /
    • pp.1033-1036
    • /
    • 1999
  • This paper proposes an efficient fault diagnosis for digital circuits using multilayer neural networks. The efficient learning algorithm is also proposed for the multilayer neural network, which is combined the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The fault-diagnosis system using the multilayer neural network of the proposed algorithm has been applied to the parity generator circuit. The simulation results shows that the proposed system is higher convergence speed and rate, in comparision with system using the backpropagation algorithm based on the gradient descent.

  • PDF

2차원 익렬 익형의 최적역설계 (Optimum Inverse Design of 2-D Cascade Airfoil)

  • 조장근;박원규
    • 대한조선학회논문집
    • /
    • 제39권4호
    • /
    • pp.17-23
    • /
    • 2002
  • 2차원 익렬 익형의 표면에 목적하는 압력계수 분포를 설정하고 그 압력계수의 분포에 해당하는 형상을 설계하기 위해 임의의 초기형상으로부터 목적 형상에 근접해가도록 최적화 기법을 도입하여 역설계를 수행하였다. 목적함수인 표면압력계수를 구하기 위해 비직교 일반좌표계상의 2차원 비압축성 나비어-스톡스 방정식을 사용하였으며 목적함수의 감소를 위해서는 최속강하법과 공액 경사도 방법을 사용하였다. 해의 탐색방향을 위해 1차 정확도의 유한 차분화를 행하였고, 해의 탐색거리를 위해 황금분할법을 사용하였다. 본 연구의 결과, 목적한 형상으로의 수렴성이 뛰어남을 확인할 수 있었다.

최적화 기법을 이용한 1차원 부등류에서의 매닝조도계수 추정 (Identification of Manning's Roughness in 1D nonuniform flow)

  • 이두한;이동섭;김명환
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2010년도 학술발표회
    • /
    • pp.679-683
    • /
    • 2010
  • 본 연구에서는 공간적 변수인 조도계수를 기지의 수위값을 이용하여 최적값을 결정하는 방법에 대해서 검토하고자 한다. 최적화 기법에 의한 조도계수는 기지의 수위값과 수치모의에 의한 결과 값의 전체 오차를 최소화하는 값으로 결정된다. 본 연구에서는 3가지 최적화 기법을 이용하였으며 가상 수로에 대해서 적용하였다. 수위계산은 표준축차법에 의해 수행하였으며 사용된 최적화 기법은 quasi-Newton 방법이다. 1차원 모형은 Matlab을 이용하여 표준축자법으로 구성하였으며 BFGS 기법, L-BFGS 기법, Steepest Gradient Descent 기법 등도 Matlab으로 구성하였다. 표준축차법은 조도계수가 입력되면 기지의 수위값과의 2-norm을 계산하도록 구성하였다. 계산 결과에 의하면 세가 기법 모두 20 23회 정도의 반복계산을 수행하고 값이 수렴되었는데, L-BFGS의 경우에는 정확하게 음수의 조도계수로 수렴하였으며, BFGS기법과 Steepest Gradient 기법의 경우에는 양의 값으로 정확하게 수렴하였다.

  • PDF

PSS 파라미터 최적화 및 최적위치선정에 관한 연구 (Optimizaiton of PSS Parametes and Identification of Optimum Site for PSS Applications)

  • 박영문;정정원
    • 대한전기학회논문지
    • /
    • 제40권5호
    • /
    • pp.453-459
    • /
    • 1991
  • This paper presents a new algorithm to select optimal parameters and location of power system stabilizer (PSS). A new performance measure, which evaluates the share of a particular mode among state responses, is introduced. The gradient of the performance measure with respect to PSS parametes is derived in an explicit form, so optimal parameters of PSS can be obtained by the steepest descent method. The machine, with which it is most probable to reduce the performance measure, is identified as the optimum site for PSS application.

  • PDF

하이브리드 학습알고리즘의 다층신경망을 이용한 시급수의 비선형예측 (Nonlinear Prediction of Time Series Using Multilayer Neural Networks of Hybrid Learning Algorithm)

  • 조용현;김지영
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 1998년도 추계종합학술대회 논문집
    • /
    • pp.1281-1284
    • /
    • 1998
  • This paper proposes an efficient time series prediction of the nonlinear dynamical discrete-time systems using multilayer neural networks of a hybrid learning algorithm. The proposed learning algorithm is a hybrid backpropagation algorithm based on the steepest descent for high-speed optimization and the dynamic tunneling for global optimization. The proposed algorithm has been applied to the y00 samples of 700 sequences to predict the next 100 samples. The simulation results shows that the proposed algorithm has better performances of the convergence and the prediction, in comparision with that using backpropagation algorithm based on the gradient descent for multilayer neural network.

  • PDF

확률적 근사법과 공액기울기법을 이용한 다층신경망의 효율적인 학습 (An Efficient Traning of Multilayer Neural Newtorks Using Stochastic Approximation and Conjugate Gradient Method)

  • 조용현
    • 한국지능시스템학회논문지
    • /
    • 제8권5호
    • /
    • pp.98-106
    • /
    • 1998
  • 본 논문에서는 신경망의 학습성능을 개선하기 위해 확룰적 근사법과 공액기울기법에 기초를 둔 새로운 학습방법을 제안하였다. 제안된 방법에서는 확률적 근사법과 공액기울기법을 조합 사용한 전역 최적화 기법의 역전파 알고리즘을 적용함으로써 학습성능을 최대한 개선할 수 있도록 하였다. 확률적 근사법은 국소최소점을 벗어나 전역최적점에 치우친 근사점을 결정해 주는 기능을 하도록 하며, 이점을 초기값으로 하여 결정론적 기법의 공액기울기법을 적용함으로써 빠른 수렴속도로 전역최적점으로의 수렴확률을 놓였다. 제안된 방법을 패리티 검사와 패턴 분류에 각각 적용하여 그 타당성과 성능을 확인한 결과 제안된 방법은 초기값을 무작위로 설정하는 기울기하강법에 기초를 둔 기존의 역전파 알고리즘이나 확률적 근사법과 기울기하강법에 기초를 둔 역전파 알고리즘에 비해 최적해로의 수렴 확률과 그 수렴속도가 우수함을 확인할 수 있었다.

  • PDF

FEA based optimization of semi-submersible floater considering buckling and yield strength

  • Jang, Beom-Seon;Kim, Jae Dong;Park, Tae-Yoon;Jeon, Sang Bae
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • 제11권1호
    • /
    • pp.82-96
    • /
    • 2019
  • A semi-submersible structure has been widely used for offshore drilling and production of oil and gas. The small water plane area makes the structure very sensitive to weight increase in terms of payload and stability. Therefore, it is necessary to lighten the substructure from the early design stage. This study aims at an optimization of hull structure based on a sophisticated yield and buckling strength in accordance with classification rules. An in-house strength assessment system is developed to automate the procedure such as a generation of buckling panels, a collection of required panel information, automatic buckling and yield check and so on. The developed system enables an automatic yield and buckling strength check of all panels composing the hull structure at each iteration of the optimization. Design variables are plate thickness and stiffener section profiles. In order to overcome the difficulty of large number of design variables and the computational burden of FE analysis, various methods are proposed. The steepest descent method is selected as the optimization algorithm for an efficient search. For a reduction of the number of design variables and a direct application to practical design, the stiffener section variable is determined by selecting one from a pre-defined standard library. Plate thickness is also discretized at 0.5t interval. The number of FE analysis is reduced by using equations to analytically estimating the stress changes in gradient calculation and line search steps. As an endeavor to robust optimization, the number of design variables to be simultaneously optimized is divided by grouping the scantling variables by the plane. A sequential optimization is performed group by group. As a verification example, a central column of a semi-submersible structure is optimized and compared with a conventional optimization of all design variables at once.

훈련 데이터 개수와 훈련 횟수에 따른 과도학습과 신뢰도 분석에 대한 연구 (A Study on Reliability Analysis According to the Number of Training Data and the Number of Training)

  • 김성혁;오상진;윤근영;김완기
    • 한국인공지능학회지
    • /
    • 제5권1호
    • /
    • pp.29-37
    • /
    • 2017
  • The range of problems that can be handled by the activation of big data and the development of hardware has been rapidly expanded and machine learning such as deep learning has become a very versatile technology. In this paper, mnist data set is used as experimental data, and the Cross Entropy function is used as a loss model for evaluating the efficiency of machine learning, and the value of the loss function in the steepest descent method is We applied the Gradient Descent Optimize algorithm to minimize and updated weight and bias via backpropagation. In this way we analyze optimal reliability value corresponding to the number of exercises and optimal reliability value without overfitting. And comparing the overfitting time according to the number of data changes based on the number of training times, when the training frequency was 1110 times, we obtained the result of 92%, which is the optimal reliability value without overfitting.

Influence on overfitting and reliability due to change in training data

  • Kim, Sung-Hyeock;Oh, Sang-Jin;Yoon, Geun-Young;Jung, Yong-Gyu;Kang, Min-Soo
    • International Journal of Advanced Culture Technology
    • /
    • 제5권2호
    • /
    • pp.82-89
    • /
    • 2017
  • The range of problems that can be handled by the activation of big data and the development of hardware has been rapidly expanded and machine learning such as deep learning has become a very versatile technology. In this paper, mnist data set is used as experimental data, and the Cross Entropy function is used as a loss model for evaluating the efficiency of machine learning, and the value of the loss function in the steepest descent method is We applied the GradientDescentOptimize algorithm to minimize and updated weight and bias via backpropagation. In this way we analyze optimal reliability value corresponding to the number of exercises and optimal reliability value without overfitting. And comparing the overfitting time according to the number of data changes based on the number of training times, when the training frequency was 1110 times, we obtained the result of 92%, which is the optimal reliability value without overfitting.

간섭신호 환경에서 교대 주빔 제거 알고리듬을 위한 반복 기법 (An Iterative Approach for Alternate Mainbeam Nulling Algorithm in Coherent Environment)

  • 장병건;전창대
    • 한국전자파학회:학술대회논문집
    • /
    • 한국전자파학회 2005년도 종합학술발표회 논문집 Vol.15 No.1
    • /
    • pp.153-156
    • /
    • 2005
  • This paper concerns an efficient iterative approach for eliminating coherent interference signals in linearly constrained adaptive arrays. The Alternate Mainbeam Nulling Algorithm[1] is implemented iteratively to find an optimum weight vector. The convergence parameters in the unit gain and null constraints are calculated using steepest descent method with gradient estimation. The nulling performance of the proposed method is compared with that of conventional ones. It is shown that the proposed method performs better than conventional ones when the power of the coherent signals is large compared with a desired signal. Also, it performs consistently well for more number of interferences.

  • PDF