• 제목/요약/키워드: Network robustness

검색결과 498건 처리시간 0.182초

경로 탐색 기법과 강화학습을 사용한 주먹 지르기동작 생성 기법 (Punching Motion Generation using Reinforcement Learning and Trajectory Search Method)

  • 박현준;최위동;장승호;홍정모
    • 한국멀티미디어학회논문지
    • /
    • 제21권8호
    • /
    • pp.969-981
    • /
    • 2018
  • Recent advances in machine learning approaches such as deep neural network and reinforcement learning offer significant performance improvements in generating detailed and varied motions in physically simulated virtual environments. The optimization methods are highly attractive because it allows for less understanding of underlying physics or mechanisms even for high-dimensional subtle control problems. In this paper, we propose an efficient learning method for stochastic policy represented as deep neural networks so that agent can generate various energetic motions adaptively to the changes of tasks and states without losing interactivity and robustness. This strategy could be realized by our novel trajectory search method motivated by the trust region policy optimization method. Our value-based trajectory smoothing technique finds stably learnable trajectories without consulting neural network responses directly. This policy is set as a trust region of the artificial neural network, so that it can learn the desired motion quickly.

전자기 과도현상 해석과 고조파 평가를 위한 S영역 주파수 의존 등가시스템 개발 (S-Domain Frequency Dependent Network Equivalent for Electromagnetic Transient and Harmonic Assessment)

  • 왕용필;정형환;이준탁;한형주;김해재;정동일;곽노홍
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 제37회 하계학술대회 논문집 A
    • /
    • pp.143-144
    • /
    • 2006
  • The recent power systems are very complex and to model them completely is impractical for analysis of electromagnetic transient Therefore areas outside the immediate area of interest must be represented by some form of Frequency Dependent Network Equivalent (FDNE). In this paper a method for developing Frequency Dependent Network Equivalent (FDNE) using S-domain rational Function Fitting is presented and demonstrated. The FDNE is generated by Linearized Least Squares Fitting(LSF) of the frequency response of a S-domain formulation. This Three-port FDNE have been applied to the test AC power system. The electromagnetic transient package PSCAD/EMTDC is used to assess the transient response of the Three-port FDNE developed under different condition. The study results have indicated the robustness and accuracy of Three-port FDNE for analisys of electromagnetic transient and harmonic assessment.

  • PDF

전자기 과도현상 해석과 고조파 평가를 위한 Z영역 주파수 의존 등가시스템 개발 (Z-Domain Frequency Dependent Network Equivalent for Electromagnetic Transient and Harmonic Assessment)

  • 왕용필;정형환;김경엽;이준탁;한형주;안병철;전영수
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년도 제37회 하계학술대회 논문집 A
    • /
    • pp.145-146
    • /
    • 2006
  • The recent power systems are very complex and to model them completely is impractical for analysis of electromagnetic transient. Therefore areas outside the immediate area of interest must be represented by some form of Frequency Dependent Network Equivalent (FDNE). In this paper a method for developing Frequency Dependent Network Equivalent (FDNE) using Z-domain rational Function Fitting is presented and demonstrated. The FDNE is generated by Linearized Least Squares Fitting(LSF) of the frequency response of a Z-domain formulation. This Three-port FDNE have been applied to the test AC power system. The electromagnetic transient package PSCAD/EMTDC is used to assess the transient response of the Three-port FDNE developed under different condition. The study results have indicated the robustness and accuracy of Three-port FDNE for analisys of electromagnetic transient and harmonic assessment.

  • PDF

Resilient Routing Overlay Network Construction with Super-Relay Nodes

  • Tian, Shengwen;Liao, Jianxin;Li, Tonghong;Wang, Jingyu;Cui, Guanghai
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제11권4호
    • /
    • pp.1911-1930
    • /
    • 2017
  • Overlay routing has emerged as a promising approach to improve reliability and efficiency of the Internet. The key to overlay routing is the placement and maintenance of the overlay infrastructure, especially, the selection and placement of key relay nodes. Spurred by the observation that a few relay nodes with high betweenness centrality can provide more optimal routes for a large number of node pairs, we propose a resilient routing overlay network construction method by introducing Super-Relay nodes. In detail, we present the K-Minimum Spanning Tree with Super-Relay nodes algorithm (SR-KMST), in which we focus on the selection and connection of Super-Relay nodes to optimize the routing quality in a resilient and scalable manner. For the simultaneous path failures between the default physical path and the overlay backup path, we also address the selection of recovery path. The objective is to select a proper one-hop recovery path with minimum cost in path probing and measurement. Simulations based on a real ISP network and a synthetic Internet topology show that our approach can provide high-quality overlay routing service, while achieving good robustness.

제한된 입력 전압을 갖는 전기 구동 로봇 매니퓰레이터에 대한 분산 강인 적응 신경망 제어 (Decentralized Robust Adaptive Neural Network Control for Electrically Driven Robot Manipulators with Bounded Input Voltages)

  • 신진호;김원호
    • 한국소음진동공학회논문집
    • /
    • 제25권11호
    • /
    • pp.753-763
    • /
    • 2015
  • This paper proposes a decentralized robust adaptive neural network control scheme using multiple radial basis function neural networks for electrically driven robot manipulators with bounded input voltages in the presence of uncertainties. The proposed controller considers both robot link dynamics and actuator dynamics. Practically, the controller gain coefficients applied at each joint may be nonlinear time-varying and the input voltage at each joint is saturated. The proposed robot controller overcomes the various uncertainties and the input voltage saturation problem. The proposed controller does not require any robot and actuator parameters. The adaptation laws of the proposed controller are derived by using the Lyapunov stability analysis and the stability of the closed-loop control system is guaranteed. The validity and robustness of the proposed control scheme are verified through simulation results.

Robust control by universal learning network

  • Ohbayashi, Masanao;Hirasawa, Kotaro;Murata, Junichi
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1995년도 Proceedings of the Korea Automation Control Conference, 10th (KACC); Seoul, Korea; 23-25 Oct. 1995
    • /
    • pp.123-126
    • /
    • 1995
  • Characteristics of control system design using Universal Learning Network (U.L.N.) are that a system to be controlled and a controller are both constructed by U.L.N. and that the controller is best tuned through learning. U.L.N has the same generalization ability as N.N.. So the controller constructed by U.L.N. is able to control the system in a favorable way under the condition different from the condition of the control system in learning stage. But stability can not be realized sufficiently. In this paper, we propose a robust control method using U.L.N. and second order derivatives of U.L.N.. The proposed method can realize better performance and robustness than the commonly used Neural Network. Robust control considered here is defined as follows. Even though initial values of node outputs change from those in learning, the control system is able to reduce its influence to other node outputs and can control the system in a preferable way as in the case of no variation. In order to realize such robust control, a new term concerning the variation is added to a usual criterion function. And parameter variables are adjusted so as to minimize the above mentioned criterion function using the second order derivatives of criterion function with respect to the parameters. Finally it is shown that the controller constricted by the proposed method works in an effective way through a simulation study of a nonlinear crane system.

  • PDF

FNN에 의한 태양광 발전의 MPPT 제어 (MPPT Control of Photovoltaic by FNN)

  • 정철호;고재섭;최정식;전영선;김도연;정병진;정동화
    • 한국조명전기설비학회:학술대회논문집
    • /
    • 한국조명전기설비학회 2008년도 춘계학술대회 논문집
    • /
    • pp.399-402
    • /
    • 2008
  • The paper proposes a novel control algorithm for tracking maximum power of PV generation system. The maximum power of PV array is determinated by a insolation and temperature. Prior considered the term in PV generation system is how maximum power point is accurately tracked. The paper proposes a FNN(Fuzzy Neural-Network) control algorithm so as to accurately track those maximum power points. The proposed control algorithm comprises the antecedence part of fuzzy rule and clustering method, multi-layer neural network in the consequent part. FNN has the advantages which are depicted both high performance and robustness in Fuzzy control and high adaptive control in Neural Network. Specially, it can show the outstanding control performance for parameter variations appling to non-linear character of PV array. In paper, the tracking speed and the accuracy prove the validity through comparing a proposed algorithm with a conventional one.

  • PDF

모바일 애드혹 네트워크를 위한 링 기반 멀티캐스트 라우팅 구조 (A Ring-based Multicast Routing Architecture for Mobile Ad Hoc Networks)

  • 허준;홍충선;양육백
    • 정보처리학회논문지C
    • /
    • 제11C권7호
    • /
    • pp.895-904
    • /
    • 2004
  • 예상치 못한 에드혹 망의 접속형태의 변경이 동반되는 멀티캐스트 라우팅 프로토콜에 대한 연구에 많은 과제를 남겨놓고 있으며, 다양한 이동 에드혹 망에 적합한 프로토콜에 대한 연구의 필요성이 제기되고 있다. 본 논문에서는 계층적 Eulerian 링 멀티캐스트 구조를 갖는 새로운 프로토콜을 제안한다. 제안한 구조는 Eulerian 링, 계층구조, 멀티캐스트 에이전트를 갖으며 기존의 방법보다 효율적이며 안전한 특성을 갖는다. 제안한 구조는 트리기반 및 메시기만 멀티캐스트 프로토콜과 비교하여 제어트래픽의 양, 점대점 지연, 패킷전송률 등에 있어 우수함은 시뮬레이션을 통해 입증한다.

오차를 기반으로한 RBF 신경회로망 적응 백스테핑 제어기 설계 (The Adaptive Backstepping Controller of RBF Neural Network Which is Designed on the Basis of the Error)

  • 김현우;윤육현;정진한;박장현
    • 한국정밀공학회지
    • /
    • 제34권2호
    • /
    • pp.125-131
    • /
    • 2017
  • 2-Axis Pan and Tilt Motion Platform, a complex multivariate non-linear system, may incur any disturbance, thus requiring system controller with robustness against various disturbances. In this study, we designed an adaptive backstepping compensated controller by estimating the disturbance and error using the Radial Basis Function Neural Network (RBF NN). In this process, Uniformly Ultimately Bounded (UUB) was demonstrated via Lyapunov and stability was confirmed. By generating progressive disturbance to the irregular frequency and amplitude changes, it was verified for various environmental disturbances. In addition, by setting the RBF NN input vector to the minimum, the estimated disturbance compensation process was analyzed. Only two input vectors facilitated compensatory function of RBF NN via estimating the modeling and control error values as well as irregular disturbance; the application of the process resulted in improved backstepping controller performance that was confirmed through simulation.

디지탈 신호 처리기를 사용한 산업용 로봇의 실시간 뉴럴 제어기 설계 (Real Time Neural Controller Design of Industrial Robot Using Digital Signal Processors)

  • 김용태;한성현
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 1996년도 추계학술대회 논문집
    • /
    • pp.759-763
    • /
    • 1996
  • This paper presents a new approach to the design of neural control system using digital signal processors in order to improve the precision and robustness. Robotic manipulators have become increasingly important in the field of flexible automation. High speed and high-precision trajectory tracking are indispensable capabilities for their versatile application. The need to meet demanding control requirement in increasingly complex dynamical control systems under significant uncertainties, leads toward design of intelligent manipulation robots. The TMS320C31 is used in implementing real time neural control to provide an enhanced motion control for robotic manipulators. In this control scheme, the networks introduced are neural nets with dynamic neurons, whose dynamics are distributed over all the network nodes. The nets are trained by the distributed dynamic back propagation algorithm. The proposed neural network control scheme is simple in structure, fast in computation, and suitable for implementation of real-time control. Performance of the neural controller is illustrated by simulation and experimental results for a SCARA robot.

  • PDF