• 제목/요약/키워드: generalized optimal control policy

검색결과 2건 처리시간 0.015초

Nonlinear stochastic optimal control strategy of hysteretic structures

  • Li, Jie;Peng, Yong-Bo;Chen, Jian-Bing
    • Structural Engineering and Mechanics
    • /
    • 제38권1호
    • /
    • pp.39-63
    • /
    • 2011
  • Referring to the formulation of physical stochastic optimal control of structures and the scheme of optimal polynomial control, a nonlinear stochastic optimal control strategy is developed for a class of structural systems with hysteretic behaviors in the present paper. This control strategy provides an amenable approach to the classical stochastic optimal control strategies, bypasses the dilemma involved in It$\hat{o}$-type stochastic differential equations and is applicable to the dynamical systems driven by practical non-stationary and non-white random excitations, such as earthquake ground motions, strong winds and sea waves. The newly developed generalized optimal control policy is integrated in the nonlinear stochastic optimal control scheme so as to logically distribute the controllers and design their parameters associated with control gains. For illustrative purposes, the stochastic optimal controls of two base-excited multi-degree-of-freedom structural systems with hysteretic behavior in Clough bilinear model and Bouc-Wen differential model, respectively, are investigated. Numerical results reveal that a linear control with the 1st-order controller suffices even for the hysteretic structural systems when a control criterion in exceedance probability performance function for designing the weighting matrices is employed. This is practically meaningful due to the nonlinear controllers which may be associated with dynamical instabilities being saved. It is also noted that using the generalized optimal control policy, the maximum control effectiveness with the few number of control devices can be achieved, allowing for a desirable structural performance. It is remarked, meanwhile, that the response process and energy-dissipation behavior of the hysteretic structures are controlled to a certain extent.

The Application of RL and SVMs to Decide Action of Mobile Robot

  • Ko, Kwang-won;Oh, Yong-sul;Jung, Qeun-yong;Hoon Heo
    • 한국지능시스템학회:학술대회논문집
    • /
    • 한국퍼지및지능시스템학회 2003년도 ISIS 2003
    • /
    • pp.496-499
    • /
    • 2003
  • Support Vector Machines (SVMs) is applied to a practical problem as one of standard tools for machine learning. The application of Reinforcement Learning (RL) and SVMs in action of mobile robot is investigated. A technique to decide the action of autonomous mobile robot in practice is explained in the paper, The proposed method is to find n basis for good action of the system under unknown environment. In multi-dimensional sensor input, the most reasonable action can be automatically decided in each state by RL. Using SVMs, not only optimal decision policy but also generalized state in unknown environment is obtained.

  • PDF