• Title/Summary/Keyword: Optimal stochastic Policy

Search Result 51, Processing Time 0.019 seconds

Nonlinear stochastic optimal control strategy of hysteretic structures

  • Li, Jie;Peng, Yong-Bo;Chen, Jian-Bing
    • Structural Engineering and Mechanics
    • /
    • v.38 no.1
    • /
    • pp.39-63
    • /
    • 2011
  • Referring to the formulation of physical stochastic optimal control of structures and the scheme of optimal polynomial control, a nonlinear stochastic optimal control strategy is developed for a class of structural systems with hysteretic behaviors in the present paper. This control strategy provides an amenable approach to the classical stochastic optimal control strategies, bypasses the dilemma involved in It$\hat{o}$-type stochastic differential equations and is applicable to the dynamical systems driven by practical non-stationary and non-white random excitations, such as earthquake ground motions, strong winds and sea waves. The newly developed generalized optimal control policy is integrated in the nonlinear stochastic optimal control scheme so as to logically distribute the controllers and design their parameters associated with control gains. For illustrative purposes, the stochastic optimal controls of two base-excited multi-degree-of-freedom structural systems with hysteretic behavior in Clough bilinear model and Bouc-Wen differential model, respectively, are investigated. Numerical results reveal that a linear control with the 1st-order controller suffices even for the hysteretic structural systems when a control criterion in exceedance probability performance function for designing the weighting matrices is employed. This is practically meaningful due to the nonlinear controllers which may be associated with dynamical instabilities being saved. It is also noted that using the generalized optimal control policy, the maximum control effectiveness with the few number of control devices can be achieved, allowing for a desirable structural performance. It is remarked, meanwhile, that the response process and energy-dissipation behavior of the hysteretic structures are controlled to a certain extent.

Application of Stochastic Optimization Method to (s, S) Inventory System ((s, S) 재고관리 시스템에 대한 확률최적화 기법의 응용)

  • Chimyung Kwon
    • Journal of the Korea Society for Simulation
    • /
    • v.12 no.2
    • /
    • pp.1-11
    • /
    • 2003
  • In this paper, we focus an optimal policy focus optimal class of (s, S) inventory control systems. To this end, we use the perturbation analysis and apply a stochastic optimization algorithm to minimize the average cost over a period. We obtain the gradients of objective function with respect to ordering amount S and reorder point s via a combined perturbation method. This method uses the infinitesimal perturbation analysis and the smoothed perturbation analysis alternatively according to occurrences of ordering event changes. Our simulation results indicate that the optimal estimates of s and S obtained from a stochastic optimization algorithm are quite accurate. We consider that this may be due to the estimated gradients of little noise from the regenerative system simulation, and their effect on search procedure when we apply the stochastic optimization algorithm. The directions for future study stemming from this research pertain to extension to the more general inventory system with regard to demand distribution, backlogging policy, lead time, and review period. Another directions involves the efficiency of stochastic optimization algorithm related to searching procedure for an improving point of (s, S).

  • PDF

The Effect of (Q, r) Policy in Production-Inventory Systems

  • Kim, Joon-Seok;Jung, Uk
    • Management Science and Financial Engineering
    • /
    • v.15 no.1
    • /
    • pp.33-49
    • /
    • 2009
  • We examine the effectiveness of the conventional (Q, r) model in managing production-inventory systems with finite capacity, stochastic demand, and stochastic order processing times. We show that, for systems with finite production capacity, order replenishment lead times are highly sensitive to loading and order quantity. Consequently, the choice of optimal order quantity and optimal reorder point can vary significantly from those obtained under the usual assumption of a load-independent lead time. More importantly, we show that for a given (Q, r) policy the conventional model can grossly under or over-estimate the actual cost of the policy. In cases where a setup time is associated with placing a production order, we show that the optimal (Q, r) policy derived from the conventional model can, in fact, be infeasible.

Differential Burn-in and Reliability Screening Policy Using Yield Information Based on Spatial Stochastic Processes (공간적 확률 과정 기반의 수율 정보를 이용한 번인과 신뢰성 검사 정책)

  • Hwang, Jung Yoon;Shim, Younghak
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.35 no.4
    • /
    • pp.1-9
    • /
    • 2012
  • Decisions on reliability screening rules and burn-in policies are determined based on the estimated reliability. The variability in a semiconductor manufacturing process does not only causes quality problems but it also makes reliability estimation more complicated. This study investigates the nonuniformity characteristics of integrated circuit reliability according to defect density distribution within a wafer and between wafers then develops optimal burn-in policy based on the estimated reliability. New reliability estimation model based on yield information is developed using a spatial stochastic process. Spatial defect density variation is reflected in the reliability estimation, and the defect densities of each die location are considered as input variables of the burn-in optimization. Reliability screening and optimal burn-in policy subject to the burn-in cost minimization is examined, and numerical experiments are conducted.

The study of stochastic inventory model with setup cost and backorder rate (Setup cost와 Backorder rate를 고려한 확률적 재고모형에 관한 연구)

  • 유승우;서창현;김경섭
    • Proceedings of the Korea Society for Simulation Conference
    • /
    • 2003.06a
    • /
    • pp.129-134
    • /
    • 2003
  • In this paper, we determine optimal reduction in the lead time and setup cost for some stochastic inventory models. And we propose more general model that allow the backorder rate as a control variable. We first assume that the lead time demand follows a normal distribution. And we assume that the backorder rate is dependent on the length of lead time through the amount of shortages. The stochastic models analyzed in this paper are the classical continuous and periodic review policy models with a mixture of backorders and lost sales. For each of these models, we provide a sufficient conditions for the uniqueness of the optimal operating policy. We also develop algorithms for solving these models and provide illustrative numerical examples.

  • PDF

Optimal Policy for (s, S) Inventory System Characterized by Renewal Arrival Process of Demand through Simulation Sensitivity Analysis (수요가 재생 도착과정을 따르는 (s, S) 재고 시스템에서 시뮬레이션 민감도 분석을 이용한 최적 전략)

  • 권치명
    • Journal of the Korea Society for Simulation
    • /
    • v.12 no.3
    • /
    • pp.31-40
    • /
    • 2003
  • This paper studies an optimal policy for a certain class of (s, S) inventory control systems, where the demands are characterized by the renewal arrival process. To minimize the average cost over a simulation period, we apply a stochastic optimization algorithm which uses the gradients of parameters, s and S. We obtain the gradients of objective function with respect to ordering amount S and reorder point s via a combined perturbation method. This method uses the infinitesimal perturbation analysis and the smoothed perturbation analysis alternatively according to occurrences of ordering event changes. The optimal estimates of s and S from our simulation results are quite accurate. We consider that this may be due to the estimated gradients of little noise from the regenerative system simulation, and their effect on search procedure when we apply the stochastic optimization algorithm. The directions for future study stemming from this research pertain to extension to the more general inventory system with regard to demand distribution, backlogging policy, lead time, and inter-arrival times of demands. Another direction involves the efficiency of stochastic optimization algorithm related to searching procedure for an improving point of (s, S).

  • PDF

Stochastic modelling fatigue crack evolution and optimum maintenance strategy for composite blades of wind turbines

  • Chen, Hua-Peng;Zhang, Chi;Huang, Tian-Li
    • Structural Engineering and Mechanics
    • /
    • v.63 no.6
    • /
    • pp.703-712
    • /
    • 2017
  • The composite blades of offshore wind turbines accumulate structural damage such as fatigue cracking due to harsh operation environments during their service time, leading to premature structural failures. This paper investigates various fatigue crack models for reproducing crack development in composite blades and proposes a stochastic approach to predict fatigue crack evolution and to analyse failure probability for the composite blades. Three typical fatigue models for the propagation of fatigue cracks, i.e., Miner model, Paris model and Reifsnider model, are discussed to reproduce the fatigue crack evolution in composite blades subjected to cyclical loadings. The lifetime probability of fatigue failure of the composite blades is estimated by stochastic deterioration modelling such as gamma process. Based on time-dependent reliability analysis and lifecycle cost analysis, an optimised maintenance policy is determined to make the optimal decision for the composite blades during the service time. A numerical example is employed to investigate the effectiveness of predicting fatigue crack growth, estimating the probability of fatigue failure and evaluating an optimal maintenance policy. The results from the numerical study show that the stochastic gamma process together with the proper fatigue models can provide a useful tool for remaining useful life predictions and optimum maintenance strategies of the composite blades of offshore wind turbines.

On The Performance of A Suboptimal Assignment Policy in N-Queue m-Server System

  • Ko Soon-Ju
    • Journal of the military operations research society of Korea
    • /
    • v.17 no.1
    • /
    • pp.43-60
    • /
    • 1991
  • Consider N queues without arrivals and with m identical servers. All jobs are independent and service requirements of jobs in a queue are i.i.d. random variables. At any time only one server may be assigned to a queue and switching between queues are allowed. A unit cost is imposed per job per unit time. The objective is to minimized the expected total cost. An flow approximation model is considered and an upperbound for the percentage error of best nonswitching policies to an optimal policy is found. It is shown that the best nonswitching policy is not worse than $11\%$ of an optimal policy For the stochastic model, we consider the case in which the service requirements of all jobs are i.i.d. with an exponential distribution. A longest first policy is shown to be optimal and a worst case analysis shows that the nonswitching policy which starts with the longest queues is not worse than $11\%$ of the optimal policy.

  • PDF

Two Echelon Inventory System With Stochastic Demand (확률적 수요를 가지는 2단계 재고 시스템)

  • 최규탁;김정자
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.15 no.26
    • /
    • pp.99-109
    • /
    • 1992
  • This paper presents a cost model of the system which is managed under a continuous review (Q,r) policy at each retailer and peridic review (R,T) policy at the central warehouse. An iterative procedure is performed to find the optimal or near-optimal' solution for the policy parameters at each retailers and a central warehouse in this study.

  • PDF

Deriving Robust Reservoir Operation Policy under Changing Climate: Use of Robust Optimiziation with Stochastic Dynamic Programming

  • Kim, Gi Joo;Kim, Young-Oh
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.171-171
    • /
    • 2020
  • Decision making strategies should consider both adaptiveness and robustness in order to deal with two main characteristics of climate change: non-stationarity and deep uncertainty. Especially, robust strategies are different from traditional optimal strategies in the sense that they are satisfactory over a wider range of uncertainty and may act as a key when confronting climate change. In this study, a new framework named Robust Stochastic Dynamic Programming (R-SDP) is proposed, which couples previously developed robust optimization (RO) into the objective function and constraint of SDP. Two main approaches of RO, feasibility robustness and solution robustness, are considered in the optimization algorithm and consequently, three models to be tested are developed: conventional-SDP (CSDP), R-SDP-Feasibility (RSDP-F), and R-SDP-Solution (RSDP-S). The developed models were used to derive optimal monthly release rules in a single reservoir, and multiple simulations of the derived monthly policy under inflow scenarios with varying mean and standard deviations are undergone. Simulation results were then evaluated with a wide range of evaluation metrics from reliability, resiliency, vulnerability to additional robustness measures. Evaluation results were finally visualized with advanced visualization tools that are used in multi-objective robust decision making (MORDM) framework. As a result, RSDP-F and RSDP-S models yielded more risk averse, or conservative, results than the CSDP model, and a trade-off relationship between traditional and robustness metrics was discovered.

  • PDF