• 제목/요약/키워드: Bellman Equation

검색결과 25건 처리시간 0.022초

Control of an stochastic nonlinear system by the method of dynamic programming

  • Choi, Wan-Sik
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1994년도 Proceedings of the Korea Automatic Control Conference, 9th (KACC) ; Taejeon, Korea; 17-20 Oct. 1994
    • /
    • pp.156-161
    • /
    • 1994
  • In this paper, we consider an optimal control problem of a nonlinear stochastic system. Dynamic programming approach is employed for the formulation of a stochastic optimal control problem. As an optimality condition, dynamic programming equation so called the Bellman equation is obtained, which seldom yields an analytical solution, even very difficult to solve numerically. We obtain the numerical solution of the Bellman equation using an algorithm based on the finite difference approximation and the contraction mapping method. Optimal controls are constructed through the solution process of the Bellman equation. We also construct a test case in order to investigate the actual performance of the algorithm.

  • PDF

CARA UTILITY AND OPTIMAL RETIREMENT

  • CHOI, JONGSUNG;LEE, HO-SEOK
    • Journal of applied mathematics & informatics
    • /
    • 제39권1_2호
    • /
    • pp.215-222
    • /
    • 2021
  • We explore an optimal consumption/portfolio and retirement problem with a CARA utility function of consumption. The relevant Bellman equation for the value function is transformed into a linear equation and the optimal strategies are obtained explicitly.

확률 최적 제어문제에서 발생되는 Elliptic Type H-J-B 방정식의 수치해 (Numerical Solution of an Elliptic Type H-J-B Equation Arising from Stochastic Optimal Control Problem)

  • Wan Sik Choi
    • 제어로봇시스템학회논문지
    • /
    • 제4권6호
    • /
    • pp.703-706
    • /
    • 1998
  • 본 논문에서는 확률 최적 제어문제에서 발생되는 Elliptic type H-J-B(Hamilton-Jacobi-Bellman) 방정식에 대한 수치해를 구하였다. 수치해를 구하기 위하여 Contraction 사상 및 유한차분법을 이용하였으며, 시스템은 It/sub ∧/ 형태의 Stochastic 방정식으로 취하였다. 수치해는 수학적인 테스트 케이스를 설정하여 검증하였으며, 최적제어 Map을 방정식의 해를 구하면서 동시에 구하였다.

  • PDF

RETARDED NONLINEAR INTEGRAL INEQUALITIES OF GRONWALL-BELLMAN-PACHPATTE TYPE AND THEIR APPLICATIONS

  • Abdul Shakoor;Mahvish Samar;Samad Wali;Muzammil Saleem
    • 호남수학학술지
    • /
    • 제45권1호
    • /
    • pp.54-70
    • /
    • 2023
  • In this article, we state and prove several new retarded nonlinear integral and integro-differential inequalities of Gronwall-Bellman-Pachpatte type. These inequalities generalize some former famous inequalities and can be used in examining the existence, uniqueness, boundedness, stability, asymptotic behaviour, quantitative and qualitative properties of solutions of nonlinear differential and integral equations. Applications are provided to demonstrate the strength of our inequalities in estimating the boundedness and global existence of the solution to initial value problem for nonlinear integro-differential equation and Volterra type retarded nonlinear equation. This research work will ensure to open the new opportunities for studying of nonlinear dynamic inequalities on time scale structure of varying nature.

Computational Solution of a H-J-B equation arising from Stochastic Optimal Control Problem

  • Park, Wan-Sik
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1998년도 제13차 학술회의논문집
    • /
    • pp.440-444
    • /
    • 1998
  • In this paper, we consider numerical solution of a H-J-B (Hamilton-Jacobi-Bellman) equation of elliptic type arising from the stochastic control problem. For the numerical solution of the equation, we take an approach involving contraction mapping and finite difference approximation. We choose the It(equation omitted) type stochastic differential equation as the dynamic system concerned. The numerical method of solution is validated computationally by using the constructed test case. Map of optimal controls is obtained through the numerical solution process of the equation. We also show how the method applies by taking a simple example of nonlinear spacecraft control.

  • PDF

ON STOCHASTIC OPTIMAL REINSURANCE AND INVESTMENT STRATEGIES FOR THE SURPLUS

  • Kim, Jai Heui;Lee, Eun Sun
    • Korean Journal of Mathematics
    • /
    • 제16권2호
    • /
    • pp.145-156
    • /
    • 2008
  • When we consider a life insurance company that sells a large number of continuous T-year term life insurance policies, it is important to find an optimal strategy which maximizes the surplus of the insurance company at time T. The purpose of this paper is to give an explicit expression for the optimal reinsurance and investment strategy which maximizes the expected exponential utility of the final value of the surplus at the end of T-th year. To do this we solve the corresponding Hamilton-Jacobi-Bellman equation.

  • PDF

SOME EXISTENCE THEOREMS FOR FUNCTIONAL EQUATIONS ARISING IN DYNAMIC PROGRAMMING

  • LIU ZEQING;UME JEONG SHEOK;KANG SHIN MIN
    • 대한수학회지
    • /
    • 제43권1호
    • /
    • pp.11-28
    • /
    • 2006
  • The existence, uniqueness and iterative approximation of solutions for a few classes of functional equations arising in dynamic programming of multistage decision processes are discussed. The results presented in this paper extend, improve and unify the results due to Bellman [2, 3], Bhakta-Choudhury [6], Bhakta-Mitra [7], and Liu [12].

STIELTJES DERIVATIVES AND ITS APPLICATIONS TO INTEGRAL INEQUALITIES OF STIELTJES TYPE

  • Kim, Yung-Jin
    • 한국수학교육학회지시리즈B:순수및응용수학
    • /
    • 제18권1호
    • /
    • pp.63-78
    • /
    • 2011
  • In the present paper, we obtain integral inequalities involving the Kurzweil-Stieltjes integrals which generalize Gronwall-Bellman inequality and we use the inequalities to verify existence of solutions of a certain integral equation. Such inequalities will play an important role in the study of impulsively perturbed systems [9].