• Title/Summary/Keyword: Dynamic programming method

Search Result 388, Processing Time 0.031 seconds

Global torque optimization of redundant manipulator using dynamic programming

  • Shim, Ick-Chan;Yoon, Yong-San
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.811-814
    • /
    • 1997
  • In this paper, the torque optimization of a kinematically redundant manipulator for minimizing the torque demands is discussed. The minimum torque solution based on a local optimization has been known to encounter the instability problem and then the global torque optimization was suggested as one of the alternatives. Herein, by adopting the infinity-norm rather than the 2-norm for the magnitude of torques, we are to propose a new cost function more advantageous to the avoidance of torque limits. By the way, a solution to the global torque optimization formulated with the new cost function can not be obtained by the previous methods due to their difficulties such as inability to treat discontinuous cost functions and various constraints on the joint variables. Thus, to overcome those deficiencies, we are developing a new approach using the dynamic programming. The effectiveness of the proposed method is shown through simulation examples for a 3-link planar redundant manipulator.

  • PDF

Basin-Wide Multi-Reservoir Operation Using Reinforcement Learning (강화학습법을 이용한 유역통합 저수지군 운영)

  • Lee, Jin-Hee;Shim, Myung-Pil
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2006.05a
    • /
    • pp.354-359
    • /
    • 2006
  • The analysis of large-scale water resources systems is often complicated by the presence of multiple reservoirs and diversions, the uncertainty of unregulated inflows and demands, and conflicting objectives. Reinforcement learning is presented herein as a new approach to solving the challenging problem of stochastic optimization of multi-reservoir systems. The Q-Learning method, one of the reinforcement learning algorithms, is used for generating integrated monthly operation rules for the Keum River basin in Korea. The Q-Learning model is evaluated by comparing with implicit stochastic dynamic programming and sampling stochastic dynamic programming approaches. Evaluation of the stochastic basin-wide operational models considered several options relating to the choice of hydrologic state and discount factors as well as various stochastic dynamic programming models. The performance of Q-Learning model outperforms the other models in handling of uncertainty of inflows.

  • PDF

An efficient optimization method for multiple sequence alignment (효율적인 복수서열정렬 최적화기법)

  • Kim, Jin;Jung, Woo-Cheol;Uhmn, Saang-Yong
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2003.04c
    • /
    • pp.368-370
    • /
    • 2003
  • 단백질들의 복수서열정렬은 단백질 서열간의 관계를 유추할 수 있는 유용한 도구이다. 최적화된 복수서열정렬을 얻기 위해 사용되는 가장 유용한 방법은 dynamic programming이다. 그러나 dynamic programming은 특정한 비용함수를 사용할 수 없기 때운에 특별한 경우 최적의 복수서열정렬을 제공하지 못하는 문제점이 있다. 우리는 이러한 문제점을 해결하기 위하여 부분정렬개선기법을 사용한 알고리즘을 제안하였으며, 이 알고리즘이 dynamic programming의 문제점을 효과적으로 해결함을 보였다.

  • PDF

Theoretical Study on Eco-Driving Technique for an Electric Vehicle with Dynamic Programming

  • Kuriyama, Motoi;Yamamoto, Sou;Miyatake, Masafumi
    • Journal of international Conference on Electrical Machines and Systems
    • /
    • v.1 no.1
    • /
    • pp.114-120
    • /
    • 2012
  • Eco-driving technique for electric vehicles (EVs) is investigated in this paper. Many findings on EVs have been reported; however, they did not deal with eco-driving from the viewpoint of theoretical study. The authors have developed an energy-saving driving technique - the so-called "eco-driving" technique based on dynamic programming (DP). Optimal speed profile of an EV, which minimizes the amount of total energy consumption, was determined under fixed origin and destination, running time, and track conditions. DP algorithm can deal with such complicated conditions and can also derive the optimal solution. Using the proposed method, simulations were run for some cases. In particular, the author ran simulations for the case of a gradient road with a traffic signal. The optimization model was solved with MATLAB.

A Study on an Engine Control System using an Object Oriented Programming Method (객체지향 프로그래밍 기법을 이용한 엔진제어시스템에 관한 연구)

  • 윤팔주;이상준;선우명호
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.8 no.3
    • /
    • pp.98-109
    • /
    • 2000
  • A new PC-based Engine Control system (ECS) is developed using an object oriented programming method. This system provides more convenient environment for engine tests, easier user interface and extended functions. A Windows-based ECS software is developed with class, and the class structure is built on encapsulation and abstraction. The closed-loop engine control scheme can be easily constructed by using dynamic link library and multitasking. This means that a user can perform desired experiments without clear knowledge of the hardware structure of the ECS. Also this system allows a user to individually control the ignition and fuel injection for each cylinder in a simple manner such as through a keyboard/mouse or in a real-time operation from a closed-loop control program.

  • PDF

Application of the Cross Decomposition Method for a Dynamic Capacitated Facility Location Problem (시설용량의 제한이 있는 동적 입지선정문제를 위한 교차분해 기법의 응용)

  • 김승권;김선오
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.15 no.1
    • /
    • pp.23-35
    • /
    • 1990
  • A mathematical model for a dynamic capacitate facility location problem is formulated by a mixed integer problem. The objective of the model is to minimize total discounted costs that include fixed charges and distributed costs. The Cross Decomposition method of Van Roy is extended and applied to solve the dynamic capacitated facility location problem. The method unifies Benders Decomposition and Lagrangean relaxation into a single framework. It successively solves a transportation problem and a dynamic uncapacitated facility location problem as two subproblems. Computational results are compared with those of general mixed integer programming.

  • PDF

Stereo Matching using Dynamic Programming in Scale-Space (스케일 공간에서 동적 계획을 이용한 스테레오 정합)

  • 최우영;박래홍
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.29B no.8
    • /
    • pp.44-53
    • /
    • 1992
  • In this paper, a matching method is proposed to improve the correct matching rate in stereo correspondence matching in which the fingerprint of zero-crossing points on the scale-space is used as the robust matching feature. The dynamic programming, which is appropriate for the fingerprint feature, is introduced for correspondence matching. We also improve the matching rate by using the post-processing for correcting mismatched points. In simulation, we apply the proposed algorithm to the synthetic and real images and obtain good matching results.

  • PDF

A Boundary Extraction Method Based on Active Contour Model and Dynamic Programming (능동 윤곽선 모델을 이용한 경계선 추출과 다이나믹 프로그래밍)

  • 김령주;김영철;최흥국
    • Proceedings of the Korea Multimedia Society Conference
    • /
    • 2002.05c
    • /
    • pp.282-285
    • /
    • 2002
  • 의료영상에서 윤곽선의 추출은 관심영역 대한 객관적인 수치 즉 면적, 부피, 장단축의 길이 등을 분석하고 3차원 재구성을 위해 선행되어야 하는 중요한 과정이다. 현재 윤곽선 추출에 대한 않은 방법들이 개발 중에 있으나 이 방법들은 한계를 지니고 있어 더 높은 수준의 처리가 요구된다. 본 논문에서는 active contour model(snake)을 이용하여 MR뇌 영상에서 종양을 추출하였다. Snake의 에너지 최적화 문제를 dynamic programming을 사용하여 개선하였으며 canny edge detection을 이용하여 잡음에 덜 민감하도록 하였다.

  • PDF

Development of Optimal Design Simulation Model for Least Cost Urban Sewer System Considering Risk (I) (위험도를 고려한 최소비용 도시우수관망 설계의 최적화 모형개발 (I): 모형의 개발과 시험유역의 적용)

  • Jang, Suk-Hwan;Park, Sang-Woo
    • Journal of Korea Water Resources Association
    • /
    • v.38 no.12 s.161
    • /
    • pp.1021-1028
    • /
    • 2005
  • This study purpose to develop simulation model of optimal design condition of urban storm sewer system considering risk. Urban Storm Sewer Optimal Design Model(USSOD) can compute pipe capacity, pipe slope, crown elevation, excavation depth, risk and return cost in the condition of design discharge. Rational formula is adopted for design discharge and Manning's formula is used for pipe capacity. Discrete differential dynamic programming(DDDP) technique which is a kind of dynamic programming(DP) is used for optimization and first order second moment approximation method and uncertainty analysis is also for developing model. USSOD is applied to hypothetical drainage basin to test and verify, which resulted economical and efficient design in urban drainage sewer system.

An Efficient Job Scheduling Strategy for Computational Grid (계산 그리드를 위한 효율적인 작업 스케줄링 정책)

  • Jo, Ji-Hun;Lee, Won-Joo;Jeon, Chang-Ho
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.14 no.8
    • /
    • pp.753-757
    • /
    • 2008
  • In this paper, we propose a new scheduling strategy for dynamic programming in Grid environment. The key idea of this scheme is to reduce the execution time of a job by dividing the dynamic table based on the locality of table and allocating jobs to nodes which minimize network latency. This scheme obtains optimal concurrency by constructing the dynamic table using a distributed top down method. Through simulation, we show that the proposed Grid strategy improves the performance of Grid environment compared to previous branch-bound strategies.