• Title/Summary/Keyword: model based PID control

Search Result 277, Processing Time 0.03 seconds

Reinforcement Learning based on Deep Deterministic Policy Gradient for Roll Control of Underwater Vehicle (수중운동체의 롤 제어를 위한 Deep Deterministic Policy Gradient 기반 강화학습)

  • Kim, Su Yong;Hwang, Yeon Geol;Moon, Sung Woong
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.24 no.5
    • /
    • pp.558-568
    • /
    • 2021
  • The existing underwater vehicle controller design is applied by linearizing the nonlinear dynamics model to a specific motion section. Since the linear controller has unstable control performance in a transient state, various studies have been conducted to overcome this problem. Recently, there have been studies to improve the control performance in the transient state by using reinforcement learning. Reinforcement learning can be largely divided into value-based reinforcement learning and policy-based reinforcement learning. In this paper, we propose the roll controller of underwater vehicle based on Deep Deterministic Policy Gradient(DDPG) that learns the control policy and can show stable control performance in various situations and environments. The performance of the proposed DDPG based roll controller was verified through simulation and compared with the existing PID and DQN with Normalized Advantage Functions based roll controllers.

Design of a real Time Adaptive Controller for Industrial Robot Using Digital Signal Processor (디지털 신호처리기를 사용한 산업용 로봇의 실시간 적응제어기 설계)

  • 최근국
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1999.10a
    • /
    • pp.154-161
    • /
    • 1999
  • This paper presents a new approach to the design of adaptive control system using DSPs(TMS320C30) for robotic manipulators to achieve trajectory tracking by the joint angles. Digital signal processors are used in implementing real time adaptive control algorithms to provide an enhanced motion control for robotic manipulators. In the proposed control scheme, adaptation laws are derived from the improved Lyapunov second stability analysis method based on the adaptive model reference control theory. The adaptive controller consists of an adaptive feedforward controller, feedback controller, and PID type time-varying auxillary control elements. The proposed adaptive control scheme is simple in structure, fast in computation, and suitable for implementation of real-time control. Moreover, this scheme does not require an accurate dynamic modeling, nor values of manipulator parameters and payload. Performance of the adaptive controller is illustrated by simulation and experimental results for a SCARA robot.

  • PDF

A Study on the Real Time Adaptive Controller for SCARA Robot Using TMS320C31 Chip (TMS320C31 칩을 사용한 스카라 로봇의 실시간 적응제어데 관한 연구)

  • 김용태
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1996.03a
    • /
    • pp.79-84
    • /
    • 1996
  • This paper presents a new approach to the design of adaptive control system using DSPs(TMS320C31) for robotic manipulators to achieve trajectory tracking by the joint angles. Digital signal processors are used in implementing real time adaptive control algorithms to provide an enhanced motion control for robotic manipulators. In the proposed control scheme, adaptation laws are derived from the improved Lyapunov second stability analysis method based on the adaptive model reference control theory. The adaptive controller consists of an adaptive feedforward controller, feedback controller, and PID type time-varying auxillary control elements. The proposed adaptive control scheme is simple in structure, fast in computation, and suitable for implementation of real-time control. Moreover, this scheme does not require an accurate dynamic modeling, nor values of manipulator parameters and payload. Performance of the adaptive controller is illustrated by simulation and experimental results for a SCARA robot.

  • PDF

Design of a Real Time Adaptive Controller for Industrial Robot Using Digital Signal Processor (디지털 신호처리기를 사용한 산업용 로버트의 실시간 적응제어기 설계)

    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.5 no.4
    • /
    • pp.26-37
    • /
    • 1996
  • This paper presents a new approach to the design of adaptive control system using DSPs(TMS320C30) for robotic manipulators to achieve trajectory tracking by the joint angles Digital signal processors are used in implementing real time adaptive control algorithms to provide an enhanced motion control for robotic manipulators. In the proposed control scheme adaptation laws are derived from the improved Lyapunov second stability analysis method based on the adaptive model reference control theory. The adaptive controller consists of an adaptive feedforward controller. feedback controller. and PID type time-varying auxiliary control elements. The proposed adaptive control scheme is simple in structure, fast in computation, and suitable for implementation of real-time control. Moreover, this scheme does not require a an accurate dynamic modeling, nor values of manipulator parameters and payload. Performance of the adaptive controller is illustrated by simulation and experimental results for a SCARA robot.

  • PDF

Control for Optical Image Stabilization System in Digital Cameras (디지털 카메라용 이미지 안정화 시스템 제어)

  • Cho, Ju-Yeon;Cho, Woo-Jong;Park, Jung-Ho;Kim, Kyung-Soo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.16 no.5
    • /
    • pp.411-414
    • /
    • 2010
  • As high quality image is required for digital cameras in recent use, the image stabilization technique has drawn much attention to prevent image degradation from shaky disturbance by users. In this paper, the optical image stabilization (OIS) system for DSLR (Digital Single Lens Reflex) camera is considered. First, the analytic model of an OIS system is presented to demonstrate the mechanism of image destabilization due to unknown disturbance that causes blurry images on CCD sensor. Then, to enhance the stabilization performance, a sliding mode control based on the min-max nonlinear control is introduced. Through the experiments and simulations, the effectiveness of the proposed method will be verified.

CONTROLLER DESIGN FOR A ROBOTIC MANIPULATOR DELAYED FEEDBACK (Delayed Feedback을 이용한 로보트 제어기의 설계)

  • ;Chyung, Dong H.
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10a
    • /
    • pp.145-148
    • /
    • 1990
  • In this paper, the problem of designing a feedback controller for a robotic manipulator, which is activated by a D.C. motor through a gear train and a flexible shaft or chain, is considered. When the response of the closed loop control system is relatively slow, a satisfactory controller may be designed as a PID controller. As the speed of the control system increases, however, the spring effect of the linkage becomes profound, and as a result, the transient response exhibits a substantial oscillation. To eliminate this oscillation, it is necessary to design the controller based on at least a fourth order system model. This, in turn, requires the feedback of the entire state variables. In practice, however, only the position of the manipulator and the velocity of the motor are readily measurable. The state variable reconstruction method or a state observer cannot be used because of the system nonlinearities such as the Coulomb frictions. In this study, an alternative controller, which is based on delayed feedback of the output variable only, is proposed, and a successful delayed feedback controller is designed and implemented on an actual experimental manipulator.

  • PDF

Multiple-Axes Velocity-Synchronizing Control of AC-Servomotor Load System for Injection Process (사출공정을 위한 AC 서보모터-부하계의 다축 속도 동기제어)

  • Jon, Yun-Son;Jung, Kwon;Choi, Jang Hoon;Ahn, Hyun;Lee, Hyeong Cheol;Kim, Young Shin;Hong, Seong Ho;Cho, Seung Ho
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.32 no.8
    • /
    • pp.719-726
    • /
    • 2015
  • This paper presents a velocity-synchronizing control for the multiple axes of an injection unit; based on MBS, a virtual design model has been developed for the multiple-axes servomechanism. Prior to the design of the controller, a linear plant model was derived via open-loop response simulations. To synchronize the motions of the multiple axes, a cross-type synchronizing controller was designed and combined with the PID control to accommodate any parameter mismatches among the multiple axes. From the tracking control simulations, a significant reduction of both velocity-tracking and position-tracking errors was achieved through the use of the proposed control scheme.

Least Squares Based PID Control of an Electromagnetic Suspension System

  • Park, Yon-Mook;Nam, Myeong-Ryong;Seo, In-Ho;Lee, Sang-Hyun;Lim, Jong-Tae;Tahk, Min-Jea
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.2252-2257
    • /
    • 2003
  • In this paper, we develop the so-called functional test model for magnetic bearing reaction wheels. The functional test model has three degree of freedom, which consists of one axial suspension from gravity and the other two axes gimbaling capability to small angle, and does not include the motor. For the control of the functional test model, we derive the optimal electromagnetic forces based on the least squares method, and use the proportional-integral-derivative controller. Then, we develop a hardware setup, which mainly consists of the digital signal processor and the 12-bit analog-to-digital and digital-to-analog converters, and show the experimental results.

  • PDF

Least Squares Based PID Control of an Electromagnetic Suspension System

  • Park, Yon-Mook;Tahk, Min-Jea;Nam, Myeong-Ryong;Seo, In-Ho;Lee, Sang-Hyun;Lim, Jong-Tae
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.4 no.2
    • /
    • pp.69-78
    • /
    • 2003
  • In this paper, we develop the so-called functional test model for magnetic bearing wheels. The functional test model developed in this paper is a kind of electromagnetic suspension systems and has three degree of freedom, which consists of one axial suspension from gravity and the other two axes gimbaling capability to small angle, and does not include the motor. For the control of the functional test model, we derive the optimal electromagnetic forces based on the least squares method, and use the proportional-integral derivative controller. Then, we develop a hardware setup, which mainly consists of the digital signal processor and the 12-bit analog-to-digital and digital-to-analog converters, and show the experimental results.

A Study on the attitude control of the quadrotor using neural networks (신경회로망을 이용한 쿼드로터의 자세 제어에 관한 연구)

  • Kim, Sung-Dea
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.9 no.9
    • /
    • pp.1019-1025
    • /
    • 2014
  • Recently, the studies of the Unmanned Aerial Vehicle(UAV) has been studied a variety from military aircraft to civilian aircraft and for general hobby activity aircraft. In particular, for small unmanned aircraft research for the ease of turning and hovering and Vertical-Off Take Landing(VTOL), have been studied mainly quadrotor unmanned aircraft is a type suitable for this study of small unmanned aircraft. The studies of these unmanned aircraft is the kinetic analysis requires complex processes, because these support by the aerodynamic forces on the unmanned aircraft study, and the controller design based on these dynamical analysis and experimental model analysis. In this paper, after the implementation of the basic attitude control based on a general PID controller, we propose concept design of the attitude control method on quadrotor attitude control by using the reinforcement learning algorithm of neural networks for non-linear elements not considered in the controller design.