• 제목/요약/키워드: state space and measurement model

검색결과 51건 처리시간 0.027초

복잡계망 모델을 사용한 강화 학습 상태 공간의 효율적인 근사 (Efficient Approximation of State Space for Reinforcement Learning Using Complex Network Models)

  • 이승준;엄재홍;장병탁
    • 한국정보과학회논문지:소프트웨어및응용
    • /
    • 제36권6호
    • /
    • pp.479-490
    • /
    • 2009
  • 여러 가지 실세계 문제들은 마르코프 결정 문제(Markov decision problem) 들로 형식화하여 풀 수 있으나, 풀이 과정의 높은 계산 복잡도 때문에 실세계 문제들을 직접적으로 다루는 데 많은 어려움이 있다. 이를 해결하기 위해 많은 시간적 추상화(Temporal abstraction) 방법들이 제안되어 왔고 이를 자동화하기 위한 여러 방법들 또한 연구되어 왔으나, 이들 방법들은 명시적인 효율성 척도를 갖고 있지 않아 이론적인 성능 보장을 하지 못하는 문제가 있었다. 본 연구에서는 문제의 크기가 커지더라도 좋은 성능이 보장되는 자동적인 시간적 추상화 구현 방법에 대해 제안한다. 이를 위하여 네트워크 척도(Network measurements)를 이용하여 마르코프 결정 문제의 풀이 효율과 상태 궤적 그래프(State trajectory graph)의 위상 특성간의 관계를 분석하고, 네트워크 척도들 중 평균 측지 거리(Mean geodesic distance)가 마르코프 결정 문제의 풀이 성능과 밀접한 관계가 있다는 사실을 알아내었다. 이 사실을 기반으로 하여, 낮은 평균 측지 거리를 보장하는 복잡계망 모델(Complex network model)을 사용하여 시간적 추상화를 만들어 나가는 알고리즘을 제안한다. 제안된 알고리즘은 사실적인 3차원 게임 환경을 비롯한 여러 문제에 대해 테스트되었고, 문제 크기의 증가에도 불구하고 효율적인 풀이 성능을 보여 주었다.

Topography, Vertical and Horizontal Deformation In the Sulzberger Ice Shelf, West Antarctica Using InSAR

  • Kwoun Oh-Ig;Baek Sangho;Lee Hyongki;Sohn Hong-Gyoo;Han Uk;Shum C. K.
    • 대한원격탐사학회지
    • /
    • 제21권1호
    • /
    • pp.73-81
    • /
    • 2005
  • We construct improved geocentric digital elevation model (DEM), estimate tidal dynamics and ice stream velocity over Sulzberger Ice Shelf, West Antarctica employing differential interferograms from 12 ERS tandem mission Synthetic Aperture Radar (SAR) images acquired in austral fall of 1996. Ice, Cloud, and land Elevation Satellite (ICESat) laser altimetry profiles acquired in the same season as the SAR scenes in 2004 are used as ground control points (GCPs) for Interferometric SAR (InSAR) DEM generation. 20 additional ICESat profiles acquired in 2003-2004 are then used to assess the accuracy of the DEM. The vertical accuracy of the OEM is estimated by comparing elevations with laser altimetry data from ICESat. The mean height difference between all ICESat data and DEM is -0.57m with a standard deviation of 5.88m. We demonstrate that ICESat elevations can be successfully used as GCPs to improve the accuracy of an InSAR derived DEM. In addition, the magnitude and the direction of tidal changes estimated from interferogram are compared with those predicted tidal differences from four ocean tide models. Tidal deformation measured in InSAR is -16.7cm and it agrees well within 3cm with predicted ones from tide models. Lastly, ice surface velocity is estimated by combining speckle matching technique and InSAR line-of-sight measurement. This study shows that the maximum speed and mean speed are 509 m/yr and 131 m/yr, respectively. Our results can be useful for the mass balance study in this area and sea level change.

RADAR 시스템과 SGP4 모델을 이용한 저궤도 위성의 실시간 궤도결정 (REAL - TIME ORBIT DETERMINATION OF LOW EARTH ORBIT SATELLITES USING RADAR SYSTEM AND SGP4 MODEL)

  • 이재광;이성섭;윤재철;최규홍
    • Journal of Astronomy and Space Sciences
    • /
    • 제20권1호
    • /
    • pp.21-28
    • /
    • 2003
  • 다른 나라의 저궤도 위성에 대한 궤도 정보를 레이더 시스템을 이용하여 독자적으로 획득할 경우, 이에 필요한 궤도결정 알고리즘을 해석적 모델인 SGP4 모델과 실시간 처리방식인 확장 칼만필터를 이용하여 수치적 방법으로 개발하였다. 궤도결정 알고리즘의 상태벡터를 Kepler 6궤도 요소로 지정할 경우, 상태천이 행렬 계산시 궤도 경사각과 이심률에 대해 특이점 문제가 발생한다. 이를 해결하기 위해 평균 궤도 요소를 평균 위치 및 속도 요소로 변환하여 상태벡터로 지정하였다. 필터 구성시 상태천이 행렬(State Transition Matrix)과 공분산 행렬(Covariance Matrix)은 SGP4모델과 수치적 방법인 finite difference방법을 이용하여 계산하였으며, 관측 자료는 방위 각, 고도각, 그리고 시선거리 형태로 각각 입력되며 각 관측 형태에 따라 일괄적으로 처리하도록 필터를 구성하였다. TOPEX/POSEIDON POE를 이용 시뮬레이션 생성한 관측간을 사용하여 개발한 궤도결정 알고리즘의 성능을 분석한 결과 개발한 알고리즘은 약 1km의 위치 오차를 가지며 7일 동안 약 3km의 위치 오차를 가지는 NORAD시스템과 동일한 성능을 가지기 위해 필요한 레이더 시스템의 최소 성능 요구조건은 방위각과 고도각은 0.1도 이내이고 시선거리는 50m이 내여야 한다.

인공슬롯을 고려한 수압파쇄 균열의 발전양상에 관한 연구 (The Analysis of Fracture Propagation in Hydraulic Fracturing using Artificial Slot Model)

  • 최성웅;이희근
    • 터널과지하공간
    • /
    • 제5권3호
    • /
    • pp.251-265
    • /
    • 1995
  • One of the most important matters in stress measurement by hydraulic fracturing technique is the determination of the breakdown pressure, reopening pressure, and shut-in pressure, since these values are the basic input data for the calculation of the in-situ stress. The control of the fracture propagation is also important when the hydraulic fracturing technique is applied to the development of groundwater system, geothermal energy, oil, and natural gas. In this study, a laboratory scale hydraulic fracturing device was built and a series of model tests were conducted with cube blocks of Machon gabbro. A new method called 'flatjack method' was adopted to determine shut-in pressure. The initial stress calculated from the shut-in pressure measured by flatjack method showed much higher accuracy than the stress determined by the conventional method. The dependency of the direction of fracture propagation on the state of the initial stresses was measured by introducin g artificial slots in the borehole made by water jet system. Numerical modeling by BEM was also performed to simulate the fracture propagation process. Both results form numerical and laboratory tests showed good agreement. From this study which provides the extensive results on the determination of shut-in pressure and the control of fracture propagation which are the critical issue in the recent hydraulic fracturing, it is conclued that in-situ stress measurement and the control of fracture propagation could be achived more accurately.

  • PDF

Comprehensive Code Validation on Airloads and Aeroelastic Responses of the HART II Rotor

  • You, Young-Hyun;Park, Jae-Sang;Jung, Sung-Nam;Kim, Do-Hyung
    • International Journal of Aeronautical and Space Sciences
    • /
    • 제11권2호
    • /
    • pp.145-153
    • /
    • 2010
  • In this work, the comprehensive structural dynamics codes including DYMORE and CAMRAD II are used to validate the higher harmonic control aeroacoustic rotor test (HART) II data in descending flight condition. A total of 16 finite elements along with 17 aerodynamic panels are used for the CAMRAD II analysis; whereas, in the DYMORE analysis, 10 finite elements with 31 equally-spaced aerodynamic panels are utilized. To improve the prediction capability of the DYMORE analysis, the finite state dynamic inflow model is upgraded with a free vortex wake model comprised of near shed wake and trailed tip vortices. The predicted results on aerodynamic loads and blade motions are correlated with the HART II measurement data for the baseline, minimum noise and minimum vibration cases. It is found that an improvement of solution, especially for blade vortex interaction airloads, is achieved with the free wake method employed in the DYMORE analysis. Overall, fair to good correlation is achieved for the test cases considered in this study.

Modelling and Simulating the Spatio-Temporal Correlations of Clustered Wind Power Using Copula

  • Zhang, Ning;Kang, Chongqing;Xu, Qianyao;Jiang, Changming;Chen, Zhixu;Liu, Jun
    • Journal of Electrical Engineering and Technology
    • /
    • 제8권6호
    • /
    • pp.1615-1625
    • /
    • 2013
  • Modelling and simulating the wind power intermittent behaviour are the basis of the planning and scheduling studies concerning wind power integration. The wind power outputs are evidently correlated in space and time and bring challenges in characterizing their behaviour. This paper provides a methodology to model and simulate the clustered wind power considering its spatio-temporal correlations using the theory of copula. The sampling approach captures the complex spatio-temporal connections among the wind farms by employing a conditional density function calculated using multidimensional copula function. The empirical study of real wind power measurement shows how the wind power outputs are correlated and how these correlations affect the overall uncertainty of clustered wind power output. The case study validates the simulation technique by comparing the simulated results with the real measurements.

6자유도 운동재현기의 다변수 제어기 설계 (A multivariable controller design of 6 DOF motion simulator)

  • 이호영;강지윤;이교일
    • 한국정밀공학회:학술대회논문집
    • /
    • 한국정밀공학회 1994년도 추계학술대회 논문집
    • /
    • pp.449-454
    • /
    • 1994
  • The Stewart Platform is one example of a motion simulator which generater 6DOF motion in space by six actuators in parallel. The presented control methrol of 6DOF motion simulator is generally classified into two types, one is SISO and the other is MIMO control type. The SISO control can't compensate for external load variation and different dynamic behavior of 6DOF motion, trerefore this type don's control motion precisely. On the other hand, the MIMO control compensates for a interference of 6DOF motion because MIMO controller is designed with 6DOF motion simulator synamics. But MIMO control of motion simulator has a complexity of 6DOF displacement feedback, because in oder to obtain feedback value we must solve the forward kinematics using measurement of cylinder length or design a state estimator, unless measurement of 6DOF displacement is possible. In this paper, a multivariable controller using H .inf. optimal control theory is designed to consider a interference of 6DOF motion and to obtain robust,precise control of system. Also in order to solve the mentioned problem of MIMO control, this paper presents a modified MIMO control model which control 6DOF motion by using feedback of measurement od cylinder length.

  • PDF

레버암 상태 추정을 이용한 IMU 의 자세 결정 알고리즘 (Enhanced Attitude Determination with IMU using Estimation of Lever Arms)

  • 황태현;오재용;박세길;박병재;조득재
    • 제어로봇시스템학회논문지
    • /
    • 제19권10호
    • /
    • pp.941-946
    • /
    • 2013
  • In this paper, an enhanced method for attitude determination is proposed for systems using an IMU (Inertial Measurement Unit). In attitude determination with IMU, it is generally assumed that the IMU can be located in the center of gravity on the vehicle. If the IMU is not located in the center of gravity, the accelerometers of the IMU are disturbed from additive accelerations such as centripetal acceleration and tangential acceleration. Additive accelerations are derived from the lever arm which is the distance between the center of gravity and the position of the IMU. The performance of estimation errors can be maintained in system with a non-zero lever arm, if the lever arm is estimated to remove the additive accelerations from the accelerometer's measurements. In this paper, an estimation using Kalman filter is proposed to include the lever arm in the state variables of the state space equation. For the Kalman filter, the process model and the measurement model for attitude determination are made up by using quaternion. In order to evaluate the proposed algorithm, both of the simulations and the experiments are performed for the simplified scenario of motion.

임무조건에 따른 달 착륙선 항법시스템 요구성능 분석 (Requirement Analysis of Navigation System for Lunar Lander According to Mission Conditions)

  • 박영범;박찬국;권재욱;류동영
    • 한국항공우주학회지
    • /
    • 제45권9호
    • /
    • pp.734-745
    • /
    • 2017
  • 달 착륙선의 항법 시스템은 자율 정밀 항법 성능을 확보하기 위해 관성측정기와 별추적기, 고도계, 속도계, 지형상대항법 카메라 등 다양한 항법용 전장부품으로 구성되는데 착륙선의 착륙 시나리오와 임무 요구 성능에 따라 적합한 성능의 항법용 전장부품 선정이 필요하다. 본 논문에서는 달 착륙선에 요구되는 항법용 전장부품의 사양을 공분산해석을 통해 분석하였다. 77차 상태변수로 구성되는 기준 시스템 오차모델과 센서의 측정모델을 정의하고 착륙선의 임무 요구 성능은 90m($3{\sigma}$) 착륙 위치 정확도를 요구하는 정밀탐사 임무와 6km($3{\sigma}$)의 착륙 오차가 허용되는 영역탐사 임무로 구분하였다. 자율항법 시작 시점에 따라 PDI(Powered descent initiation)와 DOI(Deorbit initiation) 시나리오로 나누고 항법용 전장부품의 조합과 착륙 시나리오에 따른 성능 분석을 통해 가상의 임무 요구 성능을 만족하기 위한 항법 시스템의 요구사양을 도출하였다.

Design and Implementation of an FPGA-based Real-time Simulator for a Dual Three-Phase Induction Motor Drive

  • Gregor, Raul;Valenzano, Guido;Rodas, Jorge;Rodriguez-Pineiro, Jose;Gregor, Derlis
    • Journal of Power Electronics
    • /
    • 제16권2호
    • /
    • pp.553-563
    • /
    • 2016
  • This paper presents a digital hardware implementation of a real-time simulator for a multiphase drive using a field-programmable gate array (FPGA) device. The simulator was developed with a modular and hierarchical design using very high-speed integrated circuit hardware description language (VHDL). Hence, this simulator is flexible and portable. A state-space representation model suitable for FPGA implementations was proposed for a dual three-phase induction machine (DTPIM). The simulator also models a two-level 12-pulse insulated-gate bipolar transistor (IGBT)-based voltage-source converter (VSC), a pulse-width modulation scheme, and a measurement system. Real-time simulation outputs (stator currents and rotor speed) were validated under steady-state and transient conditions using as reference an experimental test bench based on a DTPIM with 15 kW-rated power. The accuracy of the proposed digital hardware implementation was evaluated according to the simulation and experimental results. Finally, statistical performance parameters were provided to analyze the efficiency of the proposed DTPIM hardware implementation method.