• Title/Summary/Keyword: State Approximation

Search Result 399, Processing Time 0.028 seconds

A Semi-Markov Decision Process (SMDP) for Active State Control of A Heterogeneous Network

  • Yang, Janghoon
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.7
    • /
    • pp.3171-3191
    • /
    • 2016
  • Due to growing demand on wireless data traffic, a large number of different types of base stations (BSs) have been installed. However, space-time dependent wireless data traffic densities can result in a significant number of idle BSs, which implies the waste of power resources. To deal with this problem, we propose an active state control algorithm based on semi-Markov decision process (SMDP) for a heterogeneous network. A MDP in discrete time domain is formulated from continuous domain with some approximation. Suboptimal on-line learning algorithm with a random policy is proposed to solve the problem. We explicitly include coverage constraint so that active cells can provide the same signal to noise ratio (SNR) coverage with a targeted outage rate. Simulation results verify that the proposed algorithm properly controls the active state depending on traffic densities without increasing the number of handovers excessively while providing average user perceived rate (UPR) in a more power efficient way than a conventional algorithm.

Robust $H_{\infty}$ Control for Bilinear Systems via State Feedback (상태 피드백에 의한 쌍일차 계통의 강인 $H_{\infty}$ 제어)

  • Kim, Young-Joong;Kim, Beom-Soo;Lim, Myo-Taeg
    • Proceedings of the KIEE Conference
    • /
    • 2002.07d
    • /
    • pp.2037-2039
    • /
    • 2002
  • This paper focuses on robust $H_{\infty}$ control for bilinear systems with time-varying parameter uncertainties via state feedback. The suitable robustly stabilizing feedback control law can be constructed in term of solution to a state variable x-dependent quadratic Riccati equation using successive approximation technique. Also, the state feedback control law robustly stabilizes the plant and guarantees a robust $H_{\infty}$ performance for the closed-loop bilinear system with parameter uncertainties and exogenous disturbance.

  • PDF

A study of Temperal Difference Learning using Nonlinear Function Approximation (비선형 함수 근사화를 사용한 TD학습에 관한 연구)

  • Kwon, Jae-Cheol;Lee, Young-Seog;Kim, Dong-Ok;Seo, Bo-Hyeok
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.407-409
    • /
    • 1998
  • This paper deals with temporal-difference learning that is a method for approximating long-term future cost as a function of current state in knowlege-poor environment, a function approximator is used to approximate the mapping from state to future cost, a linear function approximator is limited because mapping from state to future cost has a nonlinear characteristic, so a nonlinear function approximator is used to approximate the mapping from state to future cost in this paper, and that TD learning using a nonlinear function approximator is stable is proved.

  • PDF

Structural, Magnetic, and Electronic Properties of Fe: A Screened Hybrid Functional Study

  • Jang, Young-Rok;Yu, Byung-Deok
    • Journal of Magnetics
    • /
    • v.16 no.3
    • /
    • pp.201-205
    • /
    • 2011
  • We performed total energy and electronic structure calculations for the basic ground state properties of Fe using the conventional generalized gradient approximation (GGA) and screened hybrid functionals as the form of the exchange-correlation functional. To that end, we calculated structural (equilibrium lattice constants, bulk moduli, and cohesive energies) and electronic (magnetic moments and densities of states) properties. Both functional calculations gave the correct ground state, the ferromagnetic bcc phase, in which the structural parameters agreed well with experimental results. However, the description of the cohesive energies and magnetic moments at the ground state exhibited different behavior from each other: the unusually small cohesive energy and large magnetic moment were observed in the screened hybrid functional calculations compared to the GGA calculations. The reason for the difference was examined by analyzing the calculated electronic structures.

Correlation between Structures and Magnetism in Iron: Ferromagnetism and Antiferromagnetism

  • Lee, Dong-Kook;Hong, Soon-Cheol
    • Journal of Magnetics
    • /
    • v.12 no.2
    • /
    • pp.68-71
    • /
    • 2007
  • Even a pure bulk Fe has a complicated magnetic phase and its magnetism is still needed to be clarified. In this study we investigated the magnetism of bcc and fcc bulk Fe with total energy calculations as functions of atomic volume. The full-potential linearized augmented plane wave method was adopted within a generalized gradient approximation. The ground state of bulk Fe is confirmed to be of ferromagnetic (FM) bcc. For fcc structured Fe an antiferromagnetic (AFM) state is more stable compared to FM states which exist as low spin and high spin states. The stable AFM states were found to accompany a tetragonal distortion, while the FM states remained in a cubic symmetry. At an expanded lattice constant a high spin FM state was calculated to be able to be stabilized with significant enhanced magnetic moment compared to the value of the ground state, bcc FM.

Structure Reliability Analysis using 3rd Order Polynomials Approximation of a Limit State Equation (한계상태식의 3차 다항식 근사를 통한 구조물 신뢰도 평가)

  • Lee, Seung Gyu;Kim, Sung Chan;Kim, Tea Uk
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.26 no.3
    • /
    • pp.183-189
    • /
    • 2013
  • In this paper, uncertainties and failure criteria of structure are mathematically expressed by random variables and a limit state equation. A limit state equation is approximated by Fleishman's 3rd order polynomials and the theoretical moments of an approximated limit state equation are calculated. Fleishman introduced a 3rd order polynomial in terms of only standard normal distiribution random variables. But, in this paper, Fleishman's polynomial is extended to various random variables including beta, gamma, uniform distributions. Cumulants and a normalized limit state equation are used to calculate a theoretical moments of a limit state equation. A cumulative distribution function of a normalized limit state equation is approximated by a Pearson system.

On the Modified Supplementary Variable Technique for a Discrete-Time GI/G/1 Queue with Multiple Vacations (복수휴가형 이산시간 GI/G/1 대기체계에 대한 수정부가변수법)

  • Lee, Doo Ho
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.42 no.5
    • /
    • pp.304-313
    • /
    • 2016
  • This work suggests a new analysis approach for a discrete-time GI/G/1 queue with multiple vacations. The method used is called a modified supplementary variable technique and our result is an exact transform-free expression for the steady state queue length distribution. Utilizing this result, we propose a simple two-moment approximation for the queue length distribution. From this, approximations for the mean queue length and the probabilities of the number of customers in the system are also obtained. To evaluate the approximations, we conduct numerical experiments which show that our approximations are remarkably simple yet provide fairly good performance, especially for a Bernoulli arrival process.

The Prediction of Fatigue Crack Initiation Life of Cylindrical Notch Specimens Using Local Strain Approximation (국부 변형률 근사를 이용한 원통형 노치시편의 피로균열 발생수명의 예측)

  • Lim, Jae-Yong;Hong, Seong-Gu;Lee, Soon-Bok
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.28 no.6
    • /
    • pp.791-798
    • /
    • 2004
  • Fatigue crack initiation lives of round cylindrical notch specimen were investigated. Firstly, local strain approximation methods, such as the modified incremental Neuber's rule and the modified incremental Glinka's equivalent strain energy density(ESED) rule, were used to get multiaxial stress and strain state components at the notch tip. Based on the history of local stress and strain, multiaxial fatigue models were used to obtain fatigue crack initiation lives. Because the solution of Neuber's rule and Glinka's ESED rule make the upper and lower bound of local strain approximations, fatigue crack initiation lives are expected to place between life predictions by two local strain approximations. Experimental data were compared with the fatigue crack initiation life prediction results.

Properties and Approximation Method of the Random - Request Availability (임의 요구 가용도의 성질과 근사방법)

  • Lee, Kang-W.;Park, Jung-W.
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.27 no.3
    • /
    • pp.260-266
    • /
    • 2001
  • The characteristic of the random-request availability is that random task arrival is included as one of system elements. If the mean number of task arrivals grows, the computational complexity for deriving the random-request availability becomes extremely high. Using a simulation method, the effect of 'random task arrival' elements on the random-request availability is investigated. Some approximation methods are also discussed.

  • PDF

New Guidance Filter Structure for Homing Missiles with Strapdown IIR Seeker

  • Kim, Tae-Hun;Kim, Jong-Han;Kim, Philsung
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.18 no.4
    • /
    • pp.757-766
    • /
    • 2017
  • For implementing the proportional navigation guidance law on passive homing missiles equipped with strapdown imaging infrared seekers, the line-of-sight angles and rates with respect to the inertial frame should be estimated by carefully handling the parasitic instability effect due to the seeker's latency. By introducing a new state vector representation along with the Pade approximation for compensating the time-delay of the seeker, this paper proposes a new guidance filter structure, stochastic dynamic models and measurement equations, in three-dimensional homing problem. Then, it derives the line-of-sight angle and rate estimator in general two-dimensional engagement by applying the extended Kalman filter to the proposed structure. The estimation performance and the characteristics of the proposed filter were evaluated via a series of numerical experiments.