• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2000.11a
• /
• pp.163-167
• /
• 2000

The eligibility is used to solve the credit-assignment problem which is one of important problems in reinforcement learning. Conventional eligibilities which are accumulating eligibility and replacing eligibility make ineffective use of rewards acquired in learning process. Because only an executed action in a visited state is learned by these eligibilities. Thus, we propose a new eligibility, called the weighted eligibility with which not only an executed action but also neighboring actions in a visited state are to be learned. The fuzzy Q-learning algorithm using proposed eligibility is applied to a cart-pole balancing problem, which shows improvement of learning speed.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.31.5-31
• /
• 2001

In conventional perturbation estimators such as disturbance observers(DOB) [1, 2] or time-delayed controllers(TDC) [3{5}, the low pass filter(so-called Q-filter) plays an important role in the stability and performance. However, a general design guideline or analysis for the Q-filter has not been researched yet. In this paper, a guideline for the design of discrete Q-filter is suggested in terms of the analysis of the relationship between the filter parameters and stability performance robustness in discrete-time domain. The analysis clarifies the discrete-time effect of the perturbation estimator and provides a transparent relationship between performance and robustness depending ...

• Journal of the Institute of Electronics Engineers of Korea TC
• /
• v.49 no.6
• /
• pp.39-47
• /
• 2012

As a scheme to efficiently reduce the effects of multipath fading in next generation wireless communication systems, cooperative communication systems have recently come into the spotlight. Since these cooperative communication systems use cooperative relays with diverse fading coefficients to transmit information, having all relays participate in cooperative communication may result in unnecessary waste of resources, and thus relay selection schemes are required to efficiently use wireless resources. In this paper, we propose an efficient relay selection scheme through self-learning in cooperative wireless networks using Q-learning algorithm. In this scheme, we define states, actions and two rewards to achieve good SER (Symbol Error Rate) performance, while selecting a small number of cooperative relays. When these parameters are well-defined, we can obtain good performance. For demonstrating the superiority of the proposed Q-learning, We compared the proposed scheme with Q-learning and a relay selection scheme with a mathematical analysis. The simulation results show that, compared to a scheme that obtains optimum relays through a mathematical analysis, the proposed scheme uses resources efficiently by using smaller numbers of relays with comparable SER performance. According to these simulation results, the proposed scheme can be considered as a good attempt for future wireless communication.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.1B
• /
• pp.176-182
• /
• 2010

In this paper, we propose an adaptive I/Q diversity combining scheme which reduces unnecessary computations while maintaining the required performance level. The system with the proposed scheme adaptively applies a proper combining scheme among the conventional selective scheme and combining scheme based on the comparison result between the estimated instantaneous SNR and the pre-determined threshold. As a result, the system with our proposed scheme can reduce the computational load while maintaining the required performance level. Some selected simulation results show that the system with the proposed scheme can decrease the unnecessary computations compared with the system with the conventional schemes while maintaining the required performance level.

• Journal of Advanced Navigation Technology
• /
• v.19 no.3
• /
• pp.244-249
• /
• 2015

High-altitude electromagnetic pulse (HEMP) is generated from a nuclear burst at high altitudes above the Earth, the electromagnetic fields reach the ground nearly simultaneously with regard to the operation time of systems. The aim of this analysis is to inquire about HEMP characteristics and to analyze about effect in orthogonal frequency division multiplexing (OFDM) system. Specifically, HEMP characteristics are classified field sources, spatial coverage, time domain behavior, frequency spectrum and field intensities in this study. Bits error rate (BER) of the receiver with the software simulation is confirmed for the HEMP effect. Q-factor made a difference about interference duration by transfer characteristics of system. When Q factor is smaller, the recovery time from HEMP interference is short. To the contrary, if the Q factor is larger, the recovery duration is lasted longer by 300-600%.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.11 no.5
• /
• pp.388-394
• /
• 2001

Reinforcement learning is a kind of unsupervised learning methods that an agent control rules from experiences acquired by interactions with environment. The eligibility is used to resolve the credit-assignment problem which is one of important problems in reinforcement learning, Conventional eligibilities such as the accumulating eligibility and the replacing eligibility are ineffective in use of rewards acquired in learning process, since on1y one executed action for a visited state is learned. In this paper, we propose a new eligibility, called the distributed eligibility, with which not only an executed action but also neighboring actions in a visited state are to be learned. The fuzzy Q-learning algorithm using the proposed eligibility is applied to a cart-pole balancing problem, which shows the superiority of the proposed method to conventional methods in terms of learning speed.

• The Journal of Information Systems
• /
• v.17 no.3
• /
• pp.25-37
• /
• 2008

In a fault tree analysis, an uncertainty importance measure is often used to assess how much uncertainty of the top event probability (Q) is attributable to the uncertainty of a basic event probability ($q_i$), and thus, to identify those basic events whose uncertainties need to be reduced to effectively reduce the uncertainty of Q. For evaluating the measures suggested by many authors which assess a percentage change in the variance V of Q with respect to unit percentage change in the variance $v_i$ of $q_i$, V and ${\partial}V/{\partial}v_i$ need to be estimated analytically or by Monte Carlo simulation. However, it is very complicated to analytically compute V and ${\partial}V/{\partial}v_i$ for large-sized fault trees, and difficult to estimate them in a robust manner by Monte Carlo simulation. In this paper, we propose a method for evaluating the measure using discretization technique and Monte Carlo simulation. The proposed method provides a stable uncertainty importance of each basic event.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.49 no.9
• /
• pp.145-154
• /
• 2012

This paper proves that multi-port junction-based direct receivers (MPDRs) can regenerate I- and Q-channel signals accurately by using conventional I/Q mismatch compensation. This proof enables MPDRs to be integrated into existing RFIC based systems without additional digital signal processing. This paper analyzes the relationship between accuracy of I/Q regeneration parameters and degree of I/Q mismatch, and shows that the estimation results and the simulation results are almost the same.

• Proceedings of the Korean Information Science Society Conference
• /
• 2006.10d
• /
• pp.18-23
• /
• 2006

높은 데이터 전송률과 넓은 전송 대역을 제공할 수 있도록 표준화 된 시스템인 IEEE 802.16d[1]시스템에서는 여러 가지 서비스 클래스들을 이용하여 QoS를 보장해 줄 수 있을 것으로 기대하고 있다. 그러나, 효율적인 QoS를 제공하기 위해서는 스케줄링에 필요한 factor들을 적절하게 설정해야 하며, 시스템의 환경에 맞도록 변경해야 한다. 따라서, 본 논문에서는 IEEE 802.16d 시스템을 simulator (NS-2) [2]에 구현하고, IEEE 802.16f [3]에서 표준화한 MIB과 QoS를 고려한 MIB (Q-MAN MIB)을 구현하여 IEEE 802.16d 시스템과 연동하도록 구축한 네트워크 관리 시스템인 Q-MAN을 소개한다. Q-MAN 네트워크 관리 시스템을 통해 IEEE 802.16d 시스템의 QoS 제공 상태에 대한 모니터링이 가능하고, 스케줄링에 필요한 설정 값을 동적으로 변경이 가능하기 때문에 IEEE 802.16d 시스템의 효율을 극대화 시킬 수 있다.

• Journal of Korean Tunnelling and Underground Space Association
• /
• v.10 no.4
• /
• pp.383-395
• /
• 2008

The grouting is one of the improved techniques which is aim to decrease the permeability and to strengthen the soft ground. But The grouting method has many problems about a suitability of grouting procedure and an effectiveness of grouting after grouting work because of a technical characteristic operated inside the soil. The grouting $p{\sim}q{\sim}t$ chart of a typical index about grouting rate and time alteration of grouting pressure is one method to estimate the suitability of grouting factor with monitoring during grouting procedure. This study is automatic grouting system (AGS) which can control the testing and grouting procedures. It can make the detailed $p{\sim}q{\sim}t$ chart and analyze the grouting characters of the ground by comparing the detailed pattern of $p{\sim}q{\sim}t$ chart with standard pattern. If using the $p{\sim}q{\sim}t$ chart derived from AGS in the grouting work, it is an objective standard estimating the suitability of grouting factor with grouting materials, grouting method, grouting rate and grouting pressure, as results it expects successfully to improve reliability of the grouting work.